2024-09-13T22:46:34.563 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T22:46:34.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T22:46:34.681 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904356' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAPuBrH6hS7V+Hz4hrKLYe8exhrJLTED458cBgt8Cna37ACsMz+RFfAegCSEdI5JsTgQWgoZWsvDu7f3lkyBWQ= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjUjAJt4BcrzLw5HUBxuqxdV1zw6ceAoE9WW+G39A/01jzqfnMvkbFndpiW7PGs6BNxvqXGdq6BpC/yXvLclNQ= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T22:46:34.682 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T22:46:34.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T22:46:34.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T22:46:34.684 INFO:teuthology.task.internal:Checking packages... 2024-09-13T22:46:34.706 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T22:46:34.706 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:46:34.706 INFO:teuthology.packaging:ref: None 2024-09-13T22:46:34.706 INFO:teuthology.packaging:tag: None 2024-09-13T22:46:34.707 INFO:teuthology.packaging:branch: squid 2024-09-13T22:46:34.707 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:46:34.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T22:46:34.926 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T22:46:34.928 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T22:46:34.935 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T22:46:34.935 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T22:46:34.950 INFO:teuthology.task.internal:Saving configuration 2024-09-13T22:46:34.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T22:46:34.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T22:46:35.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:41:34.669541', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAAPuBrH6hS7V+Hz4hrKLYe8exhrJLTED458cBgt8Cna37ACsMz+RFfAegCSEdI5JsTgQWgoZWsvDu7f3lkyBWQ='} 2024-09-13T22:46:35.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:41:34.668045', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjUjAJt4BcrzLw5HUBxuqxdV1zw6ceAoE9WW+G39A/01jzqfnMvkbFndpiW7PGs6BNxvqXGdq6BpC/yXvLclNQ='} 2024-09-13T22:46:35.032 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T22:46:35.038 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T22:46:35.038 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T22:46:35.038 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T22:46:35.106 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab4677fac0>, signals=[15]) 2024-09-13T22:46:35.106 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T22:46:35.112 INFO:teuthology.task.internal:Opening connections... 2024-09-13T22:46:35.112 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T22:46:35.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:46:35.196 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-13T22:46:35.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:46:35.281 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T22:46:35.287 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-13T22:46:35.306 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-13T22:46:35.306 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-13T22:46:35.364 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:46:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:46:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:46:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:46:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:46:35.365 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:46:35.365 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-13T22:46:35.395 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-13T22:46:35.414 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-13T22:46:35.414 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-13T22:46:35.472 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-13T22:46:35.472 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:46:35.473 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:46:35.474 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-13T22:46:35.503 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T22:46:35.513 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T22:46:35.555 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T22:46:35.555 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:46:35.558 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:46:35.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T22:46:35.580 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T22:46:35.581 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:46:35.615 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:46:35.641 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T22:46:35.709 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T22:46:35.722 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T22:46:35.722 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T22:46:35.722 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:46:35.723 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:46:35.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:46:35.739 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-13T22:46:35.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:46:35.740 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-13T22:46:35.797 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:46:35.797 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.14.0-503.el9.x86_64 2024-09-13T22:46:35.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-09-13T22:46:35.798 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:46:35.799 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-503.el9.x86_64 2024-09-13T22:46:35.799 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-09-13T22:46:38.443 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.2 MB 00:00 2024-09-13T22:46:40.419 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-13T22:46:42.537 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:00 2024-09-13T22:46:42.935 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-13T22:46:48.461 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-13T22:46:48.487 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-13T22:46:49.913 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-13T22:46:50.028 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-13T22:46:51.215 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T22:46:51.276 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-13T22:46:56.595 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T22:46:56.698 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T22:46:58.568 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:46:58.569 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:46:58.650 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:46:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:46:58.654 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T22:46:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:46:58.654 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:46:58.654 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-09-13T22:46:58.655 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:46:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 79 M 2024-09-13T22:46:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 126 M 2024-09-13T22:46:58.656 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:46:58.722 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:46:58.722 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:46:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:46:58.822 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 189 kB/s | 23 kB 00:00 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:46:58.827 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 79 M 2024-09-13T22:46:58.828 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 126 M 2024-09-13T22:46:58.829 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:46:59.233 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 75 kB/s | 23 kB 00:00 2024-09-13T22:46:59.572 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-13T22:47:00.147 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-13T22:47:00.689 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-13T22:47:00.689 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:47:00.690 INFO:teuthology.orchestra.run.smithi115.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-13T22:47:01.375 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:47:01.719 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:47:01.719 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:47:02.730 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:47:02.730 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:47:05.161 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:47:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:47:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:47:08.697 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:47:08.826 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:47:12.524 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.2 MB/s | 16 MB 00:13 2024-09-13T22:47:13.635 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:47:13.676 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:18.565 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:33.538 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 852 kB/s | 29 MB 00:34 2024-09-13T22:47:41.487 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 831 kB/s | 35 MB 00:42 2024-09-13T22:47:41.487 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:47:41.488 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.8 MB/s | 79 MB 00:42 2024-09-13T22:47:42.168 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:47:42.544 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:47:42.545 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:47:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:47:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:47:45.981 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:47:46.707 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:47:46.789 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:47:49.588 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:47:49.726 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:47:54.625 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:47:54.660 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:57.069 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:57.483 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:57.484 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:47:57.484 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:47:57.484 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:47:58.349 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:47:58.349 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:47:58.350 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:47:58.676 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:47:58.760 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.760 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:47:58.760 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:47:58.761 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:47:58.761 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:47:58.761 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T22:47:58.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:47:58.761 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:47:58.819 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:47:58.819 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:47:58.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 82.el9 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8274670 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:47:58.852 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:47:58.853 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:47:58.854 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:47:58.854 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:47:58.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:47:59.463 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-09-13T22:47:59.485 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:48:00.791 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:48:00.830 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-09-13T22:48:00.832 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-09-13T22:48:00.849 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.nHJ7D17HWu 2024-09-13T22:48:00.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nHJ7D17HWu 2024-09-13T22:48:00.938 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.nHJ7D17HWu 2024-09-13T22:48:01.035 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.nHJ7D17HWu is 6KB 2024-09-13T22:48:01.084 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.nHJ7D17HWu 2024-09-13T22:48:01.099 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:48:01.161 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:48:01.161 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:48:01.161 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:48:01.161 INFO:teuthology.orchestra.run.smithi115.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:48:01.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:48:01.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-09-13T22:48:31.291 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T22:48:31.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:48:31.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:48:37.785 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:48:37.829 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:48:38.109 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:48:38.109 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:48:38.109 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:48:38.109 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:48:38.923 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:48:39.254 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:48:39.379 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:48:39.379 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:48:39.380 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:48:39.380 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:48:39.380 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:48:39.380 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T22:48:39.380 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:48:39.380 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:48:39.440 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:48:39.440 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:48:39.440 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-09-13T22:48:39.472 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-09-13T22:48:39.472 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-09-13T22:48:39.472 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-09-13T22:48:39.472 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 82.el9 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8274670 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-09-13T22:48:39.473 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:48:39.474 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:48:39.475 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:48:39.475 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:48:39.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:48:40.185 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-09-13T22:48:41.543 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:48:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-09-13T22:48:41.579 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-13T22:48:41.595 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.FxPKqbQCXU 2024-09-13T22:48:41.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FxPKqbQCXU 2024-09-13T22:48:41.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.FxPKqbQCXU 2024-09-13T22:48:41.806 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.FxPKqbQCXU is 6KB 2024-09-13T22:48:41.857 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.FxPKqbQCXU 2024-09-13T22:48:41.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:48:41.939 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:48:41.939 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:48:41.939 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:48:41.939 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:48:41.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:48:42.097 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-09-13T22:48:49.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T22:48:58.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:48:58.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:49:01.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T22:49:12.105 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T22:49:12.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:49:12.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:49:13.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:49:13.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:49:30.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-13T22:49:32.221 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-09-13T22:49:39.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:49:39.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:49:42.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-13T22:49:47.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:49:47.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:49:47.549 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-13T22:49:47.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:49:47.932 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:49:47.933 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-09-13T22:49:47.947 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:49:47.947 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:49:47.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:49:47.948 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:49:48.948 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T22:49:48.949 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:49:49.032 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-09-13T22:49:49.070 DEBUG:teuthology.parallel:result is None 2024-09-13T22:49:54.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:49:54.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:50:12.929 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-13T22:50:27.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:50:27.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:50:28.373 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-13T22:50:28.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:50:28.762 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:50:28.763 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-13T22:50:28.777 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:50:28.777 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:50:28.777 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:50:28.778 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:50:29.779 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T22:50:29.779 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:50:29.874 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-09-13T22:50:29.898 DEBUG:teuthology.parallel:result is None 2024-09-13T22:50:29.898 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T22:50:29.907 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T22:50:29.908 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:50:29.910 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:50:29.927 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T22:50:29.934 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T22:50:29.943 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T22:50:29.943 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:50:29.970 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:50:29.999 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T22:50:30.006 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T22:50:30.007 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:50:30.035 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:50:30.070 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:50:30.070 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:50:30.080 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:50:30.081 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:50:30.083 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T22:50:30.089 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T22:50:30.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:50:30.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:50:30.152 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T22:50:30.161 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T22:50:30.161 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:50:30.193 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:50:30.212 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:50:30.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:50:30.342 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:50:30.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:50:30.467 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:50:30.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:50:30.533 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:50:30.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:50:30.627 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:50:30.720 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:50:30.758 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:50:30.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:50:30.828 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-13T22:50:30.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-13T22:50:30.872 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:50:30.924 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:50:31.338 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T22:50:31.346 INFO:teuthology.task.internal:Starting timer... 2024-09-13T22:50:31.346 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T22:50:31.463 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T22:50:31.472 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T22:50:31.473 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-13T22:50:31.530 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-13T22:50:31.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-13T22:50:31.602 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-13T22:50:31.604 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T22:50:31.604 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-13T22:50:31.630 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-13T22:50:31.631 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-13T22:50:31.658 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-13T22:50:31.659 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-09-13T22:50:31.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:50:31.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:50:31.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:50:31.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:50:31.728 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T22:50:31.729 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:50:31.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:50:31.799 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T22:50:31.814 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T22:50:31.826 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T22:50:31.827 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi115.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T22:54:15.349 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-09-13T22:54:15.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:54:15.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:54:15.435 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-13T22:54:15.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-13T22:54:15.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:54:15.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:54:15.600 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-13T22:54:15.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-13T22:54:15.684 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T22:54:15.694 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T22:54:15.695 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:54:15.695 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:54:15.697 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:54:15.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:54:15.723 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T22:54:15.737 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T22:54:15.754 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T22:54:15.761 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-13T22:54:15.768 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T22:54:15.772 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-13T22:54:15.787 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T22:54:15.793 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-13T22:54:15.800 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T22:54:15.804 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-13T22:54:15.818 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T22:54:15.832 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T22:54:15.855 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.859 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.890 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.895 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:54:15.895 INFO:teuthology.run_tasks:Running task install... 2024-09-13T22:54:15.903 DEBUG:teuthology.task.install:project ceph 2024-09-13T22:54:15.903 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T22:54:15.903 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:54:15.903 INFO:teuthology.task.install:Using flavor: default 2024-09-13T22:54:15.908 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T22:54:15.908 INFO:teuthology.task.install:extra packages: [] 2024-09-13T22:54:15.909 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T22:54:15.909 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:54:15.909 INFO:teuthology.packaging:ref: None 2024-09-13T22:54:15.909 INFO:teuthology.packaging:tag: None 2024-09-13T22:54:15.909 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:54:15.909 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:15.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T22:54:15.911 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T22:54:15.912 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:54:15.912 INFO:teuthology.packaging:ref: None 2024-09-13T22:54:15.912 INFO:teuthology.packaging:tag: None 2024-09-13T22:54:15.912 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:54:15.912 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:15.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T22:54:16.132 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T22:54:16.132 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T22:54:16.148 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/ 2024-09-13T22:54:16.148 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1629.geb16b97b 2024-09-13T22:54:16.257 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T22:54:16.257 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:54:16.257 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T22:54:16.273 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T22:54:16.274 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:54:16.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T22:54:16.283 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T22:54:16.283 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:54:16.283 INFO:teuthology.packaging:ref: None 2024-09-13T22:54:16.284 INFO:teuthology.packaging:tag: None 2024-09-13T22:54:16.284 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:54:16.284 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:16.284 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T22:54:16.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T22:54:16.301 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:54:16.301 INFO:teuthology.packaging:ref: None 2024-09-13T22:54:16.301 INFO:teuthology.packaging:tag: None 2024-09-13T22:54:16.301 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:54:16.301 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:16.301 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T22:54:16.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T22:54:16.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T22:54:16.424 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T22:54:16.443 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T22:54:16.493 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-13T22:54:16.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-13T22:54:16.507 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-13T22:54:16.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-13T22:54:16.720 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-13T22:54:16.743 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-13T22:54:16.747 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2024-09-13T22:54:16.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw 2024-09-13T22:54:17.325 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 264 kB/s | 77 kB 00:00 2024-09-13T22:54:17.329 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 281 kB/s | 77 kB 00:00 2024-09-13T22:54:17.608 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T22:54:17.614 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T22:54:17.883 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-13T22:54:17.900 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 7.2 kB/s | 1.8 kB 00:00 2024-09-13T22:54:18.400 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-13T22:54:18.497 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-13T22:54:22.126 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 20 MB 00:02 2024-09-13T22:54:23.490 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-13T22:54:26.609 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-13T22:54:28.144 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-13T22:54:28.201 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-13T22:54:29.115 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T22:54:29.885 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-13T22:54:30.739 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-13T22:54:34.495 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T22:54:36.152 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T22:54:36.863 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:54:36.870 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:54:36.870 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:54:36.870 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:54:36.870 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:54:36.870 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T22:54:36.871 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T22:54:36.872 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:Install 22 Packages 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 58 M 2024-09-13T22:54:36.873 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:54:37.671 INFO:teuthology.orchestra.run.smithi152.stdout:(1/24): ceph-base-17.2.7-1629.geb16b97b.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-13T22:54:37.755 INFO:teuthology.orchestra.run.smithi152.stdout:(2/24): ceph-selinux-17.2.7-1629.geb16b97b.el9. 302 kB/s | 25 kB 00:00 2024-09-13T22:54:37.855 INFO:teuthology.orchestra.run.smithi152.stdout:(3/24): libcephfs2-17.2.7-1629.geb16b97b.el9.x8 6.2 MB/s | 636 kB 00:00 2024-09-13T22:54:37.955 INFO:teuthology.orchestra.run.smithi152.stdout:(4/24): libradosstriper1-17.2.7-1629.geb16b97b. 4.5 MB/s | 458 kB 00:00 2024-09-13T22:54:38.339 INFO:teuthology.orchestra.run.smithi152.stdout:(5/24): ceph-common-17.2.7-1629.geb16b97b.el9.x 19 MB/s | 23 MB 00:01 2024-09-13T22:54:38.489 INFO:teuthology.orchestra.run.smithi152.stdout:(6/24): ceph-radosgw-17.2.7-1629.geb16b97b.el9. 11 MB/s | 14 MB 00:01 2024-09-13T22:54:38.514 INFO:teuthology.orchestra.run.smithi152.stdout:(7/24): python3-ceph-argparse-17.2.7-1629.geb16 258 kB/s | 45 kB 00:00 2024-09-13T22:54:38.539 INFO:teuthology.orchestra.run.smithi152.stdout:(8/24): python3-ceph-common-17.2.7-1629.geb16b9 2.4 MB/s | 120 kB 00:00 2024-09-13T22:54:38.552 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:54:38.565 INFO:teuthology.orchestra.run.smithi152.stdout:(9/24): python3-cephfs-17.2.7-1629.geb16b97b.el 3.1 MB/s | 157 kB 00:00 2024-09-13T22:54:38.568 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:54:38.568 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:54:38.568 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:54:38.568 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:54:38.568 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 14 M 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.1 M 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 5.0 M 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 23 M 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 636 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T22:54:38.569 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 458 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 4.9 M 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 45 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 120 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 157 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 320 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 296 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 99 k 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T22:54:38.570 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:Install 22 Packages 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 2 Packages 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 58 M 2024-09-13T22:54:38.571 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:54:38.590 INFO:teuthology.orchestra.run.smithi152.stdout:(10/24): python3-rados-17.2.7-1629.geb16b97b.el 6.3 MB/s | 320 kB 00:00 2024-09-13T22:54:38.615 INFO:teuthology.orchestra.run.smithi152.stdout:(11/24): python3-rbd-17.2.7-1629.geb16b97b.el9. 5.8 MB/s | 296 kB 00:00 2024-09-13T22:54:38.640 INFO:teuthology.orchestra.run.smithi152.stdout:(12/24): python3-rgw-17.2.7-1629.geb16b97b.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T22:54:38.716 INFO:teuthology.orchestra.run.smithi152.stdout:(13/24): librgw2-17.2.7-1629.geb16b97b.el9.x86_ 6.5 MB/s | 4.9 MB 00:00 2024-09-13T22:54:38.858 INFO:teuthology.orchestra.run.smithi152.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 209 kB/s | 45 kB 00:00 2024-09-13T22:54:38.883 INFO:teuthology.orchestra.run.smithi152.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 599 kB/s | 160 kB 00:00 2024-09-13T22:54:38.941 INFO:teuthology.orchestra.run.smithi152.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-13T22:54:38.967 INFO:teuthology.orchestra.run.smithi152.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-09-13T22:54:39.026 INFO:teuthology.orchestra.run.smithi152.stdout:(18/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.6 MB/s | 308 kB 00:00 2024-09-13T22:54:39.051 INFO:teuthology.orchestra.run.smithi152.stdout:(19/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-13T22:54:39.068 INFO:teuthology.orchestra.run.smithi152.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-09-13T22:54:39.101 INFO:teuthology.orchestra.run.smithi152.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 915 kB/s | 67 kB 00:00 2024-09-13T22:54:39.160 INFO:teuthology.orchestra.run.smithi152.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T22:54:39.285 INFO:teuthology.orchestra.run.smithi152.stdout:(23/24): librados2-17.2.7-1629.geb16b97b.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-13T22:54:39.335 INFO:teuthology.orchestra.run.smithi152.stdout:(24/24): librbd1-17.2.7-1629.geb16b97b.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-13T22:54:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:54:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-13T22:54:39.400 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:54:39.432 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:54:39.432 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:54:39.978 INFO:teuthology.orchestra.run.smithi115.stdout:(1/24): ceph-base-17.2.7-1629.geb16b97b.el9.x86 5.3 MB/s | 5.0 MB 00:00 2024-09-13T22:54:40.020 INFO:teuthology.orchestra.run.smithi115.stdout:(2/24): ceph-selinux-17.2.7-1629.geb16b97b.el9. 607 kB/s | 25 kB 00:00 2024-09-13T22:54:40.077 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:54:40.078 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:54:40.129 INFO:teuthology.orchestra.run.smithi115.stdout:(3/24): libcephfs2-17.2.7-1629.geb16b97b.el9.x8 5.7 MB/s | 636 kB 00:00 2024-09-13T22:54:40.221 INFO:teuthology.orchestra.run.smithi115.stdout:(4/24): libradosstriper1-17.2.7-1629.geb16b97b. 4.9 MB/s | 458 kB 00:00 2024-09-13T22:54:40.529 INFO:teuthology.orchestra.run.smithi115.stdout:(5/24): ceph-radosgw-17.2.7-1629.geb16b97b.el9. 9.7 MB/s | 14 MB 00:01 2024-09-13T22:54:40.588 INFO:teuthology.orchestra.run.smithi115.stdout:(6/24): python3-ceph-argparse-17.2.7-1629.geb16 779 kB/s | 45 kB 00:00 2024-09-13T22:54:40.655 INFO:teuthology.orchestra.run.smithi115.stdout:(7/24): python3-ceph-common-17.2.7-1629.geb16b9 1.8 MB/s | 120 kB 00:00 2024-09-13T22:54:40.873 INFO:teuthology.orchestra.run.smithi115.stdout:(8/24): ceph-common-17.2.7-1629.geb16b97b.el9.x 12 MB/s | 23 MB 00:01 2024-09-13T22:54:40.897 INFO:teuthology.orchestra.run.smithi115.stdout:(9/24): python3-cephfs-17.2.7-1629.geb16b97b.el 647 kB/s | 157 kB 00:00 2024-09-13T22:54:40.931 INFO:teuthology.orchestra.run.smithi115.stdout:(10/24): python3-rados-17.2.7-1629.geb16b97b.el 5.4 MB/s | 320 kB 00:00 2024-09-13T22:54:40.998 INFO:teuthology.orchestra.run.smithi115.stdout:(11/24): librgw2-17.2.7-1629.geb16b97b.el9.x86_ 6.3 MB/s | 4.9 MB 00:00 2024-09-13T22:54:41.023 INFO:teuthology.orchestra.run.smithi115.stdout:(12/24): python3-rgw-17.2.7-1629.geb16b97b.el9. 1.1 MB/s | 99 kB 00:00 2024-09-13T22:54:41.048 INFO:teuthology.orchestra.run.smithi115.stdout:(13/24): python3-rbd-17.2.7-1629.geb16b97b.el9. 1.9 MB/s | 296 kB 00:00 2024-09-13T22:54:41.115 INFO:teuthology.orchestra.run.smithi115.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-13T22:54:41.141 INFO:teuthology.orchestra.run.smithi115.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-13T22:54:41.183 INFO:teuthology.orchestra.run.smithi115.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-13T22:54:41.208 INFO:teuthology.orchestra.run.smithi115.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-13T22:54:41.302 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:54:41.341 INFO:teuthology.orchestra.run.smithi115.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-13T22:54:41.375 INFO:teuthology.orchestra.run.smithi115.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 291 kB/s | 49 kB 00:00 2024-09-13T22:54:41.409 INFO:teuthology.orchestra.run.smithi115.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2024-09-13T22:54:41.434 INFO:teuthology.orchestra.run.smithi115.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 746 kB/s | 67 kB 00:00 2024-09-13T22:54:41.493 INFO:teuthology.orchestra.run.smithi115.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T22:54:41.643 INFO:teuthology.orchestra.run.smithi115.stdout:(23/24): librbd1-17.2.7-1629.geb16b97b.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-13T22:54:41.691 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T22:54:41.718 INFO:teuthology.orchestra.run.smithi115.stdout:(24/24): librados2-17.2.7-1629.geb16b97b.el9.x8 10 MB/s | 3.1 MB 00:00 2024-09-13T22:54:41.724 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:54:41.724 INFO:teuthology.orchestra.run.smithi115.stdout:Total 18 MB/s | 58 MB 00:03 2024-09-13T22:54:41.745 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:54:41.789 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:54:41.824 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:54:41.825 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:54:41.838 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:54:41.927 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T22:54:41.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:54:42.042 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:54:42.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T22:54:42.127 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T22:54:42.475 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:54:42.475 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:54:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T22:54:42.608 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T22:54:42.670 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T22:54:42.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T22:54:42.743 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 10/26 2024-09-13T22:54:42.779 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T22:54:42.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T22:54:42.869 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T22:54:42.928 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T22:54:42.978 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T22:54:43.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T22:54:43.043 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T22:54:43.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T22:54:43.422 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T22:54:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T22:54:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 19/26 2024-09-13T22:54:43.633 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 20/26 2024-09-13T22:54:43.700 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:54:44.077 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T22:54:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:54:44.237 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:54:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T22:54:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:54:44.469 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:54:44.514 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T22:54:44.560 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T22:54:45.009 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T22:54:45.042 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T22:54:45.104 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 8/26 2024-09-13T22:54:45.141 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T22:54:45.184 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 10/26 2024-09-13T22:54:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T22:54:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T22:54:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T22:54:45.377 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 13/26 2024-09-13T22:54:45.427 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T22:54:45.470 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T22:54:45.503 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T22:54:45.797 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T22:54:45.849 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T22:54:45.939 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 18/26 2024-09-13T22:54:46.021 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 19/26 2024-09-13T22:54:46.051 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 20/26 2024-09-13T22:54:46.053 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:46.087 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:46.626 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:46.665 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T22:54:46.763 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T22:54:46.763 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T22:54:46.763 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T22:54:46.763 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:54:46.800 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:54:48.516 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:48.556 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:49.092 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 21/26 2024-09-13T22:54:49.143 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T22:54:49.243 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 22/26 2024-09-13T22:54:49.243 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T22:54:49.243 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T22:54:49.243 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:54:49.277 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-13T22:54:56.975 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-13T22:54:56.976 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-13T22:54:56.976 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-13T22:54:56.976 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:54:58.270 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T22:54:58.345 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T22:54:58.345 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:54:58.345 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T22:54:58.345 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:54:58.345 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:54:58.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:54:58.347 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T22:54:58.414 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T22:54:58.414 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-13T22:54:59.248 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:54:59.723 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 1/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 5/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 6/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 7/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 8/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 9/26 2024-09-13T22:54:59.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 10/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 13/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T22:54:59.725 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:54:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T22:54:59.726 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 25/26 2024-09-13T22:55:00.563 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 24/26 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:55:00.641 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:00.643 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.656 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.657 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:00.658 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:00.732 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T22:55:00.733 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:55:01.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2024-09-13T22:55:01.584 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:01.722 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:01.723 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:01.724 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-13T22:55:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:01.724 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 48 M 2024-09-13T22:55:01.724 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 193 M 2024-09-13T22:55:01.724 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:02.014 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:55:02.014 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 1/26 2024-09-13T22:55:02.014 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 3/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 4/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 5/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_6 6/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 7/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9. 8/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x8 9/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 10/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 11/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 12/26 2024-09-13T22:55:02.015 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 13/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 23/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T22:55:02.016 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 25/26 2024-09-13T22:55:02.212 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): libcephsqlite-17.2.7-1629.geb16b97b.el9. 775 kB/s | 163 kB 00:00 2024-09-13T22:55:02.820 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-09-13T22:55:02.831 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T22:55:02.831 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T22:55:02.832 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.833 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.834 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:02.834 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T22:55:02.834 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:02.834 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:02.870 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 350 kB/s | 304 kB 00:00 2024-09-13T22:55:03.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-test 2024-09-13T22:55:03.462 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): ceph-test-17.2.7-1629.geb16b97b.el9.x86_ 33 MB/s | 48 MB 00:01 2024-09-13T22:55:03.464 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:03.465 INFO:teuthology.orchestra.run.smithi152.stdout:Total 28 MB/s | 48 MB 00:01 2024-09-13T22:55:03.492 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:03.511 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:03.512 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:03.781 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:03.878 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:03.878 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:03.918 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 48 M 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 163 k 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T22:55:03.919 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 48 M 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 193 M 2024-09-13T22:55:03.921 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:04.113 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-13T22:55:04.181 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): libcephsqlite-17.2.7-1629.geb16b97b.el9. 784 kB/s | 163 kB 00:00 2024-09-13T22:55:04.206 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-09-13T22:55:04.404 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:04.474 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T22:55:04.519 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T22:55:04.547 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T22:55:05.472 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): ceph-test-17.2.7-1629.geb16b97b.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-13T22:55:05.474 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:05.475 INFO:teuthology.orchestra.run.smithi115.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-13T22:55:05.503 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:05.522 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:05.522 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:05.888 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:05.888 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:06.490 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T22:55:06.533 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T22:55:06.557 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T22:55:08.946 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T22:55:09.019 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T22:55:10.953 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 3/4 2024-09-13T22:55:11.022 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T22:55:11.289 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T22:55:11.289 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 1/4 2024-09-13T22:55:11.289 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2/4 2024-09-13T22:55:11.290 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T22:55:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:11.622 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:11.870 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2024-09-13T22:55:12.435 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:12.573 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T22:55:12.575 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T22:55:12.576 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T22:55:12.577 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout:Install 34 Packages 2024-09-13T22:55:12.578 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:12.579 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 27 M 2024-09-13T22:55:12.579 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 96 M 2024-09-13T22:55:12.579 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:13.287 INFO:teuthology.orchestra.run.smithi152.stdout:(1/34): ceph-17.2.7-1629.geb16b97b.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-13T22:55:13.372 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 4/4 2024-09-13T22:55:13.372 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 1/4 2024-09-13T22:55:13.372 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2/4 2024-09-13T22:55:13.372 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T22:55:13.453 INFO:teuthology.orchestra.run.smithi152.stdout:(2/34): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86_ 4.9 MB/s | 1.4 MB 00:00 2024-09-13T22:55:13.520 INFO:teuthology.orchestra.run.smithi152.stdout:(3/34): ceph-mds-17.2.7-1629.geb16b97b.el9.x86_ 5.9 MB/s | 2.1 MB 00:00 2024-09-13T22:55:13.604 INFO:teuthology.orchestra.run.smithi152.stdout:(4/34): ceph-mon-17.2.7-1629.geb16b97b.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-13T22:55:13.629 INFO:teuthology.orchestra.run.smithi152.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1629.geb16 2.2 MB/s | 240 kB 00:00 2024-09-13T22:55:13.728 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T22:55:13.728 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:13.728 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:13.728 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:13.728 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:13.729 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T22:55:13.729 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T22:55:13.729 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:13.729 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:13.729 INFO:teuthology.orchestra.run.smithi152.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-13T22:55:13.772 INFO:teuthology.orchestra.run.smithi152.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T22:55:13.814 INFO:teuthology.orchestra.run.smithi152.stdout:(8/34): python3-cryptography-36.0.1-4.el9.x86_6 6.7 MB/s | 1.2 MB 00:00 2024-09-13T22:55:13.830 INFO:teuthology.orchestra.run.smithi152.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-13T22:55:13.856 INFO:teuthology.orchestra.run.smithi152.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 2.9 MB/s | 125 kB 00:00 2024-09-13T22:55:13.881 INFO:teuthology.orchestra.run.smithi152.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-13T22:55:13.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph 2024-09-13T22:55:14.040 INFO:teuthology.orchestra.run.smithi152.stdout:(12/34): ceph-osd-17.2.7-1629.geb16b97b.el9.x86 26 MB/s | 15 MB 00:00 2024-09-13T22:55:14.240 INFO:teuthology.orchestra.run.smithi152.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 97 kB/s | 35 kB 00:00 2024-09-13T22:55:14.415 INFO:teuthology.orchestra.run.smithi152.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 206 kB/s | 77 kB 00:00 2024-09-13T22:55:14.440 INFO:teuthology.orchestra.run.smithi152.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 254 kB/s | 51 kB 00:00 2024-09-13T22:55:14.482 INFO:teuthology.orchestra.run.smithi152.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-13T22:55:14.509 INFO:teuthology.orchestra.run.smithi152.stdout:(17/34): python3-mako-1.1.4-6.el9.noarch.rpm 264 kB/s | 172 kB 00:00 2024-09-13T22:55:14.533 INFO:teuthology.orchestra.run.smithi152.stdout:(18/34): python3-toml-0.10.2-6.el9.noarch.rpm 354 kB/s | 42 kB 00:00 2024-09-13T22:55:14.575 INFO:teuthology.orchestra.run.smithi152.stdout:(19/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-13T22:55:14.576 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:38 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:14.600 INFO:teuthology.orchestra.run.smithi152.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 769 kB/s | 18 kB 00:00 2024-09-13T22:55:14.625 INFO:teuthology.orchestra.run.smithi152.stdout:(21/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 126 kB/s | 11 kB 00:00 2024-09-13T22:55:14.650 INFO:teuthology.orchestra.run.smithi152.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-13T22:55:14.676 INFO:teuthology.orchestra.run.smithi152.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-13T22:55:14.693 INFO:teuthology.orchestra.run.smithi152.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 471 kB/s | 20 kB 00:00 2024-09-13T22:55:14.709 INFO:teuthology.orchestra.run.smithi152.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-13T22:55:14.711 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 6.5 k 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.1 M 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 1.4 M 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 240 k 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 3.9 M 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 15 M 2024-09-13T22:55:14.714 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T22:55:14.715 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T22:55:14.716 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout:Install 34 Packages 2024-09-13T22:55:14.717 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:14.718 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 27 M 2024-09-13T22:55:14.718 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 96 M 2024-09-13T22:55:14.718 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:14.734 INFO:teuthology.orchestra.run.smithi152.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2024-09-13T22:55:14.760 INFO:teuthology.orchestra.run.smithi152.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T22:55:14.777 INFO:teuthology.orchestra.run.smithi152.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 393 kB/s | 16 kB 00:00 2024-09-13T22:55:14.802 INFO:teuthology.orchestra.run.smithi152.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T22:55:14.819 INFO:teuthology.orchestra.run.smithi152.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 854 kB/s | 36 kB 00:00 2024-09-13T22:55:14.844 INFO:teuthology.orchestra.run.smithi152.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-13T22:55:14.861 INFO:teuthology.orchestra.run.smithi152.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-13T22:55:14.895 INFO:teuthology.orchestra.run.smithi152.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-13T22:55:14.920 INFO:teuthology.orchestra.run.smithi152.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T22:55:14.925 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:14.925 INFO:teuthology.orchestra.run.smithi152.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-13T22:55:15.061 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:15.097 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:15.097 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:15.256 INFO:teuthology.orchestra.run.smithi115.stdout:(1/34): ceph-17.2.7-1629.geb16b97b.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-13T22:55:15.465 INFO:teuthology.orchestra.run.smithi115.stdout:(2/34): ceph-mds-17.2.7-1629.geb16b97b.el9.x86_ 6.1 MB/s | 2.1 MB 00:00 2024-09-13T22:55:15.498 INFO:teuthology.orchestra.run.smithi115.stdout:(3/34): ceph-mgr-17.2.7-1629.geb16b97b.el9.x86_ 3.8 MB/s | 1.4 MB 00:00 2024-09-13T22:55:15.517 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:15.517 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:15.607 INFO:teuthology.orchestra.run.smithi115.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1629.geb16 2.2 MB/s | 240 kB 00:00 2024-09-13T22:55:15.674 INFO:teuthology.orchestra.run.smithi115.stdout:(5/34): ceph-mon-17.2.7-1629.geb16b97b.el9.x86_ 9.4 MB/s | 3.9 MB 00:00 2024-09-13T22:55:15.791 INFO:teuthology.orchestra.run.smithi115.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-13T22:55:15.833 INFO:teuthology.orchestra.run.smithi115.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T22:55:15.992 INFO:teuthology.orchestra.run.smithi115.stdout:(8/34): ceph-osd-17.2.7-1629.geb16b97b.el9.x86_ 29 MB/s | 15 MB 00:00 2024-09-13T22:55:16.017 INFO:teuthology.orchestra.run.smithi115.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 736 kB/s | 135 kB 00:00 2024-09-13T22:55:16.059 INFO:teuthology.orchestra.run.smithi115.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 3.2 MB/s | 1.2 MB 00:00 2024-09-13T22:55:16.084 INFO:teuthology.orchestra.run.smithi115.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-13T22:55:16.126 INFO:teuthology.orchestra.run.smithi115.stdout:(12/34): python3-requests-2.25.1-8.el9.noarch.r 932 kB/s | 125 kB 00:00 2024-09-13T22:55:16.193 INFO:teuthology.orchestra.run.smithi115.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-09-13T22:55:16.218 INFO:teuthology.orchestra.run.smithi115.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T22:55:16.243 INFO:teuthology.orchestra.run.smithi115.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 657 kB/s | 77 kB 00:00 2024-09-13T22:55:16.269 INFO:teuthology.orchestra.run.smithi115.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-13T22:55:16.294 INFO:teuthology.orchestra.run.smithi115.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-13T22:55:16.345 INFO:teuthology.orchestra.run.smithi115.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 431 kB/s | 43 kB 00:00 2024-09-13T22:55:16.370 INFO:teuthology.orchestra.run.smithi115.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 465 kB/s | 11 kB 00:00 2024-09-13T22:55:16.395 INFO:teuthology.orchestra.run.smithi115.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T22:55:16.420 INFO:teuthology.orchestra.run.smithi115.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 350 kB/s | 18 kB 00:00 2024-09-13T22:55:16.445 INFO:teuthology.orchestra.run.smithi115.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-09-13T22:55:16.466 INFO:teuthology.orchestra.run.smithi115.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 431 kB/s | 19 kB 00:00 2024-09-13T22:55:16.491 INFO:teuthology.orchestra.run.smithi115.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 435 kB/s | 20 kB 00:00 2024-09-13T22:55:16.516 INFO:teuthology.orchestra.run.smithi115.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 917 kB/s | 46 kB 00:00 2024-09-13T22:55:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T22:55:16.567 INFO:teuthology.orchestra.run.smithi115.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T22:55:16.584 INFO:teuthology.orchestra.run.smithi115.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 390 kB/s | 16 kB 00:00 2024-09-13T22:55:16.609 INFO:teuthology.orchestra.run.smithi115.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T22:55:16.626 INFO:teuthology.orchestra.run.smithi115.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 855 kB/s | 36 kB 00:00 2024-09-13T22:55:16.652 INFO:teuthology.orchestra.run.smithi115.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-13T22:55:16.677 INFO:teuthology.orchestra.run.smithi115.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-13T22:55:16.702 INFO:teuthology.orchestra.run.smithi115.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-13T22:55:16.744 INFO:teuthology.orchestra.run.smithi115.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-13T22:55:16.748 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:16.748 INFO:teuthology.orchestra.run.smithi115.stdout:Total 13 MB/s | 27 MB 00:02 2024-09-13T22:55:16.790 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:16.848 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T22:55:16.871 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:16.880 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T22:55:16.909 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:16.909 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:16.913 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T22:55:17.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T22:55:17.082 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T22:55:17.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T22:55:17.159 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T22:55:17.189 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T22:55:17.223 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T22:55:17.257 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T22:55:17.292 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:17.292 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:17.300 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T22:55:17.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T22:55:17.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T22:55:17.426 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T22:55:17.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T22:55:17.540 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T22:55:17.686 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T22:55:17.774 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T22:55:17.828 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T22:55:17.866 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T22:55:17.923 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T22:55:17.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T22:55:18.171 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T22:55:18.228 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T22:55:18.307 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T22:55:18.394 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T22:55:18.436 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T22:55:18.550 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T22:55:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:18.630 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T22:55:18.662 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T22:55:18.704 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T22:55:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 29/34 2024-09-13T22:55:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T22:55:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T22:55:18.773 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:18.773 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T22:55:18.773 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:55:18.773 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:55:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:18.795 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T22:55:18.873 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T22:55:18.914 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T22:55:18.949 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T22:55:18.979 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T22:55:19.022 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T22:55:19.064 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T22:55:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T22:55:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T22:55:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T22:55:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T22:55:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T22:55:19.344 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T22:55:19.481 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T22:55:19.570 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T22:55:19.632 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T22:55:19.679 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T22:55:19.728 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T22:55:19.785 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T22:55:19.969 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T22:55:20.018 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T22:55:20.096 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T22:55:20.184 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T22:55:20.218 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T22:55:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:55:20.250 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T22:55:20.480 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 29/34 2024-09-13T22:55:20.520 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T22:55:20.546 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 30/34 2024-09-13T22:55:20.546 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:20.546 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T22:55:20.546 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:55:20.547 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:20.622 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T22:55:20.647 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T22:55:20.647 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:20.647 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T22:55:20.647 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:55:20.648 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:55:20.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:20.848 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:55:20.872 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:20.936 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T22:55:21.905 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T22:55:21.934 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 31/34 2024-09-13T22:55:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T22:55:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:55:21.935 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:55:21.935 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:22.305 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 32/34 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:55:22.329 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 3/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 4/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 5/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 6/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T22:55:22.469 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T22:55:22.470 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T22:55:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T22:55:22.472 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T22:55:22.472 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T22:55:22.472 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T22:55:22.472 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T22:55:22.472 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T22:55:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T22:55:22.554 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 33/34 2024-09-13T22:55:22.555 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:22.555 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T22:55:22.555 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:55:22.555 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:55:22.555 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:22.620 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T22:55:23.467 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T22:55:23.468 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:23.469 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:23.828 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2024-09-13T22:55:24.399 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:24.468 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 34/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 1/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 3/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 4/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 5/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9. 6/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T22:55:24.469 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T22:55:24.470 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T22:55:24.471 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T22:55:24.488 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:55:24.530 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:24.532 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:55:24.532 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:24.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2024-09-13T22:55:25.157 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:25.289 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:25.289 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 83 k 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:25.290 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 83 k 2024-09-13T22:55:25.291 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 375 k 2024-09-13T22:55:25.291 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:25.489 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-17.2.7-1629.geb16b97b.el9.noarch.rpm 418 kB/s | 83 kB 00:00 2024-09-13T22:55:25.489 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:25.490 INFO:teuthology.orchestra.run.smithi152.stdout:Total 415 kB/s | 83 kB 00:00 2024-09-13T22:55:25.490 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:25.495 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:25.495 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:25.497 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:25.497 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:25.524 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T22:55:25.525 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T22:55:25.526 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:25.527 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:25.577 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:25.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-base 2024-09-13T22:55:25.979 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:26.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:26.424 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:26.440 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:26.514 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-base-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:55:26.555 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:26.556 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:55:26.556 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:26.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install cephadm 2024-09-13T22:55:26.677 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:26.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:26.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:26.678 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:26.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:26.678 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:26.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T22:55:27.191 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:27.323 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:27.323 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 83 k 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 83 k 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 375 k 2024-09-13T22:55:27.324 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:27.472 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:27.522 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm-17.2.7-1629.geb16b97b.el9.noarch.rpm 418 kB/s | 83 kB 00:00 2024-09-13T22:55:27.522 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:27.523 INFO:teuthology.orchestra.run.smithi115.stdout:Total 415 kB/s | 83 kB 00:00 2024-09-13T22:55:27.523 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:27.528 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:27.528 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:27.530 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:27.530 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:27.606 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:27.607 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 137 k 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:55:27.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:27.609 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 137 k 2024-09-13T22:55:27.609 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 379 k 2024-09-13T22:55:27.609 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:27.610 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:27.819 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-17.2.7-1629.geb16b9 654 kB/s | 137 kB 00:00 2024-09-13T22:55:27.819 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:27.820 INFO:teuthology.orchestra.run.smithi152.stdout:Total 648 kB/s | 137 kB 00:00 2024-09-13T22:55:27.820 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:27.827 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:27.828 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:27.885 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:27.885 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:28.044 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:28.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:28.145 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:28.145 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T22:55:28.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:28.185 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:28.567 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/1 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:28.833 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:29.025 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T22:55:29.108 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:29.108 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:29.108 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:29.108 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:29.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:29.109 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:29.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2024-09-13T22:55:29.601 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:29.736 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:29.736 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:29.736 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 137 k 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:55:29.737 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:29.738 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 137 k 2024-09-13T22:55:29.738 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 379 k 2024-09-13T22:55:29.738 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:29.901 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:29.912 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-immutable-object-cache-17.2.7-1629.geb16b9 792 kB/s | 137 kB 00:00 2024-09-13T22:55:29.912 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:29.912 INFO:teuthology.orchestra.run.smithi115.stdout:Total 784 kB/s | 137 kB 00:00 2024-09-13T22:55:29.913 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:29.920 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:29.920 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:29.978 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:29.978 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:29.996 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:55:30.038 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:55:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:30.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T22:55:30.141 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:30.254 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:55:30.254 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T22:55:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:30.668 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:30.801 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-13T22:55:30.802 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout:Install 7 Packages 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.7 M 2024-09-13T22:55:30.803 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 80 M 2024-09-13T22:55:30.804 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b. 1/1 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:31.214 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:31.355 INFO:teuthology.orchestra.run.smithi152.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1629.geb1 172 kB/s | 24 kB 00:00 2024-09-13T22:55:31.372 INFO:teuthology.orchestra.run.smithi152.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1629.geb16 92 kB/s | 15 kB 00:00 2024-09-13T22:55:31.405 INFO:teuthology.orchestra.run.smithi152.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 181 kB/s | 9.0 kB 00:00 2024-09-13T22:55:31.422 INFO:teuthology.orchestra.run.smithi152.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 2.0 MB/s | 31 kB 00:00 2024-09-13T22:55:31.439 INFO:teuthology.orchestra.run.smithi152.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 610 kB/s | 41 kB 00:00 2024-09-13T22:55:31.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr 2024-09-13T22:55:31.464 INFO:teuthology.orchestra.run.smithi152.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-13T22:55:31.581 INFO:teuthology.orchestra.run.smithi152.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1629.geb16b97b 9.1 MB/s | 3.4 MB 00:00 2024-09-13T22:55:31.585 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:31.586 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.7 MB/s | 3.7 MB 00:00 2024-09-13T22:55:31.586 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:31.594 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:31.594 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:31.680 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:31.680 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:31.978 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:32.021 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:32.032 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T22:55:32.066 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T22:55:32.113 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T22:55:32.116 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-mgr-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:55:32.145 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T22:55:32.160 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:32.161 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:55:32.161 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:32.173 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 5/7 2024-09-13T22:55:32.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T22:55:32.791 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:32.924 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:32.924 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:32.924 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 3.4 M 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 24 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 15 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:32.925 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout:Install 7 Packages 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 3.7 M 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 80 M 2024-09-13T22:55:32.926 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:33.171 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 6/7 2024-09-13T22:55:33.219 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T22:55:33.251 INFO:teuthology.orchestra.run.smithi115.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1629.geb1 170 kB/s | 24 kB 00:00 2024-09-13T22:55:33.276 INFO:teuthology.orchestra.run.smithi115.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1629.geb16 86 kB/s | 15 kB 00:00 2024-09-13T22:55:33.318 INFO:teuthology.orchestra.run.smithi115.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T22:55:33.343 INFO:teuthology.orchestra.run.smithi115.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T22:55:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-13T22:55:33.394 INFO:teuthology.orchestra.run.smithi115.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-13T22:55:33.518 INFO:teuthology.orchestra.run.smithi115.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1629.geb16b97b 8.1 MB/s | 3.4 MB 00:00 2024-09-13T22:55:33.522 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:33.522 INFO:teuthology.orchestra.run.smithi115.stdout:Total 6.1 MB/s | 3.7 MB 00:00 2024-09-13T22:55:33.522 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:33.531 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:33.531 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:33.627 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:33.627 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:33.929 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:34.012 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T22:55:34.046 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T22:55:34.109 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T22:55:34.165 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T22:55:34.203 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 5/7 2024-09-13T22:55:34.243 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T22:55:34.243 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 1/7 2024-09-13T22:55:34.244 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 2/7 2024-09-13T22:55:34.244 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 3/7 2024-09-13T22:55:34.244 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T22:55:34.244 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T22:55:34.244 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T22:55:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:34.525 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:34.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T22:55:35.193 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 6/7 2024-09-13T22:55:35.240 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T22:55:35.299 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:35.432 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T22:55:35.433 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout:======================================================================================= 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout:Install 12 Packages 2024-09-13T22:55:35.434 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:35.435 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 38 M 2024-09-13T22:55:35.435 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 212 M 2024-09-13T22:55:35.435 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:35.714 INFO:teuthology.orchestra.run.smithi152.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-13T22:55:35.772 INFO:teuthology.orchestra.run.smithi152.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-13T22:55:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-13T22:55:35.823 INFO:teuthology.orchestra.run.smithi152.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 548 kB/s | 18 kB 00:00 2024-09-13T22:55:35.873 INFO:teuthology.orchestra.run.smithi152.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-13T22:55:35.998 INFO:teuthology.orchestra.run.smithi152.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-13T22:55:36.099 INFO:teuthology.orchestra.run.smithi152.stdout:(7/12): ceph-mgr-diskprediction-local-17.2.7-16 14 MB/s | 7.4 MB 00:00 2024-09-13T22:55:36.124 INFO:teuthology.orchestra.run.smithi152.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-13T22:55:36.208 INFO:teuthology.orchestra.run.smithi152.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-13T22:55:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 7/7 2024-09-13T22:55:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9. 1/7 2024-09-13T22:55:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarc 2/7 2024-09-13T22:55:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.n 3/7 2024-09-13T22:55:36.229 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T22:55:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T22:55:36.230 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T22:55:36.232 INFO:teuthology.orchestra.run.smithi152.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-13T22:55:36.483 INFO:teuthology.orchestra.run.smithi152.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T22:55:36.515 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T22:55:36.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T22:55:36.516 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T22:55:36.516 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:36.516 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:36.591 INFO:teuthology.orchestra.run.smithi152.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-13T22:55:36.592 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:36.593 INFO:teuthology.orchestra.run.smithi152.stdout:Total 33 MB/s | 38 MB 00:01 2024-09-13T22:55:36.736 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T22:55:36.948 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:36.974 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:36.974 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:37.292 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:01 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:37.426 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:37.427 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-13T22:55:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:37.427 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-13T22:55:37.427 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 7.4 M 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T22:55:37.428 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout:Install 12 Packages 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:37.429 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 38 M 2024-09-13T22:55:37.430 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 212 M 2024-09-13T22:55:37.430 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:37.481 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:37.481 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:37.669 INFO:teuthology.orchestra.run.smithi115.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T22:55:37.718 INFO:teuthology.orchestra.run.smithi115.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-13T22:55:37.810 INFO:teuthology.orchestra.run.smithi115.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-13T22:55:37.870 INFO:teuthology.orchestra.run.smithi115.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 310 kB/s | 18 kB 00:00 2024-09-13T22:55:37.970 INFO:teuthology.orchestra.run.smithi115.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-13T22:55:37.995 INFO:teuthology.orchestra.run.smithi115.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 308 kB/s | 38 kB 00:00 2024-09-13T22:55:38.104 INFO:teuthology.orchestra.run.smithi115.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-13T22:55:38.154 INFO:teuthology.orchestra.run.smithi115.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.9 MB/s | 3.0 MB 00:00 2024-09-13T22:55:38.212 INFO:teuthology.orchestra.run.smithi115.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-13T22:55:38.242 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:38.329 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T22:55:38.379 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:55:38.404 INFO:teuthology.orchestra.run.smithi115.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-13T22:55:38.471 INFO:teuthology.orchestra.run.smithi115.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.9 MB/s | 4.9 MB 00:00 2024-09-13T22:55:38.477 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:55:38.524 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T22:55:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T22:55:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T22:55:38.816 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T22:55:38.856 INFO:teuthology.orchestra.run.smithi115.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-13T22:55:38.856 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:38.856 INFO:teuthology.orchestra.run.smithi115.stdout:Total 27 MB/s | 38 MB 00:01 2024-09-13T22:55:39.211 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:39.237 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:39.237 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:39.461 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T22:55:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T22:55:39.735 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:39.735 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:40.486 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T22:55:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:55:40.720 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:55:40.762 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T22:55:40.820 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:55:40.948 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T22:55:40.986 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T22:55:41.069 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T22:55:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T22:55:41.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T22:55:41.871 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T22:55:41.883 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T22:55:43.143 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:55:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T22:55:44.228 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T22:55:44.444 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T22:55:44.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 1/12 2024-09-13T22:55:44.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:55:44.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:55:44.445 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T22:55:44.875 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:44.876 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:45.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2024-09-13T22:55:45.842 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:45.985 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T22:55:45.986 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T22:55:45.987 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:45.988 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.2 M 2024-09-13T22:55:45.989 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 26 M 2024-09-13T22:55:45.989 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:46.595 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 165 kB/s | 19 kB 00:00 2024-09-13T22:55:46.612 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 193 kB/s | 26 kB 00:00 2024-09-13T22:55:46.629 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): ceph-mgr-rook-17.2.7-1629.geb16b97b.el9 317 kB/s | 47 kB 00:00 2024-09-13T22:55:46.712 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-13T22:55:46.738 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 12/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b 1/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T22:55:46.745 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T22:55:46.746 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T22:55:46.746 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T22:55:46.746 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T22:55:46.746 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:55:46.746 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T22:55:46.779 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 773 kB/s | 32 kB 00:00 2024-09-13T22:55:46.797 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 639 kB/s | 54 kB 00:00 2024-09-13T22:55:46.813 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 420 kB/s | 14 kB 00:00 2024-09-13T22:55:46.847 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-13T22:55:46.898 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-13T22:55:46.914 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 906 kB/s | 59 kB 00:00 2024-09-13T22:55:46.940 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-09-13T22:55:46.990 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2024-09-13T22:55:46.993 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:46.993 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-09-13T22:55:47.056 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:47.071 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:47.072 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:47.157 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T22:55:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T22:55:47.159 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T22:55:47.159 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T22:55:47.159 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T22:55:47.159 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:47.159 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:47.162 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:47.163 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:47.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-rook 2024-09-13T22:55:47.672 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:47.871 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T22:55:47.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T22:55:47.988 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T22:55:48.025 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T22:55:48.066 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T22:55:48.078 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:48.168 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T22:55:48.210 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:48.211 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:48.211 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:48.211 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:48.211 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:48.211 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 47 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T22:55:48.212 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout:Install 13 Packages 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.2 M 2024-09-13T22:55:48.213 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 26 M 2024-09-13T22:55:48.214 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:48.278 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T22:55:48.335 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T22:55:48.619 INFO:teuthology.orchestra.run.smithi115.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 258 kB/s | 26 kB 00:00 2024-09-13T22:55:48.645 INFO:teuthology.orchestra.run.smithi115.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 154 kB/s | 19 kB 00:00 2024-09-13T22:55:48.711 INFO:teuthology.orchestra.run.smithi115.stdout:(3/13): ceph-mgr-rook-17.2.7-1629.geb16b97b.el9 248 kB/s | 47 kB 00:00 2024-09-13T22:55:48.745 INFO:teuthology.orchestra.run.smithi115.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-13T22:55:48.787 INFO:teuthology.orchestra.run.smithi115.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-13T22:55:48.821 INFO:teuthology.orchestra.run.smithi115.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 712 kB/s | 54 kB 00:00 2024-09-13T22:55:48.863 INFO:teuthology.orchestra.run.smithi115.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-13T22:55:48.888 INFO:teuthology.orchestra.run.smithi115.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 217 kB/s | 14 kB 00:00 2024-09-13T22:55:48.913 INFO:teuthology.orchestra.run.smithi115.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-13T22:55:48.938 INFO:teuthology.orchestra.run.smithi115.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-13T22:55:48.964 INFO:teuthology.orchestra.run.smithi115.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T22:55:49.014 INFO:teuthology.orchestra.run.smithi115.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-13T22:55:49.049 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T22:55:49.056 INFO:teuthology.orchestra.run.smithi115.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-13T22:55:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:49.059 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-13T22:55:49.090 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T22:55:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T22:55:49.125 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:49.140 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:49.140 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T22:55:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T22:55:49.226 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:49.227 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:49.900 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T22:55:49.948 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T22:55:50.003 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T22:55:50.033 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T22:55:50.082 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T22:55:50.082 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 1/13 2024-09-13T22:55:50.082 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T22:55:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T22:55:50.084 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T22:55:50.192 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T22:55:50.294 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T22:55:50.351 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T22:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:50.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T22:55:51.057 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T22:55:51.107 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T22:55:51.140 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T22:55:51.186 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T22:55:51.219 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T22:55:51.240 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:51.375 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 124 k 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-09-13T22:55:51.376 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:51.377 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 7.0 M 2024-09-13T22:55:51.377 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 33 M 2024-09-13T22:55:51.377 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:51.965 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 2.0 MB/s | 248 kB 00:00 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 13/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 1/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T22:55:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T22:55:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T22:55:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-13T22:55:52.075 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): ceph-mgr-cephadm-17.2.7-1629.geb16b97b.e 540 kB/s | 124 kB 00:00 2024-09-13T22:55:52.100 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T22:55:52.192 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-13T22:55:52.217 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 525 kB/s | 74 kB 00:00 2024-09-13T22:55:52.219 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:52.220 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.3 MB/s | 7.0 MB 00:00 2024-09-13T22:55:52.292 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:52.303 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:52.303 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T22:55:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:52.390 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:52.390 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T22:55:52.391 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T22:55:52.392 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T22:55:52.392 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:52.392 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:52.401 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:52.401 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:52.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T22:55:52.707 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:52.873 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T22:55:52.927 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T22:55:53.237 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:53.371 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:53.372 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:53.372 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:53.372 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:53.372 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:53.372 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1629.geb16b97b.el9 ceph-noarch 124 k 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout:Install 6 Packages 2024-09-13T22:55:53.373 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:53.374 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 7.0 M 2024-09-13T22:55:53.374 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 33 M 2024-09-13T22:55:53.374 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:53.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T22:55:53.530 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T22:55:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T22:55:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T22:55:53.926 INFO:teuthology.orchestra.run.smithi115.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-13T22:55:53.968 INFO:teuthology.orchestra.run.smithi115.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1629.geb16b97b.e 454 kB/s | 124 kB 00:00 2024-09-13T22:55:53.993 INFO:teuthology.orchestra.run.smithi115.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 832 kB/s | 248 kB 00:00 2024-09-13T22:55:54.035 INFO:teuthology.orchestra.run.smithi115.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-13T22:55:54.060 INFO:teuthology.orchestra.run.smithi115.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 626 kB/s | 58 kB 00:00 2024-09-13T22:55:54.085 INFO:teuthology.orchestra.run.smithi115.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 871 kB/s | 74 kB 00:00 2024-09-13T22:55:54.088 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:54.088 INFO:teuthology.orchestra.run.smithi115.stdout:Total 9.8 MB/s | 7.0 MB 00:00 2024-09-13T22:55:54.160 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:54.171 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:54.172 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:54.270 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:54.271 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/6 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T22:55:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T22:55:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:54.695 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:54.696 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:54.751 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T22:55:54.804 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T22:55:54.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2024-09-13T22:55:55.323 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T22:55:55.415 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T22:55:55.471 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T22:55:55.499 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T22:55:55.515 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:55.648 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:55.648 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:55.648 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-13T22:55:55.648 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:55.648 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2024-09-13T22:55:55.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:55.650 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 893 k 2024-09-13T22:55:55.650 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 2.6 M 2024-09-13T22:55:55.650 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:55.818 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 542 kB/s | 80 kB 00:00 2024-09-13T22:55:55.935 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): ceph-fuse-17.2.7-1629.geb16b97b.el9.x86_ 3.0 MB/s | 813 kB 00:00 2024-09-13T22:55:55.935 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:55.935 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.0 MB/s | 893 kB 00:00 2024-09-13T22:55:55.947 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:55.971 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:55.971 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:56.049 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:56.049 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:56.242 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 6/6 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 1/6 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T22:55:56.338 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T22:55:56.364 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T22:55:56.433 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T22:55:56.601 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T22:55:56.601 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:56.601 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:56.601 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:17.2.7-1629.geb16b97b.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:56.602 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:56.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-fuse 2024-09-13T22:55:57.093 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T22:55:57.093 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/2 2024-09-13T22:55:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T22:55:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:57.348 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T22:55:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:57.349 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:57.405 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:55:57.537 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 813 k 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-13T22:55:57.538 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:Install 2 Packages 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 893 k 2024-09-13T22:55:57.539 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 2.6 M 2024-09-13T22:55:57.540 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:55:57.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2024-09-13T22:55:57.762 INFO:teuthology.orchestra.run.smithi115.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 863 kB/s | 80 kB 00:00 2024-09-13T22:55:57.962 INFO:teuthology.orchestra.run.smithi115.stdout:(2/2): ceph-fuse-17.2.7-1629.geb16b97b.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-13T22:55:57.963 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:57.963 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.1 MB/s | 893 kB 00:00 2024-09-13T22:55:57.974 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:55:57.996 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:55:57.996 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:55:58.077 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:55:58.077 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:55:58.197 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:55:58.266 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:55:58.330 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:55:58.330 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 126 k 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 448 k 2024-09-13T22:55:58.331 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:55:58.408 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T22:55:58.487 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T22:55:58.541 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-17.2.7-1629.geb16b97b.el9.x86_64 612 kB/s | 126 kB 00:00 2024-09-13T22:55:58.542 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:55:58.542 INFO:teuthology.orchestra.run.smithi152.stdout:Total 608 kB/s | 126 kB 00:00 2024-09-13T22:55:58.542 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:55:58.544 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:55:58.544 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:55:58.607 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:55:58.607 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:55:58.756 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:55:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:55:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2/2 2024-09-13T22:55:59.184 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/2 2024-09-13T22:55:59.267 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:55:59.486 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T22:55:59.486 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:59.486 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:55:59.486 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T22:55:59.487 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:55:59.487 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:55:59.528 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:55:59.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:59.529 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:55:59.529 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:55:59.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:55:59.529 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:55:59.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2024-09-13T22:55:59.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados-devel 2024-09-13T22:56:00.316 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:00.366 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:00.407 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:00.452 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:00.453 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:00.453 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:00.506 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:00.506 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 126 k 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:56:00.507 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:00.508 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 126 k 2024-09-13T22:56:00.508 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 448 k 2024-09-13T22:56:00.508 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:56:00.516 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2024-09-13T22:56:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:librados-devel-17.2.7-1629.geb16b97b.el9.x86_64 579 kB/s | 126 kB 00:00 2024-09-13T22:56:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:00.726 INFO:teuthology.orchestra.run.smithi115.stdout:Total 576 kB/s | 126 kB 00:00 2024-09-13T22:56:00.727 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:56:00.732 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:56:00.732 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:56:00.795 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:56:00.795 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:56:00.949 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:56:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:01.084 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:01.217 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:01.218 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:01.218 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 25 k 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 110 k 2024-09-13T22:56:01.219 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:56:01.365 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-17.2.7-1629.geb16b97b.el9.x86_6 171 kB/s | 25 kB 00:00 2024-09-13T22:56:01.366 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:01.366 INFO:teuthology.orchestra.run.smithi152.stdout:Total 169 kB/s | 25 kB 00:00 2024-09-13T22:56:01.366 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:56:01.369 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:56:01.370 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:56:01.371 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:56:01.371 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:56:01.452 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:56:01.463 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:01.708 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:01.709 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:01.709 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:56:01.709 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:01.709 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:01.709 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:01.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs2 2024-09-13T22:56:02.167 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:02.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:02.168 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:56:02.168 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:02.168 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:02.168 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:02.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2024-09-13T22:56:02.513 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:02.604 INFO:teuthology.orchestra.run.smithi115.stdout:Package libcephfs2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:02.649 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:02.650 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:02.650 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:02.717 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs-devel 2024-09-13T22:56:02.915 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:03.005 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:03.049 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:03.049 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:03.049 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:03.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2024-09-13T22:56:03.294 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:03.426 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 25 k 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:56:03.427 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:03.428 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 25 k 2024-09-13T22:56:03.428 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 110 k 2024-09-13T22:56:03.428 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:56:03.580 INFO:teuthology.orchestra.run.smithi115.stdout:libcephfs-devel-17.2.7-1629.geb16b97b.el9.x86_6 165 kB/s | 25 kB 00:00 2024-09-13T22:56:03.580 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:03.580 INFO:teuthology.orchestra.run.smithi115.stdout:Total 163 kB/s | 25 kB 00:00 2024-09-13T22:56:03.580 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:56:03.584 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:56:03.584 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:56:03.585 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:56:03.586 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:56:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:56:03.679 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:03.769 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:03.812 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:03.813 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:03.813 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:03.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2024-09-13T22:56:04.116 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:04.410 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:04.439 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:04.528 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:04.570 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:04.571 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:04.571 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:04.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados2 2024-09-13T22:56:04.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2024-09-13T22:56:05.162 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:05.198 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:05.251 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:05.286 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:05.295 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:05.296 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:05.297 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:05.328 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:05.329 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:05.329 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:05.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librbd1 2024-09-13T22:56:05.396 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2024-09-13T22:56:05.958 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:05.959 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:06.048 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:06.049 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:06.090 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:06.091 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:06.091 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:06.091 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:06.092 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:06.092 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:06.155 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2024-09-13T22:56:06.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rados 2024-09-13T22:56:06.717 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:06.730 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:06.806 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:06.819 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rados-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:06.847 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:06.849 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-13T22:56:06.849 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:06.863 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:06.864 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:06.864 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:06.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2024-09-13T22:56:06.981 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rgw 2024-09-13T22:56:07.484 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:07.550 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:07.618 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:07.619 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:07.620 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 82 k 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 222 k 2024-09-13T22:56:07.621 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:56:07.641 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rgw-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:07.684 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:07.685 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:07.686 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:07.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-cephfs 2024-09-13T22:56:07.810 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-17.2.7-1629.geb16b97b.el9.x86_64.rpm 429 kB/s | 82 kB 00:00 2024-09-13T22:56:07.811 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:07.811 INFO:teuthology.orchestra.run.smithi152.stdout:Total 426 kB/s | 82 kB 00:00 2024-09-13T22:56:07.811 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:56:07.817 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:56:07.818 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:56:07.880 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:56:07.880 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:56:08.029 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:56:08.116 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:08.318 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:08.406 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-cephfs-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:08.448 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:08.449 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:08.449 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:08.456 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:08.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rbd 2024-09-13T22:56:08.726 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:08.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:56:08.727 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:08.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:08.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2024-09-13T22:56:09.086 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:09.175 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rbd-2:17.2.7-1629.geb16b97b.el9.x86_64 is already installed. 2024-09-13T22:56:09.217 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:09.218 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-09-13T22:56:09.218 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:09.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-fuse 2024-09-13T22:56:09.561 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:09.697 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.9 M 2024-09-13T22:56:09.699 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 12 M 2024-09-13T22:56:09.699 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:56:09.854 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:09.984 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 82 k 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:09.985 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 82 k 2024-09-13T22:56:09.986 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 222 k 2024-09-13T22:56:09.986 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:56:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-17.2.7-1629.geb16b97b.el9.x86_64.rpm 8.7 MB/s | 2.9 MB 00:00 2024-09-13T22:56:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.6 MB/s | 2.9 MB 00:00 2024-09-13T22:56:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:56:10.047 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:56:10.047 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:56:10.126 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:56:10.126 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:56:10.182 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-fuse-17.2.7-1629.geb16b97b.el9.x86_64.rpm 416 kB/s | 82 kB 00:00 2024-09-13T22:56:10.183 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:10.183 INFO:teuthology.orchestra.run.smithi115.stdout:Total 413 kB/s | 82 kB 00:00 2024-09-13T22:56:10.184 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:56:10.190 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:56:10.190 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:56:10.252 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:56:10.252 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:56:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:56:10.503 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:10.535 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:56:10.597 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:56:10.621 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:10.877 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:11.130 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:11.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-mirror 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:11.695 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:11.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2024-09-13T22:56:11.986 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:12.122 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 2.9 M 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:12.146 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.9 M 2024-09-13T22:56:12.147 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 12 M 2024-09-13T22:56:12.147 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:56:12.445 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-mirror-17.2.7-1629.geb16b97b.el9.x86_64.rpm 9.1 MB/s | 2.9 MB 00:00 2024-09-13T22:56:12.446 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:12.446 INFO:teuthology.orchestra.run.smithi115.stdout:Total 9.1 MB/s | 2.9 MB 00:00 2024-09-13T22:56:12.446 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:56:12.454 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:56:12.454 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:56:12.509 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 10:54:34 PM UTC. 2024-09-13T22:56:12.533 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:56:12.533 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:56:12.646 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 165 k 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 477 k 2024-09-13T22:56:12.647 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-13T22:56:12.857 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-17.2.7-1629.geb16b97b.el9.x86_64.rpm 788 kB/s | 165 kB 00:00 2024-09-13T22:56:12.857 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:Total 782 kB/s | 165 kB 00:00 2024-09-13T22:56:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-13T22:56:12.866 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-13T22:56:12.866 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-13T22:56:12.930 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-13T22:56:12.930 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-13T22:56:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:56:13.029 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:56:13.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:13.083 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-13T22:56:13.180 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:13.593 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:13.849 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:13.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:13.849 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-13T22:56:13.849 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:13.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:56:13.850 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-13T22:56:14.094 DEBUG:teuthology.parallel:result is None 2024-09-13T22:56:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:14.149 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:56:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:14.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:14.150 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:14.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-nbd 2024-09-13T22:56:14.992 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 10:54:36 PM UTC. 2024-09-13T22:56:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-13T22:56:15.127 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:17.2.7-1629.geb16b97b.el9 ceph 165 k 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 165 k 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 477 k 2024-09-13T22:56:15.128 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-13T22:56:15.333 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-nbd-17.2.7-1629.geb16b97b.el9.x86_64.rpm 808 kB/s | 165 kB 00:00 2024-09-13T22:56:15.333 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:15.334 INFO:teuthology.orchestra.run.smithi115.stdout:Total 803 kB/s | 165 kB 00:00 2024-09-13T22:56:15.334 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-13T22:56:15.341 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-13T22:56:15.341 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-13T22:56:15.405 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-13T22:56:15.405 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-13T22:56:15.565 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-13T22:56:15.671 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:16.080 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 1/1 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:17.2.7-1629.geb16b97b.el9.x86_64 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:56:16.341 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-13T22:56:16.662 DEBUG:teuthology.parallel:result is None 2024-09-13T22:56:16.662 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:56:16.663 INFO:teuthology.packaging:ref: None 2024-09-13T22:56:16.663 INFO:teuthology.packaging:tag: None 2024-09-13T22:56:16.663 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:56:16.663 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:56:16.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T22:56:16.900 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T22:56:16.921 INFO:teuthology.orchestra.run.smithi115.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T22:56:16.922 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T22:56:16.922 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T22:56:16.924 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:56:16.924 INFO:teuthology.packaging:ref: None 2024-09-13T22:56:16.924 INFO:teuthology.packaging:tag: None 2024-09-13T22:56:16.924 INFO:teuthology.packaging:branch: quincy 2024-09-13T22:56:16.924 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:56:16.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T22:56:17.163 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T22:56:17.190 INFO:teuthology.orchestra.run.smithi152.stdout:17.2.7-1629.geb16b97b.el9 2024-09-13T22:56:17.190 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1629.geb16b97b.el9 2024-09-13T22:56:17.190 INFO:teuthology.task.install:The correct ceph version 17.2.7-1629.geb16b97b is installed. 2024-09-13T22:56:17.192 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T22:56:17.192 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:56:17.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:56:17.219 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:56:17.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:56:17.261 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T22:56:17.262 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:56:17.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:56:17.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:56:17.359 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:56:17.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:56:17.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:56:17.457 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T22:56:17.457 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:56:17.458 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:56:17.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:56:17.547 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:56:17.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:56:17.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:56:17.642 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T22:56:17.642 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:56:17.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:56:17.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:56:17.732 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:56:17.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:56:17.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:56:17.824 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:56:17.833 INFO:teuthology.task.print:**** done install task... 2024-09-13T22:56:17.833 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T22:56:17.936 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:56:17.937 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T22:56:17.937 INFO:tasks.cephadm:Cluster fsid is 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:56:17.937 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T22:56:17.937 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T22:56:17.938 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi115': '172.21.15.115', 'mon.smithi152': '172.21.15.152'} 2024-09-13T22:56:17.938 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T22:56:17.938 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-09-13T22:56:17.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-09-13T22:56:17.990 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-13T22:56:17.990 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.192 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 22:56 /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.192 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.318 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 22:56 /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.319 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.335 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:56:18.363 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-13T22:56:18.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T22:56:18.378 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T22:56:19.922 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T22:56:20.036 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T22:56:46.755 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-13T22:56:46.755 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T22:56:46.755 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446", 2024-09-13T22:56:46.755 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-09-13T22:56:46.755 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6" 2024-09-13T22:56:46.756 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-13T22:56:46.756 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-13T22:56:59.006 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)", 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446", 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6" 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-09-13T22:56:59.007 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T22:56:59.026 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-09-13T22:56:59.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-09-13T22:56:59.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-09-13T22:56:59.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-09-13T22:56:59.185 INFO:tasks.cephadm:Writing seed config... 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T22:56:59.187 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T22:56:59.188 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T22:56:59.189 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T22:56:59.190 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T22:56:59.191 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T22:56:59.191 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:56:59.192 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T22:56:59.207 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 62d5ccce-7223-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T22:56:59.207 DEBUG:teuthology.orchestra.run.smithi115:mon.smithi115> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service 2024-09-13T22:56:59.249 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T22:56:59.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.115 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:56:59.448 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:56:59.449 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '62d5ccce-7223-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.115', '--skip-admin-label'] 2024-09-13T22:56:59.473 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:56:59.474 INFO:teuthology.orchestra.run.smithi115.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T22:56:59.474 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying podman|docker is present... 2024-09-13T22:56:59.504 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:56:59.504 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying lvm2 is present... 2024-09-13T22:56:59.505 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying time synchronization is in place... 2024-09-13T22:56:59.513 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:56:59.513 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:56:59.519 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:56:59.519 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:56:59.526 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout enabled 2024-09-13T22:56:59.533 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout active 2024-09-13T22:56:59.533 INFO:teuthology.orchestra.run.smithi115.stdout:Unit chronyd.service is enabled and running 2024-09-13T22:56:59.533 INFO:teuthology.orchestra.run.smithi115.stdout:Repeating the final host check... 2024-09-13T22:56:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:56:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T22:56:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl is present 2024-09-13T22:56:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:lvcreate is present 2024-09-13T22:56:59.561 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:56:59.561 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:56:59.568 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:56:59.568 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:56:59.575 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout enabled 2024-09-13T22:56:59.581 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout active 2024-09-13T22:56:59.581 INFO:teuthology.orchestra.run.smithi115.stdout:Unit chronyd.service is enabled and running 2024-09-13T22:56:59.581 INFO:teuthology.orchestra.run.smithi115.stdout:Host looks OK 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Cluster fsid: 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Acquiring lock 140600292102496 on /run/cephadm/62d5ccce-7223-11ef-bceb-c7b262605968.lock 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Lock 140600292102496 acquired on /run/cephadm/62d5ccce-7223-11ef-bceb-c7b262605968.lock 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying IP 172.21.15.115 port 3300 ... 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying IP 172.21.15.115 port 6789 ... 2024-09-13T22:56:59.582 INFO:teuthology.orchestra.run.smithi115.stdout:Base mon IP(s) is [172.21.15.115:3300, 172.21.15.115:6789], mon addrv is [v2:172.21.15.115:3300,v1:172.21.15.115:6789] 2024-09-13T22:56:59.586 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.115 metric 100 2024-09-13T22:56:59.586 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.115 metric 100 2024-09-13T22:56:59.589 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T22:56:59.589 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T22:56:59.589 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T22:56:59.592 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T22:56:59.592 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link noprefixroute 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:Mon IP `172.21.15.115` is in CIDR network `172.21.0.0/20` 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:Mon IP `172.21.15.115` is in CIDR network `172.21.0.0/20` 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T22:56:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T22:56:59.594 INFO:teuthology.orchestra.run.smithi115.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stdout ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying blob sha256:9b559dbc30e0607f8b5bc9e421c2d3b7f5b89b8ae7a0518eaf6d2b64276fd6bc 2024-09-13T22:57:00.148 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Copying config sha256:ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 2024-09-13T22:57:00.149 INFO:teuthology.orchestra.run.smithi115.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T22:57:01.077 INFO:teuthology.orchestra.run.smithi115.stdout:ceph: stdout ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable) 2024-09-13T22:57:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Ceph version: ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable) 2024-09-13T22:57:01.078 INFO:teuthology.orchestra.run.smithi115.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T22:57:01.983 INFO:teuthology.orchestra.run.smithi115.stdout:stat: stdout 167 167 2024-09-13T22:57:01.983 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial keys... 2024-09-13T22:57:02.912 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQA+w+RmBxXBEhAA1k/vgTj1BRs1+ue/pwBKtg== 2024-09-13T22:57:03.852 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQA/w+RmpcAZDRAAQ4hGCHaj6YZUDesQXC05Mw== 2024-09-13T22:57:04.723 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph-authtool: stdout AQBAw+RmyI1WCBAAJtj3PN7Aeb6oj636L5gQmA== 2024-09-13T22:57:04.724 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial monmap... 2024-09-13T22:57:05.720 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:monmaptool for smithi115 [v2:172.21.15.115:3300,v1:172.21.15.115:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:setting min_mon_release = octopus 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: set fsid to 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:57:05.721 INFO:teuthology.orchestra.run.smithi115.stdout:Creating mon... 2024-09-13T22:57:06.617 INFO:teuthology.orchestra.run.smithi115.stdout:create mon.smithi115 on 2024-09-13T22:57:06.809 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T22:57:06.950 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T22:57:07.100 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target. 2024-09-13T22:57:07.100 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target. 2024-09-13T22:57:07.268 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115 2024-09-13T22:57:07.268 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to reset failed state of unit ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service: Unit ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service not loaded. 2024-09-13T22:57:07.418 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target.wants/ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service → /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968@.service. 2024-09-13T22:57:07.919 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:07 smithi115 podman[27222]: 2024-09-13 22:57:07.880335255 +0000 UTC m=+0.345250265 container start ecdb38c7e0b632a2da4955a4e206bdd9d6de97cb9aa67807050a9d69ab255f6f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T22:57:07.919 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:07 smithi115 ceph-mon[27240]: mkfs 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:07.991 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:57:07.992 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T22:57:07.999 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:57:07.999 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:57:07.999 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T22:57:07.999 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:57:07.999 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mon to start... 2024-09-13T22:57:08.000 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mon... 2024-09-13T22:57:08.229 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:07 smithi115 ceph-mon[27240]: mon.smithi115 is new leader, mons smithi115 in quorum (ranks 0) 2024-09-13T22:57:08.229 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:07 smithi115 bash[27222]: ecdb38c7e0b632a2da4955a4e206bdd9d6de97cb9aa67807050a9d69ab255f6f 2024-09-13T22:57:08.229 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:07 smithi115 systemd[1]: Started Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T22:57:09.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout id: 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout services: 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi115 (age 0.574269s) 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout data: 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T22:57:09.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bed8a640 1 Processor -- start 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bed8a640 1 -- start start 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bed8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bed8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8078f80 con 0x7f96b8078b70 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bcb26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bcb26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41908/0 (socket says 172.21.15.115:41908) 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.420+0000 7f96bcb26640 1 -- 172.21.15.115:0/239507082 learned_addr learned my addr 172.21.15.115:0/239507082 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.421+0000 7f96bcb26640 1 -- 172.21.15.115:0/239507082 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80790c0 con 0x7f96b8078b70 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bcb26640 1 --2- 172.21.15.115:0/239507082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009840 tx=0x7f96ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a7a9883c3a4b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96b77fe640 1 -- 172.21.15.115:0/239507082 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96ac032440 con 0x7f96b8078b70 2024-09-13T22:57:09.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96b77fe640 1 -- 172.21.15.115:0/239507082 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac0325a0 con 0x7f96b8078b70 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96b77fe640 1 -- 172.21.15.115:0/239507082 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96ac032890 con 0x7f96b8078b70 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 -- 172.21.15.115:0/239507082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 msgr2=0x7f96b8077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 --2- 172.21.15.115:0/239507082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009840 tx=0x7f96ac0091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 -- 172.21.15.115:0/239507082 shutdown_connections 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 --2- 172.21.15.115:0/239507082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8077230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 -- 172.21.15.115:0/239507082 >> 172.21.15.115:0/239507082 conn(0x7f96b80fd850 msgr2=0x7f96b80ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.423+0000 7f96bed8a640 1 -- 172.21.15.115:0/239507082 shutdown_connections 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bed8a640 1 -- 172.21.15.115:0/239507082 wait complete. 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bed8a640 1 Processor -- start 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bed8a640 1 -- start start 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bed8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bed8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8112c60 con 0x7f96b8078b70 2024-09-13T22:57:09.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bcb26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bcb26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41922/0 (socket says 172.21.15.115:41922) 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.424+0000 7f96bcb26640 1 -- 172.21.15.115:0/2280959089 learned_addr learned my addr 172.21.15.115:0/2280959089 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96bcb26640 1 -- 172.21.15.115:0/2280959089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009450 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96bcb26640 1 --2- 172.21.15.115:0/2280959089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f96ac02a790 tx=0x7f96ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96ac031be0 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac031d40 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b8112e60 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96ac03b5a0 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b81139f0 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f96ac039040 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.425+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f96ac041070 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.426+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b8113330 con 0x7f96b8078b70 2024-09-13T22:57:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.428+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f96b8113330 con 0x7f96b8078b70 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.485+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f96b804b720 con 0x7f96b8078b70 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.486+0000 7f96b57fa640 1 -- 172.21.15.115:0/2280959089 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f96ac02ae60 con 0x7f96b8078b70 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.486+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 msgr2=0x7f96b8112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.486+0000 7f96bed8a640 1 --2- 172.21.15.115:0/2280959089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f96ac02a790 tx=0x7f96ac032000 comp rx=0 tx=0).stop 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.487+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 shutdown_connections 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.487+0000 7f96bed8a640 1 --2- 172.21.15.115:0/2280959089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96b8078b70 0x7f96b8112720 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.487+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 >> 172.21.15.115:0/2280959089 conn(0x7f96b80fd850 msgr2=0x7f96b81095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.487+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 shutdown_connections 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:08.487+0000 7f96bed8a640 1 -- 172.21.15.115:0/2280959089 wait complete. 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:mon is available 2024-09-13T22:57:09.121 INFO:teuthology.orchestra.run.smithi115.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: mon.smithi115 is new leader, mons smithi115 in quorum (ranks 0) 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: monmap e1: 1 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: fsmap 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: mgrmap e1: no daemons active 2024-09-13T22:57:09.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:08 smithi115 ceph-mon[27240]: from='client.? 172.21.15.115:0/2280959089' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T22:57:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:57:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout fsid = 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T22:57:10.115 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.115:3300,v1:172.21.15.115:6789] 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:57:10.116 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.576+0000 7f4185ee3640 1 Processor -- start 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.576+0000 7f4185ee3640 1 -- start start 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.576+0000 7f4185ee3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.576+0000 7f4185ee3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801029c0 con 0x7f4180102070 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.577+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.577+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41932/0 (socket says 172.21.15.115:41932) 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.577+0000 7f417f7fe640 1 -- 172.21.15.115:0/2198427594 learned_addr learned my addr 172.21.15.115:0/2198427594 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.577+0000 7f417f7fe640 1 -- 172.21.15.115:0/2198427594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180102b00 con 0x7f4180102070 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f417f7fe640 1 --2- 172.21.15.115:0/2198427594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4170009840 tx=0x7f41700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69ae8b98de20136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f417effd640 1 -- 172.21.15.115:0/2198427594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4170032440 con 0x7f4180102070 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f417effd640 1 -- 172.21.15.115:0/2198427594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41700325a0 con 0x7f4180102070 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f417effd640 1 -- 172.21.15.115:0/2198427594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4170032890 con 0x7f4180102070 2024-09-13T22:57:10.117 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 -- 172.21.15.115:0/2198427594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 msgr2=0x7f4180102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 --2- 172.21.15.115:0/2198427594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4170009840 tx=0x7f41700091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 -- 172.21.15.115:0/2198427594 shutdown_connections 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 --2- 172.21.15.115:0/2198427594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180102480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 -- 172.21.15.115:0/2198427594 >> 172.21.15.115:0/2198427594 conn(0x7f41800fd850 msgr2=0x7f41800ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 -- 172.21.15.115:0/2198427594 shutdown_connections 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.578+0000 7f4185ee3640 1 -- 172.21.15.115:0/2198427594 wait complete. 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f4185ee3640 1 Processor -- start 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f4185ee3640 1 -- start start 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f4185ee3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f4185ee3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180110a80 con 0x7f4180102070 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:10.118 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41948/0 (socket says 172.21.15.115:41948) 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f417f7fe640 1 -- 172.21.15.115:0/1950660734 learned_addr learned my addr 172.21.15.115:0/1950660734 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.579+0000 7f417f7fe640 1 -- 172.21.15.115:0/1950660734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009450 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417f7fe640 1 --2- 172.21.15.115:0/1950660734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f417002a790 tx=0x7f4170032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4170031be0 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170031d40 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f417003b5a0 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180110c80 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180111090 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4170039040 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.580+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4170041030 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.581+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004b720 con 0x7f4180102070 2024-09-13T22:57:10.119 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.583+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f417002ae60 con 0x7f4180102070 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.638+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f4180109d00 con 0x7f4180102070 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.641+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4170046cd0 con 0x7f4180102070 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.641+0000 7f417cff9640 1 -- 172.21.15.115:0/1950660734 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+467 (secure 0 0 0) 0x7f4170037070 con 0x7f4180102070 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 msgr2=0x7f4180110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 --2- 172.21.15.115:0/1950660734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f417002a790 tx=0x7f4170032000 comp rx=0 tx=0).stop 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 shutdown_connections 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 --2- 172.21.15.115:0/1950660734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4180102070 0x7f4180110540 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 >> 172.21.15.115:0/1950660734 conn(0x7f41800fd850 msgr2=0x7f4180107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 shutdown_connections 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:09.642+0000 7f4185ee3640 1 -- 172.21.15.115:0/1950660734 wait complete. 2024-09-13T22:57:10.120 INFO:teuthology.orchestra.run.smithi115.stdout:Generating new minimal ceph.conf... 2024-09-13T22:57:10.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:09 smithi115 ceph-mon[27240]: from='client.? 172.21.15.115:0/1950660734' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:57:10.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:09 smithi115 ceph-mon[27240]: from='client.? 172.21.15.115:0/1950660734' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T22:57:11.102 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.512+0000 7f780c528640 1 Processor -- start 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780c528640 1 -- start start 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780c528640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780c528640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78041029c0 con 0x7f7804102070 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780a2c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780a2c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41952/0 (socket says 172.21.15.115:41952) 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780a2c4640 1 -- 172.21.15.115:0/315505139 learned_addr learned my addr 172.21.15.115:0/315505139 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.513+0000 7f780a2c4640 1 -- 172.21.15.115:0/315505139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804102b00 con 0x7f7804102070 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.514+0000 7f780a2c4640 1 --2- 172.21.15.115:0/315505139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7800009840 tx=0x7f78000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c0bf282b89b5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.514+0000 7f78092c2640 1 -- 172.21.15.115:0/315505139 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7800032440 con 0x7f7804102070 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.514+0000 7f78092c2640 1 -- 172.21.15.115:0/315505139 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7800032a00 con 0x7f7804102070 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.514+0000 7f78092c2640 1 -- 172.21.15.115:0/315505139 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7800031a10 con 0x7f7804102070 2024-09-13T22:57:11.103 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- 172.21.15.115:0/315505139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 msgr2=0x7f7804102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 --2- 172.21.15.115:0/315505139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7800009840 tx=0x7f78000091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- 172.21.15.115:0/315505139 shutdown_connections 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 --2- 172.21.15.115:0/315505139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804102480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- 172.21.15.115:0/315505139 >> 172.21.15.115:0/315505139 conn(0x7f78040fd850 msgr2=0x7f78040ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- 172.21.15.115:0/315505139 shutdown_connections 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- 172.21.15.115:0/315505139 wait complete. 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 Processor -- start 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 -- start start 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.515+0000 7f780c528640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780c528640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804079140 con 0x7f7804102070 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780a2c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780a2c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41962/0 (socket says 172.21.15.115:41962) 2024-09-13T22:57:11.104 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780a2c4640 1 -- 172.21.15.115:0/3548138041 learned_addr learned my addr 172.21.15.115:0/3548138041 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780a2c4640 1 -- 172.21.15.115:0/3548138041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009450 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780a2c4640 1 --2- 172.21.15.115:0/3548138041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7800006a70 tx=0x7f780002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7800031d10 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7800031e70 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78040771d0 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f780003b6f0 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7804077640 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7800039070 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.516+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f78000477b0 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.517+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404b720 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.519+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7800037070 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.574+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7804103cf0 con 0x7f7804102070 2024-09-13T22:57:11.105 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.574+0000 7f77faffd640 1 -- 172.21.15.115:0/3548138041 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f780003dad0 con 0x7f7804102070 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 msgr2=0x7f7804078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 --2- 172.21.15.115:0/3548138041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7800006a70 tx=0x7f780002c040 comp rx=0 tx=0).stop 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 shutdown_connections 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 --2- 172.21.15.115:0/3548138041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7804102070 0x7f7804078c00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 >> 172.21.15.115:0/3548138041 conn(0x7f78040fd850 msgr2=0x7f78040fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 shutdown_connections 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:10.575+0000 7f780c528640 1 -- 172.21.15.115:0/3548138041 wait complete. 2024-09-13T22:57:11.106 INFO:teuthology.orchestra.run.smithi115.stdout:Restarting the monitor... 2024-09-13T22:57:11.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:10 smithi115 ceph-mon[27240]: from='client.? 172.21.15.115:0/3548138041' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:11.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:11 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T22:57:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:12 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[27236]: 2024-09-13T22:57:12.218+0000 7f58d521e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:57:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:12 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[27236]: 2024-09-13T22:57:12.218+0000 7f58d521e640 -1 mon.smithi115@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T22:57:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:12 smithi115 podman[27481]: 2024-09-13 22:57:12.383276302 +0000 UTC m=+1.118236435 container died ecdb38c7e0b632a2da4955a4e206bdd9d6de97cb9aa67807050a9d69ab255f6f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T22:57:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:16 smithi115 podman[27481]: 2024-09-13 22:57:16.136909058 +0000 UTC m=+4.871869147 container cleanup ecdb38c7e0b632a2da4955a4e206bdd9d6de97cb9aa67807050a9d69ab255f6f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=quincy-eb16b97) 2024-09-13T22:57:16.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:16 smithi115 bash[27481]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T22:57:18.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:17 smithi115 podman[27493]: 2024-09-13 22:57:17.954449795 +0000 UTC m=+5.564023398 container remove ecdb38c7e0b632a2da4955a4e206bdd9d6de97cb9aa67807050a9d69ab255f6f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T22:57:18.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:18 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service: Deactivated successfully. 2024-09-13T22:57:18.206 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:18 smithi115 systemd[1]: Stopped Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T22:57:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:18 smithi115 systemd[1]: Starting Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T22:57:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:18 smithi115 podman[27582]: 2024-09-13 22:57:18.314624708 +0000 UTC m=+0.016187029 image pull ab51d1bebd1200e205d11a014c20a7f2cf49d932afcbeabdc1c9fc887c00f446 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T22:57:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:19 smithi115 podman[27582]: 2024-09-13 22:57:19.437057774 +0000 UTC m=+1.138620080 container create fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T22:57:21.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 podman[27582]: 2024-09-13 22:57:21.318707124 +0000 UTC m=+3.020269440 container init fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:57:21.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 podman[27582]: 2024-09-13 22:57:21.322693132 +0000 UTC m=+3.024255439 container start fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T22:57:21.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable), process ceph-mon, pid 2 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: pidfile_write: ignore empty --pid-file 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: load: jerasure load: lrc 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: RocksDB version: 6.15.5 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Compile date Sep 13 2024 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: DB SUMMARY 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: DB Session ID: TQHDZX1HYASY333NDK24 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-13T22:57:21.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000010.log size: 98148 ; 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.env: 0x55903e43d440 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.fs: Posix File System 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.info_log: 0x55903edcb0c0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.statistics: (nil) 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.use_fsync: 0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:57:21.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.db_log_dir: 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi115/store.db 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:57:21.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.write_buffer_manager: 0x55903ee88810 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:57:21.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.unordered_write: 0 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.row_cache: None 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.wal_filter: None 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:57:21.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.preserve_deletes: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:57:21.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:57:21.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_open_files: -1 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Compression algorithms supported: 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kZSTD supported: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:57:21.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000009 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.merge_operator: 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_filter: None 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:57:21.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55903ed71a38) 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-09-13T22:57:21.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: hash_index_allow_collision: 1 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 1 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x55903eda71f0 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-09-13T22:57:21.713 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 4 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-09-13T22:57:21.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression: NoCompression 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.num_levels: 7 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:57:21.715 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:57:21.716 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:57:21.717 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.arena_block_size: 4194304 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:57:21.718 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.ttl: 2592000 2024-09-13T22:57:21.719 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268241349397, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-13T22:57:21.720 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268241350461, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93380, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91460, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84042, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726268241, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "041f505d-1090-4421-b160-cfa4b0960af1", "db_session_id": "TQHDZX1HYASY333NDK24"}} 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268241350885, "job": 1, "event": "recovery_finished"} 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55903edda700 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: DB pointer 0x55903edaa000 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:57:21.721 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 23.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 23.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T22:57:21.723 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 2/0 93.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 93.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.0 0.00 0.00 1 0.001 0 0 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:57:21.724 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 22.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: starting mon.smithi115 rank 0 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???) e1 preinit fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).mds e1 new map 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).mds e1 print_map 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e1 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:57:21.725 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: -1 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: No filesystems configured 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mon.smithi115 is new leader, mons smithi115 in quorum (ranks 0) 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: monmap e1: 1 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: fsmap 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:57:21.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:21 smithi115 ceph-mon[27601]: mgrmap e1: no daemons active 2024-09-13T22:57:22.267 INFO:teuthology.orchestra.run.smithi115.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T22:57:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:22 smithi115 bash[27582]: fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc 2024-09-13T22:57:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:22 smithi115 systemd[1]: Started Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T22:57:23.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.859+0000 7f2f2ade5640 1 Processor -- start 2024-09-13T22:57:23.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.859+0000 7f2f2ade5640 1 -- start start 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.859+0000 7f2f2ade5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.859+0000 7f2f2ade5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f240790a0 con 0x7f2f24078c90 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.859+0000 7f2f28b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.860+0000 7f2f28b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57906/0 (socket says 172.21.15.115:57906) 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.860+0000 7f2f28b81640 1 -- 172.21.15.115:0/669532592 learned_addr learned my addr 172.21.15.115:0/669532592 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.860+0000 7f2f28b81640 1 -- 172.21.15.115:0/669532592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24077750 con 0x7f2f24078c90 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.862+0000 7f2f28b81640 1 --2- 172.21.15.115:0/669532592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009840 tx=0x7f2f180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec93da690b84a228 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.862+0000 7f2f237fe640 1 -- 172.21.15.115:0/669532592 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f18032440 con 0x7f2f24078c90 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.862+0000 7f2f237fe640 1 -- 172.21.15.115:0/669532592 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2f18032a00 con 0x7f2f24078c90 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.862+0000 7f2f237fe640 1 -- 172.21.15.115:0/669532592 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f180319e0 con 0x7f2f24078c90 2024-09-13T22:57:23.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 -- 172.21.15.115:0/669532592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 msgr2=0x7f2f24077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 --2- 172.21.15.115:0/669532592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009840 tx=0x7f2f180091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 -- 172.21.15.115:0/669532592 shutdown_connections 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 --2- 172.21.15.115:0/669532592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24077210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 -- 172.21.15.115:0/669532592 >> 172.21.15.115:0/669532592 conn(0x7f2f240fd740 msgr2=0x7f2f240ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 -- 172.21.15.115:0/669532592 shutdown_connections 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.863+0000 7f2f2ade5640 1 -- 172.21.15.115:0/669532592 wait complete. 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f2ade5640 1 Processor -- start 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f2ade5640 1 -- start start 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f2ade5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f2ade5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24113490 con 0x7f2f24078c90 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f28b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f28b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57914/0 (socket says 172.21.15.115:57914) 2024-09-13T22:57:23.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f28b81640 1 -- 172.21.15.115:0/3407148565 learned_addr learned my addr 172.21.15.115:0/3407148565 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.864+0000 7f2f28b81640 1 -- 172.21.15.115:0/3407148565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009450 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f28b81640 1 --2- 172.21.15.115:0/3407148565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098a0 tx=0x7f2f18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f18032880 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f24113690 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2f1803d8b0 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f1803b8e0 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f24113b00 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2f18039070 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.865+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2f18046720 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.866+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2404b720 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.868+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2f180657a0 con 0x7f2f24078c90 2024-09-13T22:57:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.924+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f2f241142e0 con 0x7f2f24078c90 2024-09-13T22:57:23.547 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.926+0000 7f2f217fa640 1 -- 172.21.15.115:0/3407148565 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2f18054030 con 0x7f2f24078c90 2024-09-13T22:57:23.547 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 msgr2=0x7f2f24112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:23.547 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 --2- 172.21.15.115:0/3407148565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2f180098a0 tx=0x7f2f18008040 comp rx=0 tx=0).stop 2024-09-13T22:57:23.547 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 shutdown_connections 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 --2- 172.21.15.115:0/3407148565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f24078c90 0x7f2f24112f50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 >> 172.21.15.115:0/3407148565 conn(0x7f2f240fd740 msgr2=0x7f2f240fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 shutdown_connections 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:22.927+0000 7f2f2ade5640 1 -- 172.21.15.115:0/3407148565 wait complete. 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:57:23.548 INFO:teuthology.orchestra.run.smithi115.stdout:Creating mgr... 2024-09-13T22:57:23.549 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T22:57:23.549 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T22:57:23.549 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T22:57:23.719 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mgr.smithi115.eqesbc 2024-09-13T22:57:23.719 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Failed to reset failed state of unit ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mgr.smithi115.eqesbc.service: Unit ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mgr.smithi115.eqesbc.service not loaded. 2024-09-13T22:57:23.875 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968.target.wants/ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mgr.smithi115.eqesbc.service → /etc/systemd/system/ceph-62d5ccce-7223-11ef-bceb-c7b262605968@.service. 2024-09-13T22:57:24.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:23 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3407148565' entity='client.admin' 2024-09-13T22:57:24.402 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:57:24.403 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T22:57:24.410 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:57:24.410 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:57:24.410 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T22:57:24.410 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:57:24.419 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:57:24.419 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr to start... 2024-09-13T22:57:24.427 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr... 2024-09-13T22:57:25.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:24 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/405783890' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:57:25.391 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsid": "62d5ccce-7223-11ef-bceb-c7b262605968", 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:57:25.392 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "smithi115" 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:25.393 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:57:25.394 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:57:25.402 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:57:25.403 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:57:07.913905+0000", 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff78decc640 1 Processor -- start 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff78decc640 1 -- start start 2024-09-13T22:57:25.404 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff78decc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff78decc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788076ea0 con 0x7ff788076a90 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57952/0 (socket says 172.21.15.115:57952) 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.841+0000 7ff7877fe640 1 -- 172.21.15.115:0/1575442034 learned_addr learned my addr 172.21.15.115:0/1575442034 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.842+0000 7ff7877fe640 1 -- 172.21.15.115:0/1575442034 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7881051a0 con 0x7ff788076a90 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.842+0000 7ff7877fe640 1 --2- 172.21.15.115:0/1575442034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff778009840 tx=0x7ff7780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef851e255aebaf2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.842+0000 7ff7867fc640 1 -- 172.21.15.115:0/1575442034 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff778032440 con 0x7ff788076a90 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.843+0000 7ff7867fc640 1 -- 172.21.15.115:0/1575442034 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff778032a00 con 0x7ff788076a90 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.843+0000 7ff7867fc640 1 -- 172.21.15.115:0/1575442034 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff778031a10 con 0x7ff788076a90 2024-09-13T22:57:25.405 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.843+0000 7ff78decc640 1 -- 172.21.15.115:0/1575442034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 msgr2=0x7ff788104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.843+0000 7ff78decc640 1 --2- 172.21.15.115:0/1575442034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff778009840 tx=0x7ff7780091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.844+0000 7ff78decc640 1 -- 172.21.15.115:0/1575442034 shutdown_connections 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.844+0000 7ff78decc640 1 --2- 172.21.15.115:0/1575442034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788104c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.844+0000 7ff78decc640 1 -- 172.21.15.115:0/1575442034 >> 172.21.15.115:0/1575442034 conn(0x7ff7880fc6d0 msgr2=0x7ff7880feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.844+0000 7ff78decc640 1 -- 172.21.15.115:0/1575442034 shutdown_connections 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.844+0000 7ff78decc640 1 -- 172.21.15.115:0/1575442034 wait complete. 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff78decc640 1 Processor -- start 2024-09-13T22:57:25.406 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff78decc640 1 -- start start 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff78decc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff78decc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff788111230 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff7877fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57966/0 (socket says 172.21.15.115:57966) 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff7877fe640 1 -- 172.21.15.115:0/405783890 learned_addr learned my addr 172.21.15.115:0/405783890 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.845+0000 7ff7877fe640 1 -- 172.21.15.115:0/405783890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778009450 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff7877fe640 1 --2- 172.21.15.115:0/405783890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff7780098a0 tx=0x7ff77802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7780327b0 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff77803b870 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff788111430 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff77803a530 con 0x7ff788076a90 2024-09-13T22:57:25.407 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff788111fc0 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff778039040 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.846+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff7780447a0 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.847+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7881002f0 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.849+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff778049060 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.907+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff788105ec0 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.907+0000 7ff76ffff640 1 -- 172.21.15.115:0/405783890 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7ff77803f070 con 0x7ff788076a90 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 msgr2=0x7ff788110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 --2- 172.21.15.115:0/405783890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff7780098a0 tx=0x7ff77802c040 comp rx=0 tx=0).stop 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 shutdown_connections 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 --2- 172.21.15.115:0/405783890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff788076a90 0x7ff788110cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 >> 172.21.15.115:0/405783890 conn(0x7ff7880fc6d0 msgr2=0x7ff7880fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 shutdown_connections 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:24.908+0000 7ff78decc640 1 -- 172.21.15.115:0/405783890 wait complete. 2024-09-13T22:57:25.408 INFO:teuthology.orchestra.run.smithi115.stdout:mgr not available, waiting (1/15)... 2024-09-13T22:57:29.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: Activating manager daemon smithi115.eqesbc 2024-09-13T22:57:29.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: mgrmap e2: smithi115.eqesbc(active, starting, since 0.00280903s) 2024-09-13T22:57:29.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:57:29.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:57:29.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: Manager daemon smithi115.eqesbc is now available 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:29.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:28 smithi115 ceph-mon[27601]: from='mgr.14100 172.21.15.115:0/253947234' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:29.923 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:29 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1978938514' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:57:29.923 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:29 smithi115 ceph-mon[27601]: mgrmap e3: smithi115.eqesbc(active, since 1.00683s) 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsid": "62d5ccce-7223-11ef-bceb-c7b262605968", 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:57:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "smithi115" 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:57:30.146 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.147 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:57:30.147 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:30.147 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:57:30.147 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:57:30.147 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:57:30.154 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:57:30.155 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:57:30.156 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:57:07.913905+0000", 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.706+0000 7fb1e73f6640 1 Processor -- start 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.706+0000 7fb1e73f6640 1 -- start start 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e73f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e73f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0078fe0 con 0x7fb1e0078b40 2024-09-13T22:57:30.157 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e5192640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e5192640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38516/0 (socket says 172.21.15.115:38516) 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e5192640 1 -- 172.21.15.115:0/205011271 learned_addr learned my addr 172.21.15.115:0/205011271 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.707+0000 7fb1e5192640 1 -- 172.21.15.115:0/205011271 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0079120 con 0x7fb1e0078b40 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e5192640 1 --2- 172.21.15.115:0/205011271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009840 tx=0x7fb1d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67aacb7e5db9217 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1dffff640 1 -- 172.21.15.115:0/205011271 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1d8032440 con 0x7fb1e0078b40 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1dffff640 1 -- 172.21.15.115:0/205011271 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb1d8032a00 con 0x7fb1e0078b40 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1dffff640 1 -- 172.21.15.115:0/205011271 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1d80319e0 con 0x7fb1e0078b40 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 -- 172.21.15.115:0/205011271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 msgr2=0x7fb1e0077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 --2- 172.21.15.115:0/205011271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009840 tx=0x7fb1d80091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:30.158 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 -- 172.21.15.115:0/205011271 shutdown_connections 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 --2- 172.21.15.115:0/205011271 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0077250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 -- 172.21.15.115:0/205011271 >> 172.21.15.115:0/205011271 conn(0x7fb1e00fd880 msgr2=0x7fb1e00ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 -- 172.21.15.115:0/205011271 shutdown_connections 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.708+0000 7fb1e73f6640 1 -- 172.21.15.115:0/205011271 wait complete. 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e73f6640 1 Processor -- start 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e73f6640 1 -- start start 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e73f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e73f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0113520 con 0x7fb1e0078b40 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e5192640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e5192640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38532/0 (socket says 172.21.15.115:38532) 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.709+0000 7fb1e5192640 1 -- 172.21.15.115:0/1978938514 learned_addr learned my addr 172.21.15.115:0/1978938514 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1e5192640 1 -- 172.21.15.115:0/1978938514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009450 con 0x7fb1e0078b40 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1e5192640 1 --2- 172.21.15.115:0/1978938514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006f00 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:30.159 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1d8032880 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb1d803b8d0 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e0113720 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1d803a8f0 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.710+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e0113b90 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.711+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 2) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fb1d803ba40 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.711+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e004b720 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.711+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb1d806c3c0 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.713+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb1d803be40 con 0x7fb1e0078b40 2024-09-13T22:57:30.160 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.771+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb1e0108170 con 0x7fb1e0078b40 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1ddffb640 1 -- 172.21.15.115:0/1978938514 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb1d8037030 con 0x7fb1e0078b40 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 msgr2=0x7fb1e0112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 --2- 172.21.15.115:0/1978938514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8006f00 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 shutdown_connections 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 --2- 172.21.15.115:0/1978938514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1e0078b40 0x7fb1e0112fe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 >> 172.21.15.115:0/1978938514 conn(0x7fb1e00fd880 msgr2=0x7fb1e00fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 shutdown_connections 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:28.772+0000 7fb1e73f6640 1 -- 172.21.15.115:0/1978938514 wait complete. 2024-09-13T22:57:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:mgr not available, waiting (2/15)... 2024-09-13T22:57:32.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:31 smithi115 ceph-mon[27601]: mgrmap e4: smithi115.eqesbc(active, since 2s) 2024-09-13T22:57:33.293 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:32 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3192237265' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsid": "62d5ccce-7223-11ef-bceb-c7b262605968", 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:57:33.366 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "smithi115" 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:33.367 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:57:33.368 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:57:33.376 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:57:33.377 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:57:07.913905+0000", 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:57:33.378 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.560+0000 7f2de02fe640 1 Processor -- start 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.560+0000 7f2de02fe640 1 -- start start 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2de02fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2de02fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8076f20 con 0x7f2dd8076b10 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2dde09a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2dde09a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38536/0 (socket says 172.21.15.115:38536) 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2dde09a640 1 -- 172.21.15.115:0/3920931016 learned_addr learned my addr 172.21.15.115:0/3920931016 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.561+0000 7f2dde09a640 1 -- 172.21.15.115:0/3920931016 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8105120 con 0x7f2dd8076b10 2024-09-13T22:57:33.379 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.562+0000 7f2dde09a640 1 --2- 172.21.15.115:0/3920931016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009840 tx=0x7f2dc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2ffbd731c09209 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.562+0000 7f2ddd098640 1 -- 172.21.15.115:0/3920931016 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc8032440 con 0x7f2dd8076b10 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.562+0000 7f2ddd098640 1 -- 172.21.15.115:0/3920931016 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2dc8032a00 con 0x7f2dd8076b10 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.562+0000 7f2ddd098640 1 -- 172.21.15.115:0/3920931016 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc8031a10 con 0x7f2dd8076b10 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- 172.21.15.115:0/3920931016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 msgr2=0x7f2dd8104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3920931016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009840 tx=0x7f2dc80091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- 172.21.15.115:0/3920931016 shutdown_connections 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3920931016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8104be0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- 172.21.15.115:0/3920931016 >> 172.21.15.115:0/3920931016 conn(0x7f2dd80fc6d0 msgr2=0x7f2dd80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- 172.21.15.115:0/3920931016 shutdown_connections 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- 172.21.15.115:0/3920931016 wait complete. 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 Processor -- start 2024-09-13T22:57:33.380 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- start start 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.563+0000 7f2de02fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8111330 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dde09a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dde09a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38538/0 (socket says 172.21.15.115:38538) 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dde09a640 1 -- 172.21.15.115:0/3192237265 learned_addr learned my addr 172.21.15.115:0/3192237265 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dde09a640 1 -- 172.21.15.115:0/3192237265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc8009450 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dde09a640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc80327b0 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd8111530 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2dc803b870 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc803a550 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.564+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd8111f80 con 0x7f2dd8076b10 2024-09-13T22:57:33.381 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.565+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2dc8039040 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.565+0000 7f2dceffd640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 0x7f2dc403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.565+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2dc806c840 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.565+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd81002f0 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.565+0000 7f2ddd899640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 0x7f2dc403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.566+0000 7f2ddd899640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 0x7f2dc403b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4006fd0 tx=0x7f2dd4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.570+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2dc803f080 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.785+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2dd804b720 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.785+0000 7f2dceffd640 1 -- 172.21.15.115:0/3192237265 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2dc8068070 con 0x7f2dd8076b10 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 msgr2=0x7f2dc403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 0x7f2dc403b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4006fd0 tx=0x7f2dd4006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 msgr2=0x7f2dd8110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098a0 tx=0x7f2dc802c040 comp rx=0 tx=0).stop 2024-09-13T22:57:33.382 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 shutdown_connections 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f2dc4039450 0x7f2dc403b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 --2- 172.21.15.115:0/3192237265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2dd8076b10 0x7f2dd8110df0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 >> 172.21.15.115:0/3192237265 conn(0x7f2dd80fc6d0 msgr2=0x7f2dd80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 shutdown_connections 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:32.787+0000 7f2de02fe640 1 -- 172.21.15.115:0/3192237265 wait complete. 2024-09-13T22:57:33.383 INFO:teuthology.orchestra.run.smithi115.stdout:mgr is available 2024-09-13T22:57:34.293 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:33 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3745832894' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:57:34.435 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:34.435 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:57:34.435 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout fsid = 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:34.435 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T22:57:34.436 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.728+0000 7ffbe9b86640 1 Processor -- start 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.728+0000 7ffbe9b86640 1 -- start start 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.728+0000 7ffbe9b86640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.728+0000 7ffbe9b86640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4070e30 con 0x7ffbe41035c0 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.729+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.729+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38540/0 (socket says 172.21.15.115:38540) 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.729+0000 7ffbe37fe640 1 -- 172.21.15.115:0/1034207869 learned_addr learned my addr 172.21.15.115:0/1034207869 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.729+0000 7ffbe37fe640 1 -- 172.21.15.115:0/1034207869 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4103f10 con 0x7ffbe41035c0 2024-09-13T22:57:34.437 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe37fe640 1 --2- 172.21.15.115:0/1034207869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009840 tx=0x7ffbd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689587933f9b1d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe2ffd640 1 -- 172.21.15.115:0/1034207869 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd4032440 con 0x7ffbe41035c0 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe2ffd640 1 -- 172.21.15.115:0/1034207869 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffbd4032a00 con 0x7ffbe41035c0 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe2ffd640 1 -- 172.21.15.115:0/1034207869 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd40319e0 con 0x7ffbe41035c0 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe9b86640 1 -- 172.21.15.115:0/1034207869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 msgr2=0x7ffbe41039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.730+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/1034207869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009840 tx=0x7ffbd40091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- 172.21.15.115:0/1034207869 shutdown_connections 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/1034207869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe41039d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- 172.21.15.115:0/1034207869 >> 172.21.15.115:0/1034207869 conn(0x7ffbe40fbdc0 msgr2=0x7ffbe40fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- 172.21.15.115:0/1034207869 shutdown_connections 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- 172.21.15.115:0/1034207869 wait complete. 2024-09-13T22:57:34.438 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 Processor -- start 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- start start 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe9b86640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4111340 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38542/0 (socket says 172.21.15.115:38542) 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.731+0000 7ffbe37fe640 1 -- 172.21.15.115:0/3745832894 learned_addr learned my addr 172.21.15.115:0/3745832894 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe37fe640 1 -- 172.21.15.115:0/3745832894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009450 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe37fe640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40098a0 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd4032880 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffbd403d8b0 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd403b910 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe4111540 con 0x7ffbe41035c0 2024-09-13T22:57:34.439 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.732+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe4111f90 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.733+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7ffbd4039070 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.733+0000 7ffbe0ff9640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 0x7ffbd003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.733+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffbd406ce90 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.733+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe40ffa60 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.733+0000 7ffbdbfff640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 0x7ffbd003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.734+0000 7ffbdbfff640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 0x7ffbd003b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc006fd0 tx=0x7ffbcc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.738+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffbd4041020 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.894+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ffbe404b720 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.895+0000 7ffbe0ff9640 1 -- 172.21.15.115:0/3745832894 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7ffbd4037070 con 0x7ffbe41035c0 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 msgr2=0x7ffbd003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 0x7ffbd003b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc006fd0 tx=0x7ffbcc006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:34.440 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 msgr2=0x7ffbe4110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40098a0 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 shutdown_connections 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7ffbd0039490 0x7ffbd003b940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 --2- 172.21.15.115:0/3745832894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffbe41035c0 0x7ffbe4110e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 >> 172.21.15.115:0/3745832894 conn(0x7ffbe40fbdc0 msgr2=0x7ffbe40fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 shutdown_connections 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:33.897+0000 7ffbe9b86640 1 -- 172.21.15.115:0/3745832894 wait complete. 2024-09-13T22:57:34.441 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling cephadm module... 2024-09-13T22:57:35.465 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:35 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/972771931' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T22:57:35.747 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.853+0000 7fa624766640 1 Processor -- start 2024-09-13T22:57:35.747 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.853+0000 7fa624766640 1 -- start start 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa624766640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa624766640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c076f20 con 0x7fa61c076b10 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa622502640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa622502640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38552/0 (socket says 172.21.15.115:38552) 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa622502640 1 -- 172.21.15.115:0/2902333382 learned_addr learned my addr 172.21.15.115:0/2902333382 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.854+0000 7fa622502640 1 -- 172.21.15.115:0/2902333382 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c105130 con 0x7fa61c076b10 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa622502640 1 --2- 172.21.15.115:0/2902333382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa618009840 tx=0x7fa6180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5a9058800ed70b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa621500640 1 -- 172.21.15.115:0/2902333382 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa618032440 con 0x7fa61c076b10 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa621500640 1 -- 172.21.15.115:0/2902333382 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa618032a00 con 0x7fa61c076b10 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa621500640 1 -- 172.21.15.115:0/2902333382 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa618031a10 con 0x7fa61c076b10 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa624766640 1 -- 172.21.15.115:0/2902333382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 msgr2=0x7fa61c104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.855+0000 7fa624766640 1 --2- 172.21.15.115:0/2902333382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa618009840 tx=0x7fa6180091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- 172.21.15.115:0/2902333382 shutdown_connections 2024-09-13T22:57:35.749 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 --2- 172.21.15.115:0/2902333382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c104bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:35.749 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- 172.21.15.115:0/2902333382 >> 172.21.15.115:0/2902333382 conn(0x7fa61c0fc700 msgr2=0x7fa61c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:35.749 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- 172.21.15.115:0/2902333382 shutdown_connections 2024-09-13T22:57:35.749 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- 172.21.15.115:0/2902333382 wait complete. 2024-09-13T22:57:35.749 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 Processor -- start 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- start start 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa624766640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c1113f0 con 0x7fa61c076b10 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa622502640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa622502640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38554/0 (socket says 172.21.15.115:38554) 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.856+0000 7fa622502640 1 -- 172.21.15.115:0/972771931 learned_addr learned my addr 172.21.15.115:0/972771931 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa622502640 1 -- 172.21.15.115:0/972771931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009450 con 0x7fa61c076b10 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa622502640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa6180098a0 tx=0x7fa61802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6180325a0 con 0x7fa61c076b10 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa618032700 con 0x7fa61c076b10 2024-09-13T22:57:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61803a550 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c1115f0 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.857+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c111ff0 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.858+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fa618039040 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.858+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c100300 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.858+0000 7fa612ffd640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 0x7fa60803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.858+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa61806c9a0 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.858+0000 7fa621d01640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 0x7fa60803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.859+0000 7fa621d01640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 0x7fa60803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006fd0 tx=0x7fa60c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:34.863+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa61803a8c0 con 0x7fa61c076b10 2024-09-13T22:57:35.751 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.058+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa61c04b720 con 0x7fa61c076b10 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.110+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa618034080 con 0x7fa61c076b10 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.112+0000 7fa612ffd640 1 -- 172.21.15.115:0/972771931 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa618030340 con 0x7fa61c076b10 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 msgr2=0x7fa60803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 0x7fa60803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006fd0 tx=0x7fa60c006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 msgr2=0x7fa61c110eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa6180098a0 tx=0x7fa61802c040 comp rx=0 tx=0).stop 2024-09-13T22:57:35.752 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 shutdown_connections 2024-09-13T22:57:35.753 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7fa608039490 0x7fa60803b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:35.753 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 --2- 172.21.15.115:0/972771931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa61c076b10 0x7fa61c110eb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:35.753 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 >> 172.21.15.115:0/972771931 conn(0x7fa61c0fc700 msgr2=0x7fa61c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:35.753 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 shutdown_connections 2024-09-13T22:57:35.753 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:35.114+0000 7fa624766640 1 -- 172.21.15.115:0/972771931 wait complete. 2024-09-13T22:57:36.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:36 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/972771931' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T22:57:36.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:36 smithi115 ceph-mon[27601]: mgrmap e5: smithi115.eqesbc(active, since 6s) 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "active_name": "smithi115.eqesbc", 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:57:36.914 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f0395a8a640 1 Processor -- start 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f0395a8a640 1 -- start start 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f0395a8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f0395a8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03901028d0 con 0x7f0390101f80 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38732/0 (socket says 172.21.15.115:38732) 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.141+0000 7f038f7fe640 1 -- 172.21.15.115:0/2593598757 learned_addr learned my addr 172.21.15.115:0/2593598757 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.142+0000 7f038f7fe640 1 -- 172.21.15.115:0/2593598757 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390102a10 con 0x7f0390101f80 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.142+0000 7f038f7fe640 1 --2- 172.21.15.115:0/2593598757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0380009840 tx=0x7f03800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5ff13bec2e2029 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.142+0000 7f038e7fc640 1 -- 172.21.15.115:0/2593598757 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0380032440 con 0x7f0390101f80 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f038e7fc640 1 -- 172.21.15.115:0/2593598757 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0380032a00 con 0x7f0390101f80 2024-09-13T22:57:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f038e7fc640 1 -- 172.21.15.115:0/2593598757 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03800319e0 con 0x7f0390101f80 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 -- 172.21.15.115:0/2593598757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 msgr2=0x7f0390102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 --2- 172.21.15.115:0/2593598757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0380009840 tx=0x7f03800091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 -- 172.21.15.115:0/2593598757 shutdown_connections 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 --2- 172.21.15.115:0/2593598757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390102390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 -- 172.21.15.115:0/2593598757 >> 172.21.15.115:0/2593598757 conn(0x7f03900fd7a0 msgr2=0x7f03900ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 -- 172.21.15.115:0/2593598757 shutdown_connections 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.143+0000 7f0395a8a640 1 -- 172.21.15.115:0/2593598757 wait complete. 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f0395a8a640 1 Processor -- start 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f0395a8a640 1 -- start start 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f0395a8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f0395a8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390111370 con 0x7f0390101f80 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:36.916 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38740/0 (socket says 172.21.15.115:38740) 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.144+0000 7f038f7fe640 1 -- 172.21.15.115:0/200881761 learned_addr learned my addr 172.21.15.115:0/200881761 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f038f7fe640 1 -- 172.21.15.115:0/200881761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009450 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f038f7fe640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f03800098a0 tx=0x7f0380008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0380032880 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0390111570 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f038003d8b0 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038003b8a0 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.145+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0390111fc0 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0380039070 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f0387fff640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 0x7f037c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03901013e0 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f038006de40 con 0x7f0390101f80 2024-09-13T22:57:36.917 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f038effd640 1 -- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 msgr2=0x7f037c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.146+0000 7f038effd640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 0x7f037c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.150+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0380041070 con 0x7f0390101f80 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.347+0000 7f038effd640 1 -- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 msgr2=0x7f037c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.347+0000 7f038effd640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 0x7f037c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.353+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0390112380 con 0x7f0390101f80 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.353+0000 7f0387fff640 1 -- 172.21.15.115:0/200881761 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f0380037030 con 0x7f0390101f80 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 msgr2=0x7f037c03b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 0x7f037c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 msgr2=0x7f0390110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f03800098a0 tx=0x7f0380008040 comp rx=0 tx=0).stop 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 shutdown_connections 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f037c039490 0x7f037c03b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 --2- 172.21.15.115:0/200881761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0390101f80 0x7f0390110e30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:36.918 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 >> 172.21.15.115:0/200881761 conn(0x7f03900fd7a0 msgr2=0x7f03900fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:36.919 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 shutdown_connections 2024-09-13T22:57:36.919 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:36.356+0000 7f0395a8a640 1 -- 172.21.15.115:0/200881761 wait complete. 2024-09-13T22:57:36.919 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for the mgr to restart... 2024-09-13T22:57:36.919 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr epoch 5... 2024-09-13T22:57:37.282 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:37 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/200881761' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:57:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: Active manager daemon smithi115.eqesbc restarted 2024-09-13T22:57:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: Activating manager daemon smithi115.eqesbc 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: mgrmap e6: smithi115.eqesbc(active, starting, since 0.00356279s) 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: Manager daemon smithi115.eqesbc is now available 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:39.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:57:39.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:39 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T22:57:40.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:40 smithi115 ceph-mon[27601]: Found migration_current of "None". Setting to last migration. 2024-09-13T22:57:40.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:40 smithi115 ceph-mon[27601]: mgrmap e7: smithi115.eqesbc(active, since 1.00514s) 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.281+0000 7f617d4d9640 1 Processor -- start 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.281+0000 7f617d4d9640 1 -- start start 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.281+0000 7f617d4d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:41.078 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.281+0000 7f617d4d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178076ec0 con 0x7f6178076ab0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.282+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.282+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38754/0 (socket says 172.21.15.115:38754) 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.282+0000 7f6176ffd640 1 -- 172.21.15.115:0/591720871 learned_addr learned my addr 172.21.15.115:0/591720871 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.282+0000 7f6176ffd640 1 -- 172.21.15.115:0/591720871 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178105230 con 0x7f6178076ab0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f6176ffd640 1 --2- 172.21.15.115:0/591720871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6168009840 tx=0x7f61680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc723fbe2fbb139 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f6175ffb640 1 -- 172.21.15.115:0/591720871 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6168032440 con 0x7f6178076ab0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f6175ffb640 1 -- 172.21.15.115:0/591720871 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6168032a00 con 0x7f6178076ab0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f6175ffb640 1 -- 172.21.15.115:0/591720871 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61680319e0 con 0x7f6178076ab0 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f617d4d9640 1 -- 172.21.15.115:0/591720871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 msgr2=0x7f6178104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.283+0000 7f617d4d9640 1 --2- 172.21.15.115:0/591720871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6168009840 tx=0x7f61680091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- 172.21.15.115:0/591720871 shutdown_connections 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 --2- 172.21.15.115:0/591720871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178104cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.079 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- 172.21.15.115:0/591720871 >> 172.21.15.115:0/591720871 conn(0x7f61780fc6e0 msgr2=0x7f61780feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- 172.21.15.115:0/591720871 shutdown_connections 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- 172.21.15.115:0/591720871 wait complete. 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 Processor -- start 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- start start 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.284+0000 7f617d4d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178111350 con 0x7f6178076ab0 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f6176ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38760/0 (socket says 172.21.15.115:38760) 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f6176ffd640 1 -- 172.21.15.115:0/1772591998 learned_addr learned my addr 172.21.15.115:0/1772591998 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f6176ffd640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168009450 con 0x7f6178076ab0 2024-09-13T22:57:41.080 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f6176ffd640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61680098a0 tx=0x7f6168008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6168032880 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f616803d8b0 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6178111550 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f616803b8e0 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.285+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6178111fa0 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.286+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6168039070 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.286+0000 7f615f7fe640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.286+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f616003c0a0 con 0x7f61600394e0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.286+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f616806ced0 con 0x7f6178076ab0 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.286+0000 7f61767fc640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 msgr2=0x7f616003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.287+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.488+0000 7f61767fc640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 msgr2=0x7f616003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:41.081 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.488+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.889+0000 7f61767fc640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 msgr2=0x7f616003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:37.889+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:38.690+0000 7f61767fc640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 msgr2=0x7f616003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2340686319 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:38.690+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:39.505+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7f616806c3d0 con 0x7f6178076ab0 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:39.505+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 msgr2=0x7f616003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:39.505+0000 7f615f7fe640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.506+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f6168049570 con 0x7f6178076ab0 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.506+0000 7f615f7fe640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 0x7f616003f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.506+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f616003c0a0 con 0x7f616003cdf0 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.506+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 0x7f616003f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.507+0000 7f61767fc640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 0x7f616003f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f616c003940 tx=0x7f616c009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:41.082 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.507+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f616003c0a0 con 0x7f616003cdf0 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.512+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6178100380 con 0x7f616003cdf0 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.512+0000 7f615f7fe640 1 -- 172.21.15.115:0/1772591998 <== mgr.14118 v2:172.21.15.115:6800/2055434874 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6178100380 con 0x7f616003cdf0 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 msgr2=0x7f616003f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 0x7f616003f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f616c003940 tx=0x7f616c009350 comp rx=0 tx=0).stop 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 msgr2=0x7f6178110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61680098a0 tx=0x7f6168008040 comp rx=0 tx=0).stop 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 shutdown_connections 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f616003cdf0 0x7f616003f1d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:6800/2340686319,v1:172.21.15.115:6801/2340686319] conn(0x7f61600394e0 0x7f616003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 --2- 172.21.15.115:0/1772591998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6178076ab0 0x7f6178110e10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 >> 172.21.15.115:0/1772591998 conn(0x7f61780fc6e0 msgr2=0x7f61780fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 shutdown_connections 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:40.513+0000 7f617d4d9640 1 -- 172.21.15.115:0/1772591998 wait complete. 2024-09-13T22:57:41.083 INFO:teuthology.orchestra.run.smithi115.stdout:mgr epoch 5 is available 2024-09-13T22:57:41.084 INFO:teuthology.orchestra.run.smithi115.stdout:Setting orchestrator backend to cephadm... 2024-09-13T22:57:41.673 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:41 smithi115 ceph-mon[27601]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:57:41.673 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:41 smithi115 ceph-mon[27601]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:57:41.673 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:41 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:41.673 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:41 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.495+0000 7f806be06640 1 Processor -- start 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.495+0000 7f806be06640 1 -- start start 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f806be06640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f806be06640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064101830 con 0x7f8064100ee0 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f8069ba2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f8069ba2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38832/0 (socket says 172.21.15.115:38832) 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f8069ba2640 1 -- 172.21.15.115:0/3778497718 learned_addr learned my addr 172.21.15.115:0/3778497718 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.496+0000 7f8069ba2640 1 -- 172.21.15.115:0/3778497718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064101970 con 0x7f8064100ee0 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f8069ba2640 1 --2- 172.21.15.115:0/3778497718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8060009840 tx=0x7f80600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbc2aa66e3837ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:42.199 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f8068ba0640 1 -- 172.21.15.115:0/3778497718 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8060032440 con 0x7f8064100ee0 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f8068ba0640 1 -- 172.21.15.115:0/3778497718 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8060032a00 con 0x7f8064100ee0 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f8068ba0640 1 -- 172.21.15.115:0/3778497718 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80600319e0 con 0x7f8064100ee0 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f806be06640 1 -- 172.21.15.115:0/3778497718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 msgr2=0x7f80641012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f806be06640 1 --2- 172.21.15.115:0/3778497718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8060009840 tx=0x7f80600091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f806be06640 1 -- 172.21.15.115:0/3778497718 shutdown_connections 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f806be06640 1 --2- 172.21.15.115:0/3778497718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f80641012f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.497+0000 7f806be06640 1 -- 172.21.15.115:0/3778497718 >> 172.21.15.115:0/3778497718 conn(0x7f80640fc620 msgr2=0x7f80640fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 -- 172.21.15.115:0/3778497718 shutdown_connections 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 -- 172.21.15.115:0/3778497718 wait complete. 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 Processor -- start 2024-09-13T22:57:42.200 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 -- start start 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f806be06640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064113a90 con 0x7f8064100ee0 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f8069ba2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f8069ba2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38836/0 (socket says 172.21.15.115:38836) 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f8069ba2640 1 -- 172.21.15.115:0/191031279 learned_addr learned my addr 172.21.15.115:0/191031279 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.498+0000 7f8069ba2640 1 -- 172.21.15.115:0/191031279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009450 con 0x7f8064100ee0 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f8069ba2640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80600098a0 tx=0x7f8060008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8060032880 con 0x7f8064100ee0 2024-09-13T22:57:42.201 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f806003d8b0 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8064113bd0 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806003b910 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.499+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8064113fe0 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f8060039070 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806404b720 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f805a7fc640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 0x7f805003b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f806006d160 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f80693a1640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 0x7f805003b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.500+0000 7f80693a1640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 0x7f805003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.505+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8060039320 con 0x7f8064100ee0 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.672+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f80640fd890 con 0x7f8050039380 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.679+0000 7f805a7fc640 1 -- 172.21.15.115:0/191031279 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f80640fd890 con 0x7f8050039380 2024-09-13T22:57:42.202 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 msgr2=0x7f805003b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 0x7f805003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 msgr2=0x7f8064076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80600098a0 tx=0x7f8060008040 comp rx=0 tx=0).stop 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 shutdown_connections 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8050039380 0x7f805003b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 --2- 172.21.15.115:0/191031279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8064100ee0 0x7f8064076ae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 >> 172.21.15.115:0/191031279 conn(0x7f80640fc620 msgr2=0x7f80640fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 shutdown_connections 2024-09-13T22:57:42.203 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:41.681+0000 7f806be06640 1 -- 172.21.15.115:0/191031279 wait complete. 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: [13/Sep/2024:22:57:41] ENGINE Bus STARTING 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: [13/Sep/2024:22:57:41] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: [13/Sep/2024:22:57:41] ENGINE Bus STARTED 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: [13/Sep/2024:22:57:41] ENGINE Error in HTTPServer.serve 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T22:57:43.030 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T22:57:43.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:43.032 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:42 smithi115 ceph-mon[27601]: mgrmap e8: smithi115.eqesbc(active, since 2s) 2024-09-13T22:57:43.345 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.586+0000 7f4de64f5640 1 Processor -- start 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.586+0000 7f4de64f5640 1 -- start start 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4de64f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4de64f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de01017e0 con 0x7f4de0100e90 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38852/0 (socket says 172.21.15.115:38852) 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4ddffff640 1 -- 172.21.15.115:0/1282061450 learned_addr learned my addr 172.21.15.115:0/1282061450 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.587+0000 7f4ddffff640 1 -- 172.21.15.115:0/1282061450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0101920 con 0x7f4de0100e90 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4ddffff640 1 --2- 172.21.15.115:0/1282061450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009840 tx=0x7f4dd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a0a67977cbe69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4ddeffd640 1 -- 172.21.15.115:0/1282061450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd0032440 con 0x7f4de0100e90 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4ddeffd640 1 -- 172.21.15.115:0/1282061450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4dd0032a00 con 0x7f4de0100e90 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4ddeffd640 1 -- 172.21.15.115:0/1282061450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd0031a10 con 0x7f4de0100e90 2024-09-13T22:57:43.346 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4de64f5640 1 -- 172.21.15.115:0/1282061450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 msgr2=0x7f4de01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.588+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1282061450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009840 tx=0x7f4dd00091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- 172.21.15.115:0/1282061450 shutdown_connections 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1282061450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de01012a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- 172.21.15.115:0/1282061450 >> 172.21.15.115:0/1282061450 conn(0x7f4de00fc6d0 msgr2=0x7f4de00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- 172.21.15.115:0/1282061450 shutdown_connections 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- 172.21.15.115:0/1282061450 wait complete. 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 Processor -- start 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- start start 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.589+0000 7f4de64f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0113a80 con 0x7f4de0100e90 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38864/0 (socket says 172.21.15.115:38864) 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddffff640 1 -- 172.21.15.115:0/1528673843 learned_addr learned my addr 172.21.15.115:0/1528673843 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:43.347 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddffff640 1 -- 172.21.15.115:0/1528673843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009450 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddffff640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0006a70 tx=0x7f4dd002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd0031d10 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4dd0031e70 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4dd003b6f0 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0113bc0 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.590+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de0113fd0 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.591+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4dd0039070 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.591+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de004b720 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.591+0000 7f4ddcff9640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 0x7f4dcc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.591+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4dd006cf90 con 0x7f4de0100e90 2024-09-13T22:57:43.348 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.591+0000 7f4ddf7fe640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 0x7f4dcc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.592+0000 7f4ddf7fe640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 0x7f4dcc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8006fd0 tx=0x7f4dc8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.596+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4dd009f2a0 con 0x7f4de0100e90 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.753+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f4de00fda90 con 0x7f4dcc0394e0 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.754+0000 7f4ddcff9640 1 -- 172.21.15.115:0/1528673843 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f4de00fda90 con 0x7f4dcc0394e0 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 msgr2=0x7f4dcc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 0x7f4dcc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8006fd0 tx=0x7f4dc8006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 msgr2=0x7f4de0076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0006a70 tx=0x7f4dd002c040 comp rx=0 tx=0).stop 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 shutdown_connections 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f4dcc0394e0 0x7f4dcc03b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 --2- 172.21.15.115:0/1528673843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4de0100e90 0x7f4de0076ae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 >> 172.21.15.115:0/1528673843 conn(0x7f4de00fc6d0 msgr2=0x7f4de00fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 shutdown_connections 2024-09-13T22:57:43.349 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:42.756+0000 7f4de64f5640 1 -- 172.21.15.115:0/1528673843 wait complete. 2024-09-13T22:57:43.350 INFO:teuthology.orchestra.run.smithi115.stdout:Generating ssh key... 2024-09-13T22:57:43.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:43 smithi115 ceph-mon[27601]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:44.569 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f35471ee640 1 Processor -- start 2024-09-13T22:57:44.569 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f35471ee640 1 -- start start 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f35471ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f35471ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3540102d80 con 0x7f3540102430 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f3544f8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f3544f8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38868/0 (socket says 172.21.15.115:38868) 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.754+0000 7f3544f8a640 1 -- 172.21.15.115:0/411668041 learned_addr learned my addr 172.21.15.115:0/411668041 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.755+0000 7f3544f8a640 1 -- 172.21.15.115:0/411668041 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540102ec0 con 0x7f3540102430 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.755+0000 7f3544f8a640 1 --2- 172.21.15.115:0/411668041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f353c00baf0 tx=0x7f353c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5e82a78e303bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.755+0000 7f35377fe640 1 -- 172.21.15.115:0/411668041 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f353c0327a0 con 0x7f3540102430 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.755+0000 7f35377fe640 1 -- 172.21.15.115:0/411668041 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f353c032d60 con 0x7f3540102430 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.755+0000 7f35377fe640 1 -- 172.21.15.115:0/411668041 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f353c031df0 con 0x7f3540102430 2024-09-13T22:57:44.570 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 -- 172.21.15.115:0/411668041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 msgr2=0x7f3540102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 --2- 172.21.15.115:0/411668041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f353c00baf0 tx=0x7f353c00b460 comp rx=0 tx=0).stop 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 -- 172.21.15.115:0/411668041 shutdown_connections 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 --2- 172.21.15.115:0/411668041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f3540102840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 -- 172.21.15.115:0/411668041 >> 172.21.15.115:0/411668041 conn(0x7f35400fbdd0 msgr2=0x7f35400fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 -- 172.21.15.115:0/411668041 shutdown_connections 2024-09-13T22:57:44.571 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.756+0000 7f35471ee640 1 -- 172.21.15.115:0/411668041 wait complete. 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f35471ee640 1 Processor -- start 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f35471ee640 1 -- start start 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f35471ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f35471ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354010f090 con 0x7f3540102430 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f3544f8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f3544f8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38880/0 (socket says 172.21.15.115:38880) 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.757+0000 7f3544f8a640 1 -- 172.21.15.115:0/2531300488 learned_addr learned my addr 172.21.15.115:0/2531300488 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f3544f8a640 1 -- 172.21.15.115:0/2531300488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c00b700 con 0x7f3540102430 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f3544f8a640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f353c031ad0 tx=0x7f353c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f353c032b80 con 0x7f3540102430 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f353c03b880 con 0x7f3540102430 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f353c0447d0 con 0x7f3540102430 2024-09-13T22:57:44.572 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354010f290 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.758+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354010f700 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.759+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f353c04e440 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.759+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354004b720 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.759+0000 7f35357fa640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 0x7f352803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.759+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f353c06f330 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.759+0000 7f3537fff640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 0x7f352803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.760+0000 7f3537fff640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 0x7f352803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3530006fd0 tx=0x7f3530006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.763+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f353c039790 con 0x7f3540102430 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.920+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f354010f700 con 0x7f35280394e0 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.975+0000 7f35357fa640 1 -- 172.21.15.115:0/2531300488 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f354010f700 con 0x7f35280394e0 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.977+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 msgr2=0x7f352803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:44.573 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.977+0000 7f35471ee640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 0x7f352803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3530006fd0 tx=0x7f3530006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.977+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 msgr2=0x7f354010eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.977+0000 7f35471ee640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f353c031ad0 tx=0x7f353c00b460 comp rx=0 tx=0).stop 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.977+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 shutdown_connections 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.978+0000 7f35471ee640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f35280394e0 0x7f352803b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.978+0000 7f35471ee640 1 --2- 172.21.15.115:0/2531300488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3540102430 0x7f354010eb50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.978+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 >> 172.21.15.115:0/2531300488 conn(0x7f35400fbdd0 msgr2=0x7f35401053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.978+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 shutdown_connections 2024-09-13T22:57:44.574 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:43.978+0000 7f35471ee640 1 -- 172.21.15.115:0/2531300488 wait complete. 2024-09-13T22:57:45.112 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:44 smithi115 ceph-mon[27601]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:45.113 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:44 smithi115 ceph-mon[27601]: Generating ssh key... 2024-09-13T22:57:45.113 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:44 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:45.113 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:44 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYX1e84TzQI8uJzF4q5YONuvikmSRZPWXlftNzkqgkTEPXVB6lCNSBp5b+D1dHLxPdtvlnrVVAoN9KlTUHU5m5TXVXP94DFQ1vrQ7nUIH+K8Iyo//1PHPsDO9SS9OzSBp2ExGus8UvB6CsW5qQovX05sRV/whtK+8xHVqB/d0AoQsiBD8xxP+KrZjiYsRzVbmKWF7onYrL9FtRMJa6mRP9pQn02X32A1jBmYHir2cqtw3EGcKp1UkA6YYWUmo4Vh7nXUVPiceP1PAanprTu2K7w37IwUTwEAlMNEaYVzENn3cxaPGCAGRmTbj/C7xZjHN5eWZ6Uxf+fklAqPavIlBTKEN6RO+8YrW7okdmzwgR+QCoqQqujWAkdBOTZOWrdGbKifN5yg9TDnSY1mPzfUMbJAoa8WzMj97e7IUf5+tMQu64OZuSXGcZa01f344G9cg3z5lQ35uAM+617dl/wD9h3o3hg1z3GoanmJZ23CZqB/WbrwQVL+yBewf4dvzhnhE= ceph-62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcddda9640 1 Processor -- start 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcddda9640 1 -- start start 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcddda9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcddda9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8100ce0 con 0x7fdcd8100390 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcd77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.633 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcd77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38892/0 (socket says 172.21.15.115:38892) 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcd77fe640 1 -- 172.21.15.115:0/367689453 learned_addr learned my addr 172.21.15.115:0/367689453 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.931+0000 7fdcd77fe640 1 -- 172.21.15.115:0/367689453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8100e20 con 0x7fdcd8100390 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.932+0000 7fdcd77fe640 1 --2- 172.21.15.115:0/367689453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4327617b10456a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.932+0000 7fdcd67fc640 1 -- 172.21.15.115:0/367689453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcc8032440 con 0x7fdcd8100390 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.932+0000 7fdcd67fc640 1 -- 172.21.15.115:0/367689453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdcc8032a00 con 0x7fdcd8100390 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.932+0000 7fdcd67fc640 1 -- 172.21.15.115:0/367689453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcc80319e0 con 0x7fdcd8100390 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- 172.21.15.115:0/367689453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 msgr2=0x7fdcd81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 --2- 172.21.15.115:0/367689453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009840 tx=0x7fdcc80091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- 172.21.15.115:0/367689453 shutdown_connections 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 --2- 172.21.15.115:0/367689453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd81007a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- 172.21.15.115:0/367689453 >> 172.21.15.115:0/367689453 conn(0x7fdcd80fbdd0 msgr2=0x7fdcd80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.634 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- 172.21.15.115:0/367689453 shutdown_connections 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- 172.21.15.115:0/367689453 wait complete. 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 Processor -- start 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.933+0000 7fdcddda9640 1 -- start start 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcddda9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcddda9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8111310 con 0x7fdcd8100390 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcd77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcd77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38904/0 (socket says 172.21.15.115:38904) 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcd77fe640 1 -- 172.21.15.115:0/2293831640 learned_addr learned my addr 172.21.15.115:0/2293831640 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcd77fe640 1 -- 172.21.15.115:0/2293831640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8009450 con 0x7fdcd8100390 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcd77fe640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000c00 tx=0x7fdcc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcc803d450 con 0x7fdcd8100390 2024-09-13T22:57:45.635 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd8111510 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdcc803da10 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcc803b8e0 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.934+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd8111f60 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.935+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fdcc8039070 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.935+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd80ffa70 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.935+0000 7fdcbffff640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 0x7fdcc003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.935+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdcc806d5e0 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.935+0000 7fdcd6ffd640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 0x7fdcc003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.936+0000 7fdcd6ffd640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 0x7fdcc003b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ad90 tx=0x7fdccc009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:44.940+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdcc804e350 con 0x7fdcd8100390 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.100+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd80fd160 con 0x7fdcc0039490 2024-09-13T22:57:45.636 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.100+0000 7fdcbffff640 1 -- 172.21.15.115:0/2293831640 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fdcd80fd160 con 0x7fdcc0039490 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 msgr2=0x7fdcc003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 0x7fdcc003b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ad90 tx=0x7fdccc009410 comp rx=0 tx=0).stop 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 msgr2=0x7fdcd8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000c00 tx=0x7fdcc8008040 comp rx=0 tx=0).stop 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 shutdown_connections 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fdcc0039490 0x7fdcc003b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 --2- 172.21.15.115:0/2293831640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcd8100390 0x7fdcd8110dd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 >> 172.21.15.115:0/2293831640 conn(0x7fdcd80fbdd0 msgr2=0x7fdcd80fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 shutdown_connections 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:45.102+0000 7fdcddda9640 1 -- 172.21.15.115:0/2293831640 wait complete. 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:57:45.637 INFO:teuthology.orchestra.run.smithi115.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T22:57:45.638 INFO:teuthology.orchestra.run.smithi115.stdout:Adding host smithi115... 2024-09-13T22:57:46.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:45 smithi115 ceph-mon[27601]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:47.234 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:47 smithi115 ceph-mon[27601]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "addr": "172.21.15.115", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:47.235 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:47 smithi115 ceph-mon[27601]: Deploying cephadm binary to smithi115 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Added host 'smithi115' with addr '172.21.15.115' 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.037+0000 7f77dc794640 1 Processor -- start 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.037+0000 7f77dc794640 1 -- start start 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77dc794640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77dc794640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41028e0 con 0x7f77d4101f90 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77da530640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77da530640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52736/0 (socket says 172.21.15.115:52736) 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77da530640 1 -- 172.21.15.115:0/3886075086 learned_addr learned my addr 172.21.15.115:0/3886075086 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.038+0000 7f77da530640 1 -- 172.21.15.115:0/3886075086 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4102a20 con 0x7f77d4101f90 2024-09-13T22:57:49.473 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.039+0000 7f77da530640 1 --2- 172.21.15.115:0/3886075086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009e50 tx=0x7f77c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f28ab5151a7553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.039+0000 7f77d952e640 1 -- 172.21.15.115:0/3886075086 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c4031560 con 0x7f77d4101f90 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.039+0000 7f77d952e640 1 -- 172.21.15.115:0/3886075086 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f77c402d050 con 0x7f77d4101f90 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.039+0000 7f77d952e640 1 -- 172.21.15.115:0/3886075086 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c40079b0 con 0x7f77d4101f90 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- 172.21.15.115:0/3886075086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 msgr2=0x7f77d41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 --2- 172.21.15.115:0/3886075086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009e50 tx=0x7f77c4009840 comp rx=0 tx=0).stop 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- 172.21.15.115:0/3886075086 shutdown_connections 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 --2- 172.21.15.115:0/3886075086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d41023a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- 172.21.15.115:0/3886075086 >> 172.21.15.115:0/3886075086 conn(0x7f77d40fd730 msgr2=0x7f77d40ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- 172.21.15.115:0/3886075086 shutdown_connections 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- 172.21.15.115:0/3886075086 wait complete. 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 Processor -- start 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- start start 2024-09-13T22:57:49.474 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.040+0000 7f77dc794640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4111310 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77da530640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77da530640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52738/0 (socket says 172.21.15.115:52738) 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77da530640 1 -- 172.21.15.115:0/2880712529 learned_addr learned my addr 172.21.15.115:0/2880712529 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77da530640 1 -- 172.21.15.115:0/2880712529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009ae0 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77da530640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77c4007030 tx=0x7f77c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c4045430 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f77c40459f0 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4111510 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c403a7f0 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.041+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d4111f60 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.042+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f77c4038040 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.042+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d41013f0 con 0x7f77d4101f90 2024-09-13T22:57:49.475 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.042+0000 7f77d2ffd640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 0x7f77bc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.042+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f77c4040030 con 0x7f77d4101f90 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.042+0000 7f77d9d2f640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 0x7f77bc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.043+0000 7f77d9d2f640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 0x7f77bc03b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77c8006fd0 tx=0x7f77c8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.047+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f77c4038aa0 con 0x7f77d4101f90 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:46.206+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "addr": "172.21.15.115", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d40fe990 con 0x7f77bc0394e0 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.884+0000 7f77d2ffd640 1 -- 172.21.15.115:0/2880712529 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f77d40fe990 con 0x7f77bc0394e0 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 msgr2=0x7f77bc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 0x7f77bc03b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77c8006fd0 tx=0x7f77c8006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 msgr2=0x7f77d4110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77c4007030 tx=0x7f77c4009840 comp rx=0 tx=0).stop 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 shutdown_connections 2024-09-13T22:57:49.476 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f77bc0394e0 0x7f77bc03b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 --2- 172.21.15.115:0/2880712529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77d4101f90 0x7f77d4110dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 >> 172.21.15.115:0/2880712529 conn(0x7f77d40fd730 msgr2=0x7f77d40fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 shutdown_connections 2024-09-13T22:57:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:48.887+0000 7f77dc794640 1 -- 172.21.15.115:0/2880712529 wait complete. 2024-09-13T22:57:49.477 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying mon service with default placement... 2024-09-13T22:57:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:49 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:49 smithi115 ceph-mon[27601]: Added host smithi115 2024-09-13T22:57:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:49 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:51.057 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.911+0000 7f1180b18640 1 Processor -- start 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.911+0000 7f1180b18640 1 -- start start 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f1180b18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f1180b18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c1028e0 con 0x7f117c101f90 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f117a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f117a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52748/0 (socket says 172.21.15.115:52748) 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f117a59c640 1 -- 172.21.15.115:0/1750747314 learned_addr learned my addr 172.21.15.115:0/1750747314 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.912+0000 7f117a59c640 1 -- 172.21.15.115:0/1750747314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c102a20 con 0x7f117c101f90 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.913+0000 7f117a59c640 1 --2- 172.21.15.115:0/1750747314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1174009e50 tx=0x7f1174009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7ed57579fc572 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:51.058 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.913+0000 7f117959a640 1 -- 172.21.15.115:0/1750747314 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1174031560 con 0x7f117c101f90 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.913+0000 7f117959a640 1 -- 172.21.15.115:0/1750747314 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f117402d050 con 0x7f117c101f90 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.913+0000 7f117959a640 1 -- 172.21.15.115:0/1750747314 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11740079b0 con 0x7f117c101f90 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- 172.21.15.115:0/1750747314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 msgr2=0x7f117c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 --2- 172.21.15.115:0/1750747314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1174009e50 tx=0x7f1174009840 comp rx=0 tx=0).stop 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- 172.21.15.115:0/1750747314 shutdown_connections 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 --2- 172.21.15.115:0/1750747314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c1023a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- 172.21.15.115:0/1750747314 >> 172.21.15.115:0/1750747314 conn(0x7f117c0fd710 msgr2=0x7f117c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- 172.21.15.115:0/1750747314 shutdown_connections 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- 172.21.15.115:0/1750747314 wait complete. 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 Processor -- start 2024-09-13T22:57:51.059 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- start start 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.914+0000 7f1180b18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c111220 con 0x7f117c101f90 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f117a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f117a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52754/0 (socket says 172.21.15.115:52754) 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f117a59c640 1 -- 172.21.15.115:0/918724108 learned_addr learned my addr 172.21.15.115:0/918724108 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f117a59c640 1 -- 172.21.15.115:0/918724108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174009ae0 con 0x7f117c101f90 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f117a59c640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1174007030 tx=0x7f1174009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1174045430 con 0x7f117c101f90 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f11740459f0 con 0x7f117c101f90 2024-09-13T22:57:51.060 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f117403a7f0 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c111420 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.915+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c111890 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.916+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1174038040 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.916+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c04b720 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.916+0000 7f1172ffd640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 0x7f116803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.916+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1174040030 con 0x7f117c101f90 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.916+0000 7f1179d9b640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 0x7f116803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:51.061 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.917+0000 7f1179d9b640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 0x7f116803b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1164006fd0 tx=0x7f1164006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:49.921+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1174043990 con 0x7f117c101f90 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.100+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f117c111890 con 0x7f1168039490 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.107+0000 7f1172ffd640 1 -- 172.21.15.115:0/918724108 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f117c111890 con 0x7f1168039490 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 msgr2=0x7f116803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 0x7f116803b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1164006fd0 tx=0x7f1164006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 msgr2=0x7f117c110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1174007030 tx=0x7f1174009840 comp rx=0 tx=0).stop 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 shutdown_connections 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f1168039490 0x7f116803b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 --2- 172.21.15.115:0/918724108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f117c101f90 0x7f117c110ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:51.062 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 >> 172.21.15.115:0/918724108 conn(0x7f117c0fd710 msgr2=0x7f117c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 shutdown_connections 2024-09-13T22:57:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:50.109+0000 7f1180b18640 1 -- 172.21.15.115:0/918724108 wait complete. 2024-09-13T22:57:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying mgr service with default placement... 2024-09-13T22:57:51.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:51 smithi115 ceph-mon[27601]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:51.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:51 smithi115 ceph-mon[27601]: Saving service mon spec with placement count:5 2024-09-13T22:57:51.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:51 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:52.247 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T22:57:52.247 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9dbdda7640 1 Processor -- start 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9dbdda7640 1 -- start start 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9dbdda7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9dbdda7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db81028e0 con 0x7f9db8101f90 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52756/0 (socket says 172.21.15.115:52756) 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.485+0000 7f9db77fe640 1 -- 172.21.15.115:0/3541457993 learned_addr learned my addr 172.21.15.115:0/3541457993 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.486+0000 7f9db77fe640 1 -- 172.21.15.115:0/3541457993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8102a20 con 0x7f9db8101f90 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.486+0000 7f9db77fe640 1 --2- 172.21.15.115:0/3541457993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009840 tx=0x7f9da80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa58a90abc25511c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.486+0000 7f9db67fc640 1 -- 172.21.15.115:0/3541457993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9da8032440 con 0x7f9db8101f90 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.486+0000 7f9db67fc640 1 -- 172.21.15.115:0/3541457993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9da8032a00 con 0x7f9db8101f90 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.486+0000 7f9db67fc640 1 -- 172.21.15.115:0/3541457993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9da80319e0 con 0x7f9db8101f90 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3541457993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 msgr2=0x7f9db81023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:52.248 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3541457993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009840 tx=0x7f9da80091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3541457993 shutdown_connections 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3541457993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db81023a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3541457993 >> 172.21.15.115:0/3541457993 conn(0x7f9db80fd710 msgr2=0x7f9db80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3541457993 shutdown_connections 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.487+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3541457993 wait complete. 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9dbdda7640 1 Processor -- start 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9dbdda7640 1 -- start start 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9dbdda7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9dbdda7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8111220 con 0x7f9db8101f90 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9db77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52772/0 (socket says 172.21.15.115:52772) 2024-09-13T22:57:52.249 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9db77fe640 1 -- 172.21.15.115:0/3462784449 learned_addr learned my addr 172.21.15.115:0/3462784449 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9db77fe640 1 -- 172.21.15.115:0/3462784449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009450 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.488+0000 7f9db77fe640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9da803d450 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9da803da10 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db8111420 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9da803b8e0 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db8111890 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.489+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9da8039070 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.490+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db804b720 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.490+0000 7f9daffff640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 0x7f9da403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.490+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9da806d200 con 0x7f9db8101f90 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.490+0000 7f9db6ffd640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 0x7f9da403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:52.250 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.490+0000 7f9db6ffd640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 0x7f9da403b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9da0006fd0 tx=0x7f9da0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.494+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9da804ed70 con 0x7f9db8101f90 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.668+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f9db8111890 con 0x7f9da40394e0 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.672+0000 7f9daffff640 1 -- 172.21.15.115:0/3462784449 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9db8111890 con 0x7f9da40394e0 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.674+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 msgr2=0x7f9da403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.674+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 0x7f9da403b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9da0006fd0 tx=0x7f9da0006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.674+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 msgr2=0x7f9db8110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.674+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9da8000c00 tx=0x7f9da8008040 comp rx=0 tx=0).stop 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 shutdown_connections 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f9da40394e0 0x7f9da403b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 --2- 172.21.15.115:0/3462784449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9db8101f90 0x7f9db8110ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:52.251 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 >> 172.21.15.115:0/3462784449 conn(0x7f9db80fd710 msgr2=0x7f9db80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 shutdown_connections 2024-09-13T22:57:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:51.675+0000 7f9dbdda7640 1 -- 172.21.15.115:0/3462784449 wait complete. 2024-09-13T22:57:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying crash service with default placement... 2024-09-13T22:57:52.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:52 smithi115 ceph-mon[27601]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:52.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:52 smithi115 ceph-mon[27601]: Saving service mgr spec with placement count:2 2024-09-13T22:57:52.736 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:52 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:53.643 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T22:57:53.648 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.651+0000 7f4364e40640 1 Processor -- start 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f4364e40640 1 -- start start 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f4364e40640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f4364e40640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43601028e0 con 0x7f4360101f90 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f435e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f435e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52774/0 (socket says 172.21.15.115:52774) 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f435e59c640 1 -- 172.21.15.115:0/2621097120 learned_addr learned my addr 172.21.15.115:0/2621097120 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.652+0000 7f435e59c640 1 -- 172.21.15.115:0/2621097120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360102a20 con 0x7f4360101f90 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.653+0000 7f435e59c640 1 --2- 172.21.15.115:0/2621097120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4350009840 tx=0x7f43500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5653c7e5d3b5163 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.653+0000 7f435dd9b640 1 -- 172.21.15.115:0/2621097120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4350032440 con 0x7f4360101f90 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.653+0000 7f435dd9b640 1 -- 172.21.15.115:0/2621097120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4350032a00 con 0x7f4360101f90 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.653+0000 7f435dd9b640 1 -- 172.21.15.115:0/2621097120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43500319e0 con 0x7f4360101f90 2024-09-13T22:57:53.649 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- 172.21.15.115:0/2621097120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 msgr2=0x7f43601023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 --2- 172.21.15.115:0/2621097120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4350009840 tx=0x7f43500091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- 172.21.15.115:0/2621097120 shutdown_connections 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 --2- 172.21.15.115:0/2621097120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f43601023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- 172.21.15.115:0/2621097120 >> 172.21.15.115:0/2621097120 conn(0x7f43600fd730 msgr2=0x7f43600ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- 172.21.15.115:0/2621097120 shutdown_connections 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- 172.21.15.115:0/2621097120 wait complete. 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 Processor -- start 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.654+0000 7f4364e40640 1 -- start start 2024-09-13T22:57:53.650 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4364e40640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4364e40640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360111310 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f435e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f435e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52786/0 (socket says 172.21.15.115:52786) 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f435e59c640 1 -- 172.21.15.115:0/657173917 learned_addr learned my addr 172.21.15.115:0/657173917 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f435e59c640 1 -- 172.21.15.115:0/657173917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009450 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f435e59c640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4350000c00 tx=0x7f4350008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f435003d450 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f435003da10 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360111510 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f435003b8e0 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.655+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4360111f60 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.656+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4350039070 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.656+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43601013f0 con 0x7f4360101f90 2024-09-13T22:57:53.651 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.656+0000 7f4356ffd640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 0x7f434c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.657+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f435006d3a0 con 0x7f4360101f90 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.657+0000 7f4357fff640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 0x7f434c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.657+0000 7f4357fff640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 0x7f434c03b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4348006fd0 tx=0x7f4348006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.661+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f435004e770 con 0x7f4360101f90 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.831+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f43600fe9e0 con 0x7f434c0394e0 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.836+0000 7f4356ffd640 1 -- 172.21.15.115:0/657173917 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f43600fe9e0 con 0x7f434c0394e0 2024-09-13T22:57:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 msgr2=0x7f434c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 0x7f434c03b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4348006fd0 tx=0x7f4348006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 msgr2=0x7f4360110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4350000c00 tx=0x7f4350008040 comp rx=0 tx=0).stop 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 shutdown_connections 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f434c0394e0 0x7f434c03b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 --2- 172.21.15.115:0/657173917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4360101f90 0x7f4360110dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 >> 172.21.15.115:0/657173917 conn(0x7f43600fd730 msgr2=0x7f43600fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 shutdown_connections 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:52.838+0000 7f4364e40640 1 -- 172.21.15.115:0/657173917 wait complete. 2024-09-13T22:57:53.653 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying prometheus service with default placement... 2024-09-13T22:57:53.918 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:53 smithi115 ceph-mon[27601]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:53.918 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:53 smithi115 ceph-mon[27601]: Saving service crash spec with placement * 2024-09-13T22:57:53.918 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:53 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:55.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T22:57:55.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d7a16f640 1 Processor -- start 2024-09-13T22:57:55.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d7a16f640 1 -- start start 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d7a16f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d7a16f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d741017e0 con 0x7f6d74100e90 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52802/0 (socket says 172.21.15.115:52802) 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d737fe640 1 -- 172.21.15.115:0/1515947565 learned_addr learned my addr 172.21.15.115:0/1515947565 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.059+0000 7f6d737fe640 1 -- 172.21.15.115:0/1515947565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74101920 con 0x7f6d74100e90 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.060+0000 7f6d737fe640 1 --2- 172.21.15.115:0/1515947565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009e50 tx=0x7f6d64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711479bf2a39aa72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.060+0000 7f6d727fc640 1 -- 172.21.15.115:0/1515947565 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d64031560 con 0x7f6d74100e90 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.060+0000 7f6d727fc640 1 -- 172.21.15.115:0/1515947565 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6d6402d050 con 0x7f6d74100e90 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.060+0000 7f6d727fc640 1 -- 172.21.15.115:0/1515947565 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d640079b0 con 0x7f6d74100e90 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 -- 172.21.15.115:0/1515947565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 msgr2=0x7f6d741012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/1515947565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009e50 tx=0x7f6d64009840 comp rx=0 tx=0).stop 2024-09-13T22:57:55.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 -- 172.21.15.115:0/1515947565 shutdown_connections 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/1515947565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d741012a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 -- 172.21.15.115:0/1515947565 >> 172.21.15.115:0/1515947565 conn(0x7f6d740fc6d0 msgr2=0x7f6d740feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 -- 172.21.15.115:0/1515947565 shutdown_connections 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 -- 172.21.15.115:0/1515947565 wait complete. 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.061+0000 7f6d7a16f640 1 Processor -- start 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d7a16f640 1 -- start start 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d7a16f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d7a16f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74113a80 con 0x7f6d74100e90 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52816/0 (socket says 172.21.15.115:52816) 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d737fe640 1 -- 172.21.15.115:0/4232566864 learned_addr learned my addr 172.21.15.115:0/4232566864 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d737fe640 1 -- 172.21.15.115:0/4232566864 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64009ae0 con 0x7f6d74100e90 2024-09-13T22:57:55.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d737fe640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d64007690 tx=0x7f6d64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d64031b70 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.062+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6d64031cd0 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.063+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d74113bc0 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.063+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d640445a0 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.063+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d74113fd0 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.063+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6d64038040 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.063+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7404b720 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.064+0000 7f6d6bfff640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 0x7f6d6003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.064+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6d64040030 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.064+0000 7f6d72ffd640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 0x7f6d6003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.064+0000 7f6d72ffd640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 0x7f6d6003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006fd0 tx=0x7f6d5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.068+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6d64042ad0 con 0x7f6d74100e90 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.235+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d740fda90 con 0x7f6d60039490 2024-09-13T22:57:55.027 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.239+0000 7f6d6bfff640 1 -- 172.21.15.115:0/4232566864 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f6d740fda90 con 0x7f6d60039490 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 msgr2=0x7f6d6003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 0x7f6d6003b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006fd0 tx=0x7f6d5c006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 msgr2=0x7f6d74076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d64007690 tx=0x7f6d64009840 comp rx=0 tx=0).stop 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 shutdown_connections 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f6d60039490 0x7f6d6003b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 --2- 172.21.15.115:0/4232566864 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d74100e90 0x7f6d74076ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 >> 172.21.15.115:0/4232566864 conn(0x7f6d740fc6d0 msgr2=0x7f6d740fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 shutdown_connections 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:54.241+0000 7f6d7a16f640 1 -- 172.21.15.115:0/4232566864 wait complete. 2024-09-13T22:57:55.028 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying grafana service with default placement... 2024-09-13T22:57:55.271 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:55 smithi115 ceph-mon[27601]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:55.271 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:55 smithi115 ceph-mon[27601]: Saving service prometheus spec with placement count:1 2024-09-13T22:57:55.271 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:55 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:55.271 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:55 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:55.271 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:55 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:56.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:56 smithi115 ceph-mon[27601]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:56.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:56 smithi115 ceph-mon[27601]: Saving service grafana spec with placement count:1 2024-09-13T22:57:56.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:56 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:56.700 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.460+0000 7fce5a99e640 1 Processor -- start 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.460+0000 7fce5a99e640 1 -- start start 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce5a99e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce5a99e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54101cf0 con 0x7fce541013a0 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce53fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce53fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52820/0 (socket says 172.21.15.115:52820) 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce53fff640 1 -- 172.21.15.115:0/4257683399 learned_addr learned my addr 172.21.15.115:0/4257683399 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.461+0000 7fce53fff640 1 -- 172.21.15.115:0/4257683399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54101e30 con 0x7fce541013a0 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.462+0000 7fce53fff640 1 --2- 172.21.15.115:0/4257683399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce44009840 tx=0x7fce440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a241d4349927e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.462+0000 7fce52ffd640 1 -- 172.21.15.115:0/4257683399 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce44032440 con 0x7fce541013a0 2024-09-13T22:57:56.701 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.462+0000 7fce52ffd640 1 -- 172.21.15.115:0/4257683399 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce44032a40 con 0x7fce541013a0 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.462+0000 7fce52ffd640 1 -- 172.21.15.115:0/4257683399 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce44031a70 con 0x7fce541013a0 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- 172.21.15.115:0/4257683399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 msgr2=0x7fce541017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 --2- 172.21.15.115:0/4257683399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce44009840 tx=0x7fce440091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- 172.21.15.115:0/4257683399 shutdown_connections 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 --2- 172.21.15.115:0/4257683399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce541017b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- 172.21.15.115:0/4257683399 >> 172.21.15.115:0/4257683399 conn(0x7fce540fbd30 msgr2=0x7fce540fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- 172.21.15.115:0/4257683399 shutdown_connections 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- 172.21.15.115:0/4257683399 wait complete. 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 Processor -- start 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.463+0000 7fce5a99e640 1 -- start start 2024-09-13T22:57:56.702 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce5a99e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce5a99e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54110170 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce53fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce53fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52830/0 (socket says 172.21.15.115:52830) 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce53fff640 1 -- 172.21.15.115:0/2612632808 learned_addr learned my addr 172.21.15.115:0/2612632808 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce53fff640 1 -- 172.21.15.115:0/2612632808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44009450 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce53fff640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce44009810 tx=0x7fce440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce4403c400 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce4403ca00 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce54110370 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce4403a870 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.464+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce541107e0 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.465+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fce4403cb70 con 0x7fce541013a0 2024-09-13T22:57:56.703 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.465+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5404b720 con 0x7fce541013a0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.465+0000 7fce50ff9640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 0x7fce3c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.465+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fce4406cdc0 con 0x7fce541013a0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.465+0000 7fce537fe640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 0x7fce3c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.466+0000 7fce537fe640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 0x7fce3c03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.470+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fce4403b360 con 0x7fce541013a0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.656+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fce541107e0 con 0x7fce3c0394e0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.662+0000 7fce50ff9640 1 -- 172.21.15.115:0/2612632808 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fce541107e0 con 0x7fce3c0394e0 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.664+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 msgr2=0x7fce3c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.664+0000 7fce5a99e640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 0x7fce3c03b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fce48006fd0 tx=0x7fce48006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.664+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 msgr2=0x7fce5410fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.664+0000 7fce5a99e640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fce44009810 tx=0x7fce440091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.704 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 shutdown_connections 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7fce3c0394e0 0x7fce3c03b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 --2- 172.21.15.115:0/2612632808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce541013a0 0x7fce5410fc30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 >> 172.21.15.115:0/2612632808 conn(0x7fce540fbd30 msgr2=0x7fce540fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 shutdown_connections 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:55.665+0000 7fce5a99e640 1 -- 172.21.15.115:0/2612632808 wait complete. 2024-09-13T22:57:56.705 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying node-exporter service with default placement... 2024-09-13T22:57:57.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T22:57:57.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.084+0000 7f8deeae6640 1 Processor -- start 2024-09-13T22:57:57.866 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8deeae6640 1 -- start start 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8deeae6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8deeae6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81028e0 con 0x7f8de8101f90 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8dec882640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8dec882640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56204/0 (socket says 172.21.15.115:56204) 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8dec882640 1 -- 172.21.15.115:0/161788387 learned_addr learned my addr 172.21.15.115:0/161788387 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.085+0000 7f8dec882640 1 -- 172.21.15.115:0/161788387 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8102a20 con 0x7f8de8101f90 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.086+0000 7f8dec882640 1 --2- 172.21.15.115:0/161788387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd07f3e8b61f8b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.086+0000 7f8de77fe640 1 -- 172.21.15.115:0/161788387 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc032440 con 0x7f8de8101f90 2024-09-13T22:57:57.867 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.086+0000 7f8de77fe640 1 -- 172.21.15.115:0/161788387 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ddc032a40 con 0x7f8de8101f90 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.086+0000 7f8de77fe640 1 -- 172.21.15.115:0/161788387 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc031a70 con 0x7f8de8101f90 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- 172.21.15.115:0/161788387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 msgr2=0x7f8de81023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 --2- 172.21.15.115:0/161788387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc0091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- 172.21.15.115:0/161788387 shutdown_connections 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 --2- 172.21.15.115:0/161788387 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de81023a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- 172.21.15.115:0/161788387 >> 172.21.15.115:0/161788387 conn(0x7f8de80fd710 msgr2=0x7f8de80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- 172.21.15.115:0/161788387 shutdown_connections 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- 172.21.15.115:0/161788387 wait complete. 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 Processor -- start 2024-09-13T22:57:57.868 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.087+0000 7f8deeae6640 1 -- start start 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8deeae6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8deeae6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de8111260 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8dec882640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8dec882640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56210/0 (socket says 172.21.15.115:56210) 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8dec882640 1 -- 172.21.15.115:0/1568729297 learned_addr learned my addr 172.21.15.115:0/1568729297 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8dec882640 1 -- 172.21.15.115:0/1568729297 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009450 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8dec882640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009810 tx=0x7f8ddc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc03c400 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ddc03ca00 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de8111460 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ddc03a870 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.088+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de81118d0 con 0x7f8de8101f90 2024-09-13T22:57:57.869 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.089+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8ddc03aae0 con 0x7f8de8101f90 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.089+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de804b720 con 0x7f8de8101f90 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.089+0000 7f8de57fa640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 0x7f8dd803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.090+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8ddc06cee0 con 0x7f8de8101f90 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.090+0000 7f8de7fff640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 0x7f8dd803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.090+0000 7f8de7fff640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 0x7f8dd803b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006fd0 tx=0x7f8dd4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.094+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8ddc071070 con 0x7f8de8101f90 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.265+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f8de81118d0 con 0x7f8dd80394e0 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.273+0000 7f8de57fa640 1 -- 172.21.15.115:0/1568729297 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f8de81118d0 con 0x7f8dd80394e0 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 msgr2=0x7f8dd803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 0x7f8dd803b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006fd0 tx=0x7f8dd4006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 msgr2=0x7f8de8110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009810 tx=0x7f8ddc0091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 shutdown_connections 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f8dd80394e0 0x7f8dd803b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.870 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 --2- 172.21.15.115:0/1568729297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8101f90 0x7f8de8110d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:57.871 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 >> 172.21.15.115:0/1568729297 conn(0x7f8de80fd710 msgr2=0x7f8de80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:57.871 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 shutdown_connections 2024-09-13T22:57:57.871 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:57.275+0000 7f8deeae6640 1 -- 172.21.15.115:0/1568729297 wait complete. 2024-09-13T22:57:57.871 INFO:teuthology.orchestra.run.smithi115.stdout:Deploying alertmanager service with default placement... 2024-09-13T22:57:58.503 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:58 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:58.503 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:58 smithi115 ceph-mon[27601]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:58.504 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:58 smithi115 ceph-mon[27601]: Saving service node-exporter spec with placement * 2024-09-13T22:57:58.504 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:58 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:58.504 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:58 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:57:59.140 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T22:57:59.140 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.302+0000 7f282c259640 1 Processor -- start 2024-09-13T22:57:59.140 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f282c259640 1 -- start start 2024-09-13T22:57:59.140 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f282c259640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:59.140 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f282c259640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824102920 con 0x7f2824101fd0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f2829ff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f2829ff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56214/0 (socket says 172.21.15.115:56214) 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f2829ff5640 1 -- 172.21.15.115:0/2291645143 learned_addr learned my addr 172.21.15.115:0/2291645143 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.303+0000 7f2829ff5640 1 -- 172.21.15.115:0/2291645143 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2824102a60 con 0x7f2824101fd0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.304+0000 7f2829ff5640 1 --2- 172.21.15.115:0/2291645143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2814009840 tx=0x7f28140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5d6ad5ecacc08e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.304+0000 7f2828ff3640 1 -- 172.21.15.115:0/2291645143 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2814032440 con 0x7f2824101fd0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.304+0000 7f2828ff3640 1 -- 172.21.15.115:0/2291645143 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2814032a40 con 0x7f2824101fd0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.304+0000 7f2828ff3640 1 -- 172.21.15.115:0/2291645143 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2814031a70 con 0x7f2824101fd0 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 -- 172.21.15.115:0/2291645143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 msgr2=0x7f28241023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 --2- 172.21.15.115:0/2291645143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2814009840 tx=0x7f28140091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 -- 172.21.15.115:0/2291645143 shutdown_connections 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 --2- 172.21.15.115:0/2291645143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f28241023e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 -- 172.21.15.115:0/2291645143 >> 172.21.15.115:0/2291645143 conn(0x7f28240fd770 msgr2=0x7f28240ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:59.141 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 -- 172.21.15.115:0/2291645143 shutdown_connections 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.305+0000 7f282c259640 1 -- 172.21.15.115:0/2291645143 wait complete. 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f282c259640 1 Processor -- start 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f282c259640 1 -- start start 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f282c259640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f282c259640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824111370 con 0x7f2824101fd0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f2829ff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f2829ff5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56220/0 (socket says 172.21.15.115:56220) 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f2829ff5640 1 -- 172.21.15.115:0/786799426 learned_addr learned my addr 172.21.15.115:0/786799426 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f2829ff5640 1 -- 172.21.15.115:0/786799426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009450 con 0x7f2824101fd0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.306+0000 7f2829ff5640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2814006a70 tx=0x7f28140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f281403c400 con 0x7f2824101fd0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2824111570 con 0x7f2824101fd0 2024-09-13T22:57:59.142 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f281403ca00 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f281403a9a0 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824111fc0 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.307+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f281403ac20 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.308+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824101430 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.308+0000 7f281a7fc640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 0x7f281003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.308+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f281406ce50 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.308+0000 7f28297f4640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 0x7f281003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.308+0000 7f28297f4640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 0x7f281003b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2820006fd0 tx=0x7f2820006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.312+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f281403b360 con 0x7f2824101fd0 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.505+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f28240fea00 con 0x7f2810039490 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.509+0000 7f281a7fc640 1 -- 172.21.15.115:0/786799426 <== mgr.14118 v2:172.21.15.115:6800/2055434874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f28240fea00 con 0x7f2810039490 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 msgr2=0x7f281003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 0x7f281003b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2820006fd0 tx=0x7f2820006db0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.143 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 msgr2=0x7f2824110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2814006a70 tx=0x7f28140091d0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 shutdown_connections 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f2810039490 0x7f281003b940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 --2- 172.21.15.115:0/786799426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2824101fd0 0x7f2824110e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 >> 172.21.15.115:0/786799426 conn(0x7f28240fd770 msgr2=0x7f28240fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 shutdown_connections 2024-09-13T22:57:59.144 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:58.511+0000 7f282c259640 1 -- 172.21.15.115:0/786799426 wait complete. 2024-09-13T22:57:59.794 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:59 smithi115 ceph-mon[27601]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:59.794 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:59 smithi115 ceph-mon[27601]: Saving service alertmanager spec with placement count:1 2024-09-13T22:57:59.794 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:57:59 smithi115 ceph-mon[27601]: from='mgr.14118 172.21.15.115:0/1584441778' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff2d41a640 1 Processor -- start 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff2d41a640 1 -- start start 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff2d41a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff2d41a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281028e0 con 0x7eff28101f90 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.976+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56236/0 (socket says 172.21.15.115:56236) 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.977+0000 7eff26ffd640 1 -- 172.21.15.115:0/3131770661 learned_addr learned my addr 172.21.15.115:0/3131770661 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.977+0000 7eff26ffd640 1 -- 172.21.15.115:0/3131770661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28102a20 con 0x7eff28101f90 2024-09-13T22:58:00.941 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.977+0000 7eff26ffd640 1 --2- 172.21.15.115:0/3131770661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff18009e50 tx=0x7eff18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a62cb760efb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff25ffb640 1 -- 172.21.15.115:0/3131770661 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff18031560 con 0x7eff28101f90 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff25ffb640 1 -- 172.21.15.115:0/3131770661 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff1802d050 con 0x7eff28101f90 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff25ffb640 1 -- 172.21.15.115:0/3131770661 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff18007a60 con 0x7eff28101f90 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 -- 172.21.15.115:0/3131770661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 msgr2=0x7eff281023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3131770661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff18009e50 tx=0x7eff18009840 comp rx=0 tx=0).stop 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 -- 172.21.15.115:0/3131770661 shutdown_connections 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3131770661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff281023a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 -- 172.21.15.115:0/3131770661 >> 172.21.15.115:0/3131770661 conn(0x7eff280fd730 msgr2=0x7eff280ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 -- 172.21.15.115:0/3131770661 shutdown_connections 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.978+0000 7eff2d41a640 1 -- 172.21.15.115:0/3131770661 wait complete. 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff2d41a640 1 Processor -- start 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff2d41a640 1 -- start start 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff2d41a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:00.942 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff2d41a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28111350 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56238/0 (socket says 172.21.15.115:56238) 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.979+0000 7eff26ffd640 1 -- 172.21.15.115:0/3939873443 learned_addr learned my addr 172.21.15.115:0/3939873443 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff26ffd640 1 -- 172.21.15.115:0/3939873443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009ae0 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff26ffd640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff1802abe0 tx=0x7eff18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff18031bc0 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff18031d20 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff18045570 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff28111550 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.980+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28111fa0 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.981+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7eff18038050 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.981+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff281013f0 con 0x7eff28101f90 2024-09-13T22:58:00.943 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.981+0000 7eff1f7fe640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 0x7eff1403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.981+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7eff1806ccc0 con 0x7eff28101f90 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.981+0000 7eff267fc640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 0x7eff1403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.982+0000 7eff267fc640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 0x7eff1403b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:57:59.985+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7eff1804dae0 con 0x7eff28101f90 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.150+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7eff2804b720 con 0x7eff28101f90 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.153+0000 7eff1f7fe640 1 -- 172.21.15.115:0/3939873443 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7eff18041070 con 0x7eff28101f90 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 msgr2=0x7eff1403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 0x7eff1403b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 msgr2=0x7eff28110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff1802abe0 tx=0x7eff18009840 comp rx=0 tx=0).stop 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 shutdown_connections 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7eff14039490 0x7eff1403b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 --2- 172.21.15.115:0/3939873443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff28101f90 0x7eff28110e10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:00.944 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 >> 172.21.15.115:0/3939873443 conn(0x7eff280fd730 msgr2=0x7eff280fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:00.945 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 shutdown_connections 2024-09-13T22:58:00.945 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:00.156+0000 7eff2d41a640 1 -- 172.21.15.115:0/3939873443 wait complete. 2024-09-13T22:58:01.245 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:01 smithi115 ceph-mon[27601]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:01.245 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:01 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3939873443' entity='client.admin' 2024-09-13T22:58:02.047 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f152084c640 1 Processor -- start 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f152084c640 1 -- start start 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f152084c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f152084c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c076ec0 con 0x7f151c076ab0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f151a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f151a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56250/0 (socket says 172.21.15.115:56250) 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f151a59c640 1 -- 172.21.15.115:0/1280619468 learned_addr learned my addr 172.21.15.115:0/1280619468 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.320+0000 7f151a59c640 1 -- 172.21.15.115:0/1280619468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c105180 con 0x7f151c076ab0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.321+0000 7f151a59c640 1 --2- 172.21.15.115:0/1280619468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f150c009840 tx=0x7f150c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90d151d0f9c84c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.321+0000 7f1519d9b640 1 -- 172.21.15.115:0/1280619468 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c032440 con 0x7f151c076ab0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.321+0000 7f1519d9b640 1 -- 172.21.15.115:0/1280619468 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f150c032a40 con 0x7f151c076ab0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.321+0000 7f1519d9b640 1 -- 172.21.15.115:0/1280619468 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c031aa0 con 0x7f151c076ab0 2024-09-13T22:58:02.048 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 -- 172.21.15.115:0/1280619468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 msgr2=0x7f151c104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 --2- 172.21.15.115:0/1280619468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f150c009840 tx=0x7f150c0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 -- 172.21.15.115:0/1280619468 shutdown_connections 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 --2- 172.21.15.115:0/1280619468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c104c40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 -- 172.21.15.115:0/1280619468 >> 172.21.15.115:0/1280619468 conn(0x7f151c0fc6d0 msgr2=0x7f151c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 -- 172.21.15.115:0/1280619468 shutdown_connections 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.322+0000 7f152084c640 1 -- 172.21.15.115:0/1280619468 wait complete. 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f152084c640 1 Processor -- start 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f152084c640 1 -- start start 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f152084c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f152084c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c111380 con 0x7f151c076ab0 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f151a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f151a59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56252/0 (socket says 172.21.15.115:56252) 2024-09-13T22:58:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f151a59c640 1 -- 172.21.15.115:0/416053726 learned_addr learned my addr 172.21.15.115:0/416053726 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f151a59c640 1 -- 172.21.15.115:0/416053726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c009450 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.323+0000 7f151a59c640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f150c006a70 tx=0x7f150c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.324+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c031d20 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.324+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f150c031e80 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.324+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c111580 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.324+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f150c03a750 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.324+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c111fd0 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.325+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f150c039040 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.325+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c1002f0 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.325+0000 7f15137fe640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 0x7f150803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.325+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f150c06cba0 con 0x7f151c076ab0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.325+0000 7f1511d9b640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 0x7f150803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.326+0000 7f1511d9b640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 0x7f150803b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1504006fd0 tx=0x7f1504006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:02.050 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.329+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f150c03b7b0 con 0x7f151c076ab0 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.486+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f151c04b720 con 0x7f151c076ab0 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.490+0000 7f15137fe640 1 -- 172.21.15.115:0/416053726 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f150c0370c0 con 0x7f151c076ab0 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 msgr2=0x7f150803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 0x7f150803b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1504006fd0 tx=0x7f1504006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 msgr2=0x7f151c110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f150c006a70 tx=0x7f150c0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 shutdown_connections 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f15080394e0 0x7f150803b990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 --2- 172.21.15.115:0/416053726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f151c076ab0 0x7f151c110e40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 >> 172.21.15.115:0/416053726 conn(0x7f151c0fc6d0 msgr2=0x7f151c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 shutdown_connections 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:01.492+0000 7f152084c640 1 -- 172.21.15.115:0/416053726 wait complete. 2024-09-13T22:58:02.051 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling the dashboard module... 2024-09-13T22:58:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/416053726' entity='client.admin' 2024-09-13T22:58:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:02 smithi115 ceph-mon[27601]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:03.768 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:03 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1779946898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T22:58:04.096 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09ed91f640 1 Processor -- start 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09ed91f640 1 -- start start 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09ed91f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09ed91f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81050d0 con 0x7f09e8076b70 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09e6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09e6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56262/0 (socket says 172.21.15.115:56262) 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09e6ffd640 1 -- 172.21.15.115:0/3745723562 learned_addr learned my addr 172.21.15.115:0/3745723562 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.470+0000 7f09e6ffd640 1 -- 172.21.15.115:0/3745723562 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8105210 con 0x7f09e8076b70 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.471+0000 7f09e6ffd640 1 --2- 172.21.15.115:0/3745723562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009840 tx=0x7f09d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12181d2b11e5c3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.471+0000 7f09e67fc640 1 -- 172.21.15.115:0/3745723562 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d8032440 con 0x7f09e8076b70 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.471+0000 7f09e67fc640 1 -- 172.21.15.115:0/3745723562 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f09d8032a40 con 0x7f09e8076b70 2024-09-13T22:58:04.097 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.471+0000 7f09e67fc640 1 -- 172.21.15.115:0/3745723562 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d8031aa0 con 0x7f09e8076b70 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- 172.21.15.115:0/3745723562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 msgr2=0x7f09e8104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 --2- 172.21.15.115:0/3745723562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009840 tx=0x7f09d80091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- 172.21.15.115:0/3745723562 shutdown_connections 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 --2- 172.21.15.115:0/3745723562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8104b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- 172.21.15.115:0/3745723562 >> 172.21.15.115:0/3745723562 conn(0x7f09e80fc700 msgr2=0x7f09e80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- 172.21.15.115:0/3745723562 shutdown_connections 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- 172.21.15.115:0/3745723562 wait complete. 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 Processor -- start 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.472+0000 7f09ed91f640 1 -- start start 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09ed91f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09ed91f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8111380 con 0x7f09e8076b70 2024-09-13T22:58:04.098 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09e6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09e6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56270/0 (socket says 172.21.15.115:56270) 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09e6ffd640 1 -- 172.21.15.115:0/1779946898 learned_addr learned my addr 172.21.15.115:0/1779946898 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09e6ffd640 1 -- 172.21.15.115:0/1779946898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8009450 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09e6ffd640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09d80316a0 tx=0x7f09d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d80327b0 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f09d803b8d0 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e8111580 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d803a780 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.473+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8112060 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.474+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f09d8039040 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.474+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e8100300 con 0x7f09e8076b70 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.474+0000 7f09dffff640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 0x7f09d403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:04.099 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.474+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f09d806cd30 con 0x7f09e8076b70 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.474+0000 7f09de7fc640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 0x7f09d403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.475+0000 7f09de7fc640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 0x7f09d403b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f09d0006fd0 tx=0x7f09d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.479+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f09d804b6c0 con 0x7f09e8076b70 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:02.680+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f09e804b720 con 0x7f09e8076b70 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.495+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f09d8038d40 con 0x7f09e8076b70 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.497+0000 7f09dffff640 1 -- 172.21.15.115:0/1779946898 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f09d8043b30 con 0x7f09e8076b70 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 msgr2=0x7f09d403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 0x7f09d403b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f09d0006fd0 tx=0x7f09d0006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 msgr2=0x7f09e8110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09d80316a0 tx=0x7f09d80091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 shutdown_connections 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f09d4039490 0x7f09d403b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.100 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 --2- 172.21.15.115:0/1779946898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e8076b70 0x7f09e8110e40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:04.101 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 >> 172.21.15.115:0/1779946898 conn(0x7f09e80fc700 msgr2=0x7f09e80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:04.101 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 shutdown_connections 2024-09-13T22:58:04.101 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:03.500+0000 7f09ed91f640 1 -- 172.21.15.115:0/1779946898 wait complete. 2024-09-13T22:58:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:04 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1779946898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T22:58:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:04 smithi115 ceph-mon[27601]: mgrmap e9: smithi115.eqesbc(active, since 23s) 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "active_name": "smithi115.eqesbc", 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:58:05.287 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.531+0000 7f30e5b81640 1 Processor -- start 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.531+0000 7f30e5b81640 1 -- start start 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.531+0000 7f30e5b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.531+0000 7f30e5b81640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0100f00 con 0x7f30e01005b0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.532+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.532+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56302/0 (socket says 172.21.15.115:56302) 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.532+0000 7f30df7fe640 1 -- 172.21.15.115:0/4152674194 learned_addr learned my addr 172.21.15.115:0/4152674194 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.532+0000 7f30df7fe640 1 -- 172.21.15.115:0/4152674194 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0101040 con 0x7f30e01005b0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30df7fe640 1 --2- 172.21.15.115:0/4152674194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8d4f74fa849608 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30de7fc640 1 -- 172.21.15.115:0/4152674194 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d0031560 con 0x7f30e01005b0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30de7fc640 1 -- 172.21.15.115:0/4152674194 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30d002d050 con 0x7f30e01005b0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30de7fc640 1 -- 172.21.15.115:0/4152674194 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d0007a60 con 0x7f30e01005b0 2024-09-13T22:58:05.288 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30e5b81640 1 -- 172.21.15.115:0/4152674194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 msgr2=0x7f30e01009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30e5b81640 1 --2- 172.21.15.115:0/4152674194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d0009840 comp rx=0 tx=0).stop 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30e5b81640 1 -- 172.21.15.115:0/4152674194 shutdown_connections 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30e5b81640 1 --2- 172.21.15.115:0/4152674194 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e01009c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.533+0000 7f30e5b81640 1 -- 172.21.15.115:0/4152674194 >> 172.21.15.115:0/4152674194 conn(0x7f30e00fbd90 msgr2=0x7f30e00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 -- 172.21.15.115:0/4152674194 shutdown_connections 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 -- 172.21.15.115:0/4152674194 wait complete. 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 Processor -- start 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 -- start start 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.534+0000 7f30e5b81640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0113b10 con 0x7f30e01005b0 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30df7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56318/0 (socket says 172.21.15.115:56318) 2024-09-13T22:58:05.289 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30df7fe640 1 -- 172.21.15.115:0/2183371051 learned_addr learned my addr 172.21.15.115:0/2183371051 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30df7fe640 1 -- 172.21.15.115:0/2183371051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009ae0 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30df7fe640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009560 tx=0x7f30d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d003b410 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30d003ba10 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30d0045710 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e0113c50 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.535+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e0114060 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.536+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f30d0038050 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.536+0000 7f30d7fff640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 0x7f30cc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.536+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f30d006cff0 con 0x7f30e01005b0 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.536+0000 7f30deffd640 1 -- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 msgr2=0x7f30cc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:05.290 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.536+0000 7f30deffd640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 0x7f30cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.537+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e004b720 con 0x7f30e01005b0 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.541+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f30d0041020 con 0x7f30e01005b0 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.737+0000 7f30deffd640 1 -- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 msgr2=0x7f30cc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.737+0000 7f30deffd640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 0x7f30cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.746+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f30e002aa40 con 0x7f30e01005b0 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.747+0000 7f30d7fff640 1 -- 172.21.15.115:0/2183371051 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f30d0036070 con 0x7f30e01005b0 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 msgr2=0x7f30cc03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 0x7f30cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 msgr2=0x7f30e00fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009560 tx=0x7f30d0009840 comp rx=0 tx=0).stop 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 shutdown_connections 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7f30cc0394e0 0x7f30cc03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:05.291 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 --2- 172.21.15.115:0/2183371051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30e01005b0 0x7f30e00fd340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:05.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 >> 172.21.15.115:0/2183371051 conn(0x7f30e00fbd90 msgr2=0x7f30e00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:05.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 shutdown_connections 2024-09-13T22:58:05.292 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:04.749+0000 7f30e5b81640 1 -- 172.21.15.115:0/2183371051 wait complete. 2024-09-13T22:58:05.292 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for the mgr to restart... 2024-09-13T22:58:05.292 INFO:teuthology.orchestra.run.smithi115.stdout:Waiting for mgr epoch 9... 2024-09-13T22:58:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:05 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2183371051' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: Active manager daemon smithi115.eqesbc restarted 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: Activating manager daemon smithi115.eqesbc 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: mgrmap e10: smithi115.eqesbc(active, starting, since 0.0033896s) 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:58:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:58:08.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:58:08.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: Manager daemon smithi115.eqesbc is now available 2024-09-13T22:58:08.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:08.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:58:08.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:07 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7febad6fe640 1 Processor -- start 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7febad6fe640 1 -- start start 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7febad6fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:09.755 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7febad6fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8105120 con 0x7feba8076b90 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56324/0 (socket says 172.21.15.115:56324) 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7feba6ffd640 1 -- 172.21.15.115:0/1426069209 learned_addr learned my addr 172.21.15.115:0/1426069209 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.679+0000 7feba6ffd640 1 -- 172.21.15.115:0/1426069209 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8105260 con 0x7feba8076b90 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.680+0000 7feba6ffd640 1 --2- 172.21.15.115:0/1426069209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb98009840 tx=0x7feb980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62c70afe6b8f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7feba67fc640 1 -- 172.21.15.115:0/1426069209 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb98032440 con 0x7feba8076b90 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7feba67fc640 1 -- 172.21.15.115:0/1426069209 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feb98032a40 con 0x7feba8076b90 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7feba67fc640 1 -- 172.21.15.115:0/1426069209 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb98031a70 con 0x7feba8076b90 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 -- 172.21.15.115:0/1426069209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 msgr2=0x7feba8104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:09.756 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 --2- 172.21.15.115:0/1426069209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb98009840 tx=0x7feb980091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 -- 172.21.15.115:0/1426069209 shutdown_connections 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 --2- 172.21.15.115:0/1426069209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8104be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 -- 172.21.15.115:0/1426069209 >> 172.21.15.115:0/1426069209 conn(0x7feba80fc710 msgr2=0x7feba80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 -- 172.21.15.115:0/1426069209 shutdown_connections 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.681+0000 7febad6fe640 1 -- 172.21.15.115:0/1426069209 wait complete. 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7febad6fe640 1 Processor -- start 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7febad6fe640 1 -- start start 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7febad6fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7febad6fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8111380 con 0x7feba8076b90 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56336/0 (socket says 172.21.15.115:56336) 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7feba6ffd640 1 -- 172.21.15.115:0/2098194084 learned_addr learned my addr 172.21.15.115:0/2098194084 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:09.757 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7feba6ffd640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009450 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.682+0000 7feba6ffd640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb98031750 tx=0x7feb980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.683+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb9803c400 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.683+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feb9803ca00 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.683+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb9803a880 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.683+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba8111580 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.683+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba8111fd0 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7feb9803a9e0 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9f7fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb9403c0f0 con 0x7feb94039530 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7feb9806cf20 con 0x7feba8076b90 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9ffff640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 msgr2=0x7feb9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:09.758 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.684+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.885+0000 7feb9ffff640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 msgr2=0x7feb9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:05.885+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:06.286+0000 7feb9ffff640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 msgr2=0x7feb9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:06.286+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:07.087+0000 7feb9ffff640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 msgr2=0x7feb9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/2055434874 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:07.087+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:07.886+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7feb9806c020 con 0x7feba8076b90 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:07.886+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 msgr2=0x7feb9403b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:07.886+0000 7feb9f7fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.887+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7feb98039310 con 0x7feba8076b90 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.887+0000 7feb9f7fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 0x7feb9403f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.887+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb9403c0f0 con 0x7feb9403cfd0 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.888+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 0x7feb9403f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:09.759 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.888+0000 7feb9ffff640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 0x7feb9403f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb90003940 tx=0x7feb90009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.889+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7feb9403c0f0 con 0x7feb9403cfd0 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.894+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feba8100350 con 0x7feb9403cfd0 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7feb9f7fe640 1 -- 172.21.15.115:0/2098194084 <== mgr.14160 v2:172.21.15.115:6800/1740627202 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7feba8100350 con 0x7feb9403cfd0 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 msgr2=0x7feb9403f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 0x7feb9403f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feb90003940 tx=0x7feb90009350 comp rx=0 tx=0).stop 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 msgr2=0x7feba8110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb98031750 tx=0x7feb980091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 shutdown_connections 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/2055434874,v1:172.21.15.115:6801/2055434874] conn(0x7feb94039530 0x7feb9403b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7feb9403cfd0 0x7feb9403f3b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 --2- 172.21.15.115:0/2098194084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feba8076b90 0x7feba8110e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 >> 172.21.15.115:0/2098194084 conn(0x7feba80fc710 msgr2=0x7feba80fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:09.760 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 shutdown_connections 2024-09-13T22:58:09.761 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:08.895+0000 7febad6fe640 1 -- 172.21.15.115:0/2098194084 wait complete. 2024-09-13T22:58:09.761 INFO:teuthology.orchestra.run.smithi115.stdout:mgr epoch 9 is available 2024-09-13T22:58:09.761 INFO:teuthology.orchestra.run.smithi115.stdout:Generating a dashboard self-signed certificate... 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: mgrmap e11: smithi115.eqesbc(active, since 1.00588s) 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: [13/Sep/2024:22:58:09] ENGINE Bus STARTING 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: [13/Sep/2024:22:58:09] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: [13/Sep/2024:22:58:09] ENGINE Bus STARTED 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: [13/Sep/2024:22:58:09] ENGINE Error in HTTPServer.serve 2024-09-13T22:58:10.000 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:58:10.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T22:58:10.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:58:10.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T22:58:10.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:58:10.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:10.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:09 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:10.968 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.181+0000 7fca17ef0640 1 Processor -- start 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.181+0000 7fca17ef0640 1 -- start start 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.181+0000 7fca17ef0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.181+0000 7fca17ef0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101028d0 con 0x7fca10101f80 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.182+0000 7fca15c8c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.182+0000 7fca15c8c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49584/0 (socket says 172.21.15.115:49584) 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.182+0000 7fca15c8c640 1 -- 172.21.15.115:0/3251253848 learned_addr learned my addr 172.21.15.115:0/3251253848 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.182+0000 7fca15c8c640 1 -- 172.21.15.115:0/3251253848 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10102a10 con 0x7fca10101f80 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca15c8c640 1 --2- 172.21.15.115:0/3251253848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca08009840 tx=0x7fca080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576a041584bd8efa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca14c8a640 1 -- 172.21.15.115:0/3251253848 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca08032440 con 0x7fca10101f80 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca14c8a640 1 -- 172.21.15.115:0/3251253848 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca08032a40 con 0x7fca10101f80 2024-09-13T22:58:10.969 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca14c8a640 1 -- 172.21.15.115:0/3251253848 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca08031a70 con 0x7fca10101f80 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 -- 172.21.15.115:0/3251253848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 msgr2=0x7fca10102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 --2- 172.21.15.115:0/3251253848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca08009840 tx=0x7fca080091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 -- 172.21.15.115:0/3251253848 shutdown_connections 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 --2- 172.21.15.115:0/3251253848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10102390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 -- 172.21.15.115:0/3251253848 >> 172.21.15.115:0/3251253848 conn(0x7fca100fd7a0 msgr2=0x7fca100ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.183+0000 7fca17ef0640 1 -- 172.21.15.115:0/3251253848 shutdown_connections 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca17ef0640 1 -- 172.21.15.115:0/3251253848 wait complete. 2024-09-13T22:58:10.970 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca17ef0640 1 Processor -- start 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca17ef0640 1 -- start start 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca17ef0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca17ef0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101113b0 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca15c8c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca15c8c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49590/0 (socket says 172.21.15.115:49590) 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.184+0000 7fca15c8c640 1 -- 172.21.15.115:0/619801843 learned_addr learned my addr 172.21.15.115:0/619801843 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca15c8c640 1 -- 172.21.15.115:0/619801843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009450 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca15c8c640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca08009420 tx=0x7fca080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca0803c400 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca0803ca00 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca101115b0 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca0803a850 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.185+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10112090 con 0x7fca10101f80 2024-09-13T22:58:10.971 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7fca0803c560 con 0x7fca10101f80 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca101013e0 con 0x7fca10101f80 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca0e7fc640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 0x7fc9f803b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fca0806ce20 con 0x7fca10101f80 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca1548b640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 0x7fc9f803b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.186+0000 7fca1548b640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 0x7fc9f803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca0400ad90 tx=0x7fca04009410 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.191+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fca0803b7d0 con 0x7fca10101f80 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.320+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fca08045ca0 con 0x7fca10101f80 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.362+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fca100fec00 con 0x7fc9f80393d0 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.421+0000 7fca0e7fc640 1 -- 172.21.15.115:0/619801843 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fca100fec00 con 0x7fc9f80393d0 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 msgr2=0x7fc9f803b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 0x7fc9f803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca0400ad90 tx=0x7fca04009410 comp rx=0 tx=0).stop 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 msgr2=0x7fca10110e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:10.972 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca08009420 tx=0x7fca080091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 shutdown_connections 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fc9f80393d0 0x7fc9f803b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 --2- 172.21.15.115:0/619801843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca10101f80 0x7fca10110e70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 >> 172.21.15.115:0/619801843 conn(0x7fca100fd7a0 msgr2=0x7fca100fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 shutdown_connections 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:10.423+0000 7fca17ef0640 1 -- 172.21.15.115:0/619801843 wait complete. 2024-09-13T22:58:10.973 INFO:teuthology.orchestra.run.smithi115.stdout:Creating initial admin user... 2024-09-13T22:58:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:11 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:11 smithi115 ceph-mon[27601]: mgrmap e12: smithi115.eqesbc(active, since 2s) 2024-09-13T22:58:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:11 smithi115 ceph-mon[27601]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:11 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:11 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:13.014 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:12 smithi115 ceph-mon[27601]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:13.015 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:12 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$T9iKXvvF4mTvv0we7gJbmeAvtApzvGUN4hiOjNjM6oEC9AANMEzKi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726268291, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43b6a12640 1 Processor -- start 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43b6a12640 1 -- start start 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43b6a12640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43b6a12640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0076f00 con 0x7f43b0076af0 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49598/0 (socket says 172.21.15.115:49598) 2024-09-13T22:58:13.022 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43affff640 1 -- 172.21.15.115:0/2037005818 learned_addr learned my addr 172.21.15.115:0/2037005818 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.397+0000 7f43affff640 1 -- 172.21.15.115:0/2037005818 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b01051c0 con 0x7f43b0076af0 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.398+0000 7f43affff640 1 --2- 172.21.15.115:0/2037005818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009840 tx=0x7f43a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35adb31f66df9ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.398+0000 7f43aeffd640 1 -- 172.21.15.115:0/2037005818 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a0032440 con 0x7f43b0076af0 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.398+0000 7f43aeffd640 1 -- 172.21.15.115:0/2037005818 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43a0032a40 con 0x7f43b0076af0 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.398+0000 7f43aeffd640 1 -- 172.21.15.115:0/2037005818 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a0031aa0 con 0x7f43b0076af0 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- 172.21.15.115:0/2037005818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 msgr2=0x7f43b0104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:13.023 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2037005818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009840 tx=0x7f43a00091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- 172.21.15.115:0/2037005818 shutdown_connections 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2037005818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0104c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- 172.21.15.115:0/2037005818 >> 172.21.15.115:0/2037005818 conn(0x7f43b00fc790 msgr2=0x7f43b00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- 172.21.15.115:0/2037005818 shutdown_connections 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- 172.21.15.115:0/2037005818 wait complete. 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 Processor -- start 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 -- start start 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.399+0000 7f43b6a12640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43b6a12640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0111340 con 0x7f43b0076af0 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49606/0 (socket says 172.21.15.115:49606) 2024-09-13T22:58:13.024 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43affff640 1 -- 172.21.15.115:0/2482987708 learned_addr learned my addr 172.21.15.115:0/2482987708 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43affff640 1 -- 172.21.15.115:0/2482987708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0009450 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43affff640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009420 tx=0x7f43a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a0031d20 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43a0031e80 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b01115a0 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43a003a750 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.400+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b0111f90 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.401+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f43a0039040 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.401+0000 7f43acff9640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 0x7f439c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.401+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b004b720 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.402+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f43a006cdb0 con 0x7f43b0076af0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.402+0000 7f43af7fe640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 0x7f439c03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.402+0000 7f43af7fe640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 0x7f439c03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.406+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f43a004bae0 con 0x7f43b0076af0 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.582+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f43b0112120 con 0x7f439c039530 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.807+0000 7f43acff9640 1 -- 172.21.15.115:0/2482987708 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f43b0112120 con 0x7f439c039530 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 msgr2=0x7f439c03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 0x7f439c03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 msgr2=0x7f43b0110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009420 tx=0x7f43a00091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 shutdown_connections 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f439c039530 0x7f439c03b9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 --2- 172.21.15.115:0/2482987708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43b0076af0 0x7f43b0110e00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 >> 172.21.15.115:0/2482987708 conn(0x7f43b00fc790 msgr2=0x7f43b00fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 shutdown_connections 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:11.809+0000 7f43b6a12640 1 -- 172.21.15.115:0/2482987708 wait complete. 2024-09-13T22:58:13.026 INFO:teuthology.orchestra.run.smithi115.stdout:Fetching dashboard port number... 2024-09-13T22:58:14.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:13 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1233597025' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.475+0000 7fb962931640 1 Processor -- start 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.475+0000 7fb962931640 1 -- start start 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.475+0000 7fb962931640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.475+0000 7fb962931640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c076ec0 con 0x7fb95c076ab0 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.475+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.476+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49622/0 (socket says 172.21.15.115:49622) 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.476+0000 7fb95bfff640 1 -- 172.21.15.115:0/4238688127 learned_addr learned my addr 172.21.15.115:0/4238688127 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:14.228 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.476+0000 7fb95bfff640 1 -- 172.21.15.115:0/4238688127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c105200 con 0x7fb95c076ab0 2024-09-13T22:58:14.229 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.476+0000 7fb95bfff640 1 --2- 172.21.15.115:0/4238688127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f986979200a18df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:14.232 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb95b7fe640 1 -- 172.21.15.115:0/4238688127 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94c032440 con 0x7fb95c076ab0 2024-09-13T22:58:14.232 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb95b7fe640 1 -- 172.21.15.115:0/4238688127 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb94c032a40 con 0x7fb95c076ab0 2024-09-13T22:58:14.232 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb95b7fe640 1 -- 172.21.15.115:0/4238688127 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94c031aa0 con 0x7fb95c076ab0 2024-09-13T22:58:14.232 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 -- 172.21.15.115:0/4238688127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 msgr2=0x7fb95c104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:14.232 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 --2- 172.21.15.115:0/4238688127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 -- 172.21.15.115:0/4238688127 shutdown_connections 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 --2- 172.21.15.115:0/4238688127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c104cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 -- 172.21.15.115:0/4238688127 >> 172.21.15.115:0/4238688127 conn(0x7fb95c0fc790 msgr2=0x7fb95c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 -- 172.21.15.115:0/4238688127 shutdown_connections 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.477+0000 7fb962931640 1 -- 172.21.15.115:0/4238688127 wait complete. 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb962931640 1 Processor -- start 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb962931640 1 -- start start 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb962931640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb962931640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c1113a0 con 0x7fb95c076ab0 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49628/0 (socket says 172.21.15.115:49628) 2024-09-13T22:58:14.233 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb95bfff640 1 -- 172.21.15.115:0/1233597025 learned_addr learned my addr 172.21.15.115:0/1233597025 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.478+0000 7fb95bfff640 1 -- 172.21.15.115:0/1233597025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009450 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb95bfff640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009420 tx=0x7fb94c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94c031d20 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c1115a0 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb94c031e80 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94c03a750 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.479+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c111ff0 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fb94c039040 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c1003f0 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb9597fa640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 0x7fb94803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb94c06cbf0 con 0x7fb95c076ab0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb953fff640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 0x7fb94803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.480+0000 7fb953fff640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 0x7fb94803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb944006fd0 tx=0x7fb944006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:14.234 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.484+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb94c03a8b0 con 0x7fb95c076ab0 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.641+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fb95c04b720 con 0x7fb95c076ab0 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.641+0000 7fb9597fa640 1 -- 172.21.15.115:0/1233597025 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fb94c03f0b0 con 0x7fb95c076ab0 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 msgr2=0x7fb94803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 0x7fb94803b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb944006fd0 tx=0x7fb944006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 msgr2=0x7fb95c110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009420 tx=0x7fb94c0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 shutdown_connections 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fb9480394e0 0x7fb94803b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 --2- 172.21.15.115:0/1233597025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb95c076ab0 0x7fb95c110e60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 >> 172.21.15.115:0/1233597025 conn(0x7fb95c0fc790 msgr2=0x7fb95c0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 shutdown_connections 2024-09-13T22:58:14.235 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:13.643+0000 7fb962931640 1 -- 172.21.15.115:0/1233597025 wait complete. 2024-09-13T22:58:14.236 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:58:14.236 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout disabled 2024-09-13T22:58:14.242 INFO:teuthology.orchestra.run.smithi115.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:58:14.242 INFO:teuthology.orchestra.run.smithi115.stdout:systemctl: stdout inactive 2024-09-13T22:58:14.242 INFO:teuthology.orchestra.run.smithi115.stdout:firewalld.service is not enabled 2024-09-13T22:58:14.242 INFO:teuthology.orchestra.run.smithi115.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout:Ceph Dashboard is now available at: 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout: URL: https://smithi115.front.sepia.ceph.com:8443/ 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout: User: admin 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout: Password: ennbdvhk6b 2024-09-13T22:58:14.244 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:14.245 INFO:teuthology.orchestra.run.smithi115.stdout:Saving cluster configuration to /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config directory 2024-09-13T22:58:14.245 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling autotune for osd_memory_target 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe276092640 1 Processor -- start 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe276092640 1 -- start start 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe276092640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe276092640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701029e0 con 0x7fe270102090 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:15.326 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49634/0 (socket says 172.21.15.115:49634) 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.649+0000 7fe26f7fe640 1 -- 172.21.15.115:0/3436221935 learned_addr learned my addr 172.21.15.115:0/3436221935 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.650+0000 7fe26f7fe640 1 -- 172.21.15.115:0/3436221935 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270102b20 con 0x7fe270102090 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.650+0000 7fe26f7fe640 1 --2- 172.21.15.115:0/3436221935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe2600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116dc548b5af73fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.650+0000 7fe26e7fc640 1 -- 172.21.15.115:0/3436221935 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe260032440 con 0x7fe270102090 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.650+0000 7fe26e7fc640 1 -- 172.21.15.115:0/3436221935 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe260032a40 con 0x7fe270102090 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.650+0000 7fe26e7fc640 1 -- 172.21.15.115:0/3436221935 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe260031aa0 con 0x7fe270102090 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 -- 172.21.15.115:0/3436221935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 msgr2=0x7fe2701024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 --2- 172.21.15.115:0/3436221935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe2600091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 -- 172.21.15.115:0/3436221935 shutdown_connections 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 --2- 172.21.15.115:0/3436221935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe2701024a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 -- 172.21.15.115:0/3436221935 >> 172.21.15.115:0/3436221935 conn(0x7fe2700fd850 msgr2=0x7fe2700ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 -- 172.21.15.115:0/3436221935 shutdown_connections 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 -- 172.21.15.115:0/3436221935 wait complete. 2024-09-13T22:58:15.327 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.651+0000 7fe276092640 1 Processor -- start 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe276092640 1 -- start start 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe276092640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe276092640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270111360 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe26f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49636/0 (socket says 172.21.15.115:49636) 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe26f7fe640 1 -- 172.21.15.115:0/1708717512 learned_addr learned my addr 172.21.15.115:0/1708717512 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe26f7fe640 1 -- 172.21.15.115:0/1708717512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260009450 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.652+0000 7fe26f7fe640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe260006a70 tx=0x7fe2600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe260031d20 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe260031e80 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270111560 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe26003a750 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270111fb0 con 0x7fe270102090 2024-09-13T22:58:15.328 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.653+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fe260039040 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.654+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2701014f0 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.654+0000 7fe257fff640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 0x7fe25803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.654+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe26006ce60 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.654+0000 7fe26effd640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 0x7fe25803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.654+0000 7fe26effd640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 0x7fe25803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe264006fd0 tx=0x7fe264006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.658+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe26004b520 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.808+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fe260047d00 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.816+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fe27004b720 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.816+0000 7fe257fff640 1 -- 172.21.15.115:0/1708717512 <== mon.0 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fe260037070 con 0x7fe270102090 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 msgr2=0x7fe25803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 0x7fe25803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe264006fd0 tx=0x7fe264006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 msgr2=0x7fe270110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:15.329 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe260006a70 tx=0x7fe2600091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 shutdown_connections 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fe2580394e0 0x7fe25803b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 --2- 172.21.15.115:0/1708717512 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe270102090 0x7fe270110e20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 >> 172.21.15.115:0/1708717512 conn(0x7fe2700fd850 msgr2=0x7fe2700fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 shutdown_connections 2024-09-13T22:58:15.330 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:14.818+0000 7fe276092640 1 -- 172.21.15.115:0/1708717512 wait complete. 2024-09-13T22:58:15.979 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:15 smithi115 ceph-mon[27601]: mgrmap e13: smithi115.eqesbc(active, since 6s) 2024-09-13T22:58:16.540 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3f0b6d640 1 Processor -- start 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3f0b6d640 1 -- start start 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3f0b6d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3f0b6d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec101880 con 0x7fa3ec100f30 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3ea59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3ea59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49640/0 (socket says 172.21.15.115:49640) 2024-09-13T22:58:16.541 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.728+0000 7fa3ea59c640 1 -- 172.21.15.115:0/1474164038 learned_addr learned my addr 172.21.15.115:0/1474164038 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.729+0000 7fa3ea59c640 1 -- 172.21.15.115:0/1474164038 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec1019c0 con 0x7fa3ec100f30 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.729+0000 7fa3ea59c640 1 --2- 172.21.15.115:0/1474164038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009840 tx=0x7fa3dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e268fbdd2b51daf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.729+0000 7fa3e9d9b640 1 -- 172.21.15.115:0/1474164038 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3dc032440 con 0x7fa3ec100f30 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.729+0000 7fa3e9d9b640 1 -- 172.21.15.115:0/1474164038 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3dc032a40 con 0x7fa3ec100f30 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.729+0000 7fa3e9d9b640 1 -- 172.21.15.115:0/1474164038 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3dc031a70 con 0x7fa3ec100f30 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/1474164038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 msgr2=0x7fa3ec101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/1474164038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009840 tx=0x7fa3dc0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/1474164038 shutdown_connections 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/1474164038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec101340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/1474164038 >> 172.21.15.115:0/1474164038 conn(0x7fa3ec0fc730 msgr2=0x7fa3ec0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/1474164038 shutdown_connections 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.730+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/1474164038 wait complete. 2024-09-13T22:58:16.542 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 Processor -- start 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 -- start start 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec10f110 con 0x7fa3ec100f30 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3ea59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3ea59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49654/0 (socket says 172.21.15.115:49654) 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3ea59c640 1 -- 172.21.15.115:0/2460406126 learned_addr learned my addr 172.21.15.115:0/2460406126 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3ea59c640 1 -- 172.21.15.115:0/2460406126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009450 con 0x7fa3ec100f30 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3ea59c640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006a70 tx=0x7fa3dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3dc03c400 con 0x7fa3ec100f30 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec10f310 con 0x7fa3ec100f30 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3dc03ca00 con 0x7fa3ec100f30 2024-09-13T22:58:16.543 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3dc03a9a0 con 0x7fa3ec100f30 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.731+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec10f780 con 0x7fa3ec100f30 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.732+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fa3dc03abe0 con 0x7fa3ec100f30 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.732+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec04b720 con 0x7fa3ec100f30 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.733+0000 7fa3e37fe640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 0x7fa3d803fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.733+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa3dc06d090 con 0x7fa3ec100f30 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.733+0000 7fa3e1d9b640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 0x7fa3d803fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:16.544 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.733+0000 7fa3e1d9b640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 0x7fa3d803fe80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.737+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa3dc030940 con 0x7fa3ec100f30 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.975+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa3ec10f780 con 0x7fa3ec100f30 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.978+0000 7fa3e37fe640 1 -- 172.21.15.115:0/2460406126 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa3dc037020 con 0x7fa3ec100f30 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 msgr2=0x7fa3d803fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 0x7fa3d803fe80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006fd0 tx=0x7fa3d4006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 msgr2=0x7fa3ec10ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006a70 tx=0x7fa3dc0091d0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 shutdown_connections 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fa3d803d9d0 0x7fa3d803fe80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 --2- 172.21.15.115:0/2460406126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3ec100f30 0x7fa3ec10ebd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:16.545 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 >> 172.21.15.115:0/2460406126 conn(0x7fa3ec0fc730 msgr2=0x7fa3ec105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 shutdown_connections 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/bin/ceph: stderr 2024-09-13T22:58:15.980+0000 7fa3f0b6d640 1 -- 172.21.15.115:0/2460406126 wait complete. 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph telemetry on 2024-09-13T22:58:16.546 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.547 INFO:teuthology.orchestra.run.smithi115.stdout:For more information see: 2024-09-13T22:58:16.547 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.547 INFO:teuthology.orchestra.run.smithi115.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-13T22:58:16.547 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:16.547 INFO:teuthology.orchestra.run.smithi115.stdout:Bootstrap complete. 2024-09-13T22:58:16.575 INFO:tasks.cephadm:Fetching config... 2024-09-13T22:58:16.575 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:58:16.576 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T22:58:16.591 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T22:58:16.592 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:58:16.592 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T22:58:16.647 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T22:58:16.647 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:58:16.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/keyring of=/dev/stdout 2024-09-13T22:58:16.711 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T22:58:16.712 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:58:16.712 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T22:58:16.767 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T22:58:16.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYX1e84TzQI8uJzF4q5YONuvikmSRZPWXlftNzkqgkTEPXVB6lCNSBp5b+D1dHLxPdtvlnrVVAoN9KlTUHU5m5TXVXP94DFQ1vrQ7nUIH+K8Iyo//1PHPsDO9SS9OzSBp2ExGus8UvB6CsW5qQovX05sRV/whtK+8xHVqB/d0AoQsiBD8xxP+KrZjiYsRzVbmKWF7onYrL9FtRMJa6mRP9pQn02X32A1jBmYHir2cqtw3EGcKp1UkA6YYWUmo4Vh7nXUVPiceP1PAanprTu2K7w37IwUTwEAlMNEaYVzENn3cxaPGCAGRmTbj/C7xZjHN5eWZ6Uxf+fklAqPavIlBTKEN6RO+8YrW7okdmzwgR+QCoqQqujWAkdBOTZOWrdGbKifN5yg9TDnSY1mPzfUMbJAoa8WzMj97e7IUf5+tMQu64OZuSXGcZa01f344G9cg3z5lQ35uAM+617dl/wD9h3o3hg1z3GoanmJZ23CZqB/WbrwQVL+yBewf4dvzhnhE= ceph-62d5ccce-7223-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:58:16.849 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYX1e84TzQI8uJzF4q5YONuvikmSRZPWXlftNzkqgkTEPXVB6lCNSBp5b+D1dHLxPdtvlnrVVAoN9KlTUHU5m5TXVXP94DFQ1vrQ7nUIH+K8Iyo//1PHPsDO9SS9OzSBp2ExGus8UvB6CsW5qQovX05sRV/whtK+8xHVqB/d0AoQsiBD8xxP+KrZjiYsRzVbmKWF7onYrL9FtRMJa6mRP9pQn02X32A1jBmYHir2cqtw3EGcKp1UkA6YYWUmo4Vh7nXUVPiceP1PAanprTu2K7w37IwUTwEAlMNEaYVzENn3cxaPGCAGRmTbj/C7xZjHN5eWZ6Uxf+fklAqPavIlBTKEN6RO+8YrW7okdmzwgR+QCoqQqujWAkdBOTZOWrdGbKifN5yg9TDnSY1mPzfUMbJAoa8WzMj97e7IUf5+tMQu64OZuSXGcZa01f344G9cg3z5lQ35uAM+617dl/wD9h3o3hg1z3GoanmJZ23CZqB/WbrwQVL+yBewf4dvzhnhE= ceph-62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:58:16.862 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYX1e84TzQI8uJzF4q5YONuvikmSRZPWXlftNzkqgkTEPXVB6lCNSBp5b+D1dHLxPdtvlnrVVAoN9KlTUHU5m5TXVXP94DFQ1vrQ7nUIH+K8Iyo//1PHPsDO9SS9OzSBp2ExGus8UvB6CsW5qQovX05sRV/whtK+8xHVqB/d0AoQsiBD8xxP+KrZjiYsRzVbmKWF7onYrL9FtRMJa6mRP9pQn02X32A1jBmYHir2cqtw3EGcKp1UkA6YYWUmo4Vh7nXUVPiceP1PAanprTu2K7w37IwUTwEAlMNEaYVzENn3cxaPGCAGRmTbj/C7xZjHN5eWZ6Uxf+fklAqPavIlBTKEN6RO+8YrW7okdmzwgR+QCoqQqujWAkdBOTZOWrdGbKifN5yg9TDnSY1mPzfUMbJAoa8WzMj97e7IUf5+tMQu64OZuSXGcZa01f344G9cg3z5lQ35uAM+617dl/wD9h3o3hg1z3GoanmJZ23CZqB/WbrwQVL+yBewf4dvzhnhE= ceph-62d5ccce-7223-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:58:17.092 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYX1e84TzQI8uJzF4q5YONuvikmSRZPWXlftNzkqgkTEPXVB6lCNSBp5b+D1dHLxPdtvlnrVVAoN9KlTUHU5m5TXVXP94DFQ1vrQ7nUIH+K8Iyo//1PHPsDO9SS9OzSBp2ExGus8UvB6CsW5qQovX05sRV/whtK+8xHVqB/d0AoQsiBD8xxP+KrZjiYsRzVbmKWF7onYrL9FtRMJa6mRP9pQn02X32A1jBmYHir2cqtw3EGcKp1UkA6YYWUmo4Vh7nXUVPiceP1PAanprTu2K7w37IwUTwEAlMNEaYVzENn3cxaPGCAGRmTbj/C7xZjHN5eWZ6Uxf+fklAqPavIlBTKEN6RO+8YrW7okdmzwgR+QCoqQqujWAkdBOTZOWrdGbKifN5yg9TDnSY1mPzfUMbJAoa8WzMj97e7IUf5+tMQu64OZuSXGcZa01f344G9cg3z5lQ35uAM+617dl/wD9h3o3hg1z3GoanmJZ23CZqB/WbrwQVL+yBewf4dvzhnhE= ceph-62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:58:17.109 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T22:58:17.131 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:16 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2460406126' entity='client.admin' 2024-09-13T22:58:17.363 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:58:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 -- 172.21.15.115:0/3412541773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 msgr2=0x7f6d740ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 --2- 172.21.15.115:0/3412541773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740ff070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6d64004850 tx=0x7f6d64009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 -- 172.21.15.115:0/3412541773 shutdown_connections 2024-09-13T22:58:19.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 --2- 172.21.15.115:0/3412541773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740ff070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 -- 172.21.15.115:0/3412541773 >> 172.21.15.115:0/3412541773 conn(0x7f6d740f6ac0 msgr2=0x7f6d740f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 -- 172.21.15.115:0/3412541773 shutdown_connections 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.757+0000 7f6d7c383640 1 -- 172.21.15.115:0/3412541773 wait complete. 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7c383640 1 Processor -- start 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7c383640 1 -- start start 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7c383640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7c383640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740fcee0 con 0x7f6d740655d0 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7a11f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7a11f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42756/0 (socket says 172.21.15.115:42756) 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7a11f640 1 -- 172.21.15.115:0/1866708010 learned_addr learned my addr 172.21.15.115:0/1866708010 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.758+0000 7f6d7a11f640 1 -- 172.21.15.115:0/1866708010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64005040 con 0x7f6d740655d0 2024-09-13T22:58:19.779 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d7a11f640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d6402a6d0 tx=0x7f6d64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d64033630 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d64033c30 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740faf70 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d6403dc30 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.759+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740fb3e0 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.760+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f6d64030020 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.760+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d74102810 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.760+0000 7f6d6affd640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 0x7f6d6003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.760+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6d6406caf0 con 0x7f6d740655d0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.760+0000 7f6d7991e640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 0x7f6d6003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.761+0000 7f6d7991e640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 0x7f6d6003ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d70006fd0 tx=0x7f6d70006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:19.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.765+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6d6403bb50 con 0x7f6d740655d0 2024-09-13T22:58:19.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.928+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f6d7405ed70 con 0x7f6d740655d0 2024-09-13T22:58:19.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:19.929 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:19.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:19 smithi115 ceph-mon[27601]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T22:58:19.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.931+0000 7f6d6affd640 1 -- 172.21.15.115:0/1866708010 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6d6403b370 con 0x7f6d740655d0 2024-09-13T22:58:19.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 msgr2=0x7f6d6003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:19.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 0x7f6d6003ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d70006fd0 tx=0x7f6d70006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 msgr2=0x7f6d740fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:19.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d6402a6d0 tx=0x7f6d64009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 shutdown_connections 2024-09-13T22:58:19.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f6d600395d0 0x7f6d6003ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 --2- 172.21.15.115:0/1866708010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d740655d0 0x7f6d740fc9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:19.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 >> 172.21.15.115:0/1866708010 conn(0x7f6d740f6ac0 msgr2=0x7f6d740f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:19.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 shutdown_connections 2024-09-13T22:58:19.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:19.934+0000 7f6d7c383640 1 -- 172.21.15.115:0/1866708010 wait complete. 2024-09-13T22:58:21.124 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T22:58:21.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T22:58:21.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:20 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1866708010' entity='client.admin' 2024-09-13T22:58:21.935 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- 172.21.15.115:0/3369586090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 msgr2=0x7f9aa00fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 --2- 172.21.15.115:0/3369586090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa00fb4e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c004850 tx=0x7f9a9c009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- 172.21.15.115:0/3369586090 shutdown_connections 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 --2- 172.21.15.115:0/3369586090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa00fb4e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- 172.21.15.115:0/3369586090 >> 172.21.15.115:0/3369586090 conn(0x7f9aa00f6890 msgr2=0x7f9aa00f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- 172.21.15.115:0/3369586090 shutdown_connections 2024-09-13T22:58:24.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- 172.21.15.115:0/3369586090 wait complete. 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 Processor -- start 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- start start 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.007+0000 7f9aa7323640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa010f450 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa50bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa50bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42788/0 (socket says 172.21.15.115:42788) 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa50bf640 1 -- 172.21.15.115:0/4147942550 learned_addr learned my addr 172.21.15.115:0/4147942550 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa50bf640 1 -- 172.21.15.115:0/4147942550 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c005040 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa50bf640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c02a6d0 tx=0x7f9a9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a9c033630 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a9c033c30 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa010f590 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9a9c03dc00 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.008+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa010f9a0 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.009+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f9a9c030020 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.009+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa005ed70 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.009+0000 7f9a91ffb640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 0x7f9a8c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.009+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9a9c06cbc0 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.009+0000 7f9aa48be640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 0x7f9a8c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.010+0000 7f9aa48be640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 0x7f9a8c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a94006fd0 tx=0x7f9a94006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:24.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.014+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9a9c03bdb0 con 0x7f9aa00fb0d0 2024-09-13T22:58:24.179 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.178+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa005dbe0 con 0x7f9a8c039580 2024-09-13T22:58:24.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.181+0000 7f9a91ffb640 1 -- 172.21.15.115:0/4147942550 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9aa005dbe0 con 0x7f9a8c039580 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 msgr2=0x7f9a8c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 0x7f9a8c03ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a94006fd0 tx=0x7f9a94006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 msgr2=0x7f9aa0066020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c02a6d0 tx=0x7f9a9c009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 shutdown_connections 2024-09-13T22:58:24.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f9a8c039580 0x7f9a8c03ba30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 --2- 172.21.15.115:0/4147942550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9aa00fb0d0 0x7f9aa0066020 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:24.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 >> 172.21.15.115:0/4147942550 conn(0x7f9aa00f6890 msgr2=0x7f9aa00f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:24.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 shutdown_connections 2024-09-13T22:58:24.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:24.183+0000 7f9aa7323640 1 -- 172.21.15.115:0/4147942550 wait complete. 2024-09-13T22:58:25.072 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2024-09-13T22:58:25.072 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:58:25.072 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2024-09-13T22:58:25.091 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:58:25.092 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:58:25.149 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2024-09-13T22:58:25.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch host add smithi152 2024-09-13T22:58:25.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:25.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:25.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:25.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:25.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:25.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:25 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:25.552 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:58:26.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:26 smithi115 ceph-mon[27601]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T22:58:27.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.068+0000 7fefed270640 1 -- 172.21.15.115:0/3175047810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 msgr2=0x7fefe80fedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.068+0000 7fefed270640 1 --2- 172.21.15.115:0/3175047810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe80fedd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009bd0 tx=0x7fefd8004d10 comp rx=0 tx=0).stop 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.068+0000 7fefed270640 1 -- 172.21.15.115:0/3175047810 shutdown_connections 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.068+0000 7fefed270640 1 --2- 172.21.15.115:0/3175047810 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe80fedd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.068+0000 7fefed270640 1 -- 172.21.15.115:0/3175047810 >> 172.21.15.115:0/3175047810 conn(0x7fefe80f6880 msgr2=0x7fefe80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 -- 172.21.15.115:0/3175047810 shutdown_connections 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 -- 172.21.15.115:0/3175047810 wait complete. 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 Processor -- start 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 -- start start 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefed270640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe810cc60 con 0x7fefe8065ee0 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:27.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefe6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36284/0 (socket says 172.21.15.115:36284) 2024-09-13T22:58:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.069+0000 7fefe6ffd640 1 -- 172.21.15.115:0/4039867999 learned_addr learned my addr 172.21.15.115:0/4039867999 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefe6ffd640 1 -- 172.21.15.115:0/4039867999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80098b0 con 0x7fefe8065ee0 2024-09-13T22:58:27.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefe6ffd640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefd8003400 tx=0x7fefd8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefd8032910 con 0x7fefe8065ee0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefd803d420 con 0x7fefe8065ee0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe810ce60 con 0x7fefe8065ee0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefd8031590 con 0x7fefe8065ee0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.070+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe810d9f0 con 0x7fefe8065ee0 2024-09-13T22:58:27.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.071+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fefd802f030 con 0x7fefe8065ee0 2024-09-13T22:58:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.071+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe81025e0 con 0x7fefe8065ee0 2024-09-13T22:58:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.071+0000 7fefdf7fe640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 0x7fefd403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.071+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fefd806d200 con 0x7fefe8065ee0 2024-09-13T22:58:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.071+0000 7fefe67fc640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 0x7fefd403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:27.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.072+0000 7fefe67fc640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 0x7fefd403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:27.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.076+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefd8044dd0 con 0x7fefe8065ee0 2024-09-13T22:58:27.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:27.237+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7fefe810dc30 con 0x7fefd40395d0 2024-09-13T22:58:28.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:27 smithi115 ceph-mon[27601]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:29.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:28 smithi115 ceph-mon[27601]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:29.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:28 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:29.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:28 smithi115 ceph-mon[27601]: Deploying cephadm binary to smithi152 2024-09-13T22:58:30.055 INFO:teuthology.orchestra.run.smithi115.stdout:Added host 'smithi152' with addr '172.21.15.152' 2024-09-13T22:58:30.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.053+0000 7fefdf7fe640 1 -- 172.21.15.115:0/4039867999 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fefe810dc30 con 0x7fefd40395d0 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 msgr2=0x7fefd403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 0x7fefd403ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefd0006fd0 tx=0x7fefd0006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 msgr2=0x7fefe810c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefd8003400 tx=0x7fefd8004d10 comp rx=0 tx=0).stop 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 shutdown_connections 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fefd40395d0 0x7fefd403ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:30.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 --2- 172.21.15.115:0/4039867999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe8065ee0 0x7fefe810c720 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 >> 172.21.15.115:0/4039867999 conn(0x7fefe80f6880 msgr2=0x7fefe80f7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 shutdown_connections 2024-09-13T22:58:30.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:30.056+0000 7fefed270640 1 -- 172.21.15.115:0/4039867999 wait complete. 2024-09-13T22:58:30.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T22:58:30.890 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:58:31.011 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:31.012 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:30 smithi115 ceph-mon[27601]: Added host smithi152 2024-09-13T22:58:33.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:32 smithi115 ceph-mon[27601]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:33.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:32 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 -- 172.21.15.115:0/3455890531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 msgr2=0x7f26f00fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 --2- 172.21.15.115:0/3455890531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f00fb6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26ec004850 tx=0x7f26ec009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 -- 172.21.15.115:0/3455890531 shutdown_connections 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 --2- 172.21.15.115:0/3455890531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f00fb6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 -- 172.21.15.115:0/3455890531 >> 172.21.15.115:0/3455890531 conn(0x7f26f00f6ac0 msgr2=0x7f26f00f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 -- 172.21.15.115:0/3455890531 shutdown_connections 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.949+0000 7f26f715a640 1 -- 172.21.15.115:0/3455890531 wait complete. 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f715a640 1 Processor -- start 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f715a640 1 -- start start 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f715a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:34.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f715a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f010ce40 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f4ef6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f4ef6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36304/0 (socket says 172.21.15.115:36304) 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.950+0000 7f26f4ef6640 1 -- 172.21.15.115:0/2318757497 learned_addr learned my addr 172.21.15.115:0/2318757497 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26f4ef6640 1 -- 172.21.15.115:0/2318757497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec005040 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26f4ef6640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009920 tx=0x7f26ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26ec033630 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26ec033c30 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f010d040 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26ec03dc40 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.951+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f010d4b0 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f26ec030020 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f005ed70 con 0x7f26f00fb2e0 2024-09-13T22:58:34.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26e57fa640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 0x7f26d803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:34.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f26ec06ca80 con 0x7f26f00fb2e0 2024-09-13T22:58:34.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26e7fff640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 0x7f26d803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:34.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.952+0000 7f26e7fff640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 0x7f26d803ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:34.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:33.957+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f26ec03bb50 con 0x7f26f00fb2e0 2024-09-13T22:58:34.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.116+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26f010d4b0 con 0x7f26d80395d0 2024-09-13T22:58:34.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.117+0000 7f26e57fa640 1 -- 172.21.15.115:0/2318757497 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f26f010d4b0 con 0x7f26d80395d0 2024-09-13T22:58:34.121 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:58:34.121 INFO:teuthology.orchestra.run.smithi115.stdout:[{"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 msgr2=0x7f26d803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 0x7f26d803ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f26e0006fd0 tx=0x7f26e0006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 msgr2=0x7f26f010c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009920 tx=0x7f26ec009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 shutdown_connections 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f26d80395d0 0x7f26d803ba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 --2- 172.21.15.115:0/2318757497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26f00fb2e0 0x7f26f010c900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.119+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 >> 172.21.15.115:0/2318757497 conn(0x7f26f00f6ac0 msgr2=0x7f26f0064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.120+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 shutdown_connections 2024-09-13T22:58:34.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:34.120+0000 7f26f715a640 1 -- 172.21.15.115:0/2318757497 wait complete. 2024-09-13T22:58:34.882 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T22:58:34.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T22:58:35.147 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:34 smithi115 ceph-mon[27601]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:35.148 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:34 smithi115 ceph-mon[27601]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:58:36.228 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:58:37.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:36 smithi115 ceph-mon[27601]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:39.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- 172.21.15.115:0/373774557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 msgr2=0x7f167c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:39.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 --2- 172.21.15.115:0/373774557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0fb6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1678004850 tx=0x7f1678009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- 172.21.15.115:0/373774557 shutdown_connections 2024-09-13T22:58:39.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 --2- 172.21.15.115:0/373774557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0fb6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- 172.21.15.115:0/373774557 >> 172.21.15.115:0/373774557 conn(0x7f167c0f6ac0 msgr2=0x7f167c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- 172.21.15.115:0/373774557 shutdown_connections 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- 172.21.15.115:0/373774557 wait complete. 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 Processor -- start 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.160+0000 7f168441f640 1 -- start start 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f168441f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f168441f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c10f660 con 0x7f167c0fb2e0 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f16821bb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f16821bb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39834/0 (socket says 172.21.15.115:39834) 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f16821bb640 1 -- 172.21.15.115:0/1701374419 learned_addr learned my addr 172.21.15.115:0/1701374419 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f16821bb640 1 -- 172.21.15.115:0/1701374419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1678005040 con 0x7f167c0fb2e0 2024-09-13T22:58:39.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f16821bb640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f167802a6d0 tx=0x7f1678009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:39.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1678033630 con 0x7f167c0fb2e0 2024-09-13T22:58:39.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1678033c30 con 0x7f167c0fb2e0 2024-09-13T22:58:39.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f167803dc00 con 0x7f167c0fb2e0 2024-09-13T22:58:39.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c10f7a0 con 0x7f167c0fb2e0 2024-09-13T22:58:39.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.161+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c10fbb0 con 0x7f167c0fb2e0 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.162+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f1678030020 con 0x7f167c0fb2e0 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.162+0000 7f1672ffd640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 0x7f166803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.162+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c05ed70 con 0x7f167c0fb2e0 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.162+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f167806ca20 con 0x7f167c0fb2e0 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.162+0000 7f16819ba640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 0x7f166803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:39.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.163+0000 7f16819ba640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 0x7f166803ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:39.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.167+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1678045800 con 0x7f167c0fb2e0 2024-09-13T22:58:39.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:38 smithi115 ceph-mon[27601]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:39.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.341+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f167c04b720 con 0x7f167c0fb2e0 2024-09-13T22:58:39.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.951+0000 7f1672ffd640 1 -- 172.21.15.115:0/1701374419 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1678045800 con 0x7f167c0fb2e0 2024-09-13T22:58:39.952 INFO:teuthology.orchestra.run.smithi115.stderr:adjusted tunables profile to default 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 msgr2=0x7f166803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 0x7f166803ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 msgr2=0x7f167c0654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f167802a6d0 tx=0x7f1678009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 shutdown_connections 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f1668039580 0x7f166803ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 --2- 172.21.15.115:0/1701374419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0fb2e0 0x7f167c0654d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:39.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 >> 172.21.15.115:0/1701374419 conn(0x7f167c0f6ac0 msgr2=0x7f167c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:39.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 shutdown_connections 2024-09-13T22:58:39.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:58:39.953+0000 7f168441f640 1 -- 172.21.15.115:0/1701374419 wait complete. 2024-09-13T22:58:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:39 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1701374419' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:58:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:39 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:39 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:39 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:39 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:40.838 INFO:tasks.cephadm:Adding mon.smithi115 on smithi115 2024-09-13T22:58:40.838 INFO:tasks.cephadm:Adding mon.smithi152 on smithi152 2024-09-13T22:58:40.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi115:172.21.15.115=smithi115;smithi152:172.21.15.152=smithi152' 2024-09-13T22:58:41.078 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:41.140 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:41.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:41.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1701374419' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:41.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:40 smithi115 ceph-mon[27601]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 -- 172.21.15.152:0/2840194902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 msgr2=0x7f14600fac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 --2- 172.21.15.152:0/2840194902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f14600fac70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f145c004850 tx=0x7f145c009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 -- 172.21.15.152:0/2840194902 shutdown_connections 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 --2- 172.21.15.152:0/2840194902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f14600fac70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 -- 172.21.15.152:0/2840194902 >> 172.21.15.152:0/2840194902 conn(0x7f14600f6040 msgr2=0x7f14600f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 -- 172.21.15.152:0/2840194902 shutdown_connections 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.646+0000 7f146820f640 1 -- 172.21.15.152:0/2840194902 wait complete. 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f146820f640 1 Processor -- start 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f146820f640 1 -- start start 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f146820f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:42.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f146820f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146010aa10 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f1465fab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f1465fab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:34476/0 (socket says 172.21.15.152:34476) 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f1465fab640 1 -- 172.21.15.152:0/3886124464 learned_addr learned my addr 172.21.15.152:0/3886124464 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f1465fab640 1 -- 172.21.15.152:0/3886124464 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c005040 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.647+0000 7f1465fab640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.648+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f145c033630 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.648+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146010ac10 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.648+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146010b080 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.648+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f145c033c30 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.648+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f145c03fbc0 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.649+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146005ed70 con 0x7f14600fa860 2024-09-13T22:58:42.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.649+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f145c030020 con 0x7f14600fa860 2024-09-13T22:58:42.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.649+0000 7f14567fc640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 0x7f144c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:42.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.649+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f145c06e5d0 con 0x7f14600fa860 2024-09-13T22:58:42.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.649+0000 7f14657aa640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 0x7f144c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:42.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.650+0000 7f14657aa640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 0x7f144c03ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1450006fd0 tx=0x7f1450006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:42.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.654+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f145c047390 con 0x7f14600fa860 2024-09-13T22:58:42.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.815+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 --> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi115:172.21.15.115=smithi115;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7f146010c190 con 0x7f144c0395d0 2024-09-13T22:58:42.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.821+0000 7f14567fc640 1 -- 172.21.15.152:0/3886124464 <== mgr.14160 v2:172.21.15.115:6800/1740627202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f146010c190 con 0x7f144c0395d0 2024-09-13T22:58:42.822 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mon update... 2024-09-13T22:58:42.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 msgr2=0x7f144c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:42.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 0x7f144c03ba80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1450006fd0 tx=0x7f1450006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 msgr2=0x7f146010a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:42.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 shutdown_connections 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f144c0395d0 0x7f144c03ba80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 --2- 172.21.15.152:0/3886124464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14600fa860 0x7f146010a4d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.822+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 >> 172.21.15.152:0/3886124464 conn(0x7f14600f6040 msgr2=0x7f14600f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.823+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 shutdown_connections 2024-09-13T22:58:42.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:42.823+0000 7f146820f640 1 -- 172.21.15.152:0/3886124464 wait complete. 2024-09-13T22:58:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:42 smithi115 ceph-mon[27601]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:42 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:42 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:43.431 DEBUG:teuthology.orchestra.run.smithi152:mon.smithi152> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service 2024-09-13T22:58:43.433 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:58:43.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:58:43.701 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:43.755 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:43 smithi115 ceph-mon[27601]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi115:172.21.15.115=smithi115;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:43 smithi115 ceph-mon[27601]: Saving service mon spec with placement smithi115:172.21.15.115=smithi115;smithi152:172.21.15.152=smithi152;count:2 2024-09-13T22:58:45.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 -- 172.21.15.152:0/3699351110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 msgr2=0x7f56900fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:45.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 --2- 172.21.15.152:0/3699351110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900fb6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5680004850 tx=0x7f5680009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 -- 172.21.15.152:0/3699351110 shutdown_connections 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 --2- 172.21.15.152:0/3699351110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900fb6f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 -- 172.21.15.152:0/3699351110 >> 172.21.15.152:0/3699351110 conn(0x7f56900f6ac0 msgr2=0x7f56900f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 -- 172.21.15.152:0/3699351110 shutdown_connections 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.113+0000 7f5697a34640 1 -- 172.21.15.152:0/3699351110 wait complete. 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f5697a34640 1 Processor -- start 2024-09-13T22:58:45.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f5697a34640 1 -- start start 2024-09-13T22:58:45.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f5697a34640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:45.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f5697a34640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569010f660 con 0x7f56900fb2e0 2024-09-13T22:58:45.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f56957d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f56957d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:34492/0 (socket says 172.21.15.152:34492) 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.114+0000 7f56957d0640 1 -- 172.21.15.152:0/680408602 learned_addr learned my addr 172.21.15.152:0/680408602 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f56957d0640 1 -- 172.21.15.152:0/680408602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680005040 con 0x7f56900fb2e0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f56957d0640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f568002a6d0 tx=0x7f5680009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5680033630 con 0x7f56900fb2e0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5680033c30 con 0x7f56900fb2e0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569010f7a0 con 0x7f56900fb2e0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f568003dc00 con 0x7f56900fb2e0 2024-09-13T22:58:45.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.115+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569010fbb0 con 0x7f56900fb2e0 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.116+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f5680030020 con 0x7f56900fb2e0 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.116+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569005ed70 con 0x7f56900fb2e0 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.117+0000 7f5685ffb640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 0x7f567c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.117+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f568006caf0 con 0x7f56900fb2e0 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.117+0000 7f5694fcf640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 0x7f567c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:45.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.117+0000 7f5694fcf640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 0x7f567c03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f568c006fd0 tx=0x7f568c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:45.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.122+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5680045800 con 0x7f56900fb2e0 2024-09-13T22:58:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:44 smithi115 ceph-mon[27601]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:45.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.336+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f569004b720 con 0x7f56900fb2e0 2024-09-13T22:58:45.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.336+0000 7f5685ffb640 1 -- 172.21.15.152:0/680408602 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f5680042210 con 0x7f56900fb2e0 2024-09-13T22:58:45.338 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:58:45.338 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:58:45.339 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 msgr2=0x7f567c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 0x7f567c03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f568c006fd0 tx=0x7f568c006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 msgr2=0x7f56900654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f568002a6d0 tx=0x7f5680009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 shutdown_connections 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f567c039580 0x7f567c03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 --2- 172.21.15.152:0/680408602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56900fb2e0 0x7f56900654d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:45.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 >> 172.21.15.152:0/680408602 conn(0x7f56900f6ac0 msgr2=0x7f56900f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:45.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 shutdown_connections 2024-09-13T22:58:45.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:45.338+0000 7f5697a34640 1 -- 172.21.15.152:0/680408602 wait complete. 2024-09-13T22:58:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:45 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/680408602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:58:46.927 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:58:46.927 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:58:47.170 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:47.220 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:47.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:46 smithi115 ceph-mon[27601]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/4211470441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 msgr2=0x7fd3d00fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/4211470441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00fb6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0004850 tx=0x7fd3c0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/4211470441 shutdown_connections 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/4211470441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00fb6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/4211470441 >> 172.21.15.152:0/4211470441 conn(0x7fd3d00f6ac0 msgr2=0x7fd3d00f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/4211470441 shutdown_connections 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.636+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/4211470441 wait complete. 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3d4dc6640 1 Processor -- start 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3d4dc6640 1 -- start start 2024-09-13T22:58:48.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3d4dc6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3d4dc6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d010d450 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3ce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3ce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:50122/0 (socket says 172.21.15.152:50122) 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3ce59c640 1 -- 172.21.15.152:0/948803583 learned_addr learned my addr 172.21.15.152:0/948803583 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.637+0000 7fd3ce59c640 1 -- 172.21.15.152:0/948803583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0005040 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3ce59c640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd3c002a6d0 tx=0x7fd3c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c0033630 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d0111a60 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d0111d90 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3c0033c30 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.638+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3c003da10 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.639+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b0005240 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.639+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fd3c0030020 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.639+0000 7fd3beffd640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 0x7fd3b803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.639+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd3c006c9a0 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.639+0000 7fd3cdd9b640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 0x7fd3b803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.640+0000 7fd3cdd9b640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 0x7fd3b803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4006fd0 tx=0x7fd3c4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:48.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.645+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd3c003bbb0 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.858+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd3b00054f0 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.859+0000 7fd3beffd640 1 -- 172.21.15.152:0/948803583 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd3c003b790 con 0x7fd3d00fb2e0 2024-09-13T22:58:48.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:58:48.861 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:58:48.861 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 msgr2=0x7fd3b803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 0x7fd3b803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4006fd0 tx=0x7fd3c4006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 msgr2=0x7fd3d00654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd3c002a6d0 tx=0x7fd3c0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 shutdown_connections 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd3b8039580 0x7fd3b803ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 --2- 172.21.15.152:0/948803583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3d00fb2e0 0x7fd3d00654d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 >> 172.21.15.152:0/948803583 conn(0x7fd3d00f6ac0 msgr2=0x7fd3d00f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:48.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 shutdown_connections 2024-09-13T22:58:48.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:48.861+0000 7fd3d4dc6640 1 -- 172.21.15.152:0/948803583 wait complete. 2024-09-13T22:58:49.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:48 smithi115 ceph-mon[27601]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:49.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:48 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/948803583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:58:50.433 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:58:50.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:58:50.675 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:50.718 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:51.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:50 smithi115 ceph-mon[27601]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:52.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.076+0000 7fcfb5188640 1 -- 172.21.15.152:0/1100967711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 msgr2=0x7fcfb00fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:52.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.076+0000 7fcfb5188640 1 --2- 172.21.15.152:0/1100967711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00fb4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0004850 tx=0x7fcfa0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.076+0000 7fcfb5188640 1 -- 172.21.15.152:0/1100967711 shutdown_connections 2024-09-13T22:58:52.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.076+0000 7fcfb5188640 1 --2- 172.21.15.152:0/1100967711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00fb4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.076+0000 7fcfb5188640 1 -- 172.21.15.152:0/1100967711 >> 172.21.15.152:0/1100967711 conn(0x7fcfb00f6880 msgr2=0x7fcfb00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 -- 172.21.15.152:0/1100967711 shutdown_connections 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 -- 172.21.15.152:0/1100967711 wait complete. 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 Processor -- start 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 -- start start 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfb5188640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00f8d30 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfaed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfaed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:50142/0 (socket says 172.21.15.152:50142) 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.077+0000 7fcfaed9d640 1 -- 172.21.15.152:0/993965589 learned_addr learned my addr 172.21.15.152:0/993965589 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfaed9d640 1 -- 172.21.15.152:0/993965589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0005040 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfaed9d640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfa002a6d0 tx=0x7fcfa0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:52.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfa0033630 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfa0033c30 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb00f6dc0 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfa003dc00 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.078+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00f7230 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.079+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fcfa0030020 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.079+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb005ed70 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.079+0000 7fcfa77fe640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 0x7fcf9c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.079+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcfa006caa0 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.079+0000 7fcfa7fff640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 0x7fcf9c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:52.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.080+0000 7fcfa7fff640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 0x7fcf9c03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf98006fd0 tx=0x7fcf98006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:52.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.084+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfa0045800 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.298 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.297+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfb004b720 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.297+0000 7fcfa77fe640 1 -- 172.21.15.152:0/993965589 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fcfa0045800 con 0x7fcfb00fb0c0 2024-09-13T22:58:52.299 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:58:52.299 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:58:52.299 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 msgr2=0x7fcf9c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 0x7fcf9c03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf98006fd0 tx=0x7fcf98006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 msgr2=0x7fcfb00f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfa002a6d0 tx=0x7fcfa0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 shutdown_connections 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fcf9c039580 0x7fcf9c03ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 --2- 172.21.15.152:0/993965589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfb00fb0c0 0x7fcfb00f87f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:52.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 >> 172.21.15.152:0/993965589 conn(0x7fcfb00f6880 msgr2=0x7fcfb0065520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 shutdown_connections 2024-09-13T22:58:52.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:52.299+0000 7fcfb5188640 1 -- 172.21.15.152:0/993965589 wait complete. 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/993965589' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.179 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:52 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:58:53.937 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:58:53.937 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:58:54.022 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:53 smithi115 ceph-mon[27601]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T22:58:54.182 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:54.225 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:54 smithi115 ceph-mon[27601]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:55.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 -- 172.21.15.152:0/735774476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 msgr2=0x7fd5540fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 --2- 172.21.15.152:0/735774476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd5540fb6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd544004850 tx=0x7fd544009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 -- 172.21.15.152:0/735774476 shutdown_connections 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 --2- 172.21.15.152:0/735774476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd5540fb6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 -- 172.21.15.152:0/735774476 >> 172.21.15.152:0/735774476 conn(0x7fd5540f6ac0 msgr2=0x7fd5540f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 -- 172.21.15.152:0/735774476 shutdown_connections 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.582+0000 7fd55a39a640 1 -- 172.21.15.152:0/735774476 wait complete. 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd55a39a640 1 Processor -- start 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd55a39a640 1 -- start start 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd55a39a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:55.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd55a39a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55410bd60 con 0x7fd5540fb2e0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd553fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd553fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:50162/0 (socket says 172.21.15.152:50162) 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.583+0000 7fd553fff640 1 -- 172.21.15.152:0/3579386905 learned_addr learned my addr 172.21.15.152:0/3579386905 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd553fff640 1 -- 172.21.15.152:0/3579386905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544005040 con 0x7fd5540fb2e0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd553fff640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd54402a6d0 tx=0x7fd544009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd544033630 con 0x7fd5540fb2e0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd544033c30 con 0x7fd5540fb2e0 2024-09-13T22:58:55.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55410bf60 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd54403dc00 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.584+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55410c3d0 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.585+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55405ed70 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.585+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7fd544030020 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.585+0000 7fd550ff9640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 0x7fd53c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.586+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd54406c8f0 con 0x7fd5540fb2e0 2024-09-13T22:58:55.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.586+0000 7fd5537fe640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 0x7fd53c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:55.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.586+0000 7fd5537fe640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 0x7fd53c03ba80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd548006fd0 tx=0x7fd548006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:55.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.594+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd544033790 con 0x7fd5540fb2e0 2024-09-13T22:58:55.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.811+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd55404b720 con 0x7fd5540fb2e0 2024-09-13T22:58:55.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.812+0000 7fd550ff9640 1 -- 172.21.15.152:0/3579386905 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd544042210 con 0x7fd5540fb2e0 2024-09-13T22:58:55.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:58:55.814 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:58:55.814 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 msgr2=0x7fd53c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 0x7fd53c03ba80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd548006fd0 tx=0x7fd548006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 msgr2=0x7fd55410b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd54402a6d0 tx=0x7fd544009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 shutdown_connections 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7fd53c0395d0 0x7fd53c03ba80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 --2- 172.21.15.152:0/3579386905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5540fb2e0 0x7fd55410b820 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 >> 172.21.15.152:0/3579386905 conn(0x7fd5540f6ac0 msgr2=0x7fd5540f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:55.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 shutdown_connections 2024-09-13T22:58:55.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:55.814+0000 7fd55a39a640 1 -- 172.21.15.152:0/3579386905 wait complete. 2024-09-13T22:58:56.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:55 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/3579386905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:58:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:56 smithi115 ceph-mon[27601]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:57.468 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:58:57.468 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:58:57.712 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:57.755 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:58:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 -- 172.21.15.152:0/895292634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 msgr2=0x7f2df00fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 --2- 172.21.15.152:0/895292634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df00fee60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2de0004850 tx=0x7f2de0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 -- 172.21.15.152:0/895292634 shutdown_connections 2024-09-13T22:58:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 --2- 172.21.15.152:0/895292634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df00fee60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 -- 172.21.15.152:0/895292634 >> 172.21.15.152:0/895292634 conn(0x7f2df00f6890 msgr2=0x7f2df00f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 -- 172.21.15.152:0/895292634 shutdown_connections 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.192+0000 7f2df7c23640 1 -- 172.21.15.152:0/895292634 wait complete. 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df7c23640 1 Processor -- start 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df7c23640 1 -- start start 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df7c23640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df7c23640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df010cc60 con 0x7f2df0066120 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df59bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.193+0000 7f2df59bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:35514/0 (socket says 172.21.15.152:35514) 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2df59bf640 1 -- 172.21.15.152:0/1848449594 learned_addr learned my addr 172.21.15.152:0/1848449594 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2df59bf640 1 -- 172.21.15.152:0/1848449594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0005040 con 0x7f2df0066120 2024-09-13T22:58:59.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2df59bf640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009920 tx=0x7f2de0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2de0033630 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df010ce60 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df010d2d0 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2de0033c30 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.194+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2de003dc10 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.195+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7f2de0030020 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.195+0000 7f2de67fc640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 0x7f2ddc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.195+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df005ed70 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.195+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2de006c900 con 0x7f2df0066120 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.196+0000 7f2df51be640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 0x7f2ddc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:59.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.196+0000 7f2df51be640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 0x7f2ddc03ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006fd0 tx=0x7f2dec006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:59.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.200+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2de009b2a0 con 0x7f2df0066120 2024-09-13T22:58:59.244 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:58 smithi115 ceph-mon[27601]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:58:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.413+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2df004b720 con 0x7f2df0066120 2024-09-13T22:58:59.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.413+0000 7f2de67fc640 1 -- 172.21.15.152:0/1848449594 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2de0045800 con 0x7f2df0066120 2024-09-13T22:58:59.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:58:59.415 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:58:59.416 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:58:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 msgr2=0x7f2ddc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 0x7f2ddc03ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006fd0 tx=0x7f2dec006db0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 msgr2=0x7f2df010c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009920 tx=0x7f2de0009da0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 shutdown_connections 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f2ddc039580 0x7f2ddc03ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 --2- 172.21.15.152:0/1848449594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2df0066120 0x7f2df010c720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 >> 172.21.15.152:0/1848449594 conn(0x7f2df00f6890 msgr2=0x7f2df00f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 shutdown_connections 2024-09-13T22:58:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:58:59.416+0000 7f2df7c23640 1 -- 172.21.15.152:0/1848449594 wait complete. 2024-09-13T22:59:00.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:58:59 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/1848449594' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:00.988 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:00.989 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:01.229 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:01.273 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:01.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:00 smithi115 ceph-mon[27601]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:02.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.637+0000 7efc9fb44640 1 -- 172.21.15.152:0/2788421543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 msgr2=0x7efc980fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:02.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.637+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2788421543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc980fc5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc94004850 tx=0x7efc94009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- 172.21.15.152:0/2788421543 shutdown_connections 2024-09-13T22:59:02.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2788421543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc980fc5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- 172.21.15.152:0/2788421543 >> 172.21.15.152:0/2788421543 conn(0x7efc980f7990 msgr2=0x7efc980f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- 172.21.15.152:0/2788421543 shutdown_connections 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- 172.21.15.152:0/2788421543 wait complete. 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 Processor -- start 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- start start 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.638+0000 7efc9fb44640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980719d0 con 0x7efc980fc1b0 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9d8e0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9d8e0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:35530/0 (socket says 172.21.15.152:35530) 2024-09-13T22:59:02.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9d8e0640 1 -- 172.21.15.152:0/2988578716 learned_addr learned my addr 172.21.15.152:0/2988578716 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9d8e0640 1 -- 172.21.15.152:0/2988578716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94005040 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9d8e0640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc94009920 tx=0x7efc94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc94033630 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9806fa60 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc94033c30 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc9403dc40 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.639+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9806fed0 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.640+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc981025d0 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.640+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) v1 ==== 45564+0+0 (secure 0 0 0) 0x7efc94030020 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.641+0000 7efc8e7fc640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 0x7efc8403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.641+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efc9406c990 con 0x7efc980fc1b0 2024-09-13T22:59:02.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.641+0000 7efc9d0df640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 0x7efc8403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:02.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.641+0000 7efc9d0df640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 0x7efc8403ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc88006fd0 tx=0x7efc88006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:02.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.646+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc94033da0 con 0x7efc980fc1b0 2024-09-13T22:59:02.861 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.860+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efc9805ed70 con 0x7efc980fc1b0 2024-09-13T22:59:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.860+0000 7efc8e7fc640 1 -- 172.21.15.152:0/2988578716 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7efc94045800 con 0x7efc980fc1b0 2024-09-13T22:59:02.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:02.862 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:02.862 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 msgr2=0x7efc8403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 0x7efc8403ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc88006fd0 tx=0x7efc88006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 msgr2=0x7efc98071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc94009920 tx=0x7efc94009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 shutdown_connections 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7efc840395d0 0x7efc8403ba80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 --2- 172.21.15.152:0/2988578716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc980fc1b0 0x7efc98071490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 >> 172.21.15.152:0/2988578716 conn(0x7efc980f7990 msgr2=0x7efc980f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 shutdown_connections 2024-09-13T22:59:02.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:02.862+0000 7efc9fb44640 1 -- 172.21.15.152:0/2988578716 wait complete. 2024-09-13T22:59:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T22:59:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/2988578716' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:02 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:04.410 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:04.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:04.653 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:04.697 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:04 smithi115 ceph-mon[27601]: from='mgr.14160 172.21.15.115:0/1668114313' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T22:59:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:04 smithi115 ceph-mon[27601]: mgrmap e14: smithi115.eqesbc(active, since 55s) 2024-09-13T22:59:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- 172.21.15.152:0/3717292040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 msgr2=0x7f86d40fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 --2- 172.21.15.152:0/3717292040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d40fc5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86c4004850 tx=0x7f86c4009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- 172.21.15.152:0/3717292040 shutdown_connections 2024-09-13T22:59:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 --2- 172.21.15.152:0/3717292040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d40fc5d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- 172.21.15.152:0/3717292040 >> 172.21.15.152:0/3717292040 conn(0x7f86d40f7980 msgr2=0x7f86d40f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- 172.21.15.152:0/3717292040 shutdown_connections 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- 172.21.15.152:0/3717292040 wait complete. 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 Processor -- start 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.093+0000 7f86d8832640 1 -- start start 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d8832640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d8832640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d410cc60 con 0x7f86d40fc1c0 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:35552/0 (socket says 172.21.15.152:35552) 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d259c640 1 -- 172.21.15.152:0/2765948402 learned_addr learned my addr 172.21.15.152:0/2765948402 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d259c640 1 -- 172.21.15.152:0/2765948402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4005040 con 0x7f86d40fc1c0 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d259c640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86c402a6d0 tx=0x7f86c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:06.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c4033630 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d410ce60 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86c4033c30 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c403dc00 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.094+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d410d2d0 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.095+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 14) v1 ==== 45578+0+0 (secure 0 0 0) 0x7f86c4030020 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.095+0000 7f86c2ffd640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 0x7f86bc03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.095+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d410d2d0 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.095+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f86c406cad0 con 0x7f86d40fc1c0 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.095+0000 7f86d1d9b640 1 -- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 msgr2=0x7f86bc03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1740627202 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.096+0000 7f86d1d9b640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 0x7f86bc03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:59:06.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.100+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86d410d2d0 con 0x7f86d40fc1c0 2024-09-13T22:59:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.297+0000 7f86d1d9b640 1 -- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 msgr2=0x7f86bc03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.115:6800/1740627202 2024-09-13T22:59:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.297+0000 7f86d1d9b640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 0x7f86bc03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:59:06.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.314+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f86d405ed70 con 0x7f86d40fc1c0 2024-09-13T22:59:06.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.315+0000 7f86c2ffd640 1 -- 172.21.15.152:0/2765948402 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f86c403b730 con 0x7f86d40fc1c0 2024-09-13T22:59:06.316 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:06.317 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 msgr2=0x7f86bc03ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:59:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 0x7f86bc03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 msgr2=0x7f86d410c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86c402a6d0 tx=0x7f86c4009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 shutdown_connections 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:6800/1740627202,v1:172.21.15.115:6801/1740627202] conn(0x7f86bc0395d0 0x7f86bc03ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 --2- 172.21.15.152:0/2765948402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86d40fc1c0 0x7f86d410c720 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 >> 172.21.15.152:0/2765948402 conn(0x7f86d40f7980 msgr2=0x7f86d40f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 shutdown_connections 2024-09-13T22:59:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:06.317+0000 7f86d8832640 1 -- 172.21.15.152:0/2765948402 wait complete. 2024-09-13T22:59:06.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:06 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/2765948402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:07.899 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:07.899 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:08.184 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:08.470 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: Active manager daemon smithi115.eqesbc restarted 2024-09-13T22:59:08.470 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: Activating manager daemon smithi115.eqesbc 2024-09-13T22:59:08.470 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:59:08.470 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: mgrmap e15: smithi115.eqesbc(active, starting, since 0.00314921s) 2024-09-13T22:59:08.470 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: Manager daemon smithi115.eqesbc is now available 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:08.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:59:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T22:59:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:09.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:09 smithi115 ceph-mon[27601]: mgrmap e16: smithi115.eqesbc(active, since 1.00532s) 2024-09-13T22:59:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 -- 172.21.15.152:0/2965458231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 msgr2=0x7f46500fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 --2- 172.21.15.152:0/2965458231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f46500fb4e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4640004850 tx=0x7f4640009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 -- 172.21.15.152:0/2965458231 shutdown_connections 2024-09-13T22:59:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 --2- 172.21.15.152:0/2965458231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f46500fb4e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 -- 172.21.15.152:0/2965458231 >> 172.21.15.152:0/2965458231 conn(0x7f46500f6890 msgr2=0x7f46500f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 -- 172.21.15.152:0/2965458231 shutdown_connections 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.658+0000 7f4655c29640 1 -- 172.21.15.152:0/2965458231 wait complete. 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f4655c29640 1 Processor -- start 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f4655c29640 1 -- start start 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f4655c29640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f4655c29640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465010bb50 con 0x7f46500fb0d0 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f464f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f464f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:49676/0 (socket says 172.21.15.152:49676) 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f464f7fe640 1 -- 172.21.15.152:0/1721060003 learned_addr learned my addr 172.21.15.152:0/1721060003 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.659+0000 7f464f7fe640 1 -- 172.21.15.152:0/1721060003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640005040 con 0x7f46500fb0d0 2024-09-13T22:59:09.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f464f7fe640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4640009920 tx=0x7f4640009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4640033630 con 0x7f46500fb0d0 2024-09-13T22:59:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4640033c30 con 0x7f46500fb0d0 2024-09-13T22:59:09.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465010bd50 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f464003dc40 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.660+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465010c1c0 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.661+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7f4640030020 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.661+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465005ed70 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.661+0000 7f464cff9640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 0x7f463c03b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.661+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f464006c830 con 0x7f46500fb0d0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.661+0000 7f4646ffd640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 0x7f463c03b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:09.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.662+0000 7f4646ffd640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 0x7f463c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4638006fd0 tx=0x7f4638006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:09.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.667+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f464003bb50 con 0x7f46500fb0d0 2024-09-13T22:59:09.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.889+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f465004b720 con 0x7f46500fb0d0 2024-09-13T22:59:09.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.889+0000 7f464cff9640 1 -- 172.21.15.152:0/1721060003 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4640042210 con 0x7f46500fb0d0 2024-09-13T22:59:09.892 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:09.892 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:09.892 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 msgr2=0x7f463c03b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 0x7f463c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4638006fd0 tx=0x7f4638006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 msgr2=0x7f465010b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4640009920 tx=0x7f4640009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 shutdown_connections 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f463c039420 0x7f463c03b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 --2- 172.21.15.152:0/1721060003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46500fb0d0 0x7f465010b610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 >> 172.21.15.152:0/1721060003 conn(0x7f46500f6890 msgr2=0x7f46500f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 shutdown_connections 2024-09-13T22:59:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:09.892+0000 7f4655c29640 1 -- 172.21.15.152:0/1721060003 wait complete. 2024-09-13T22:59:10.548 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:10 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:10.548 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:10 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/1721060003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:10.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:10 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:11.519 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:11.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: [13/Sep/2024:22:59:10] ENGINE Bus STARTING 2024-09-13T22:59:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: [13/Sep/2024:22:59:10] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T22:59:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: [13/Sep/2024:22:59:10] ENGINE Bus STARTED 2024-09-13T22:59:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: [13/Sep/2024:22:59:10] ENGINE Error in HTTPServer.serve 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T22:59:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:11.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:11 smithi115 ceph-mon[27601]: mgrmap e17: smithi115.eqesbc(active, since 2s) 2024-09-13T22:59:12.001 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:12.054 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 -- 172.21.15.152:0/1690440756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 msgr2=0x7fd6c40fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/1690440756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c40fdc20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8004850 tx=0x7fd6b8009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 -- 172.21.15.152:0/1690440756 shutdown_connections 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/1690440756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c40fdc20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 -- 172.21.15.152:0/1690440756 >> 172.21.15.152:0/1690440756 conn(0x7fd6c40f6010 msgr2=0x7fd6c40f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:13.540 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 -- 172.21.15.152:0/1690440756 shutdown_connections 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.532+0000 7fd6c91ba640 1 -- 172.21.15.152:0/1690440756 wait complete. 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.533+0000 7fd6c91ba640 1 Processor -- start 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.533+0000 7fd6c91ba640 1 -- start start 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.533+0000 7fd6c91ba640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.533+0000 7fd6c91ba640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c410cc70 con 0x7fd6c40fd810 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.533+0000 7fd6c2d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c2d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:49688/0 (socket says 172.21.15.152:49688) 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c2d9d640 1 -- 172.21.15.152:0/3417828163 learned_addr learned my addr 172.21.15.152:0/3417828163 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c2d9d640 1 -- 172.21.15.152:0/3417828163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8005040 con 0x7fd6c40fd810 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c2d9d640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6b802a6d0 tx=0x7fd6b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6b8033630 con 0x7fd6c40fd810 2024-09-13T22:59:13.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c410ce70 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6b8033c30 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6b803dc30 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.534+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c410d2e0 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.535+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fd6b8030020 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.535+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c405ed70 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.535+0000 7fd6ab7fe640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 0x7fd6ac03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.535+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd6b806cad0 con 0x7fd6c40fd810 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.535+0000 7fd6c259c640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 0x7fd6ac03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:13.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.536+0000 7fd6c259c640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 0x7fd6ac03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:13.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.540+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6b8033790 con 0x7fd6c40fd810 2024-09-13T22:59:13.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.754+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd6c404b720 con 0x7fd6c40fd810 2024-09-13T22:59:13.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.754+0000 7fd6ab7fe640 1 -- 172.21.15.152:0/3417828163 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd6b803de60 con 0x7fd6c40fd810 2024-09-13T22:59:13.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:13.756 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:13.756 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:13.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 msgr2=0x7fd6ac03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:13.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 0x7fd6ac03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 msgr2=0x7fd6c410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:13.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6b802a6d0 tx=0x7fd6b8009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 shutdown_connections 2024-09-13T22:59:13.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd6ac039670 0x7fd6ac03bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 --2- 172.21.15.152:0/3417828163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c40fd810 0x7fd6c410c730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:13.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 >> 172.21.15.152:0/3417828163 conn(0x7fd6c40f6010 msgr2=0x7fd6c40f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:13.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 shutdown_connections 2024-09-13T22:59:13.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:13.756+0000 7fd6c91ba640 1 -- 172.21.15.152:0/3417828163 wait complete. 2024-09-13T22:59:14.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:14.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:14.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:14.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:14.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:59:15.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:14 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/3417828163' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:15.373 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:15.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:15.612 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:16.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:59:16.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:59:16.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:17.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:17.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:17.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:59:17.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:59:17.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:59:17.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:59:17.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:16 smithi115 ceph-mon[27601]: Deploying daemon crash.smithi152 on smithi152 2024-09-13T22:59:17.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.931+0000 7f302df08640 1 -- 172.21.15.152:0/4164573491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 msgr2=0x7f30281025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:17.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.932+0000 7f302df08640 1 --2- 172.21.15.152:0/4164573491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f30281025b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3018004850 tx=0x7f3018009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:17.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.934+0000 7f302df08640 1 -- 172.21.15.152:0/4164573491 shutdown_connections 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.934+0000 7f302df08640 1 --2- 172.21.15.152:0/4164573491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f30281025b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.934+0000 7f302df08640 1 -- 172.21.15.152:0/4164573491 >> 172.21.15.152:0/4164573491 conn(0x7f30280f7d90 msgr2=0x7f30280fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.937+0000 7f302df08640 1 -- 172.21.15.152:0/4164573491 shutdown_connections 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.937+0000 7f302df08640 1 -- 172.21.15.152:0/4164573491 wait complete. 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.938+0000 7f302df08640 1 Processor -- start 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.939+0000 7f302df08640 1 -- start start 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.939+0000 7f302df08640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.940+0000 7f302df08640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028112cc0 con 0x7f30281021e0 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.940+0000 7f30277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.940+0000 7f30277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:49710/0 (socket says 172.21.15.152:49710) 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.940+0000 7f30277fe640 1 -- 172.21.15.152:0/3112837736 learned_addr learned my addr 172.21.15.152:0/3112837736 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.940+0000 7f30277fe640 1 -- 172.21.15.152:0/3112837736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018005040 con 0x7f30281021e0 2024-09-13T22:59:17.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f30277fe640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3018009f80 tx=0x7f3018009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3018009880 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3018033ad0 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f301803dac0 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3028112ec0 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.941+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30281131f0 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.942+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280fd950 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.943+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7f3018030020 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.943+0000 7f300ffff640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 0x7f301003bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.943+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f301806cc60 con 0x7f30281021e0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.943+0000 7f3026ffd640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 0x7f301003bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.944+0000 7f3026ffd640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 0x7f301003bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f301c006fd0 tx=0x7f301c006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:17.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:17.948+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f301803d420 con 0x7f30281021e0 2024-09-13T22:59:18.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.183+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f30281064a0 con 0x7f30281021e0 2024-09-13T22:59:18.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.183+0000 7f300ffff640 1 -- 172.21.15.152:0/3112837736 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3018045390 con 0x7f30281021e0 2024-09-13T22:59:18.184 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:18.185 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:18.185 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 msgr2=0x7f301003bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 0x7f301003bb80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f301c006fd0 tx=0x7f301c006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 msgr2=0x7f3028112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3018009f80 tx=0x7f3018009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 shutdown_connections 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f30100396d0 0x7f301003bb80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 --2- 172.21.15.152:0/3112837736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30281021e0 0x7f3028112780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 >> 172.21.15.152:0/3112837736 conn(0x7f30280f7d90 msgr2=0x7f30280f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:18.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 shutdown_connections 2024-09-13T22:59:18.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:18.186+0000 7f302df08640 1 -- 172.21.15.152:0/3112837736 wait complete. 2024-09-13T22:59:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:18 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/3112837736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:19.771 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:19.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:20.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:20 smithi115 ceph-mon[27601]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-13T22:59:22.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3567333026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 msgr2=0x7fe0ac1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:22.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3567333026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac1027d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0004850 tx=0x7fe0a0009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3567333026 shutdown_connections 2024-09-13T22:59:22.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3567333026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac1027d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3567333026 >> 172.21.15.152:0/3567333026 conn(0x7fe0ac071790 msgr2=0x7fe0ac071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3567333026 shutdown_connections 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.637+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3567333026 wait complete. 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b2ed2640 1 Processor -- start 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b2ed2640 1 -- start start 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b2ed2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b2ed2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac112ea0 con 0x7fe0ac102400 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b0c6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b0c6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:34714/0 (socket says 172.21.15.152:34714) 2024-09-13T22:59:22.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.638+0000 7fe0b0c6e640 1 -- 172.21.15.152:0/3098540307 learned_addr learned my addr 172.21.15.152:0/3098540307 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0b0c6e640 1 -- 172.21.15.152:0/3098540307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0005040 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0b0c6e640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0a002a6d0 tx=0x7fe0a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0a002cf10 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac1130a0 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe0a0033ad0 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0a003ebb0 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.639+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac113570 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.640+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fe0a0030020 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.640+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac0fdb70 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.640+0000 7fe0a97fa640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 0x7fe09c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.640+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe0a006c550 con 0x7fe0ac102400 2024-09-13T22:59:22.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.640+0000 7fe0abfff640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 0x7fe09c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:22.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.641+0000 7fe0abfff640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 0x7fe09c03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe098006fd0 tx=0x7fe098006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:22.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.645+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe0a0043210 con 0x7fe0ac102400 2024-09-13T22:59:22.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.861+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe0ac113570 con 0x7fe0ac102400 2024-09-13T22:59:22.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.862+0000 7fe0a97fa640 1 -- 172.21.15.152:0/3098540307 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe0ac113570 con 0x7fe0ac102400 2024-09-13T22:59:22.863 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:22.863 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:22.863 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:22.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 msgr2=0x7fe09c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 0x7fe09c03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe098006fd0 tx=0x7fe098006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 msgr2=0x7fe0ac112960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0a002a6d0 tx=0x7fe0a0009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 shutdown_connections 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe09c039670 0x7fe09c03bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 --2- 172.21.15.152:0/3098540307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0ac102400 0x7fe0ac112960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 >> 172.21.15.152:0/3098540307 conn(0x7fe0ac071790 msgr2=0x7fe0ac0f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 shutdown_connections 2024-09-13T22:59:22.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:22.864+0000 7fe0b2ed2640 1 -- 172.21.15.152:0/3098540307 wait complete. 2024-09-13T22:59:23.252 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:22 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/3098540307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:59:24.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:59:24.472 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:24.578 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:24.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:25.006 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:25 smithi115 ceph-mon[27601]: Deploying daemon mgr.smithi152.ntylos on smithi152 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1297020403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 msgr2=0x7fd9a81014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1297020403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a81014f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd998004850 tx=0x7fd998009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1297020403 shutdown_connections 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1297020403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a81014f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1297020403 >> 172.21.15.152:0/1297020403 conn(0x7fd9a80717c0 msgr2=0x7fd9a8071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1297020403 shutdown_connections 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1297020403 wait complete. 2024-09-13T22:59:27.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 Processor -- start 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.078+0000 7fd9b04c9640 1 -- start start 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9b04c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9b04c9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8112db0 con 0x7fd9a8101120 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9ae265640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9ae265640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.152:34734/0 (socket says 172.21.15.152:34734) 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9ae265640 1 -- 172.21.15.152:0/1949902107 learned_addr learned my addr 172.21.15.152:0/1949902107 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9ae265640 1 -- 172.21.15.152:0/1949902107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998005040 con 0x7fd9a8101120 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9ae265640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd99802a6d0 tx=0x7fd998009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd99802cf10 con 0x7fd9a8101120 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd998033ad0 con 0x7fd9a8101120 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a8112fb0 con 0x7fd9a8101120 2024-09-13T22:59:27.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd99803ebb0 con 0x7fd9a8101120 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.079+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a8113400 con 0x7fd9a8101120 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.080+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a80fc970 con 0x7fd9a8101120 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.080+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) v1 ==== 45622+0+0 (secure 0 0 0) 0x7fd998030020 con 0x7fd9a8101120 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.081+0000 7fd99effd640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 0x7fd99403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.081+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd99806c6f0 con 0x7fd9a8101120 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.081+0000 7fd9ada64640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 0x7fd99403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.081+0000 7fd9ada64640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 0x7fd99403bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4006fd0 tx=0x7fd9a4006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:27.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.085+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd99803cb10 con 0x7fd9a8101120 2024-09-13T22:59:27.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.308+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd9a804b720 con 0x7fd9a8101120 2024-09-13T22:59:27.309 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.309+0000 7fd99effd640 1 -- 172.21.15.152:0/1949902107 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd99803c330 con 0x7fd9a8101120 2024-09-13T22:59:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:27.310 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:57:05.084385Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:59:27.310 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-09-13T22:59:27.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 msgr2=0x7fd99403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 0x7fd99403bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4006fd0 tx=0x7fd9a4006db0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 msgr2=0x7fd9a8112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd99802a6d0 tx=0x7fd998009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 shutdown_connections 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd994039670 0x7fd99403bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 --2- 172.21.15.152:0/1949902107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9a8101120 0x7fd9a8112870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 >> 172.21.15.152:0/1949902107 conn(0x7fd9a80717c0 msgr2=0x7fd9a80ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 shutdown_connections 2024-09-13T22:59:27.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:27.311+0000 7fd9b04c9640 1 -- 172.21.15.152:0/1949902107 wait complete. 2024-09-13T22:59:27.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:27 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/1949902107' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:28.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:28.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: Deploying daemon mon.smithi152 on smithi152 2024-09-13T22:59:28.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:28 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:29.092 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:59:29.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:59:29.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:29 smithi115 ceph-mon[27601]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:30.549 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T22:59:31.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:31 smithi115 ceph-mon[27601]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:32.558 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:32 smithi152 systemd[1]: Started Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T22:59:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: mon.smithi115 calling monitor election 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: mon.smithi152 calling monitor election 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T22:59:37.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: fsmap 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: mgrmap e17: smithi115.eqesbc(active, since 29s) 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: overall HEALTH_OK 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos started 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: mon.smithi115 calling monitor election 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: mon.smithi152 calling monitor election 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:37.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: monmap e2: 2 mons at {smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: fsmap 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: mgrmap e17: smithi115.eqesbc(active, since 29s) 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: overall HEALTH_OK 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos started 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:37.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:38.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.637+0000 7f504dd5d640 1 -- 172.21.15.152:0/645423180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 msgr2=0x7f50300085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.637+0000 7f504dd5d640 1 --2- 172.21.15.152:0/645423180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f50300085c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50480fc2e0 tx=0x7f5038002040 comp rx=0 tx=0).stop 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 -- 172.21.15.152:0/645423180 shutdown_connections 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 --2- 172.21.15.152:0/645423180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f50300085c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 -- 172.21.15.152:0/645423180 >> 172.21.15.152:0/645423180 conn(0x7f50480711c0 msgr2=0x7f50480715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 -- 172.21.15.152:0/645423180 shutdown_connections 2024-09-13T22:59:38.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 -- 172.21.15.152:0/645423180 wait complete. 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.638+0000 7f504dd5d640 1 Processor -- start 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f504dd5d640 1 -- start start 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f504dd5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f504810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f504dd5d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f504dd5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048116a90 con 0x7f5030006160 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f504dd5d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048116bd0 con 0x7f504810ded0 2024-09-13T22:59:38.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56158/0 (socket says 172.21.15.152:56158) 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 -- 172.21.15.152:0/2882805661 learned_addr learned my addr 172.21.15.152:0/2882805661 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 -- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 msgr2=0x7f504810e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 -- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 msgr2=0x7f504810e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f50477fe640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f504810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f5046ffd640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f50477fe640 1 -- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 msgr2=0x7f504810e300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.639+0000 7f50477fe640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f50477fe640 1 -- 172.21.15.152:0/2882805661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038005040 con 0x7f5030006160 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f50477fe640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f504810d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50480fc2e0 tx=0x7f503802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5038035dc0 con 0x7f5030006160 2024-09-13T22:59:38.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f503800f040 con 0x7f5030006160 2024-09-13T22:59:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048116dd0 con 0x7f5030006160 2024-09-13T22:59:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f503803e710 con 0x7f5030006160 2024-09-13T22:59:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.640+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048117290 con 0x7f5030006160 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.641+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480fc960 con 0x7f5030006160 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.641+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f5038040470 con 0x7f5030006160 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.642+0000 7f502ffff640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 0x7f50340712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.642+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f50380af0b0 con 0x7f5030006160 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.642+0000 7f5046ffd640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 0x7f50340712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.643+0000 7f5046ffd640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 0x7f50340712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f503c006fd0 tx=0x7f503c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.646+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f503807d2b0 con 0x7f5030006160 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: mgrmap e18: smithi115.eqesbc(active, since 29s), standbys: smithi152.ntylos 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:38.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: mgrmap e18: smithi115.eqesbc(active, since 29s), standbys: smithi152.ntylos 2024-09-13T22:59:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T22:59:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T22:59:38.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.866+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f504805ed70 con 0x7f5030006160 2024-09-13T22:59:38.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.866+0000 7f502ffff640 1 -- 172.21.15.152:0/2882805661 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f5038031020 con 0x7f5030006160 2024-09-13T22:59:38.867 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T22:59:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","modified":"2024-09-13T22:59:32.394095Z","created":"2024-09-13T22:57:05.084385Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T22:59:38.868 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2024-09-13T22:59:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.868+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 msgr2=0x7f50340712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.868+0000 7f504dd5d640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 0x7f50340712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f503c006fd0 tx=0x7f503c008040 comp rx=0 tx=0).stop 2024-09-13T22:59:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.868+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 msgr2=0x7f504810d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.868+0000 7f504dd5d640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f504810d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50480fc2e0 tx=0x7f503802d040 comp rx=0 tx=0).stop 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 shutdown_connections 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f503406ee20 0x7f50340712d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f504810ded0 0x7f504810e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 --2- 172.21.15.152:0/2882805661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5030006160 0x7f504810d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 >> 172.21.15.152:0/2882805661 conn(0x7f50480711c0 msgr2=0x7f50480fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 shutdown_connections 2024-09-13T22:59:38.870 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T22:59:38.869+0000 7f504dd5d640 1 -- 172.21.15.152:0/2882805661 wait complete. 2024-09-13T22:59:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/2882805661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:39 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/2882805661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:39.929 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:39 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:39.954 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T22:59:39.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T22:59:40.205 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:59:40.568 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:59:40.569 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:40 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T22:59:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T22:59:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:59:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:59:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:40 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:41 smithi115 ceph-mon[27601]: Reconfiguring mon.smithi115 (unknown last config time)... 2024-09-13T22:59:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:41 smithi115 ceph-mon[27601]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T22:59:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:41 smithi115 ceph-mon[27601]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:41 smithi152 ceph-mon[34465]: Reconfiguring mon.smithi115 (unknown last config time)... 2024-09-13T22:59:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:41 smithi152 ceph-mon[34465]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T22:59:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:41 smithi152 ceph-mon[34465]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:43.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: Reconfiguring mgr.smithi115.eqesbc (unknown last config time)... 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: Reconfiguring daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T22:59:43.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:42 smithi115 ceph-mon[27601]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: Reconfiguring mgr.smithi115.eqesbc (unknown last config time)... 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:59:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:43.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: Reconfiguring daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T22:59:43.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:42 smithi152 ceph-mon[34465]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:43.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- 172.21.15.115:0/341334073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fcf80 msgr2=0x7f52b40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:43.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/341334073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fcf80 0x7f52b40fd3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f52a8013b80 tx=0x7f52a8009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- 172.21.15.115:0/341334073 shutdown_connections 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/341334073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fcf80 0x7f52b40fd3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/341334073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fb810 0x7f52b40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- 172.21.15.115:0/341334073 >> 172.21.15.115:0/341334073 conn(0x7f52b40723b0 msgr2=0x7f52b40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- 172.21.15.115:0/341334073 shutdown_connections 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- 172.21.15.115:0/341334073 wait complete. 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 Processor -- start 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.507+0000 7f52b8dfe640 1 -- start start 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b8dfe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 0x7f52b4111010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b8dfe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b8dfe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4111be0 con 0x7f52b40fcf80 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b8dfe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b410af90 con 0x7f52b40fb810 2024-09-13T22:59:43.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39480/0 (socket says 172.21.15.115:39480) 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 -- 172.21.15.115:0/3541747655 learned_addr learned my addr 172.21.15.115:0/3541747655 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b259c640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 0x7f52b4111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 -- 172.21.15.115:0/3541747655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 msgr2=0x7f52b4111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 0x7f52b4111010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 -- 172.21.15.115:0/3541747655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8005040 con 0x7f52b40fcf80 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b259c640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 0x7f52b4111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b1d9b640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52a800a010 tx=0x7f52a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a8012a30 con 0x7f52b40fcf80 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f52a803ae70 con 0x7f52b40fcf80 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b410b210 con 0x7f52b40fcf80 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.508+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52a8009310 con 0x7f52b40fcf80 2024-09-13T22:59:43.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.509+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b410b730 con 0x7f52b40fcf80 2024-09-13T22:59:43.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.510+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b40fcbc0 con 0x7f52b40fcf80 2024-09-13T22:59:43.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.510+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f52a8037030 con 0x7f52b40fcf80 2024-09-13T22:59:43.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.510+0000 7f52a2ffd640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 0x7f529c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:43.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.511+0000 7f52b259c640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 0x7f529c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:43.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.511+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f52a80b62c0 con 0x7f52b40fcf80 2024-09-13T22:59:43.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.511+0000 7f52b259c640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 0x7f529c071170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009a80 tx=0x7f52a4008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:43.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.515+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f52a8084540 con 0x7f52b40fcf80 2024-09-13T22:59:43.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.670+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f52b410c6b0 con 0x7f52b40fcf80 2024-09-13T22:59:43.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.670+0000 7f52a2ffd640 1 -- 172.21.15.115:0/3541747655 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7f52a8048090 con 0x7f52b40fcf80 2024-09-13T22:59:43.671 INFO:teuthology.orchestra.run.smithi115.stdout:# minimal ceph.conf for 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:59:43.672 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-09-13T22:59:43.672 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T22:59:43.672 INFO:teuthology.orchestra.run.smithi115.stdout: mon_host = [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-13T22:59:43.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 msgr2=0x7f529c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:43.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 0x7f529c071170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009a80 tx=0x7f52a4008040 comp rx=0 tx=0).stop 2024-09-13T22:59:43.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 msgr2=0x7f52b4111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52a800a010 tx=0x7f52a8009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 shutdown_connections 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f529c06ecc0 0x7f529c071170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52b40fcf80 0x7f52b4111550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 --2- 172.21.15.115:0/3541747655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52b40fb810 0x7f52b4111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 >> 172.21.15.115:0/3541747655 conn(0x7f52b40723b0 msgr2=0x7f52b40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.672+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 shutdown_connections 2024-09-13T22:59:43.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:43.673+0000 7f52b8dfe640 1 -- 172.21.15.115:0/3541747655 wait complete. 2024-09-13T22:59:43.998 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:43 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3541747655' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:43 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3541747655' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:44.651 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T22:59:44.651 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:59:44.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:59:44.678 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:59:44.678 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:59:44.743 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:59:44.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:59:44.776 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:59:44.776 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:59:44.845 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T22:59:44.845 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T22:59:44.845 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:59:44.860 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:59:44.861 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 22:59:02.127885302 +0000 2024-09-13T22:59:44.916 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 22:53:55.140653916 +0000 2024-09-13T22:59:44.917 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 22:53:55.140653916 +0000 2024-09-13T22:59:44.917 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 22:53:55.140653916 +0000 2024-09-13T22:59:44.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:59:44.980 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T22:59:44.980 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T22:59:44.980 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000218939 s, 2.3 MB/s 2024-09-13T22:59:44.981 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:59:45.037 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 22:59:02.127885302 +0000 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 22:53:55.467647640 +0000 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 22:53:55.467647640 +0000 2024-09-13T22:59:45.093 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 22:53:55.467647640 +0000 2024-09-13T22:59:45.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:59:45.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T22:59:45.155 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:45 smithi115 ceph-mon[27601]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:45.157 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T22:59:45.157 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T22:59:45.157 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000243838 s, 2.1 MB/s 2024-09-13T22:59:45.159 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:59:45.214 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-13T22:59:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:59:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:45.270 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T22:59:45.270 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:45.270 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:45.271 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 22:59:02.127885302 +0000 2024-09-13T22:59:45.271 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 22:53:55.788641479 +0000 2024-09-13T22:59:45.271 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 22:53:55.788641479 +0000 2024-09-13T22:59:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 22:53:55.788641479 +0000 2024-09-13T22:59:45.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:59:45.335 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T22:59:45.335 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T22:59:45.335 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000207645 s, 2.5 MB/s 2024-09-13T22:59:45.336 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:59:45.393 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-13 22:59:02.128885283 +0000 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 22:53:56.109635318 +0000 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 22:53:56.109635318 +0000 2024-09-13T22:59:45.449 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 22:53:56.109635318 +0000 2024-09-13T22:59:45.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T22:59:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:45 smithi152 ceph-mon[34465]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:45.513 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-13T22:59:45.513 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-13T22:59:45.513 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.00023021 s, 2.2 MB/s 2024-09-13T22:59:45.514 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:59:45.571 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T22:59:45.571 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:59:45.591 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:59:45.591 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-13 22:59:30.853476510 +0000 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-13 22:53:55.134843875 +0000 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-13 22:53:55.134843875 +0000 2024-09-13T22:59:45.650 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-13 22:53:55.134843875 +0000 2024-09-13T22:59:45.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:59:45.718 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-13T22:59:45.718 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-13T22:59:45.718 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000271935 s, 1.9 MB/s 2024-09-13T22:59:45.720 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:59:45.778 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-13 22:59:30.854476500 +0000 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-13 22:53:55.464840645 +0000 2024-09-13T22:59:45.835 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-13 22:53:55.464840645 +0000 2024-09-13T22:59:45.836 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-13 22:53:55.464840645 +0000 2024-09-13T22:59:45.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:59:45.902 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-13T22:59:45.902 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-13T22:59:45.902 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000227233 s, 2.3 MB/s 2024-09-13T22:59:45.903 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:59:45.960 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-13 22:59:30.854476500 +0000 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-13 22:53:55.791837445 +0000 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-13 22:53:55.791837445 +0000 2024-09-13T22:59:46.017 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-13 22:53:55.791837445 +0000 2024-09-13T22:59:46.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:59:46.081 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-13T22:59:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-13T22:59:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000198275 s, 2.6 MB/s 2024-09-13T22:59:46.083 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:59:46.140 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:59:46.197 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-13 22:59:30.854476500 +0000 2024-09-13T22:59:46.198 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-13 22:53:56.120834222 +0000 2024-09-13T22:59:46.198 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-13 22:53:56.120834222 +0000 2024-09-13T22:59:46.198 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-13 22:53:56.120834222 +0000 2024-09-13T22:59:46.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:59:46.262 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-13T22:59:46.262 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-13T22:59:46.262 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00017861 s, 2.9 MB/s 2024-09-13T22:59:46.264 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:59:46.321 INFO:tasks.cephadm:Deploying osd.0 on smithi115 with /dev/vg_nvme/lv_4... 2024-09-13T22:59:46.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:59:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:46 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:46 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:46 smithi152 ceph-mon[34465]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T22:59:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:46 smithi152 ceph-mon[34465]: Reconfiguring daemon alertmanager.smithi115 on smithi115 2024-09-13T22:59:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:46 smithi152 ceph-mon[34465]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:47.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:46 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:47.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:46 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:47.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:46 smithi115 ceph-mon[27601]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T22:59:47.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:46 smithi115 ceph-mon[27601]: Reconfiguring daemon alertmanager.smithi115 on smithi115 2024-09-13T22:59:47.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:46 smithi115 ceph-mon[27601]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:48.316 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:59:49.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:49 smithi115 ceph-mon[27601]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:49.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:49 smithi152 ceph-mon[34465]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:51.509 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:51 smithi115 ceph-mon[27601]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:51.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:51 smithi152 ceph-mon[34465]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:53.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:52 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:53.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:52 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:53.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:52 smithi115 ceph-mon[27601]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T22:59:53.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:52 smithi115 ceph-mon[27601]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T22:59:53.151 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T22:59:53.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-09-13T22:59:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:52 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:52 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T22:59:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:52 smithi152 ceph-mon[34465]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T22:59:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:52 smithi152 ceph-mon[34465]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T22:59:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:53 smithi115 ceph-mon[27601]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:53 smithi152 ceph-mon[34465]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:54.325 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T22:59:55.977 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:55 smithi115 ceph-mon[27601]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:55 smithi152 ceph-mon[34465]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 -- 172.21.15.115:0/2199257790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 msgr2=0x7fde400fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 --2- 172.21.15.115:0/2199257790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde400fdfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde300048d0 tx=0x7fde30009da0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 -- 172.21.15.115:0/2199257790 shutdown_connections 2024-09-13T22:59:56.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 --2- 172.21.15.115:0/2199257790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 0x7fde400fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 --2- 172.21.15.115:0/2199257790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde400fdfc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 -- 172.21.15.115:0/2199257790 >> 172.21.15.115:0/2199257790 conn(0x7fde400f63b0 msgr2=0x7fde400f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 -- 172.21.15.115:0/2199257790 shutdown_connections 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.960+0000 7fde4799d640 1 -- 172.21.15.115:0/2199257790 wait complete. 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 Processor -- start 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 -- start start 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 0x7fde4010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4010dc30 con 0x7fde400fdbb0 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde4799d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4010e450 con 0x7fde400fe500 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49570/0 (socket says 172.21.15.115:49570) 2024-09-13T22:59:56.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 -- 172.21.15.115:0/3058901938 learned_addr learned my addr 172.21.15.115:0/3058901938 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde44f38640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 0x7fde4010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 -- 172.21.15.115:0/3058901938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 msgr2=0x7fde4010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 0x7fde4010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 -- 172.21.15.115:0/3058901938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde30005040 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.961+0000 7fde45739640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde30003080 tx=0x7fde30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.962+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde30038070 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.962+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde3002abd0 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.962+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4010e680 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.962+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde3003e670 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.962+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4010ec20 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.963+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde400fa050 con 0x7fde400fdbb0 2024-09-13T22:59:56.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.963+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fde30030020 con 0x7fde400fdbb0 2024-09-13T22:59:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.964+0000 7fde35ffb640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 0x7fde2c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.964+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fde300ad370 con 0x7fde400fdbb0 2024-09-13T22:59:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.964+0000 7fde44f38640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 0x7fde2c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.969 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.964+0000 7fde44f38640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 0x7fde2c071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fde4010ce50 tx=0x7fde3c009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.970 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:56.968+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fde3007b5f0 con 0x7fde400fdbb0 2024-09-13T22:59:57.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T22:59:57.152+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fde4010efc0 con 0x7fde2c06ecc0 2024-09-13T22:59:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:57 smithi115 ceph-mon[27601]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:57 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:59:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:57 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:59:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:57 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:57 smithi152 ceph-mon[34465]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:59:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:57 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:59:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:57 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:59:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:57 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:59.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:58 smithi115 ceph-mon[27601]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:59.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:58 smithi152 ceph-mon[34465]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:59 smithi115 ceph-mon[27601]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 22:59:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:59 smithi152 ceph-mon[34465]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 22:59:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:00.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:00:00.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T23:00:00.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: overall HEALTH_OK 2024-09-13T23:00:00.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3367646839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "704a5719-c089-4a3d-a85a-1c911a4fcae6"}]: dispatch 2024-09-13T23:00:00.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3367646839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "704a5719-c089-4a3d-a85a-1c911a4fcae6"}]': finished 2024-09-13T23:00:00.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T23:00:00.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:00 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:01.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:00:01.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T23:00:01.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: overall HEALTH_OK 2024-09-13T23:00:01.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3367646839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "704a5719-c089-4a3d-a85a-1c911a4fcae6"}]: dispatch 2024-09-13T23:00:01.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3367646839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "704a5719-c089-4a3d-a85a-1c911a4fcae6"}]': finished 2024-09-13T23:00:01.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T23:00:01.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:00 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:01 smithi115 ceph-mon[27601]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:01 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2963144909' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:00:02.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:01 smithi152 ceph-mon[34465]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:02.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:01 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2963144909' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:00:04.111 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:03 smithi115 ceph-mon[27601]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:04.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:03 smithi152 ceph-mon[34465]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:06.094 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:05 smithi115 ceph-mon[27601]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:05 smithi152 ceph-mon[34465]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:08.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:07 smithi115 ceph-mon[27601]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:08.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:07 smithi152 ceph-mon[34465]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:09.019 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:09.996 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:09 smithi115 ceph-mon[27601]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:10.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:09 smithi152 ceph-mon[34465]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:11.345 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-13T23:00:11.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:11 smithi115 ceph-mon[27601]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-13T23:00:11.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:11.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:11.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-13T23:00:11.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:11 smithi152 ceph-mon[34465]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:12.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:00:12.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:12.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: Deploying daemon osd.0 on smithi115 2024-09-13T23:00:12.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: Reconfiguring mgr.smithi152.ntylos (monmap changed)... 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:12.427 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:12 smithi115 ceph-mon[27601]: Reconfiguring daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:00:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:00:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: Deploying daemon osd.0 on smithi115 2024-09-13T23:00:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: Reconfiguring mgr.smithi152.ntylos (monmap changed)... 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:12 smithi152 ceph-mon[34465]: Reconfiguring daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:13.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:13.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:13.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:13.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:13.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:13.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:13.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:14.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:14 smithi115 ceph-mon[27601]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-13T23:00:14.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:14 smithi115 ceph-mon[27601]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-13T23:00:14.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:14 smithi152 ceph-mon[34465]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-13T23:00:14.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:14 smithi152 ceph-mon[34465]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:00:15.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:15.257 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:15 smithi115 ceph-mon[27601]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:00:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi115.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi115.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T23:00:15.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi115.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T23:00:15.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:15.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:15.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:15 smithi152 ceph-mon[34465]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:16 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:16 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:16 smithi115 ceph-mon[27601]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:17.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:16 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:17.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:16 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:17.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:16 smithi152 ceph-mon[34465]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:19 smithi115 ceph-mon[27601]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:19.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:19 smithi152 ceph-mon[34465]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:20.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:20.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:21.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:21 smithi152 ceph-mon[34465]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:22.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:21 smithi115 ceph-mon[27601]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:22.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.441+0000 7fde35ffb640 1 -- 172.21.15.115:0/3058901938 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fde4010efc0 con 0x7fde2c06ecc0 2024-09-13T23:00:22.442 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 0 on host 'smithi115' 2024-09-13T23:00:22.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 msgr2=0x7fde2c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:22.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 0x7fde2c071170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fde4010ce50 tx=0x7fde3c009040 comp rx=0 tx=0).stop 2024-09-13T23:00:22.444 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 msgr2=0x7fde4010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde30003080 tx=0x7fde30009da0 comp rx=0 tx=0).stop 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 shutdown_connections 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fde2c06ecc0 0x7fde2c071170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde400fe500 0x7fde4010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 --2- 172.21.15.115:0/3058901938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde400fdbb0 0x7fde4010d0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.443+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 >> 172.21.15.115:0/3058901938 conn(0x7fde400f63b0 msgr2=0x7fde400f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.444+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 shutdown_connections 2024-09-13T23:00:22.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:22.444+0000 7fde4799d640 1 -- 172.21.15.115:0/3058901938 wait complete. 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:22 smithi115 ceph-mon[27601]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.063 DEBUG:teuthology.orchestra.run.smithi115:osd.0> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T23:00:23.067 INFO:tasks.cephadm:Deploying osd.1 on smithi115 with /dev/vg_nvme/lv_3... 2024-09-13T23:00:23.067 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T23:00:23.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:22 smithi152 ceph-mon[34465]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:00:23.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:23.887 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:00:24.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:24.050 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[46353]: 2024-09-13T23:00:23.799+0000 7fe967cd1640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T23:00:24.050 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:00:23 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[46353]: 2024-09-13T23:00:23.803+0000 7fe960b04640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:00:24.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:24.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:00:24.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T23:00:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:00:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:25.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:24 smithi115 ceph-mon[27601]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:00:25.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:24 smithi115 ceph-mon[27601]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T23:00:25.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:25.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:25.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:24 smithi152 ceph-mon[34465]: from='osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:00:25.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:24 smithi152 ceph-mon[34465]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T23:00:25.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:25.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:25.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:00:25.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:00:25.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:25.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] boot 2024-09-13T23:00:25.869 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T23:00:25.870 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:25 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: osd.0 [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] boot 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T23:00:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:25 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:26.946 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:26 smithi115 ceph-mon[27601]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T23:00:27.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:26 smithi152 ceph-mon[34465]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T23:00:27.668 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:00:27.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-09-13T23:00:28.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:27 smithi115 ceph-mon[27601]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:28.127 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:00:28.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:27 smithi152 ceph-mon[34465]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:29.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:29 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:29.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:29 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:29.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:29 smithi115 ceph-mon[27601]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:29 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:29 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:29 smithi152 ceph-mon[34465]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- 172.21.15.115:0/1408420312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 msgr2=0x7fdbdc0fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 --2- 172.21.15.115:0/1408420312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc0fa670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80048d0 tx=0x7fdbd8009da0 comp rx=0 tx=0).stop 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- 172.21.15.115:0/1408420312 shutdown_connections 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 --2- 172.21.15.115:0/1408420312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc0fa670 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 --2- 172.21.15.115:0/1408420312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 0x7fdbdc0fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- 172.21.15.115:0/1408420312 >> 172.21.15.115:0/1408420312 conn(0x7fdbdc0f63c0 msgr2=0x7fdbdc0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- 172.21.15.115:0/1408420312 shutdown_connections 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- 172.21.15.115:0/1408420312 wait complete. 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 Processor -- start 2024-09-13T23:00:31.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.052+0000 7fdbe362b640 1 -- start start 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 0x7fdbdc10d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc10e520 con 0x7fdbdc0fe510 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc10e690 con 0x7fdbdc0fdbc0 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37640/0 (socket says 172.21.15.115:37640) 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 -- 172.21.15.115:0/645768503 learned_addr learned my addr 172.21.15.115:0/645768503 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe13c7640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 0x7fdbdc10d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 -- 172.21.15.115:0/645768503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 msgr2=0x7fdbdc10d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 0x7fdbdc10d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 -- 172.21.15.115:0/645768503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8005040 con 0x7fdbdc0fe510 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe0bc6640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80094f0 tx=0x7fdbd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8038070 con 0x7fdbdc0fe510 2024-09-13T23:00:31.058 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbd802abd0 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc10e910 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbd803e670 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.053+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc10ee30 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.054+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0fa060 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.055+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7fdbd8030020 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.055+0000 7fdbd1ffb640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 0x7fdbc8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.055+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fdbd80ad5c0 con 0x7fdbdc0fe510 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.056+0000 7fdbe13c7640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 0x7fdbc8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:31.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.056+0000 7fdbe13c7640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 0x7fdbc8071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc006fd0 tx=0x7fdbcc008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:31.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.060+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdbd807b560 con 0x7fdbdc0fe510 2024-09-13T23:00:31.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:31.224+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbdc10f050 con 0x7fdbc806ecc0 2024-09-13T23:00:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:31 smithi115 ceph-mon[27601]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:00:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:00:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:31 smithi152 ceph-mon[34465]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:00:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:00:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:32.497 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:32 smithi115 ceph-mon[27601]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:32.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:32 smithi152 ceph-mon[34465]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:33.538 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:33.538 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi115 2024-09-13T23:00:33.538 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.538 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.538 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi115 to 12864M 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.539 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi115 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi115 to 12864M 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:33.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:33.717 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2398080395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8"}]: dispatch 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2398080395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8"}]': finished 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:34.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2398080395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8"}]: dispatch 2024-09-13T23:00:34.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2398080395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8"}]': finished 2024-09-13T23:00:34.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T23:00:34.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:34.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:34.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:35 smithi152 ceph-mon[34465]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:35 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2686535231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:00:35.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:35 smithi115 ceph-mon[27601]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:35.722 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:35 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2686535231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:00:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:37 smithi152 ceph-mon[34465]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:37.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:37 smithi115 ceph-mon[27601]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:38.786 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:38.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:38.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.787 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:38.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:38.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:39.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:39 smithi115 ceph-mon[27601]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:39 smithi152 ceph-mon[34465]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:41.781 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:41 smithi115 ceph-mon[27601]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:41.782 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:00:41.782 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:41 smithi152 ceph-mon[34465]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:00:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:42 smithi115 ceph-mon[27601]: Deploying daemon osd.1 on smithi115 2024-09-13T23:00:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:42 smithi152 ceph-mon[34465]: Deploying daemon osd.1 on smithi115 2024-09-13T23:00:43.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:43 smithi115 ceph-mon[27601]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:43.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:43 smithi152 ceph-mon[34465]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:45.770 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:45 smithi115 ceph-mon[27601]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:45 smithi152 ceph-mon[34465]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:47.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:47 smithi115 ceph-mon[27601]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:47.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:47.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:47.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:47 smithi152 ceph-mon[34465]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:49.714 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:49 smithi115 ceph-mon[27601]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:49 smithi152 ceph-mon[34465]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:50.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.563+0000 7fdbd1ffb640 1 -- 172.21.15.115:0/645768503 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdbdc10f050 con 0x7fdbc806ecc0 2024-09-13T23:00:50.566 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 1 on host 'smithi115' 2024-09-13T23:00:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.565+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 msgr2=0x7fdbc8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:50.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.565+0000 7fdbe362b640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 0x7fdbc8071170 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc006fd0 tx=0x7fdbcc008040 comp rx=0 tx=0).stop 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.565+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 msgr2=0x7fdbdc10d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.565+0000 7fdbe362b640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80094f0 tx=0x7fdbd8009da0 comp rx=0 tx=0).stop 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 shutdown_connections 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbc806ecc0 0x7fdbc8071170 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbdc0fe510 0x7fdbdc10d6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 --2- 172.21.15.115:0/645768503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbdc0fdbc0 0x7fdbdc10d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 >> 172.21.15.115:0/645768503 conn(0x7fdbdc0f63c0 msgr2=0x7fdbdc0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 shutdown_connections 2024-09-13T23:00:50.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:50.566+0000 7fdbe362b640 1 -- 172.21.15.115:0/645768503 wait complete. 2024-09-13T23:00:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:50 smithi115 ceph-mon[27601]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:00:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:50 smithi152 ceph-mon[34465]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:00:51.202 DEBUG:teuthology.orchestra.run.smithi115:osd.1> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T23:00:51.204 INFO:tasks.cephadm:Deploying osd.2 on smithi115 with /dev/vg_nvme/lv_2... 2024-09-13T23:00:51.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T23:00:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:00:51.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T23:00:51.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:51.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:00:51.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:51.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:51.800 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[54099]: 2024-09-13T23:00:51.559+0000 7f363d4e6640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T23:00:51.800 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:00:51 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[54099]: 2024-09-13T23:00:51.563+0000 7f3636af8640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:00:51.915 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:00:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:51.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:51 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:52.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:52 smithi115 ceph-mon[27601]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:00:52.774 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:52 smithi115 ceph-mon[27601]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T23:00:52.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:52 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:52.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:52 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:52.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:52 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:52 smithi152 ceph-mon[34465]: from='osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:00:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:52 smithi152 ceph-mon[34465]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T23:00:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:52 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:52 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:52.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:52 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:53.619 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] boot 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:53.620 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:53.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: pgmap v53: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: osd.1 [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] boot 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:55.419 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:00:55.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-09-13T23:00:55.700 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:00:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:55 smithi115 ceph-mon[27601]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:00:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:55 smithi115 ceph-mon[27601]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T23:00:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:55 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:55 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:55 smithi152 ceph-mon[34465]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:00:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:55 smithi152 ceph-mon[34465]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T23:00:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:55 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:55 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:00:57.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 -- 172.21.15.115:0/668220465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 msgr2=0x7f01d00fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:57.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 --2- 172.21.15.115:0/668220465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d00fc940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01c00048d0 tx=0x7f01c0009da0 comp rx=0 tx=0).stop 2024-09-13T23:00:57.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 -- 172.21.15.115:0/668220465 shutdown_connections 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 --2- 172.21.15.115:0/668220465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01d00fd800 0x7f01d00fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 --2- 172.21.15.115:0/668220465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d00fc940 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 -- 172.21.15.115:0/668220465 >> 172.21.15.115:0/668220465 conn(0x7f01d00f7d10 msgr2=0x7f01d00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 -- 172.21.15.115:0/668220465 shutdown_connections 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 -- 172.21.15.115:0/668220465 wait complete. 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.512+0000 7f01d4815640 1 Processor -- start 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 -- start start 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01d00fd800 0x7f01d010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d010e4c0 con 0x7f01d00fc530 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d010e630 con 0x7f01d00fd800 2024-09-13T23:00:57.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46600/0 (socket says 172.21.15.115:46600) 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 -- 172.21.15.115:0/2046964298 learned_addr learned my addr 172.21.15.115:0/2046964298 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 -- 172.21.15.115:0/2046964298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01d00fd800 msgr2=0x7f01d010d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01d00fd800 0x7f01d010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 -- 172.21.15.115:0/2046964298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0005040 con 0x7f01d00fc530 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01ce59c640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01c0003080 tx=0x7f01c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c0038070 con 0x7f01d00fc530 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d010e8b0 con 0x7f01d00fc530 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f01c0009800 con 0x7f01d00fc530 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01c0033660 con 0x7f01d00fc530 2024-09-13T23:00:57.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.513+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d010ed70 con 0x7f01d00fc530 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.515+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d00fb990 con 0x7f01d00fc530 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.515+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f01c0030020 con 0x7f01d00fc530 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.516+0000 7f01c6ffd640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 0x7f01bc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.516+0000 7f01cdd9b640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 0x7f01bc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.516+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f01c00ad620 con 0x7f01d00fc530 2024-09-13T23:00:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.516+0000 7f01cdd9b640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 0x7f01bc071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01d010cec0 tx=0x7f01b8006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.520+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f01c007b410 con 0x7f01d00fc530 2024-09-13T23:00:57.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:00:57.691+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d010f050 con 0x7f01bc06ecc0 2024-09-13T23:00:57.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:57 smithi115 ceph-mon[27601]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:00:57.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:57 smithi152 ceph-mon[34465]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:00:58.877 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:58 smithi115 ceph-mon[27601]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:58.877 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:58 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:00:58.877 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:58 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:00:58.877 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:58 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:58.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:58 smithi152 ceph-mon[34465]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:58.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:58 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:00:58.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:58 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:00:58.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:58 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:59.840 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:00:59 smithi115 ceph-mon[27601]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:00:59.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:00:59 smithi152 ceph-mon[34465]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi115 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi115 to 6432M 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:02.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:02.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:01 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:02.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi115 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi115 to 6432M 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:02.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:01 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:03.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:02 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/290737844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b70c4ec9-cdee-489f-83f9-bf0de875e472"}]: dispatch 2024-09-13T23:01:03.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:02 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/290737844' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b70c4ec9-cdee-489f-83f9-bf0de875e472"}]': finished 2024-09-13T23:01:03.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:02 smithi152 ceph-mon[34465]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T23:01:03.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:02 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:03.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:02 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/890183144' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/290737844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b70c4ec9-cdee-489f-83f9-bf0de875e472"}]: dispatch 2024-09-13T23:01:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/290737844' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b70c4ec9-cdee-489f-83f9-bf0de875e472"}]': finished 2024-09-13T23:01:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:02 smithi115 ceph-mon[27601]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T23:01:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:02 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:03.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/890183144' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:04.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:03 smithi152 ceph-mon[34465]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:04.270 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:03 smithi115 ceph-mon[27601]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:05.033 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:04 smithi115 ceph-mon[27601]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:05.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:04 smithi152 ceph-mon[34465]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:07 smithi115 ceph-mon[27601]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:07 smithi152 ceph-mon[34465]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:08.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:08.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:09.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:09 smithi115 ceph-mon[27601]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:09.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:01:09.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:09.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:09 smithi152 ceph-mon[34465]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:09.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:01:09.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:10.650 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:10 smithi115 ceph-mon[27601]: Deploying daemon osd.2 on smithi115 2024-09-13T23:01:10.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:10 smithi152 ceph-mon[34465]: Deploying daemon osd.2 on smithi115 2024-09-13T23:01:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:11 smithi152 ceph-mon[34465]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:11.767 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:11 smithi115 ceph-mon[27601]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:13.663 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:13 smithi115 ceph-mon[27601]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:13 smithi152 ceph-mon[34465]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:14.567 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:14 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:14.568 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:14 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:14.568 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:14 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:14.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:14 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:14.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:14 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:14.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:14 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:15 smithi152 ceph-mon[34465]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:15.726 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:15 smithi115 ceph-mon[27601]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:17.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:17 smithi152 ceph-mon[34465]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:17.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:17 smithi115 ceph-mon[27601]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:17.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.847+0000 7f01c6ffd640 1 -- 172.21.15.115:0/2046964298 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f01d010f050 con 0x7f01bc06ecc0 2024-09-13T23:01:17.848 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 2 on host 'smithi115' 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 msgr2=0x7f01bc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 0x7f01bc071170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01d010cec0 tx=0x7f01b8006d20 comp rx=0 tx=0).stop 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 msgr2=0x7f01d010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01c0003080 tx=0x7f01c0009da0 comp rx=0 tx=0).stop 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 shutdown_connections 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f01bc06ecc0 0x7f01bc071170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01d00fd800 0x7f01d010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:17.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 --2- 172.21.15.115:0/2046964298 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01d00fc530 0x7f01d010d110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:17.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 >> 172.21.15.115:0/2046964298 conn(0x7f01d00f7d10 msgr2=0x7f01d00f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:17.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 shutdown_connections 2024-09-13T23:01:17.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:01:17.849+0000 7f01d4815640 1 -- 172.21.15.115:0/2046964298 wait complete. 2024-09-13T23:01:18.753 DEBUG:teuthology.orchestra.run.smithi115:osd.2> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T23:01:18.756 INFO:tasks.cephadm:Deploying osd.3 on smithi152 with /dev/vg_nvme/lv_4... 2024-09-13T23:01:18.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T23:01:19.009 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:01:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:18 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:18 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:18 smithi115 ceph-mon[27601]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:01:19.123 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:18 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:19.123 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:18 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:19.123 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:18 smithi152 ceph-mon[34465]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:01:20.085 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-mon[27601]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:20.085 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-mon[27601]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:01:20.085 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-mon[27601]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T23:01:20.085 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:20.085 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-mon[27601]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:01:20.086 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[61794]: 2024-09-13T23:01:19.854+0000 7f610a13e640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T23:01:20.086 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:19 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[61794]: 2024-09-13T23:01:19.859+0000 7f6105776640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:01:20.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:19 smithi152 ceph-mon[34465]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:20.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:19 smithi152 ceph-mon[34465]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:01:20.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:19 smithi152 ceph-mon[34465]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T23:01:20.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:20.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:19 smithi152 ceph-mon[34465]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:01:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:01:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:01:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:01:20.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T23:01:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:20.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:20 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:21.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T23:01:21.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-09-13T23:01:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:01:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:01:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: from='osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-13T23:01:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T23:01:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:20 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:21.542 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:01:22.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:21 smithi115 ceph-mon[27601]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:22.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:21 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:22.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:21 smithi115 ceph-mon[27601]: osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] boot 2024-09-13T23:01:22.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:21 smithi115 ceph-mon[27601]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T23:01:22.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:21 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:22.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:21 smithi152 ceph-mon[34465]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T23:01:22.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:21 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:22.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:21 smithi152 ceph-mon[34465]: osd.2 [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] boot 2024-09-13T23:01:22.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:21 smithi152 ceph-mon[34465]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T23:01:22.202 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:21 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:01:22.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 -- 172.21.15.152:0/2659789974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 msgr2=0x7f2a300fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:22.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2659789974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a300fcb90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2a200048d0 tx=0x7f2a20009da0 comp rx=0 tx=0).stop 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 -- 172.21.15.152:0/2659789974 shutdown_connections 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2659789974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a300fcb90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2659789974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 0x7f2a300fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 -- 172.21.15.152:0/2659789974 >> 172.21.15.152:0/2659789974 conn(0x7f2a300f6c10 msgr2=0x7f2a300f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 -- 172.21.15.152:0/2659789974 shutdown_connections 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.959+0000 7f2a382c7640 1 -- 172.21.15.152:0/2659789974 wait complete. 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 Processor -- start 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 -- start start 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 0x7f2a3010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3010dc20 con 0x7f2a300fb450 2024-09-13T23:01:22.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a382c7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3010e440 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48392/0 (socket says 172.21.15.152:48392) 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 -- 172.21.15.152:0/2021446161 learned_addr learned my addr 172.21.15.152:0/2021446161 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a36063640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 0x7f2a3010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 -- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 msgr2=0x7f2a3010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 0x7f2a3010d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.960+0000 7f2a35862640 1 -- 172.21.15.152:0/2021446161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20005040 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a35862640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a200043d0 tx=0x7f2a20009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a20038070 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a20009800 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3010e670 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2003e670 con 0x7f2a300fc720 2024-09-13T23:01:22.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.961+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3010ec10 con 0x7f2a300fc720 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.962+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a300fa8b0 con 0x7f2a300fc720 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.962+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 90813+0+0 (secure 0 0 0) 0x7f2a20030020 con 0x7f2a300fc720 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.963+0000 7f2a26ffd640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 0x7f2a1c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.963+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f2a200ad9a0 con 0x7f2a300fc720 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.963+0000 7f2a36063640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 0x7f2a1c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.963+0000 7f2a36063640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 0x7f2a1c071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c004eb0 tx=0x7f2a2c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:22.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:22.967+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2a2007b510 con 0x7f2a300fc720 2024-09-13T23:01:23.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:23.129+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a30103fc0 con 0x7f2a1c06ecc0 2024-09-13T23:01:23.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:22 smithi152 ceph-mon[34465]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T23:01:23.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T23:01:23.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:22 smithi115 ceph-mon[27601]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T23:01:23.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T23:01:24.042 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: pgmap v75: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:24.043 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:24.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: pgmap v75: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:24.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:24.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:24.299 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66007]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T23:01:24.299 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66007]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:24.299 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:24.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66007]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:24.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T23:01:24.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:24.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:24.800 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66010]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:25.076 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T23:01:25.076 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:25.076 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:25.076 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:24 smithi115 sudo[66045]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:25.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.077 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:25.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:25.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:25.078 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:24 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.103 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:25.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:25.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:25.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:24 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:25.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:25.104+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2a20077a70 con 0x7f2a300fc720 2024-09-13T23:01:25.326 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66048]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T23:01:25.326 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66048]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:25.326 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:25.326 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66048]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:25.582 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66051]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T23:01:25.582 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66051]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:25.582 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:25.582 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66051]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:25.842 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T23:01:25.842 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:25.842 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:25.843 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66057]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:25.843 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66054]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T23:01:25.843 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66054]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:25.843 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:25.843 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:01:25 smithi115 sudo[66054]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:26.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 sudo[66060]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T23:01:26.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 sudo[66060]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:26.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 sudo[66060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:26.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 sudo[66060]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi115 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi115 to 4288M 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: mgrmap e19: smithi115.eqesbc(active, since 2m), standbys: smithi152.ntylos 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/126168058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]: dispatch 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]: dispatch 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]': finished 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:26.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:26 smithi115 ceph-mon[27601]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T23:01:26.593 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37852]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T23:01:26.593 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37852]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:26.593 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:26.593 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37852]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37878]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T23:01:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37878]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T23:01:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T23:01:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 sudo[37878]: pam_unix(sudo:session): session closed for user root 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi115 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi115 to 4288M 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: mgrmap e19: smithi115.eqesbc(active, since 2m), standbys: smithi152.ntylos 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/126168058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]: dispatch 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]: dispatch 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6154c01b-da26-48d6-adeb-1d6452e9706b"}]': finished 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:26 smithi152 ceph-mon[34465]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T23:01:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/3514099108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T23:01:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:27 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/3514099108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T23:01:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T23:01:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:27 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:29 smithi152 ceph-mon[34465]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:29 smithi115 ceph-mon[27601]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:31.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:31 smithi152 ceph-mon[34465]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:31 smithi115 ceph-mon[27601]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:33.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:33 smithi152 ceph-mon[34465]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:33.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:01:33.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:33.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:33 smithi152 ceph-mon[34465]: Deploying daemon osd.3 on smithi152 2024-09-13T23:01:33.505 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:33 smithi115 ceph-mon[27601]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:33.505 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:01:33.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:33.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:33 smithi115 ceph-mon[27601]: Deploying daemon osd.3 on smithi152 2024-09-13T23:01:35.435 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:35 smithi152 ceph-mon[34465]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:35 smithi115 ceph-mon[27601]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:37 smithi115 ceph-mon[27601]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:37 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:37.599 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:37 smithi152 ceph-mon[34465]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:37.600 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:37.600 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:37.600 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:37 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:38.575 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:39 smithi115 ceph-mon[27601]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:39.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:39 smithi152 ceph-mon[34465]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:40.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.439+0000 7f2a26ffd640 1 -- 172.21.15.152:0/2021446161 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2a30103fc0 con 0x7f2a1c06ecc0 2024-09-13T23:01:40.440 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 3 on host 'smithi152' 2024-09-13T23:01:40.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 msgr2=0x7f2a1c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 0x7f2a1c071170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c004eb0 tx=0x7f2a2c00b040 comp rx=0 tx=0).stop 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 msgr2=0x7f2a3010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a200043d0 tx=0x7f2a20009da0 comp rx=0 tx=0).stop 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 shutdown_connections 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2a1c06ecc0 0x7f2a1c071170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a300fc720 0x7f2a3010d5d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 --2- 172.21.15.152:0/2021446161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a300fb450 0x7f2a3010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 >> 172.21.15.152:0/2021446161 conn(0x7f2a300f6c10 msgr2=0x7f2a300660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 shutdown_connections 2024-09-13T23:01:40.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:40.441+0000 7f2a382c7640 1 -- 172.21.15.152:0/2021446161 wait complete. 2024-09-13T23:01:41.205 DEBUG:teuthology.orchestra.run.smithi152:osd.3> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T23:01:41.208 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2024-09-13T23:01:41.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T23:01:41.576 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:01:41.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:41 smithi152 ceph-mon[34465]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:41.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:41.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:41.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:41 smithi152 ceph-mon[34465]: from='osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:01:41.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:41 smithi152 ceph-mon[34465]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:01:41.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:41 smithi115 ceph-mon[27601]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:41.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:41.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:41.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:41 smithi115 ceph-mon[27601]: from='osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:01:41.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:41 smithi115 ceph-mon[27601]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:01:42.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:01:42.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T23:01:42.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:42.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:01:42.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:01:42.661 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:42.661 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:42.661 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[39824]: 2024-09-13T23:01:42.451+0000 7ff68116f640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T23:01:42.661 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:01:42 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[39824]: 2024-09-13T23:01:42.456+0000 7ff67d7a9640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:01:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:01:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T23:01:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:01:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:01:42.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:42.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:43.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:43 smithi152 ceph-mon[34465]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:43.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:43 smithi152 ceph-mon[34465]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:01:43.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:43 smithi152 ceph-mon[34465]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T23:01:43.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:43 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:43.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:43 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:43.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:43 smithi115 ceph-mon[27601]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:43.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:43 smithi115 ceph-mon[27601]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:01:43.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:43 smithi115 ceph-mon[27601]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T23:01:43.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:43 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:43.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:43 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:44.436 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] boot 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T23:01:44.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:44 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:44.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-09-13T23:01:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:01:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:01:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: osd.3 [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] boot 2024-09-13T23:01:44.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T23:01:44.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:44 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:01:45.308 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:01:45.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:45 smithi152 ceph-mon[34465]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:45.699 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:45 smithi152 ceph-mon[34465]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T23:01:45.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:45 smithi115 ceph-mon[27601]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T23:01:45.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:45 smithi115 ceph-mon[27601]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T23:01:46.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:46 smithi152 ceph-mon[34465]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T23:01:46.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:46 smithi115 ceph-mon[27601]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T23:01:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 -- 172.21.15.152:0/1440011561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fb430 msgr2=0x7f37340fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 --2- 172.21.15.152:0/1440011561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fb430 0x7f37340fb840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37240048d0 tx=0x7f3724009da0 comp rx=0 tx=0).stop 2024-09-13T23:01:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 -- 172.21.15.152:0/1440011561 shutdown_connections 2024-09-13T23:01:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 --2- 172.21.15.152:0/1440011561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fc700 0x7f37340fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:47.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 --2- 172.21.15.152:0/1440011561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fb430 0x7f37340fb840 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 -- 172.21.15.152:0/1440011561 >> 172.21.15.152:0/1440011561 conn(0x7f37340f6c10 msgr2=0x7f37340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 -- 172.21.15.152:0/1440011561 shutdown_connections 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.517+0000 7f373a99d640 1 -- 172.21.15.152:0/1440011561 wait complete. 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 Processor -- start 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 -- start start 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fb430 0x7f3734112220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734065ba0 con 0x7f37340fb430 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.518+0000 7f373a99d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734065d10 con 0x7f37340fc700 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:47.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40310/0 (socket says 172.21.15.152:40310) 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 -- 172.21.15.152:0/5942307 learned_addr learned my addr 172.21.15.152:0/5942307 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f3733fff640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fb430 0x7f3734112220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 -- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fb430 msgr2=0x7f3734112220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fb430 0x7f3734112220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 -- 172.21.15.152:0/5942307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724005040 con 0x7f37340fc700 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f37337fe640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f372800b790 tx=0x7f37280091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372800c700 con 0x7f37340fc700 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3734114cb0 con 0x7f37340fc700 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f372800cd00 con 0x7f37340fc700 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3728015e80 con 0x7f37340fc700 2024-09-13T23:01:47.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.519+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37341150f0 con 0x7f37340fc700 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.520+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340fa890 con 0x7f37340fc700 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.521+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3728012070 con 0x7f37340fc700 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.522+0000 7f3730ff9640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 0x7f371c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.522+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f372808d3f0 con 0x7f37340fc700 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.522+0000 7f3733fff640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 0x7f371c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:47.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.523+0000 7f3733fff640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 0x7f371c071200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3724007ac0 tx=0x7f3724035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:47.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.526+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f372805abb0 con 0x7f37340fc700 2024-09-13T23:01:47.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:01:47.695+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3734100b10 con 0x7f371c06ed50 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi152 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi152 to 15936M 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:47.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:01:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi152 2024-09-13T23:01:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi152 to 15936M 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:01:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:48 smithi152 ceph-mon[34465]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:48 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:01:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:48 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:01:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:48 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:49.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:48 smithi115 ceph-mon[27601]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:49.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:48 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:01:49.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:48 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:01:49.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:48 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:49.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:49 smithi152 ceph-mon[34465]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:01:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:49 smithi115 ceph-mon[27601]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:01:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/1566262190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]: dispatch 2024-09-13T23:01:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]: dispatch 2024-09-13T23:01:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]': finished 2024-09-13T23:01:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T23:01:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:01:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:50 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/4241199132' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/1566262190' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]: dispatch 2024-09-13T23:01:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]: dispatch 2024-09-13T23:01:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f97e50d-d2db-4716-9a25-89d2fb05b69a"}]': finished 2024-09-13T23:01:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T23:01:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:01:51.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:50 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/4241199132' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:01:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:51 smithi152 ceph-mon[34465]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T23:01:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:51 smithi115 ceph-mon[27601]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T23:01:53.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:53 smithi152 ceph-mon[34465]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-13T23:01:53.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:53 smithi115 ceph-mon[27601]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-13T23:01:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:55.940 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:55 smithi152 ceph-mon[34465]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T23:01:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:55 smithi115 ceph-mon[27601]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-13T23:01:57.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:57 smithi152 ceph-mon[34465]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T23:01:57.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:57 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:01:57.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:57 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:57 smithi115 ceph-mon[27601]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T23:01:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:57 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:01:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:57 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:58.869 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:58 smithi152 ceph-mon[34465]: Deploying daemon osd.4 on smithi152 2024-09-13T23:01:59.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:58 smithi115 ceph-mon[27601]: Deploying daemon osd.4 on smithi152 2024-09-13T23:01:59.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:01:59 smithi152 ceph-mon[34465]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T23:02:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:01:59 smithi115 ceph-mon[27601]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T23:02:01.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:01 smithi152 ceph-mon[34465]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:01 smithi115 ceph-mon[27601]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:02.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:02 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:02.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:02 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:02.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:02 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:03.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:02 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:03.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:02 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:03.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:02 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:04.084 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:03 smithi152 ceph-mon[34465]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:04.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:03 smithi115 ceph-mon[27601]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:05.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.104+0000 7f3730ff9640 1 -- 172.21.15.152:0/5942307 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3734100b10 con 0x7f371c06ed50 2024-09-13T23:02:05.106 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2024-09-13T23:02:05.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 msgr2=0x7f371c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 0x7f371c071200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3724007ac0 tx=0x7f3724035040 comp rx=0 tx=0).stop 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 msgr2=0x7f3734114770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f372800b790 tx=0x7f37280091d0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 shutdown_connections 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed50 0x7f371c071200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fc700 0x7f3734114770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 --2- 172.21.15.152:0/5942307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fb430 0x7f3734112220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 >> 172.21.15.152:0/5942307 conn(0x7f37340f6c10 msgr2=0x7f37340f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 shutdown_connections 2024-09-13T23:02:05.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:05.107+0000 7f373a99d640 1 -- 172.21.15.152:0/5942307 wait complete. 2024-09-13T23:02:05.810 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T23:02:05.813 INFO:tasks.cephadm:Deploying osd.5 on smithi152 with /dev/vg_nvme/lv_2... 2024-09-13T23:02:05.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T23:02:06.178 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:02:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:05 smithi152 ceph-mon[34465]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:05 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:05 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:05 smithi152 ceph-mon[34465]: from='osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:02:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:05 smithi152 ceph-mon[34465]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:02:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:05 smithi115 ceph-mon[27601]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:05 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:05 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:05 smithi115 ceph-mon[27601]: from='osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:02:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:05 smithi115 ceph-mon[27601]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:02:07.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:02:07.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T23:02:07.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:07.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: from='osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:07.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:07.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-mon[34465]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:07.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[46621]: 2024-09-13T23:02:07.113+0000 7f3660c67640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T23:02:07.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:02:07 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[46621]: 2024-09-13T23:02:07.120+0000 7f365c29f640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:02:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:02:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T23:02:07.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:07.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: from='osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:07.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:07.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:07 smithi115 ceph-mon[27601]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:08.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:02:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T23:02:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:08.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:08.616 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-13T23:02:08.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] boot 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:09.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: osd.4 [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] boot 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:02:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:09.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:02:10.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:10 smithi152 ceph-mon[34465]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T23:02:10.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:10 smithi115 ceph-mon[27601]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T23:02:11.459 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:11 smithi152 ceph-mon[34465]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:11 smithi115 ceph-mon[27601]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:12.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 -- 172.21.15.152:0/863446982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fd820 msgr2=0x7f44100fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:12.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 --2- 172.21.15.152:0/863446982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fd820 0x7f44100fdc90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f44000048d0 tx=0x7f4400009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:12.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 -- 172.21.15.152:0/863446982 shutdown_connections 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 --2- 172.21.15.152:0/863446982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fd820 0x7f44100fdc90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 --2- 172.21.15.152:0/863446982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fc550 0x7f44100fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 -- 172.21.15.152:0/863446982 >> 172.21.15.152:0/863446982 conn(0x7f44100f7d30 msgr2=0x7f44100fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 -- 172.21.15.152:0/863446982 shutdown_connections 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.240+0000 7f4417d57640 1 -- 172.21.15.152:0/863446982 wait complete. 2024-09-13T23:02:12.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 Processor -- start 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 -- start start 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 0x7f441010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441010e470 con 0x7f44100fd820 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4417d57640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441010e5e0 con 0x7f44100fc550 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4415af3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4415af3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43918/0 (socket says 172.21.15.152:43918) 2024-09-13T23:02:12.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.241+0000 7f4415af3640 1 -- 172.21.15.152:0/2741979569 learned_addr learned my addr 172.21.15.152:0/2741979569 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T23:02:12.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f44152f2640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 0x7f441010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:12.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4415af3640 1 -- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 msgr2=0x7f441010d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:12.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4415af3640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 0x7f441010d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4415af3640 1 -- 172.21.15.152:0/2741979569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400005040 con 0x7f44100fc550 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f44152f2640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 0x7f441010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4415af3640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f440c00b790 tx=0x7f440c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f440c00c700 con 0x7f44100fc550 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f440c00cd00 con 0x7f44100fc550 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441010e8c0 con 0x7f44100fc550 2024-09-13T23:02:12.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f440c015e70 con 0x7f44100fc550 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.242+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441010ede0 con 0x7f44100fc550 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.243+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44101057e0 con 0x7f44100fc550 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.244+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f440c012070 con 0x7f44100fc550 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.244+0000 7f44067fc640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 0x7f43fc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.244+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f440c08d810 con 0x7f44100fc550 2024-09-13T23:02:12.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.244+0000 7f44152f2640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 0x7f43fc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:12.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.245+0000 7f44152f2640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 0x7f43fc071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f440000b020 tx=0x7f4400009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:12.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.248+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f440c05ae20 con 0x7f44100fc550 2024-09-13T23:02:12.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:12.413+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f441010f060 con 0x7f43fc06ed60 2024-09-13T23:02:12.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi152 2024-09-13T23:02:12.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi152 to 7968M 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:12.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:12 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi152 2024-09-13T23:02:12.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi152 to 7968M 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:12.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:12 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:13 smithi152 ceph-mon[34465]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:13 smithi152 ceph-mon[34465]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:13.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:02:13.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:02:13.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:13 smithi115 ceph-mon[27601]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:13 smithi115 ceph-mon[27601]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T23:02:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T23:02:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/2520053637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]: dispatch 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]: dispatch 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]': finished 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T23:02:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:15.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:15 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/548761233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:02:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/2520053637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]: dispatch 2024-09-13T23:02:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]: dispatch 2024-09-13T23:02:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "431ed29c-72dc-444d-96b1-d29f0b4f2a9e"}]': finished 2024-09-13T23:02:15.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T23:02:15.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:15.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:15 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/548761233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T23:02:17.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:17 smithi152 ceph-mon[34465]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:17.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:17 smithi115 ceph-mon[27601]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:19.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:19 smithi152 ceph-mon[34465]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:19 smithi115 ceph-mon[27601]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:21 smithi152 ceph-mon[34465]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:21.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:21 smithi115 ceph-mon[27601]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:02:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:22 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:22 smithi152 ceph-mon[34465]: Deploying daemon osd.5 on smithi152 2024-09-13T23:02:22.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:02:22.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:22 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:22.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:22 smithi115 ceph-mon[27601]: Deploying daemon osd.5 on smithi152 2024-09-13T23:02:23.584 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:23 smithi152 ceph-mon[34465]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:23.584 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:23.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:23 smithi115 ceph-mon[27601]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:23.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:25 smithi152 ceph-mon[34465]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:25.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:25 smithi115 ceph-mon[27601]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:26 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:26 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:26 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:26 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:26 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:26 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:27 smithi152 ceph-mon[34465]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:27.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:27 smithi115 ceph-mon[27601]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:29.568 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:29 smithi152 ceph-mon[34465]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:29.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:29 smithi115 ceph-mon[27601]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:30.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.397+0000 7f44067fc640 1 -- 172.21.15.152:0/2741979569 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f441010f060 con 0x7f43fc06ed60 2024-09-13T23:02:30.398 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 5 on host 'smithi152' 2024-09-13T23:02:30.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 msgr2=0x7f43fc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:30.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 0x7f43fc071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f440000b020 tx=0x7f4400009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:30.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 msgr2=0x7f441010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:30.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f440c00b790 tx=0x7f440c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:02:30.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 shutdown_connections 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f43fc06ed60 0x7f43fc071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44100fd820 0x7f441010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 --2- 172.21.15.152:0/2741979569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44100fc550 0x7f441010d110 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.399+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 >> 172.21.15.152:0/2741979569 conn(0x7f44100f7d30 msgr2=0x7f44100f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.400+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 shutdown_connections 2024-09-13T23:02:30.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:30.400+0000 7f4417d57640 1 -- 172.21.15.152:0/2741979569 wait complete. 2024-09-13T23:02:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:30 smithi152 ceph-mon[34465]: from='osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:02:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:30 smithi152 ceph-mon[34465]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:02:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:30 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:30 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:30.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:30 smithi115 ceph-mon[27601]: from='osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:02:30.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:30 smithi115 ceph-mon[27601]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:02:30.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:30 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:30.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:30 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:31.041 DEBUG:teuthology.orchestra.run.smithi152:osd.5> sudo journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T23:02:31.043 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T23:02:31.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T23:02:31.304 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:31.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[53208]: 2024-09-13T23:02:31.466+0000 7fc0472ed640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T23:02:31.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[53208]: 2024-09-13T23:02:31.474+0000 7fc042124640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:02:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:31.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:32.770 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:32 smithi115 ceph-mon[27601]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:02:32.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:32 smithi115 ceph-mon[27601]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T23:02:32.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:32 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:32.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:32 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:32.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:32 smithi152 ceph-mon[34465]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-13T23:02:32.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:32 smithi152 ceph-mon[34465]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T23:02:32.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:32 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:32.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:32 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:33.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 -- 172.21.15.115:0/2614687692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 msgr2=0x7fc7a40fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 --2- 172.21.15.115:0/2614687692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a40fc980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7940048d0 tx=0x7fc794009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 -- 172.21.15.115:0/2614687692 shutdown_connections 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 --2- 172.21.15.115:0/2614687692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 0x7fc7a40fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 --2- 172.21.15.115:0/2614687692 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a40fc980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 -- 172.21.15.115:0/2614687692 >> 172.21.15.115:0/2614687692 conn(0x7fc7a40f7d30 msgr2=0x7fc7a40fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 -- 172.21.15.115:0/2614687692 shutdown_connections 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.095+0000 7fc7aa439640 1 -- 172.21.15.115:0/2614687692 wait complete. 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 Processor -- start 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 -- start start 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:33.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 0x7fc7a410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a410fe00 con 0x7fc7a40fc570 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.096+0000 7fc7aa439640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4110620 con 0x7fc7a40fd840 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36028/0 (socket says 172.21.15.115:36028) 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 -- 172.21.15.115:0/637601474 learned_addr learned my addr 172.21.15.115:0/637601474 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a37fe640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 0x7fc7a410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 -- 172.21.15.115:0/637601474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 msgr2=0x7fc7a410f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 0x7fc7a410f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 -- 172.21.15.115:0/637601474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc794005040 con 0x7fc7a40fc570 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a3fff640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7940043d0 tx=0x7fc794009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc794038070 con 0x7fc7a40fc570 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc79402ae90 con 0x7fc7a40fc570 2024-09-13T23:02:33.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4110850 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79403e670 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.097+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a4110df0 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.098+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a40fb9d0 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.099+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc794030020 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.099+0000 7fc7a0ff9640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 0x7fc78c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.099+0000 7fc7a37fe640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 0x7fc78c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.099+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc7940ae0b0 con 0x7fc7a40fc570 2024-09-13T23:02:33.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.100+0000 7fc7a37fe640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 0x7fc78c071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7a410f020 tx=0x7fc79800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:33.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.104+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc79407b710 con 0x7fc7a40fc570 2024-09-13T23:02:33.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.260+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc7a404b720 con 0x7fc7a40fc570 2024-09-13T23:02:33.263 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.261+0000 7fc7a0ff9640 1 -- 172.21.15.115:0/637601474 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc79407b0b0 con 0x7fc7a40fc570 2024-09-13T23:02:33.264 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 msgr2=0x7fc78c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 0x7fc78c071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7a410f020 tx=0x7fc79800b040 comp rx=0 tx=0).stop 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 msgr2=0x7fc7a410f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7940043d0 tx=0x7fc794009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 shutdown_connections 2024-09-13T23:02:33.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc78c06ed60 0x7fc78c071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7a40fd840 0x7fc7a410f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 --2- 172.21.15.115:0/637601474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7a40fc570 0x7fc7a410f270 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 >> 172.21.15.115:0/637601474 conn(0x7fc7a40f7d30 msgr2=0x7fc7a40f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 shutdown_connections 2024-09-13T23:02:33.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:33.263+0000 7fc7aa439640 1 -- 172.21.15.115:0/637601474 wait complete. 2024-09-13T23:02:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: purged_snaps scrub starts 2024-09-13T23:02:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: purged_snaps scrub ok 2024-09-13T23:02:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] boot 2024-09-13T23:02:33.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T23:02:33.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:33.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:33 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/637601474' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T23:02:33.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: purged_snaps scrub starts 2024-09-13T23:02:33.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: purged_snaps scrub ok 2024-09-13T23:02:33.809 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T23:02:33.810 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: osd.5 [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] boot 2024-09-13T23:02:33.810 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T23:02:33.810 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:02:33.810 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:33 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/637601474' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T23:02:34.058 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726268552,"num_in_osds":6,"osd_in_since":1726268534,"num_remapped_pgs":0} 2024-09-13T23:02:34.058 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T23:02:34.305 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:34.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:34.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:34 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T23:02:34.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:34.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:34 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:02:35.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:35 smithi115 ceph-mon[27601]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:35.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:35 smithi115 ceph-mon[27601]: Detected new or changed devices on smithi152 2024-09-13T23:02:35.771 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:35 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi152 to 5312M 2024-09-13T23:02:35.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:35 smithi152 ceph-mon[34465]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:35.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:35 smithi152 ceph-mon[34465]: Detected new or changed devices on smithi152 2024-09-13T23:02:35.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:35 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi152 to 5312M 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- 172.21.15.115:0/2040162158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 msgr2=0x7f832c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 --2- 172.21.15.115:0/2040162158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c0fd3d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f83200048d0 tx=0x7f8320009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- 172.21.15.115:0/2040162158 shutdown_connections 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 --2- 172.21.15.115:0/2040162158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c0fd3d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 --2- 172.21.15.115:0/2040162158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 0x7f832c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- 172.21.15.115:0/2040162158 >> 172.21.15.115:0/2040162158 conn(0x7f832c0723b0 msgr2=0x7f832c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- 172.21.15.115:0/2040162158 shutdown_connections 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- 172.21.15.115:0/2040162158 wait complete. 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 Processor -- start 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.987+0000 7f8334676640 1 -- start start 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 0x7f832c10e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:35.989 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c10ec90 con 0x7f832c0fcf80 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c10ee00 con 0x7f832c0fb810 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45046/0 (socket says 172.21.15.115:45046) 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 -- 172.21.15.115:0/841007122 learned_addr learned my addr 172.21.15.115:0/841007122 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8332412640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 0x7f832c10e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 -- 172.21.15.115:0/841007122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 msgr2=0x7f832c10e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 0x7f832c10e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 -- 172.21.15.115:0/841007122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320005040 con 0x7f832c0fcf80 2024-09-13T23:02:35.990 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8331c11640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8320000c00 tx=0x7f8320009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8320038070 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f832002ade0 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c1171c0 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f832002c7b0 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.988+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c117620 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.989+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0fcbc0 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.990+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8320030020 con 0x7f832c0fcf80 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.990+0000 7f832affd640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 0x7f8314071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.990+0000 7f8332412640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 0x7f8314071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:35.992 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.990+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f83200ae160 con 0x7f832c0fcf80 2024-09-13T23:02:35.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.991+0000 7f8332412640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 0x7f8314071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8324009af0 tx=0x7f832400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:35.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:35.994+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f832007b640 con 0x7f832c0fcf80 2024-09-13T23:02:36.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.152+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832c072ec0 con 0x7f832c0fcf80 2024-09-13T23:02:36.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.153+0000 7f832affd640 1 -- 172.21.15.115:0/841007122 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11110 (secure 0 0 0) 0x7f832007afe0 con 0x7f832c0fcf80 2024-09-13T23:02:36.285 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:02:36.285 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":39,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","created":"2024-09-13T22:57:07.913373+0000","modified":"2024-09-13T23:02:33.470879+0000","last_up_change":"2024-09-13T23:02:32.464498+0000","last_in_change":"2024-09-13T23:02:14.516687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:01:22.485564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"704a5719-c089-4a3d-a85a-1c911a4fcae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6803","nonce":559969642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6805","nonce":559969642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6809","nonce":559969642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6807","nonce":559969642}]},"public_addr":"172.21.15.115:6803/559969642","cluster_addr":"172.21.15.115:6805/559969642","heartbeat_back_addr":"172.21.15.115:6809/559969642","heartbeat_front_addr":"172.21.15.115:6807/559969642","state":["exists","up"]},{"osd":1,"uuid":"bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6811","nonce":281127096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6813","nonce":281127096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6817","nonce":281127096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6815","nonce":281127096}]},"public_addr":"172.21.15.115:6811/281127096","cluster_addr":"172.21.15.115:6813/281127096","heartbeat_back_addr":"172.21.15.115:6817/281127096","heartbeat_front_addr":"172.21.15.115:6815/281127096","state":["exists","up"]},{"osd":2,"uuid":"b70c4ec9-cdee-489f-83f9-bf0de875e472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6819","nonce":2462041936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6821","nonce":2462041936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6825","nonce":2462041936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6823","nonce":2462041936}]},"public_addr":"172.21.15.115:6819/2462041936","cluster_addr":"172.21.15.115:6821/2462041936","heartbeat_back_addr":"172.21.15.115:6825/2462041936","heartbeat_front_addr":"172.21.15.115:6823/2462041936","state":["exists","up"]},{"osd":3,"uuid":"6154c01b-da26-48d6-adeb-1d6452e9706b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6801","nonce":3291240250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6803","nonce":3291240250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6807","nonce":3291240250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6805","nonce":3291240250}]},"public_addr":"172.21.15.152:6801/3291240250","cluster_addr":"172.21.15.152:6803/3291240250","heartbeat_back_addr":"172.21.15.152:6807/3291240250","heartbeat_front_addr":"172.21.15.152:6805/3291240250","state":["exists","up"]},{"osd":4,"uuid":"0f97e50d-d2db-4716-9a25-89d2fb05b69a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6809","nonce":1086088340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6811","nonce":1086088340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6815","nonce":1086088340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6813","nonce":1086088340}]},"public_addr":"172.21.15.152:6809/1086088340","cluster_addr":"172.21.15.152:6811/1086088340","heartbeat_back_addr":"172.21.15.152:6815/1086088340","heartbeat_front_addr":"172.21.15.152:6813/1086088340","state":["exists","up"]},{"osd":5,"uuid":"431ed29c-72dc-444d-96b1-d29f0b4f2a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6817","nonce":327582524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6819","nonce":327582524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6823","nonce":327582524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6821","nonce":327582524}]},"public_addr":"172.21.15.152:6817/327582524","cluster_addr":"172.21.15.152:6819/327582524","heartbeat_back_addr":"172.21.15.152:6823/327582524","heartbeat_front_addr":"172.21.15.152:6821/327582524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:23.186337+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:51.551501+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:18.824254+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:41.917845+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:06.679620+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:31.292448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2563199978":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/2154717769":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/595553649":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/3118866913":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6801/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6800/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/2742407743":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3577026767":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/621622576":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/1038926251":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3924280677":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6800/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6801/1740627202":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6801/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6800/1740627202":"2024-09-14T22:59:08.164587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:02:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 msgr2=0x7f8314071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 0x7f8314071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8324009af0 tx=0x7f832400b040 comp rx=0 tx=0).stop 2024-09-13T23:02:36.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 msgr2=0x7f832c10e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8320000c00 tx=0x7f8320009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 shutdown_connections 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f831406ed60 0x7f8314071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f832c0fcf80 0x7f832c10e690 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 --2- 172.21.15.115:0/841007122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832c0fb810 0x7f832c10e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 >> 172.21.15.115:0/841007122 conn(0x7f832c0723b0 msgr2=0x7f832c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 shutdown_connections 2024-09-13T23:02:36.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:36.155+0000 7f8334676640 1 -- 172.21.15.115:0/841007122 wait complete. 2024-09-13T23:02:36.788 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:36 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/841007122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:36.813 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T23:01:22.485564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-13T23:02:36.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T23:02:36.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:36 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/841007122' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:37.056 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:37.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:37 smithi115 ceph-mon[27601]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:37.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:37 smithi152 ceph-mon[34465]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:38.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 -- 172.21.15.115:0/3032402277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 msgr2=0x7f9840102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 --2- 172.21.15.115:0/3032402277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840102a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f98300048d0 tx=0x7f9830009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 -- 172.21.15.115:0/3032402277 shutdown_connections 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 --2- 172.21.15.115:0/3032402277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 0x7f98400fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 --2- 172.21.15.115:0/3032402277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840102a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 -- 172.21.15.115:0/3032402277 >> 172.21.15.115:0/3032402277 conn(0x7f9840070d50 msgr2=0x7f9840071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 -- 172.21.15.115:0/3032402277 shutdown_connections 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.649+0000 7f9846472640 1 -- 172.21.15.115:0/3032402277 wait complete. 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 Processor -- start 2024-09-13T23:02:38.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 -- start start 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 0x7f9840113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840113e50 con 0x7f9840102680 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f9846472640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984010d290 con 0x7f98400facf0 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45064/0 (socket says 172.21.15.115:45064) 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.650+0000 7f983f7fe640 1 -- 172.21.15.115:0/581369846 learned_addr learned my addr 172.21.15.115:0/581369846 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983ffff640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 0x7f9840113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983f7fe640 1 -- 172.21.15.115:0/581369846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 msgr2=0x7f9840113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983f7fe640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 0x7f9840113310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983f7fe640 1 -- 172.21.15.115:0/581369846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830005040 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983f7fe640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9834002a50 tx=0x7f9834004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9834007c30 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f983400f040 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984010d570 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f983400da90 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.651+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984010da90 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.652+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98400657f0 con 0x7f9840102680 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.653+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f983400dc30 con 0x7f9840102680 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.653+0000 7f983cff9640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 0x7f9828071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.653+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f983408d620 con 0x7f9840102680 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.653+0000 7f983ffff640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 0x7f9828071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.654+0000 7f983ffff640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 0x7f9828071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9830009ac0 tx=0x7f9830035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:38.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.657+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f983404d2a0 con 0x7f9840102680 2024-09-13T23:02:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:38.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.813+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98401096a0 con 0x7f9840102680 2024-09-13T23:02:38.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.814+0000 7f983cff9640 1 -- 172.21.15.115:0/581369846 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f983405abc0 con 0x7f9840102680 2024-09-13T23:02:38.815 INFO:teuthology.orchestra.run.smithi115.stdout:pg_num: 1 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 msgr2=0x7f9828071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 0x7f9828071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9830009ac0 tx=0x7f9830035040 comp rx=0 tx=0).stop 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 msgr2=0x7f9840113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9834002a50 tx=0x7f9834004600 comp rx=0 tx=0).stop 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 shutdown_connections 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f982806ed60 0x7f9828071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9840102680 0x7f9840113850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 --2- 172.21.15.115:0/581369846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98400facf0 0x7f9840113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 >> 172.21.15.115:0/581369846 conn(0x7f9840070d50 msgr2=0x7f98400fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:38.817 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 shutdown_connections 2024-09-13T23:02:38.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:38.816+0000 7f9846472640 1 -- 172.21.15.115:0/581369846 wait complete. 2024-09-13T23:02:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:39.434 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T23:02:39.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T23:02:39.680 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:39 smithi115 ceph-mon[27601]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:39 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/581369846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T23:02:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:39 smithi152 ceph-mon[34465]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:39 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/581369846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 -- 172.21.15.115:0/2440076662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fd840 msgr2=0x7f76dc0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/2440076662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fd840 0x7f76dc0fdcb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76d00048d0 tx=0x7f76d0009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 -- 172.21.15.115:0/2440076662 shutdown_connections 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/2440076662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fd840 0x7f76dc0fdcb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/2440076662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fc570 0x7f76dc0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 -- 172.21.15.115:0/2440076662 >> 172.21.15.115:0/2440076662 conn(0x7f76dc0f7d70 msgr2=0x7f76dc0fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 -- 172.21.15.115:0/2440076662 shutdown_connections 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.286+0000 7f76e0c2c640 1 -- 172.21.15.115:0/2440076662 wait complete. 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 Processor -- start 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 -- start start 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fd840 0x7f76dc10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc10dbf0 con 0x7f76dc0fc570 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76e0c2c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc10e410 con 0x7f76dc0fd840 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:45086/0 (socket says 172.21.15.115:45086) 2024-09-13T23:02:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76da59c640 1 -- 172.21.15.115:0/3945913721 learned_addr learned my addr 172.21.15.115:0/3945913721 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76da59c640 1 -- 172.21.15.115:0/3945913721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fd840 msgr2=0x7f76dc10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76d9d9b640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fd840 0x7f76dc10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.287+0000 7f76da59c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fd840 0x7f76dc10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76da59c640 1 -- 172.21.15.115:0/3945913721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d0005040 con 0x7f76dc0fc570 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76da59c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76cc002a50 tx=0x7f76cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76cc007c30 con 0x7f76dc0fc570 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76cc00f040 con 0x7f76dc0fc570 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc10e640 con 0x7f76dc0fc570 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76cc00db50 con 0x7f76dc0fc570 2024-09-13T23:02:41.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.288+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc10ebe0 con 0x7f76dc0fc570 2024-09-13T23:02:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.289+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc0fb9d0 con 0x7f76dc0fc570 2024-09-13T23:02:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.289+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f76cc00dcb0 con 0x7f76dc0fc570 2024-09-13T23:02:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.290+0000 7f76caffd640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 0x7f76c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.290+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f76cc08dcd0 con 0x7f76dc0fc570 2024-09-13T23:02:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.290+0000 7f76d9d9b640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 0x7f76c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.290+0000 7f76d9d9b640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 0x7f76c4071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76d0000c00 tx=0x7f76d0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:41.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.294+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f76cc05b1b0 con 0x7f76dc0fc570 2024-09-13T23:02:41.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.511+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f76dc04b720 con 0x7f76dc0fc570 2024-09-13T23:02:41.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.515+0000 7f76caffd640 1 -- 172.21.15.115:0/3945913721 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f76cc05ab50 con 0x7f76dc0fc570 2024-09-13T23:02:41.516 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-09-13T23:02:41.516 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQCRxORmFqOVHhAAwqLPn5QMK8FMcXp9PbFZDw== 2024-09-13T23:02:41.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 msgr2=0x7f76c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 0x7f76c4071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76d0000c00 tx=0x7f76d0009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 msgr2=0x7f76dc10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76cc002a50 tx=0x7f76cc004600 comp rx=0 tx=0).stop 2024-09-13T23:02:41.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 shutdown_connections 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f76c406ed60 0x7f76c4071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76dc0fd840 0x7f76dc10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 --2- 172.21.15.115:0/3945913721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76dc0fc570 0x7f76dc10d060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 >> 172.21.15.115:0/3945913721 conn(0x7f76dc0f7d70 msgr2=0x7f76dc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 shutdown_connections 2024-09-13T23:02:41.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:41.517+0000 7f76e0c2c640 1 -- 172.21.15.115:0/3945913721 wait complete. 2024-09-13T23:02:41.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:41 smithi115 ceph-mon[27601]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:41 smithi152 ceph-mon[34465]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:42.124 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T23:02:42.124 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T23:02:42.124 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T23:02:42.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T23:02:42.421 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi152/config 2024-09-13T23:02:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:42 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3945913721' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:42.778 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:42 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3945913721' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T23:02:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:42 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3945913721' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:42.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:42 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3945913721' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T23:02:43.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:43 smithi115 ceph-mon[27601]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:43.802 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:43 smithi152 ceph-mon[34465]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/1747562075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d40ff720 msgr2=0x7ff7d4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/1747562075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d40ff720 0x7ff7d4101b00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80048d0 tx=0x7ff7c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/1747562075 shutdown_connections 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/1747562075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d40ff720 0x7ff7d4101b00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/1747562075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7d4066730 0x7ff7d40ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.019+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/1747562075 >> 172.21.15.152:0/1747562075 conn(0x7ff7d40f6c30 msgr2=0x7ff7d40f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/1747562075 shutdown_connections 2024-09-13T23:02:44.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/1747562075 wait complete. 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 Processor -- start 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 -- start start 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7d40ff720 0x7ff7d410d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d410e530 con 0x7ff7d40ff720 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d8cb2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d410e6a0 con 0x7ff7d4066730 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.020+0000 7ff7d259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59360/0 (socket says 172.21.15.152:59360) 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 -- 172.21.15.152:0/959836212 learned_addr learned my addr 172.21.15.152:0/959836212 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 -- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7d40ff720 msgr2=0x7ff7d410d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7d40ff720 0x7ff7d410d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 -- 172.21.15.152:0/959836212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8005040 con 0x7ff7d4066730 2024-09-13T23:02:44.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d259c640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400b580 tx=0x7ff7c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7c400f570 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d410e980 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7c400fb70 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7c4010d40 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.021+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d410eea0 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.022+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d40fa8d0 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.023+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff7c400fce0 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.023+0000 7ff7c2ffd640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 0x7ff7bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.023+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff7c408dd20 con 0x7ff7d4066730 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.024+0000 7ff7d1d9b640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 0x7ff7bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.024+0000 7ff7d1d9b640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 0x7ff7bc071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:44.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.028+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff7c405b200 con 0x7ff7d4066730 2024-09-13T23:02:44.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.245+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff7d404b720 con 0x7ff7d4066730 2024-09-13T23:02:44.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.250+0000 7ff7c2ffd640 1 -- 172.21.15.152:0/959836212 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff7c405aba0 con 0x7ff7d4066730 2024-09-13T23:02:44.251 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-09-13T23:02:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCUxORmaza+DhAA075Wv4d0RmB1HFcbObFLWg== 2024-09-13T23:02:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.252+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 msgr2=0x7ff7bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 0x7ff7bc071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 msgr2=0x7ff7d410d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400b580 tx=0x7ff7c40091a0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 shutdown_connections 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff7bc06ed60 0x7ff7bc071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7d40ff720 0x7ff7d410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 --2- 172.21.15.152:0/959836212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d4066730 0x7ff7d410d180 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 >> 172.21.15.152:0/959836212 conn(0x7ff7d40f6c30 msgr2=0x7ff7d40f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 shutdown_connections 2024-09-13T23:02:44.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:02:44.253+0000 7ff7d8cb2640 1 -- 172.21.15.152:0/959836212 wait complete. 2024-09-13T23:02:44.796 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:44 smithi152 ceph-mon[34465]: from='client.? 172.21.15.152:0/959836212' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:44.796 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:44 smithi152 ceph-mon[34465]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:44.796 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:44 smithi152 ceph-mon[34465]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T23:02:44.797 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T23:02:44.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T23:02:44.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T23:02:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:44 smithi115 ceph-mon[27601]: from='client.? 172.21.15.152:0/959836212' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:44 smithi115 ceph-mon[27601]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T23:02:44.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:44 smithi115 ceph-mon[27601]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T23:02:44.834 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T23:02:44.835 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T23:02:44.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T23:02:45.087 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:45.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:45 smithi115 ceph-mon[27601]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:45.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:45 smithi152 ceph-mon[34465]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:46.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 -- 172.21.15.115:0/1390511878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 msgr2=0x7f29bc0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 --2- 172.21.15.115:0/1390511878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc0fb0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f29b00048d0 tx=0x7f29b0009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 -- 172.21.15.115:0/1390511878 shutdown_connections 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 --2- 172.21.15.115:0/1390511878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc0fb0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 --2- 172.21.15.115:0/1390511878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 -- 172.21.15.115:0/1390511878 >> 172.21.15.115:0/1390511878 conn(0x7f29bc070ce0 msgr2=0x7f29bc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 -- 172.21.15.115:0/1390511878 shutdown_connections 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.711+0000 7f29c47e4640 1 -- 172.21.15.115:0/1390511878 wait complete. 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 Processor -- start 2024-09-13T23:02:46.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 -- start start 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc113cf0 con 0x7f29bc0fac80 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c47e4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc10d180 con 0x7f29bc102620 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c2580640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c2580640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50552/0 (socket says 172.21.15.115:50552) 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.712+0000 7f29c2580640 1 -- 172.21.15.115:0/2846263594 learned_addr learned my addr 172.21.15.115:0/2846263594 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c1d7f640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:46.715 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c2580640 1 -- 172.21.15.115:0/2846263594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 msgr2=0x7f29bc1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c2580640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c2580640 1 -- 172.21.15.115:0/2846263594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0005040 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c1d7f640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c2580640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c810 tx=0x7f29b80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b800a820 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29b800ae20 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc10d460 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b80115c0 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.713+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc10da00 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.714+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc0657b0 con 0x7f29bc0fac80 2024-09-13T23:02:46.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.714+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f29b8012840 con 0x7f29bc0fac80 2024-09-13T23:02:46.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.715+0000 7f29aeffd640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 0x7f29a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:46.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.715+0000 7f29c1d7f640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 0x7f29a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:46.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.715+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29b808e3f0 con 0x7f29bc0fac80 2024-09-13T23:02:46.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.715+0000 7f29c1d7f640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 0x7f29a8071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b020 tx=0x7f29b0009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:46.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.719+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f29b805b3d0 con 0x7f29bc0fac80 2024-09-13T23:02:46.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.915+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f29bc04b720 con 0x7f29bc0fac80 2024-09-13T23:02:46.919 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.918+0000 7f29aeffd640 1 -- 172.21.15.115:0/2846263594 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176721 (secure 0 0 0) 0x7f29b805b1f0 con 0x7f29bc0fac80 2024-09-13T23:02:46.921 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 msgr2=0x7f29a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 0x7f29a8071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29b000b020 tx=0x7f29b0009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 msgr2=0x7f29bc1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c810 tx=0x7f29b80043c0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 shutdown_connections 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f29a806ed60 0x7f29a8071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc102620 0x7f29bc1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 --2- 172.21.15.115:0/2846263594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29bc0fac80 0x7f29bc1131b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:46.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.920+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 >> 172.21.15.115:0/2846263594 conn(0x7f29bc070ce0 msgr2=0x7f29bc100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:46.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.921+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 shutdown_connections 2024-09-13T23:02:46.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:46.921+0000 7f29c47e4640 1 -- 172.21.15.115:0/2846263594 wait complete. 2024-09-13T23:02:47.530 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi115.eqesbc","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":3265730915},{"type":"v1","addr":"172.21.15.115:6801","nonce":3265730915}]},"active_addr":"172.21.15.115:6801/3265730915","active_change":"2024-09-13T22:59:08.164702+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi152.ntylos","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.115:8443/","prometheus":"http://172.21.15.115:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":212356059}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":2231349841}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":4160355678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1192149054}]}]} 2024-09-13T23:02:47.536 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T23:02:47.536 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T23:02:47.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T23:02:47.780 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:47.792 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:47 smithi152 ceph-mon[34465]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:47.793 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:47 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2846263594' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T23:02:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:47 smithi115 ceph-mon[27601]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:47 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2846263594' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 -- 172.21.15.115:0/3452314501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db0070360 msgr2=0x7f7db01088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 --2- 172.21.15.115:0/3452314501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db0070360 0x7f7db01088d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7da40048d0 tx=0x7f7da4009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 -- 172.21.15.115:0/3452314501 shutdown_connections 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 --2- 172.21.15.115:0/3452314501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db0070360 0x7f7db01088d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 --2- 172.21.15.115:0/3452314501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db006fa50 0x7f7db006fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.416 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 -- 172.21.15.115:0/3452314501 >> 172.21.15.115:0/3452314501 conn(0x7f7db00f80f0 msgr2=0x7f7db00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 -- 172.21.15.115:0/3452314501 shutdown_connections 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.408+0000 7f7db68b5640 1 -- 172.21.15.115:0/3452314501 wait complete. 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 Processor -- start 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 -- start start 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db0070360 0x7f7db0115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0115f20 con 0x7f7db006fa50 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7db68b5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0116090 con 0x7f7db0070360 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7daffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7daffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50558/0 (socket says 172.21.15.115:50558) 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7daffff640 1 -- 172.21.15.115:0/624138509 learned_addr learned my addr 172.21.15.115:0/624138509 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7daffff640 1 -- 172.21.15.115:0/624138509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db0070360 msgr2=0x7f7db0115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:49.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.409+0000 7f7daffff640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db0070360 0x7f7db0115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7daffff640 1 -- 172.21.15.115:0/624138509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4005040 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7daffff640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7da0002a50 tx=0x7f7da0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da0007c30 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db010f510 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7da000f040 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da000da90 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.410+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db010fa30 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.411+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db0071190 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.411+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7da000dd00 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.412+0000 7f7dacff9640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 0x7f7d98071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.412+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7da008d760 con 0x7f7db006fa50 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.412+0000 7f7daf7fe640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 0x7f7d98071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:49.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.412+0000 7f7daf7fe640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 0x7f7d98071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7da40043d0 tx=0x7f7da4009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:49.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.416+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7da004d2a0 con 0x7f7db006fa50 2024-09-13T23:02:49.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.573+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db004b720 con 0x7f7db006fa50 2024-09-13T23:02:49.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.574+0000 7f7dacff9640 1 -- 172.21.15.115:0/624138509 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11110 (secure 0 0 0) 0x7f7da005ab60 con 0x7f7db006fa50 2024-09-13T23:02:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:02:49.575 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":39,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","created":"2024-09-13T22:57:07.913373+0000","modified":"2024-09-13T23:02:33.470879+0000","last_up_change":"2024-09-13T23:02:32.464498+0000","last_in_change":"2024-09-13T23:02:14.516687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:01:22.485564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"704a5719-c089-4a3d-a85a-1c911a4fcae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6803","nonce":559969642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6805","nonce":559969642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6809","nonce":559969642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6807","nonce":559969642}]},"public_addr":"172.21.15.115:6803/559969642","cluster_addr":"172.21.15.115:6805/559969642","heartbeat_back_addr":"172.21.15.115:6809/559969642","heartbeat_front_addr":"172.21.15.115:6807/559969642","state":["exists","up"]},{"osd":1,"uuid":"bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6811","nonce":281127096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6813","nonce":281127096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6817","nonce":281127096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6815","nonce":281127096}]},"public_addr":"172.21.15.115:6811/281127096","cluster_addr":"172.21.15.115:6813/281127096","heartbeat_back_addr":"172.21.15.115:6817/281127096","heartbeat_front_addr":"172.21.15.115:6815/281127096","state":["exists","up"]},{"osd":2,"uuid":"b70c4ec9-cdee-489f-83f9-bf0de875e472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6819","nonce":2462041936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6821","nonce":2462041936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6825","nonce":2462041936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6823","nonce":2462041936}]},"public_addr":"172.21.15.115:6819/2462041936","cluster_addr":"172.21.15.115:6821/2462041936","heartbeat_back_addr":"172.21.15.115:6825/2462041936","heartbeat_front_addr":"172.21.15.115:6823/2462041936","state":["exists","up"]},{"osd":3,"uuid":"6154c01b-da26-48d6-adeb-1d6452e9706b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6801","nonce":3291240250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6803","nonce":3291240250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6807","nonce":3291240250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6805","nonce":3291240250}]},"public_addr":"172.21.15.152:6801/3291240250","cluster_addr":"172.21.15.152:6803/3291240250","heartbeat_back_addr":"172.21.15.152:6807/3291240250","heartbeat_front_addr":"172.21.15.152:6805/3291240250","state":["exists","up"]},{"osd":4,"uuid":"0f97e50d-d2db-4716-9a25-89d2fb05b69a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6809","nonce":1086088340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6811","nonce":1086088340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6815","nonce":1086088340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6813","nonce":1086088340}]},"public_addr":"172.21.15.152:6809/1086088340","cluster_addr":"172.21.15.152:6811/1086088340","heartbeat_back_addr":"172.21.15.152:6815/1086088340","heartbeat_front_addr":"172.21.15.152:6813/1086088340","state":["exists","up"]},{"osd":5,"uuid":"431ed29c-72dc-444d-96b1-d29f0b4f2a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6817","nonce":327582524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6819","nonce":327582524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6823","nonce":327582524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6821","nonce":327582524}]},"public_addr":"172.21.15.152:6817/327582524","cluster_addr":"172.21.15.152:6819/327582524","heartbeat_back_addr":"172.21.15.152:6823/327582524","heartbeat_front_addr":"172.21.15.152:6821/327582524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:23.186337+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:51.551501+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:18.824254+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:41.917845+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:06.679620+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:31.292448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2563199978":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/2154717769":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/595553649":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/3118866913":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6801/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6800/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/2742407743":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3577026767":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/621622576":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/1038926251":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3924280677":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6800/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6801/1740627202":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6801/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6800/1740627202":"2024-09-14T22:59:08.164587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 msgr2=0x7f7d98071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 0x7f7d98071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7da40043d0 tx=0x7f7da4009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 msgr2=0x7f7db01153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7da0002a50 tx=0x7f7da0004600 comp rx=0 tx=0).stop 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 shutdown_connections 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7d9806ed60 0x7f7d98071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7db0070360 0x7f7db0115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 --2- 172.21.15.115:0/624138509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db006fa50 0x7f7db01153e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 >> 172.21.15.115:0/624138509 conn(0x7f7db00f80f0 msgr2=0x7f7db00f9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:49.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 shutdown_connections 2024-09-13T23:02:49.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:49.576+0000 7f7db68b5640 1 -- 172.21.15.115:0/624138509 wait complete. 2024-09-13T23:02:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:49 smithi115 ceph-mon[27601]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:49 smithi152 ceph-mon[34465]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:50.217 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T23:02:50.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T23:02:50.464 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:50 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/624138509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:50 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/624138509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:51 smithi115 ceph-mon[27601]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:51 smithi152 ceph-mon[34465]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:52.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4090848736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 msgr2=0x7f11e40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:52.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4090848736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e40fc5b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0048d0 tx=0x7f11cc009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4090848736 shutdown_connections 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4090848736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e40fc5b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4090848736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4090848736 >> 172.21.15.115:0/4090848736 conn(0x7f11e40f80f0 msgr2=0x7f11e40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4090848736 shutdown_connections 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.165+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4090848736 wait complete. 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 Processor -- start 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 -- start start 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4070490 con 0x7f11e4102ef0 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11ea3f7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4070600 con 0x7f11e4102550 2024-09-13T23:02:52.175 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50582/0 (socket says 172.21.15.115:50582) 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 -- 172.21.15.115:0/4138602938 learned_addr learned my addr 172.21.15.115:0/4138602938 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11e3fff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 -- 172.21.15.115:0/4138602938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 msgr2=0x7f11e406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 -- 172.21.15.115:0/4138602938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc005040 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11e3fff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.166+0000 7f11dbfff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11cc003080 tx=0x7f11cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.167+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc038070 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.167+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f11cc009760 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.167+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e4070830 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.167+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc033420 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.167+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4119b20 con 0x7f11e4102ef0 2024-09-13T23:02:52.176 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.168+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e40fdcd0 con 0x7f11e4102ef0 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.168+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f11cc030020 con 0x7f11e4102ef0 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.169+0000 7f11e17fa640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 0x7f11d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.169+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f11cc0adba0 con 0x7f11e4102ef0 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.169+0000 7f11e3fff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 0x7f11d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.169+0000 7f11e3fff640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 0x7f11d0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11d40041d0 tx=0x7f11d4009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:52.177 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.173+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f11cc07b000 con 0x7f11e4102ef0 2024-09-13T23:02:52.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.327+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11e40fbd50 con 0x7f11e4102ef0 2024-09-13T23:02:52.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.328+0000 7f11e17fa640 1 -- 172.21.15.115:0/4138602938 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11110 (secure 0 0 0) 0x7f11cc07a9a0 con 0x7f11e4102ef0 2024-09-13T23:02:52.329 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:02:52.329 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":39,"fsid":"62d5ccce-7223-11ef-bceb-c7b262605968","created":"2024-09-13T22:57:07.913373+0000","modified":"2024-09-13T23:02:33.470879+0000","last_up_change":"2024-09-13T23:02:32.464498+0000","last_in_change":"2024-09-13T23:02:14.516687+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:01:22.485564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"704a5719-c089-4a3d-a85a-1c911a4fcae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6803","nonce":559969642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6805","nonce":559969642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6809","nonce":559969642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":559969642},{"type":"v1","addr":"172.21.15.115:6807","nonce":559969642}]},"public_addr":"172.21.15.115:6803/559969642","cluster_addr":"172.21.15.115:6805/559969642","heartbeat_back_addr":"172.21.15.115:6809/559969642","heartbeat_front_addr":"172.21.15.115:6807/559969642","state":["exists","up"]},{"osd":1,"uuid":"bfb9b40d-dd82-4b81-9eaa-2a36e3ef7fc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6811","nonce":281127096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6813","nonce":281127096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6817","nonce":281127096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":281127096},{"type":"v1","addr":"172.21.15.115:6815","nonce":281127096}]},"public_addr":"172.21.15.115:6811/281127096","cluster_addr":"172.21.15.115:6813/281127096","heartbeat_back_addr":"172.21.15.115:6817/281127096","heartbeat_front_addr":"172.21.15.115:6815/281127096","state":["exists","up"]},{"osd":2,"uuid":"b70c4ec9-cdee-489f-83f9-bf0de875e472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6819","nonce":2462041936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6821","nonce":2462041936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6825","nonce":2462041936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2462041936},{"type":"v1","addr":"172.21.15.115:6823","nonce":2462041936}]},"public_addr":"172.21.15.115:6819/2462041936","cluster_addr":"172.21.15.115:6821/2462041936","heartbeat_back_addr":"172.21.15.115:6825/2462041936","heartbeat_front_addr":"172.21.15.115:6823/2462041936","state":["exists","up"]},{"osd":3,"uuid":"6154c01b-da26-48d6-adeb-1d6452e9706b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6801","nonce":3291240250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6803","nonce":3291240250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6807","nonce":3291240250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3291240250},{"type":"v1","addr":"172.21.15.152:6805","nonce":3291240250}]},"public_addr":"172.21.15.152:6801/3291240250","cluster_addr":"172.21.15.152:6803/3291240250","heartbeat_back_addr":"172.21.15.152:6807/3291240250","heartbeat_front_addr":"172.21.15.152:6805/3291240250","state":["exists","up"]},{"osd":4,"uuid":"0f97e50d-d2db-4716-9a25-89d2fb05b69a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6809","nonce":1086088340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6811","nonce":1086088340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6815","nonce":1086088340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1086088340},{"type":"v1","addr":"172.21.15.152:6813","nonce":1086088340}]},"public_addr":"172.21.15.152:6809/1086088340","cluster_addr":"172.21.15.152:6811/1086088340","heartbeat_back_addr":"172.21.15.152:6815/1086088340","heartbeat_front_addr":"172.21.15.152:6813/1086088340","state":["exists","up"]},{"osd":5,"uuid":"431ed29c-72dc-444d-96b1-d29f0b4f2a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6817","nonce":327582524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6819","nonce":327582524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6823","nonce":327582524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":327582524},{"type":"v1","addr":"172.21.15.152:6821","nonce":327582524}]},"public_addr":"172.21.15.152:6817/327582524","cluster_addr":"172.21.15.152:6819/327582524","heartbeat_back_addr":"172.21.15.152:6823/327582524","heartbeat_front_addr":"172.21.15.152:6821/327582524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:23.186337+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:00:51.551501+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:18.824254+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:01:41.917845+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:06.679620+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:02:31.292448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:0/2563199978":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/2154717769":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/595553649":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/3118866913":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6801/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:6800/2340686319":"2024-09-14T22:57:39.503820+0000","172.21.15.115:0/2742407743":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3577026767":"2024-09-14T22:59:08.164587+0000","172.21.15.115:0/621622576":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/1038926251":"2024-09-14T22:58:07.885443+0000","172.21.15.115:0/3924280677":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6800/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6801/1740627202":"2024-09-14T22:59:08.164587+0000","172.21.15.115:6801/2055434874":"2024-09-14T22:58:07.885443+0000","172.21.15.115:6800/1740627202":"2024-09-14T22:59:08.164587+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 msgr2=0x7f11d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 0x7f11d0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11d40041d0 tx=0x7f11d4009040 comp rx=0 tx=0).stop 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 msgr2=0x7f11e406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11cc003080 tx=0x7f11cc009da0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 shutdown_connections 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f11d006ed60 0x7f11d0071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11e4102ef0 0x7f11e406ff50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 --2- 172.21.15.115:0/4138602938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11e4102550 0x7f11e406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:52.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 >> 172.21.15.115:0/4138602938 conn(0x7f11e40f80f0 msgr2=0x7f11e40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:52.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 shutdown_connections 2024-09-13T23:02:52.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:52.330+0000 7f11ea3f7640 1 -- 172.21.15.115:0/4138602938 wait complete. 2024-09-13T23:02:52.677 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:52 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/4138602938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:52 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/4138602938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T23:02:53.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T23:02:53.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T23:02:53.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T23:02:53.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T23:02:53.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T23:02:53.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T23:02:53.368 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:53.369 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:53.636 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:53 smithi115 ceph-mon[27601]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:53.636 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:53.658 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:53.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:53 smithi152 ceph-mon[34465]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:53.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:54.067 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:54.068 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:54.068 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:02:55.610 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:55 smithi115 ceph-mon[27601]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:55 smithi152 ceph-mon[34465]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:57.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:57 smithi115 ceph-mon[27601]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:57.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:57 smithi152 ceph-mon[34465]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/1096851572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 msgr2=0x7f3d24102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/1096851572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24102900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009c50 tx=0x7f3d14004d10 comp rx=0 tx=0).stop 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/1096851572 shutdown_connections 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/1096851572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d240fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/1096851572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24102900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/1096851572 >> 172.21.15.115:0/1096851572 conn(0x7f3d240f80f0 msgr2=0x7f3d240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/1096851572 shutdown_connections 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/1096851572 wait complete. 2024-09-13T23:02:58.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.426+0000 7f3d2b2ea640 1 Processor -- start 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d2b2ea640 1 -- start start 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d2b2ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d2b2ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d24113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d2b2ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24113d80 con 0x7f3d24102530 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d2b2ea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2410d1c0 con 0x7f3d24102ed0 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48926/0 (socket says 172.21.15.115:48926) 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 -- 172.21.15.115:0/2468597191 learned_addr learned my addr 172.21.15.115:0/2468597191 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 -- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 msgr2=0x7f3d24113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d28885640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d24113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d24113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140098b0 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d28885640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d24113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.427+0000 7f3d29086640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d14004a30 tx=0x7f3d14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.428+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d14009690 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.428+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3d14032b10 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.428+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2410d440 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.428+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d1403daa0 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.428+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2410d9e0 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.429+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d2410dec0 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.429+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3d1402f030 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d21ffb640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 0x7f3d0c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d140afa60 con 0x7f3d24102530 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d28885640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 0x7f3d0c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d21ffb640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 0x7f3d0c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:58.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d0c077590 con 0x7f3d0c074ad0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d140afda0 con 0x7f3d24102530 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d29887640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 0x7f3d0c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.430+0000 7f3d28885640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 0x7f3d0c071200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d2410eb00 tx=0x7f3d18009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.431+0000 7f3d29887640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 0x7f3d0c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.431+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== osd.5 v2:172.21.15.152:6816/327582524 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3d0c077590 con 0x7f3d0c074ad0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.444+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 --> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d240fdcb0 con 0x7f3d0c074ad0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.444+0000 7f3d21ffb640 1 -- 172.21.15.115:0/2468597191 <== osd.5 v2:172.21.15.152:6816/327582524 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3d240fdcb0 con 0x7f3d0c074ad0 2024-09-13T23:02:58.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.444+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 msgr2=0x7f3d0c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.444+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 0x7f3d0c076ee0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 msgr2=0x7f3d0c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 0x7f3d0c071200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d2410eb00 tx=0x7f3d18009040 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 msgr2=0x7f3d24113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d14004a30 tx=0x7f3d14004d10 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 shutdown_connections 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:6816/327582524,v1:172.21.15.152:6817/327582524] conn(0x7f3d0c074ad0 0x7f3d0c076ee0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3d0c06ed50 0x7f3d0c071200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d24102ed0 0x7f3d24113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 --2- 172.21.15.115:0/2468597191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d24102530 0x7f3d24113240 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 >> 172.21.15.115:0/2468597191 conn(0x7f3d240f80f0 msgr2=0x7f3d240f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:58.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 shutdown_connections 2024-09-13T23:02:58.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:02:57.445+0000 7f3d2b2ea640 1 -- 172.21.15.115:0/2468597191 wait complete. 2024-09-13T23:02:59.621 INFO:teuthology.orchestra.run.smithi115.stdout:163208757256 2024-09-13T23:02:59.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T23:02:59.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:02:59 smithi115 ceph-mon[27601]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:02:59.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:02:59 smithi152 ceph-mon[34465]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- 172.21.15.115:0/3070069390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fd560 msgr2=0x7f269c0fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/3070069390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fd560 0x7f269c0fd930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f268c004900 tx=0x7f268c009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- 172.21.15.115:0/3070069390 shutdown_connections 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/3070069390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fdf00 0x7f269c1065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/3070069390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fd560 0x7f269c0fd930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- 172.21.15.115:0/3070069390 >> 172.21.15.115:0/3070069390 conn(0x7f269c0f7060 msgr2=0x7f269c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- 172.21.15.115:0/3070069390 shutdown_connections 2024-09-13T23:03:00.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- 172.21.15.115:0/3070069390 wait complete. 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 Processor -- start 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.146+0000 7f26a1c4f640 1 -- start start 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fd560 0x7f269c113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c113e50 con 0x7f269c0fdf00 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c10d290 con 0x7f269c0fd560 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48954/0 (socket says 172.21.15.115:48954) 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 -- 172.21.15.115:0/602155658 learned_addr learned my addr 172.21.15.115:0/602155658 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 -- 172.21.15.115:0/602155658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fd560 msgr2=0x7f269c113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f269b7fe640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fd560 0x7f269c113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fd560 0x7f269c113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.161 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c005040 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2693fff640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f268400c810 tx=0x7f26840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268400a820 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f268400ae20 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c10d570 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26840115c0 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.147+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c10da90 con 0x7f269c0fdf00 2024-09-13T23:03:00.162 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.148+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f269c10df50 con 0x7f269c0fdf00 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2684012840 con 0x7f269c0fdf00 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 0x7f267c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f268408e3f0 con 0x7f269c0fdf00 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f269b7fe640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 0x7f267c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 0x7f267c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f267c0775a0 con 0x7f267c074ae0 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.149+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26840909e0 con 0x7f269c0fdf00 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.150+0000 7f269bfff640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 0x7f267c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.150+0000 7f269b7fe640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 0x7f267c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b020 tx=0x7f268c009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.150+0000 7f269bfff640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 0x7f267c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:00.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.150+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== osd.2 v2:172.21.15.115:6818/2462041936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f267c0775a0 con 0x7f267c074ae0 2024-09-13T23:03:00.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 --> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f269c0f9000 con 0x7f267c074ae0 2024-09-13T23:03:00.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f2698ff9640 1 -- 172.21.15.115:0/602155658 <== osd.2 v2:172.21.15.115:6818/2462041936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f269c0f9000 con 0x7f267c074ae0 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 msgr2=0x7f267c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 0x7f267c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 msgr2=0x7f267c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 0x7f267c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b020 tx=0x7f268c009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 msgr2=0x7f269c113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:00.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f268400c810 tx=0x7f26840043c0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.163+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 shutdown_connections 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6818/2462041936,v1:172.21.15.115:6819/2462041936] conn(0x7f267c074ae0 0x7f267c076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f267c06ed60 0x7f267c071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f269c0fdf00 0x7f269c113850 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 --2- 172.21.15.115:0/602155658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f269c0fd560 0x7f269c113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 >> 172.21.15.115:0/602155658 conn(0x7f269c0f7060 msgr2=0x7f269c0f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 shutdown_connections 2024-09-13T23:03:00.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:00.164+0000 7f26a1c4f640 1 -- 172.21.15.115:0/602155658 wait complete. 2024-09-13T23:03:01.703 INFO:teuthology.orchestra.run.smithi115.stdout:81604378646 2024-09-13T23:03:01.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T23:03:01.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:01 smithi115 ceph-mon[27601]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:01.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:01 smithi152 ceph-mon[34465]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:02.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- 172.21.15.115:0/2695512213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 msgr2=0x7f8b900fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:02.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 --2- 172.21.15.115:0/2695512213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b900fbbe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b800048d0 tx=0x7f8b80009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.642 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- 172.21.15.115:0/2695512213 shutdown_connections 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 --2- 172.21.15.115:0/2695512213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b900fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 --2- 172.21.15.115:0/2695512213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b900fbbe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- 172.21.15.115:0/2695512213 >> 172.21.15.115:0/2695512213 conn(0x7f8b900723b0 msgr2=0x7f8b900727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- 172.21.15.115:0/2695512213 shutdown_connections 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- 172.21.15.115:0/2695512213 wait complete. 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 Processor -- start 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.629+0000 7f8b965d2640 1 -- start start 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b9010e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9010ede0 con 0x7f8b900fb810 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9010ef50 con 0x7f8b900fcf80 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:02.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48970/0 (socket says 172.21.15.115:48970) 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 -- 172.21.15.115:0/4021922245 learned_addr learned my addr 172.21.15.115:0/4021922245 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8f7fe640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b9010e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 -- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 msgr2=0x7f8b9010e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b9010e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80005040 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8f7fe640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b9010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8ffff640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b80003080 tx=0x7f8b80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b80038070 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b800097e0 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b90117230 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8003d420 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.630+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b901176a0 con 0x7f8b900fb810 2024-09-13T23:03:02.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.631+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b900fae90 con 0x7f8b900fb810 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8b80030020 con 0x7f8b900fb810 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 0x7f8b7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8b800ae410 con 0x7f8b900fb810 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8f7fe640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 0x7f8b7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 0x7f8b7c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b7c0775a0 con 0x7f8b7c074ae0 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b800b0a60 con 0x7f8b900fb810 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.632+0000 7f8b94b6f640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 0x7f8b7c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.633+0000 7f8b8f7fe640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 0x7f8b7c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b90065980 tx=0x7f8b78008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.633+0000 7f8b94b6f640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 0x7f8b7c076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:02.645 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.634+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== osd.4 v2:172.21.15.152:6808/1086088340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8b7c0775a0 con 0x7f8b7c074ae0 2024-09-13T23:03:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.646+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 --> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b900fcbc0 con 0x7f8b7c074ae0 2024-09-13T23:03:02.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b8cff9640 1 -- 172.21.15.115:0/4021922245 <== osd.4 v2:172.21.15.152:6808/1086088340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8b900fcbc0 con 0x7f8b7c074ae0 2024-09-13T23:03:02.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 msgr2=0x7f8b7c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:02.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 0x7f8b7c076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 msgr2=0x7f8b7c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 0x7f8b7c071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b90065980 tx=0x7f8b78008040 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 msgr2=0x7f8b9010e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b80003080 tx=0x7f8b80009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 shutdown_connections 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:6808/1086088340,v1:172.21.15.152:6809/1086088340] conn(0x7f8b7c074ae0 0x7f8b7c076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8b7c06ed60 0x7f8b7c071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b900fcf80 0x7f8b9010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 --2- 172.21.15.115:0/4021922245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b900fb810 0x7f8b9010e1c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.647+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 >> 172.21.15.115:0/4021922245 conn(0x7f8b900723b0 msgr2=0x7f8b900fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.648+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 shutdown_connections 2024-09-13T23:03:02.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:02.648+0000 7f8b965d2640 1 -- 172.21.15.115:0/4021922245 wait complete. 2024-09-13T23:03:03.304 INFO:teuthology.orchestra.run.smithi115.stdout:141733920781 2024-09-13T23:03:03.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T23:03:03.875 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:03 smithi115 ceph-mon[27601]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:03.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 -- 172.21.15.115:0/1344833101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 msgr2=0x7f57780fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:03.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 --2- 172.21.15.115:0/1344833101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f57780fb8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f57600048d0 tx=0x7f5760009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 -- 172.21.15.115:0/1344833101 shutdown_connections 2024-09-13T23:03:03.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 --2- 172.21.15.115:0/1344833101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f57780fb8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 --2- 172.21.15.115:0/1344833101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57781014c0 0x7f5778101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 -- 172.21.15.115:0/1344833101 >> 172.21.15.115:0/1344833101 conn(0x7f57780f7020 msgr2=0x7f57780f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 -- 172.21.15.115:0/1344833101 shutdown_connections 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.951+0000 7f577cdcd640 1 -- 172.21.15.115:0/1344833101 wait complete. 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 Processor -- start 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 -- start start 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57781014c0 0x7f577810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577810ed00 con 0x7f57780fb480 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577cdcd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577810ee70 con 0x7f57781014c0 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48992/0 (socket says 172.21.15.115:48992) 2024-09-13T23:03:03.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 -- 172.21.15.115:0/2198158770 learned_addr learned my addr 172.21.15.115:0/2198158770 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 -- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57781014c0 msgr2=0x7f577810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57781014c0 0x7f577810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760005040 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.952+0000 7f577659c640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f576800c830 tx=0x7f5768004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576800a850 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f576800ae50 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57781171e0 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57680113a0 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781176f0 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.953+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57780f9380 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.954+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5768012400 con 0x7f57780fb480 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f576effd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 0x7f5764071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:03.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f576808e010 con 0x7f57780fb480 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f5775d9b640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 0x7f5764071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f576effd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 0x7f5764076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57640775a0 con 0x7f5764074ae0 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5768090600 con 0x7f57780fb480 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f5775d9b640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 0x7f5764071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57600043d0 tx=0x7f5760009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.955+0000 7f5776d9d640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 0x7f5764076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.956+0000 7f5776d9d640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 0x7f5764076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:03.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.956+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== osd.3 v2:172.21.15.152:6800/3291240250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f57640775a0 con 0x7f5764074ae0 2024-09-13T23:03:03.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:03 smithi152 ceph-mon[34465]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.971+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 --> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57780fcbc0 con 0x7f5764074ae0 2024-09-13T23:03:03.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f576effd640 1 -- 172.21.15.115:0/2198158770 <== osd.3 v2:172.21.15.152:6800/3291240250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f57780fcbc0 con 0x7f5764074ae0 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 msgr2=0x7f5764076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 0x7f5764076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 msgr2=0x7f5764071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 0x7f5764071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57600043d0 tx=0x7f5760009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 msgr2=0x7f577810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f576800c830 tx=0x7f5768004430 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 shutdown_connections 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:6800/3291240250,v1:172.21.15.152:6801/3291240250] conn(0x7f5764074ae0 0x7f5764076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f576406ed60 0x7f5764071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57781014c0 0x7f577810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 --2- 172.21.15.115:0/2198158770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57780fb480 0x7f577810e170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.972+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 >> 172.21.15.115:0/2198158770 conn(0x7f57780f7020 msgr2=0x7f57780f8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:03.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.973+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 shutdown_connections 2024-09-13T23:03:03.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:03.973+0000 7f577cdcd640 1 -- 172.21.15.115:0/2198158770 wait complete. 2024-09-13T23:03:04.178 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:04.178 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:04.772 INFO:teuthology.orchestra.run.smithi115.stdout:115964117011 2024-09-13T23:03:04.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T23:03:05.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:05 smithi115 ceph-mon[27601]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:05 smithi152 ceph-mon[34465]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:06.279 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:07.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:07 smithi115 ceph-mon[27601]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:07.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:07 smithi152 ceph-mon[34465]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/70828546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 msgr2=0x7fe0c0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/70828546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0102920 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00048d0 tx=0x7fe0b0009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/70828546 shutdown_connections 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/70828546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/70828546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0102920 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/70828546 >> 172.21.15.115:0/70828546 conn(0x7fe0c00f80f0 msgr2=0x7fe0c00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/70828546 shutdown_connections 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.446+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/70828546 wait complete. 2024-09-13T23:03:08.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 Processor -- start 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 -- start start 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c0113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01140d0 con 0x7fe0c0102550 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0c4c2b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c010d4e0 con 0x7fe0c0102ef0 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0be59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0be59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36404/0 (socket says 172.21.15.115:36404) 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0be59c640 1 -- 172.21.15.115:0/3265222770 learned_addr learned my addr 172.21.15.115:0/3265222770 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.447+0000 7fe0bdd9b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c0113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0be59c640 1 -- 172.21.15.115:0/3265222770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 msgr2=0x7fe0c0113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0be59c640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c0113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0be59c640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0005040 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0bdd9b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0be59c640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b0038070 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c010d760 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe0b002ade0 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b002c7b0 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.448+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c010dca0 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.449+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0c00fdcd0 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.449+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe0b0030020 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0aeffd640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 0x7fe0a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe0b00ae300 con 0x7fe0c0102550 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0bdd9b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 0x7fe0a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:08.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0aeffd640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 0x7fe0a8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0a80775a0 con 0x7fe0a8074ae0 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0b00b08f0 con 0x7fe0c0102550 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0bed9d640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 0x7fe0a8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0bdd9b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 0x7fe0a8071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0c010e7c0 tx=0x7fe0b400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.450+0000 7fe0bed9d640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 0x7fe0a8076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.451+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== osd.1 v2:172.21.15.115:6810/281127096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe0a80775a0 con 0x7fe0a8074ae0 2024-09-13T23:03:08.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 --> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0c00fbd50 con 0x7fe0a8074ae0 2024-09-13T23:03:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0aeffd640 1 -- 172.21.15.115:0/3265222770 <== osd.1 v2:172.21.15.115:6810/281127096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe0c00fbd50 con 0x7fe0a8074ae0 2024-09-13T23:03:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 msgr2=0x7fe0a8076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:08.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 0x7fe0a8076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 msgr2=0x7fe0a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 0x7fe0a8071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0c010e7c0 tx=0x7fe0b400b040 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 msgr2=0x7fe0c0113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b0009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 shutdown_connections 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6810/281127096,v1:172.21.15.115:6811/281127096] conn(0x7fe0a8074ae0 0x7fe0a8076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe0a806ed60 0x7fe0a8071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0c0102ef0 0x7fe0c0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 --2- 172.21.15.115:0/3265222770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0c0102550 0x7fe0c0113540 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 >> 172.21.15.115:0/3265222770 conn(0x7fe0c00f80f0 msgr2=0x7fe0c00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.464+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 shutdown_connections 2024-09-13T23:03:08.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.465+0000 7fe0c4c2b640 1 -- 172.21.15.115:0/3265222770 wait complete. 2024-09-13T23:03:08.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:08.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:09.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.174+0000 7f61955e2640 1 -- 172.21.15.115:0/2612936097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 msgr2=0x7f61901018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.174+0000 7f61955e2640 1 --2- 172.21.15.115:0/2612936097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901018b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61800048d0 tx=0x7f6180009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.174+0000 7f61955e2640 1 -- 172.21.15.115:0/2612936097 shutdown_connections 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.174+0000 7f61955e2640 1 --2- 172.21.15.115:0/2612936097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 0x7f61900fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.174+0000 7f61955e2640 1 --2- 172.21.15.115:0/2612936097 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901018b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 -- 172.21.15.115:0/2612936097 >> 172.21.15.115:0/2612936097 conn(0x7f61900f7060 msgr2=0x7f61900f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 -- 172.21.15.115:0/2612936097 shutdown_connections 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 -- 172.21.15.115:0/2612936097 wait complete. 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 Processor -- start 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 -- start start 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 0x7f61901131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.175+0000 7f61955e2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61955e2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190113cf0 con 0x7f61901014e0 2024-09-13T23:03:09.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61955e2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619010d130 con 0x7f61900fb4a0 2024-09-13T23:03:09.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:09.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36394/0 (socket says 172.21.15.115:36394) 2024-09-13T23:03:09.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 -- 172.21.15.115:0/2303790862 learned_addr learned my addr 172.21.15.115:0/2303790862 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:09.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618effd640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 0x7f61901131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:09.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 -- 172.21.15.115:0/2303790862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 msgr2=0x7f61901131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 0x7f61901131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6180005040 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f618e7fc640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6184002a50 tx=0x7f6184004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6184007c30 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619010d410 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f618400f040 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f618400da10 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.176+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619010d9b0 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.177+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f619010de90 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f618400dc80 con 0x7f61901014e0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 0x7f6178071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f618effd640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 0x7f6178071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:09.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f618408db20 con 0x7f61901014e0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 0x7f6178076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61780775a0 con 0x7f6178074ae0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.178+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f618408dea0 con 0x7f61901014e0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.179+0000 7f618f7fe640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 0x7f6178076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.179+0000 7f618effd640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 0x7f6178071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6180009ac0 tx=0x7f6180035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.179+0000 7f618f7fe640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 0x7f6178076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.180+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== osd.0 v2:172.21.15.115:6802/559969642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f61780775a0 con 0x7f6178074ae0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 --> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6190066480 con 0x7f6178074ae0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61777fe640 1 -- 172.21.15.115:0/2303790862 <== osd.0 v2:172.21.15.115:6802/559969642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6190066480 con 0x7f6178074ae0 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 msgr2=0x7f6178076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:09.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 0x7f6178076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 msgr2=0x7f6178071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 0x7f6178071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6180009ac0 tx=0x7f6180035040 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 msgr2=0x7f61901136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6184002a50 tx=0x7f6184004600 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 shutdown_connections 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6802/559969642,v1:172.21.15.115:6803/559969642] conn(0x7f6178074ae0 0x7f6178076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f617806ed60 0x7f6178071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61901014e0 0x7f61901136f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 --2- 172.21.15.115:0/2303790862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61900fb4a0 0x7f61901131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:09.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 >> 172.21.15.115:0/2303790862 conn(0x7f61900f7060 msgr2=0x7f6190065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:09.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 shutdown_connections 2024-09-13T23:03:09.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:08.192+0000 7f61955e2640 1 -- 172.21.15.115:0/2303790862 wait complete. 2024-09-13T23:03:09.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:09 smithi115 ceph-mon[27601]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:09.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:09 smithi152 ceph-mon[34465]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:10.426 INFO:teuthology.orchestra.run.smithi115.stdout:60129542174 2024-09-13T23:03:10.427 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 -- 172.21.15.115:0/1653799381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 msgr2=0x7fcd700fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 --2- 172.21.15.115:0/1653799381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd700fe830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0048d0 tx=0x7fcd6c009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 -- 172.21.15.115:0/1653799381 shutdown_connections 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 --2- 172.21.15.115:0/1653799381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 0x7fcd70065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 --2- 172.21.15.115:0/1653799381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd700fe830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.599+0000 7fcd78075640 1 -- 172.21.15.115:0/1653799381 >> 172.21.15.115:0/1653799381 conn(0x7fcd700723b0 msgr2=0x7fcd700727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.600+0000 7fcd78075640 1 -- 172.21.15.115:0/1653799381 shutdown_connections 2024-09-13T23:03:10.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.600+0000 7fcd78075640 1 -- 172.21.15.115:0/1653799381 wait complete. 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.600+0000 7fcd78075640 1 Processor -- start 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.600+0000 7fcd78075640 1 -- start start 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd78075640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 0x7fcd70113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd78075640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd78075640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70113cd0 con 0x7fcd700fe460 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd78075640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7010d110 con 0x7fcd70064fc0 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36422/0 (socket says 172.21.15.115:36422) 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 -- 172.21.15.115:0/3372404656 learned_addr learned my addr 172.21.15.115:0/3372404656 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:10.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75e11640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 0x7fcd70113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 -- 172.21.15.115:0/3372404656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 msgr2=0x7fcd70113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 0x7fcd70113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 -- 172.21.15.115:0/3372404656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c005040 con 0x7fcd700fe460 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd75610640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c830 tx=0x7fcd60004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.601+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6000a7d0 con 0x7fcd700fe460 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.602+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7010d3f0 con 0x7fcd700fe460 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.602+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7010d990 con 0x7fcd700fe460 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.602+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd6000add0 con 0x7fcd700fe460 2024-09-13T23:03:10.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.602+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd600113a0 con 0x7fcd700fe460 2024-09-13T23:03:10.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.603+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54005210 con 0x7fcd700fe460 2024-09-13T23:03:10.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.604+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fcd6000a930 con 0x7fcd700fe460 2024-09-13T23:03:10.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.605+0000 7fcd667fc640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 0x7fcd5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.605+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcd6008dcd0 con 0x7fcd700fe460 2024-09-13T23:03:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.605+0000 7fcd75e11640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 0x7fcd5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.605+0000 7fcd75e11640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 0x7fcd5c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009ac0 tx=0x7fcd6c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:10.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.609+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcd6005b250 con 0x7fcd700fe460 2024-09-13T23:03:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.762+0000 7f454c79a640 1 -- 172.21.15.115:0/4070163732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 msgr2=0x7f45440fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.762+0000 7f454c79a640 1 --2- 172.21.15.115:0/4070163732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f45440fc590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45400048d0 tx=0x7f4540009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- 172.21.15.115:0/4070163732 shutdown_connections 2024-09-13T23:03:10.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 --2- 172.21.15.115:0/4070163732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f45440fc590 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 --2- 172.21.15.115:0/4070163732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 0x7f4544102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- 172.21.15.115:0/4070163732 >> 172.21.15.115:0/4070163732 conn(0x7f45440f80f0 msgr2=0x7f45440fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- 172.21.15.115:0/4070163732 shutdown_connections 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- 172.21.15.115:0/4070163732 wait complete. 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 Processor -- start 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- start start 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 0x7f454406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544070490 con 0x7f4544102ed0 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.763+0000 7f454c79a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544070600 con 0x7f4544102530 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36444/0 (socket says 172.21.15.115:36444) 2024-09-13T23:03:10.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 -- 172.21.15.115:0/2323529168 learned_addr learned my addr 172.21.15.115:0/2323529168 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f454a536640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 0x7f454406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 -- 172.21.15.115:0/2323529168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 msgr2=0x7f454406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 0x7f454406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 -- 172.21.15.115:0/2323529168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540005040 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4549d35640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f454002a530 tx=0x7f4540009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4540038070 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544070830 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f454002ade0 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454002c770 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.764+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544119870 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.765+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45440fdcb0 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.766+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4540030020 con 0x7f4544102ed0 2024-09-13T23:03:10.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.766+0000 7f4536ffd640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 0x7f4530071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.766+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f45400ae220 con 0x7f4544102ed0 2024-09-13T23:03:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.766+0000 7f454a536640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 0x7f4530071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.767+0000 7f454a536640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 0x7f4530071200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4538009af0 tx=0x7f453800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:10.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.770+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f454007b680 con 0x7f4544102ed0 2024-09-13T23:03:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.773+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd540054c0 con 0x7fcd700fe460 2024-09-13T23:03:10.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.773+0000 7fcd667fc640 1 -- 172.21.15.115:0/3372404656 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd6005abf0 con 0x7fcd700fe460 2024-09-13T23:03:10.774 INFO:teuthology.orchestra.run.smithi115.stdout:81604378648 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 msgr2=0x7fcd5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 0x7fcd5c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009ac0 tx=0x7fcd6c035040 comp rx=0 tx=0).stop 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 msgr2=0x7fcd701136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c830 tx=0x7fcd60004430 comp rx=0 tx=0).stop 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 shutdown_connections 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fcd5c06ed60 0x7fcd5c071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd700fe460 0x7fcd701136d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 --2- 172.21.15.115:0/3372404656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd70064fc0 0x7fcd70113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 >> 172.21.15.115:0/3372404656 conn(0x7fcd700723b0 msgr2=0x7fcd70105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:10.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 shutdown_connections 2024-09-13T23:03:10.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.775+0000 7fcd78075640 1 -- 172.21.15.115:0/3372404656 wait complete. 2024-09-13T23:03:10.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.932+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f45440fbd30 con 0x7f4544102ed0 2024-09-13T23:03:10.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.932+0000 7f4536ffd640 1 -- 172.21.15.115:0/2323529168 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f454007b020 con 0x7f4544102ed0 2024-09-13T23:03:10.934 INFO:teuthology.orchestra.run.smithi115.stdout:141733920783 2024-09-13T23:03:10.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 msgr2=0x7f4530071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 0x7f4530071200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4538009af0 tx=0x7f453800b040 comp rx=0 tx=0).stop 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 msgr2=0x7f454406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f454002a530 tx=0x7f4540009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 shutdown_connections 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f453006ed50 0x7f4530071200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4544102ed0 0x7f454406ff50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 --2- 172.21.15.115:0/2323529168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4544102530 0x7f454406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:10.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 >> 172.21.15.115:0/2323529168 conn(0x7f45440f80f0 msgr2=0x7f45440f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:10.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 shutdown_connections 2024-09-13T23:03:10.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:10.934+0000 7f454c79a640 1 -- 172.21.15.115:0/2323529168 wait complete. 2024-09-13T23:03:11.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920781 got 141733920783 for osd.4 2024-09-13T23:03:11.692 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:11.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:11 smithi115 ceph-mon[27601]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:11.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:11 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3372404656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T23:03:11.910 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:11 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2323529168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T23:03:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:11 smithi152 ceph-mon[34465]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:11 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3372404656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T23:03:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:11 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2323529168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T23:03:12.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378648 for osd.2 2024-09-13T23:03:12.153 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:12.673 INFO:teuthology.orchestra.run.smithi115.stdout:38654705700 2024-09-13T23:03:12.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T23:03:12.898 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 -- 172.21.15.115:0/1846092355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 msgr2=0x7f4554102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 --2- 172.21.15.115:0/1846092355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554102900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45500048d0 tx=0x7f4550009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 -- 172.21.15.115:0/1846092355 shutdown_connections 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 --2- 172.21.15.115:0/1846092355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45540fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 --2- 172.21.15.115:0/1846092355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554102900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 -- 172.21.15.115:0/1846092355 >> 172.21.15.115:0/1846092355 conn(0x7f45540f8110 msgr2=0x7f45540fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 -- 172.21.15.115:0/1846092355 shutdown_connections 2024-09-13T23:03:13.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 -- 172.21.15.115:0/1846092355 wait complete. 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.193+0000 7f455b637640 1 Processor -- start 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f455b637640 1 -- start start 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f455b637640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f455b637640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45541137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f455b637640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4554113e40 con 0x7f4554102530 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f455b637640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455410d1f0 con 0x7f4554102ed0 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:36466/0 (socket says 172.21.15.115:36466) 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 -- 172.21.15.115:0/3081095075 learned_addr learned my addr 172.21.15.115:0/3081095075 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f4558bd2640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45541137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 -- 172.21.15.115:0/3081095075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 msgr2=0x7f45541137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45541137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 -- 172.21.15.115:0/3081095075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550005040 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f4558bd2640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45541137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f45593d3640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4550000c00 tx=0x7f4550009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.194+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4550038070 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.195+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f455003daf0 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.195+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455410d470 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.195+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4550033b20 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.195+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455410d990 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.196+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45540fdcb0 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.196+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4550030020 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.197+0000 7f4549ffb640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 0x7f4540071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.197+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f45500ae0f0 con 0x7f4554102530 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.197+0000 7f4558bd2640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 0x7f4540071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.197+0000 7f4558bd2640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 0x7f4540071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4544006fd0 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.201+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f455007b550 con 0x7f4554102530 2024-09-13T23:03:13.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.369+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f45540fbd30 con 0x7f4554102530 2024-09-13T23:03:13.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.370+0000 7f4549ffb640 1 -- 172.21.15.115:0/3081095075 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45540fbd30 con 0x7f4554102530 2024-09-13T23:03:13.371 INFO:teuthology.orchestra.run.smithi115.stdout:163208757259 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 msgr2=0x7f4540071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 0x7f4540071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4544006fd0 tx=0x7f4544008040 comp rx=0 tx=0).stop 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 msgr2=0x7f4554113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4550000c00 tx=0x7f4550009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 shutdown_connections 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f454006ed60 0x7f4540071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4554102ed0 0x7f45541137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 --2- 172.21.15.115:0/3081095075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4554102530 0x7f4554113270 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 >> 172.21.15.115:0/3081095075 conn(0x7f45540f8110 msgr2=0x7f45540f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 shutdown_connections 2024-09-13T23:03:13.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:13.372+0000 7f455b637640 1 -- 172.21.15.115:0/3081095075 wait complete. 2024-09-13T23:03:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:13 smithi115 ceph-mon[27601]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:13 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3081095075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T23:03:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:13.967 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:13.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:13 smithi152 ceph-mon[34465]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:13.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:13 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3081095075' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T23:03:15.910 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:15 smithi115 ceph-mon[27601]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:15.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:15 smithi152 ceph-mon[34465]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:16.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757256 got 163208757259 for osd.5 2024-09-13T23:03:16.044 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:17.629 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:17 smithi115 ceph-mon[27601]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:17.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 -- 172.21.15.115:0/3235666776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fcf80 msgr2=0x7ffb8c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/3235666776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c0fd3d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb740048d0 tx=0x7ffb74009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 -- 172.21.15.115:0/3235666776 shutdown_connections 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/3235666776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c0fd3d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/3235666776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 -- 172.21.15.115:0/3235666776 >> 172.21.15.115:0/3235666776 conn(0x7ffb8c0723b0 msgr2=0x7ffb8c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 -- 172.21.15.115:0/3235666776 shutdown_connections 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.705+0000 7ffb91ae4640 1 -- 172.21.15.115:0/3235666776 wait complete. 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 Processor -- start 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 -- start start 2024-09-13T23:03:17.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c10c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c10c9a0 con 0x7ffb8c0fb810 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb91ae4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c10cae0 con 0x7ffb8c0fcf80 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40556/0 (socket says 172.21.15.115:40556) 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 -- 172.21.15.115:0/2661283596 learned_addr learned my addr 172.21.15.115:0/2661283596 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb83fff640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c10c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 -- 172.21.15.115:0/2661283596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 msgr2=0x7ffb8c10c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c10c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 -- 172.21.15.115:0/2661283596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74005040 con 0x7ffb8c0fb810 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb83fff640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c10c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.706+0000 7ffb8b7fe640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00eb70 tx=0x7ffb7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.707+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c007c30 con 0x7ffb8c0fb810 2024-09-13T23:03:17.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.707+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c10cd30 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.707+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb7c00f040 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.707+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c0094e0 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.707+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c1198f0 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.708+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c0fcbc0 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.708+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ffb7c009720 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.708+0000 7ffb88ff9640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 0x7ffb78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.709+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffb7c08db00 con 0x7ffb8c0fb810 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.709+0000 7ffb83fff640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 0x7ffb78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.709+0000 7ffb83fff640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 0x7ffb78071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b020 tx=0x7ffb74009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:17.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.713+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb7c05af60 con 0x7ffb8c0fb810 2024-09-13T23:03:17.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.874+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb8c065790 con 0x7ffb8c0fb810 2024-09-13T23:03:17.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.874+0000 7ffb88ff9640 1 -- 172.21.15.115:0/2661283596 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb7c019020 con 0x7ffb8c0fb810 2024-09-13T23:03:17.875 INFO:teuthology.orchestra.run.smithi115.stdout:115964117014 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 msgr2=0x7ffb78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 0x7ffb78071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b020 tx=0x7ffb74009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 msgr2=0x7ffb8c10bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00eb70 tx=0x7ffb7c00b040 comp rx=0 tx=0).stop 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 shutdown_connections 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffb7806ed60 0x7ffb78071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb8c0fcf80 0x7ffb8c10c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 --2- 172.21.15.115:0/2661283596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb8c0fb810 0x7ffb8c10bf20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 >> 172.21.15.115:0/2661283596 conn(0x7ffb8c0723b0 msgr2=0x7ffb8c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 shutdown_connections 2024-09-13T23:03:17.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.876+0000 7ffb91ae4640 1 -- 172.21.15.115:0/2661283596 wait complete. 2024-09-13T23:03:17.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:17 smithi152 ceph-mon[34465]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 -- 172.21.15.115:0/754329218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae8102620 msgr2=0x7faae81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 --2- 172.21.15.115:0/754329218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae8102620 0x7faae81029f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faad80048d0 tx=0x7faad8009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 -- 172.21.15.115:0/754329218 shutdown_connections 2024-09-13T23:03:17.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 --2- 172.21.15.115:0/754329218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae80fac80 0x7faae80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 --2- 172.21.15.115:0/754329218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae8102620 0x7faae81029f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 -- 172.21.15.115:0/754329218 >> 172.21.15.115:0/754329218 conn(0x7faae8070ce0 msgr2=0x7faae80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 -- 172.21.15.115:0/754329218 shutdown_connections 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.927+0000 7faaed58f640 1 -- 172.21.15.115:0/754329218 wait complete. 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 Processor -- start 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 -- start start 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae8102620 0x7faae8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8113d30 con 0x7faae80fac80 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faaed58f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae810d170 con 0x7faae8102620 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40580/0 (socket says 172.21.15.115:40580) 2024-09-13T23:03:17.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 -- 172.21.15.115:0/4263073453 learned_addr learned my addr 172.21.15.115:0/4263073453 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 -- 172.21.15.115:0/4263073453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae8102620 msgr2=0x7faae8113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae8102620 0x7faae8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.928+0000 7faae6ffd640 1 -- 172.21.15.115:0/4263073453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8005040 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faae6ffd640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faad8003080 tx=0x7faad8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad8038070 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae810d3f0 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faad80097e0 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad803d420 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.929+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae810d930 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.930+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae80657b0 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.930+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7faad8030020 con 0x7faae80fac80 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.931+0000 7faacf7fe640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 0x7faad0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:18.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.931+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faad80ae470 con 0x7faae80fac80 2024-09-13T23:03:18.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.931+0000 7faae67fc640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 0x7faad0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:18.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.931+0000 7faae67fc640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 0x7faad0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faae810eab0 tx=0x7faadc007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:18.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:17.935+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faad807b8d0 con 0x7faae80fac80 2024-09-13T23:03:18.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.094+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faae8109590 con 0x7faae80fac80 2024-09-13T23:03:18.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.095+0000 7faacf7fe640 1 -- 172.21.15.115:0/4263073453 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faad807b270 con 0x7faae80fac80 2024-09-13T23:03:18.096 INFO:teuthology.orchestra.run.smithi115.stdout:38654705702 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 msgr2=0x7faad0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 0x7faad0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faae810eab0 tx=0x7faadc007cb0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 msgr2=0x7faae81131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faad8003080 tx=0x7faad8009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 shutdown_connections 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7faad006ed60 0x7faad0071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae8102620 0x7faae8113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 --2- 172.21.15.115:0/4263073453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae80fac80 0x7faae81131f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 >> 172.21.15.115:0/4263073453 conn(0x7faae8070ce0 msgr2=0x7faae8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 shutdown_connections 2024-09-13T23:03:18.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.097+0000 7faaed58f640 1 -- 172.21.15.115:0/4263073453 wait complete. 2024-09-13T23:03:18.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:18 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2661283596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T23:03:18.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:18 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/4263073453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T23:03:18.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:18 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1083131181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T23:03:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:18 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2661283596' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T23:03:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:18 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/4263073453' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T23:03:19.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:18 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1083131181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T23:03:19.097 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2024-09-13T23:03:19.097 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.198+0000 7f785d13c640 1 -- 172.21.15.115:0/1285997891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102ef0 msgr2=0x7f78580fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.198+0000 7f785d13c640 1 --2- 172.21.15.115:0/1285997891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102ef0 0x7f78580fc5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78400048d0 tx=0x7f7840009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 -- 172.21.15.115:0/1285997891 shutdown_connections 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 --2- 172.21.15.115:0/1285997891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102ef0 0x7f78580fc5b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 --2- 172.21.15.115:0/1285997891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102550 0x7f7858102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 -- 172.21.15.115:0/1285997891 >> 172.21.15.115:0/1285997891 conn(0x7f78580f80f0 msgr2=0x7f78580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 -- 172.21.15.115:0/1285997891 shutdown_connections 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 -- 172.21.15.115:0/1285997891 wait complete. 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.199+0000 7f785d13c640 1 Processor -- start 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785d13c640 1 -- start start 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785d13c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785d13c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 0x7f7858113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785d13c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78581141d0 con 0x7f7858102550 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785d13c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785810d550 con 0x7f7858102ef0 2024-09-13T23:03:19.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stdout:60129542176 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40602/0 (socket says 172.21.15.115:40602) 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 -- 172.21.15.115:0/1083131181 learned_addr learned my addr 172.21.15.115:0/1083131181 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785659c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 0x7f7858113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 -- 172.21.15.115:0/1083131181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 msgr2=0x7f7858113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 0x7f7858113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 -- 172.21.15.115:0/1083131181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840005040 con 0x7f7858102550 2024-09-13T23:03:19.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f785659c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 0x7f7858113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f7856d9d640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f785000b790 tx=0x7f78500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.200+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f785000c700 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.201+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f785000cd00 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.201+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785810d7e0 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.201+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7850015e70 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.201+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785810dcd0 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.202+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78580fdcd0 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.202+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7850012070 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.203+0000 7f784f7fe640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 0x7f7844071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.203+0000 7f785659c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 0x7f7844071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.203+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f785008d9c0 con 0x7f7858102550 2024-09-13T23:03:19.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.203+0000 7f785659c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 0x7f7844071200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f7840035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.207+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f785005ae20 con 0x7f7858102550 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.368+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f785810ec20 con 0x7f7858102550 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.368+0000 7f784f7fe640 1 -- 172.21.15.115:0/1083131181 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f785005a7c0 con 0x7f7858102550 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 msgr2=0x7f7844071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 0x7f7844071200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7840000c00 tx=0x7f7840035040 comp rx=0 tx=0).stop 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 msgr2=0x7f78581135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f785000b790 tx=0x7f78500091d0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 shutdown_connections 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f784406ed50 0x7f7844071200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7858102ef0 0x7f7858113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 --2- 172.21.15.115:0/1083131181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7858102550 0x7f78581135b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 >> 172.21.15.115:0/1083131181 conn(0x7f78580f80f0 msgr2=0x7f78580f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 shutdown_connections 2024-09-13T23:03:19.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:18.370+0000 7f785d13c640 1 -- 172.21.15.115:0/1083131181 wait complete. 2024-09-13T23:03:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:19 smithi115 ceph-mon[27601]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:19.870 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-09-13T23:03:19.870 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:19.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:19 smithi152 ceph-mon[34465]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:20.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-13T23:03:20.368 DEBUG:teuthology.parallel:result is None 2024-09-13T23:03:20.368 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T23:03:20.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T23:03:20.619 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:21.879 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:21 smithi115 ceph-mon[27601]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:21.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:21 smithi152 ceph-mon[34465]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:22.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 -- 172.21.15.115:0/3138223564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 msgr2=0x7f5e1c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:22.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 --2- 172.21.15.115:0/3138223564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c0fe830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e180048d0 tx=0x7f5e18009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 -- 172.21.15.115:0/3138223564 shutdown_connections 2024-09-13T23:03:22.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 --2- 172.21.15.115:0/3138223564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 0x7f5e1c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 --2- 172.21.15.115:0/3138223564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c0fe830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.187+0000 7f5e24266640 1 -- 172.21.15.115:0/3138223564 >> 172.21.15.115:0/3138223564 conn(0x7f5e1c0723b0 msgr2=0x7f5e1c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:22.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 -- 172.21.15.115:0/3138223564 shutdown_connections 2024-09-13T23:03:22.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 -- 172.21.15.115:0/3138223564 wait complete. 2024-09-13T23:03:22.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 Processor -- start 2024-09-13T23:03:22.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 -- start start 2024-09-13T23:03:22.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 0x7f5e1c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c113cd0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e24266640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c10d110 con 0x7f5e1c064fc0 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.188+0000 7f5e21801640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40630/0 (socket says 172.21.15.115:40630) 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 -- 172.21.15.115:0/2958047926 learned_addr learned my addr 172.21.15.115:0/2958047926 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e22002640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 0x7f5e1c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 -- 172.21.15.115:0/2958047926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 msgr2=0x7f5e1c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 0x7f5e1c113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 -- 172.21.15.115:0/2958047926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18005040 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e21801640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c002a80 tx=0x7f5e0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c007c30 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e0c00f040 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c10d3f0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0c00dab0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.189+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c10d910 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.190+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c0fdcf0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.191+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5e0c00dc10 con 0x7f5e1c0fe460 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.191+0000 7f5e127fc640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 0x7f5e08071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:22.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.191+0000 7f5e22002640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 0x7f5e08071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:22.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.191+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e0c08d6e0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.192+0000 7f5e22002640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 0x7f5e08071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009ac0 tx=0x7f5e18035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:22.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.195+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5e0c04d2a0 con 0x7f5e1c0fe460 2024-09-13T23:03:22.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.349+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e1c10e830 con 0x7f5e0806ed60 2024-09-13T23:03:22.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.350+0000 7f5e127fc640 1 -- 172.21.15.115:0/2958047926 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27937 (secure 0 0 0) 0x7f5e1c10e830 con 0x7f5e0806ed60 2024-09-13T23:03:22.352 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:22.353 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-13T23:03:22.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 msgr2=0x7f5e08071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:22.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 0x7f5e08071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009ac0 tx=0x7f5e18035040 comp rx=0 tx=0).stop 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 msgr2=0x7f5e1c1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c002a80 tx=0x7f5e0c004600 comp rx=0 tx=0).stop 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 shutdown_connections 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5e0806ed60 0x7f5e08071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e1c0fe460 0x7f5e1c1136d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 --2- 172.21.15.115:0/2958047926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e1c064fc0 0x7f5e1c113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 >> 172.21.15.115:0/2958047926 conn(0x7f5e1c0723b0 msgr2=0x7f5e1c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 shutdown_connections 2024-09-13T23:03:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:22.352+0000 7f5e24266640 1 -- 172.21.15.115:0/2958047926 wait complete. 2024-09-13T23:03:23.059 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-13T23:03:22.210882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787980,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682932,"statfs":{"total":575970213888,"available":574139322368,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002310"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T23:02:32.933489+0000","last_change":"2024-09-13T23:02:08.113448+0000","last_active":"2024-09-13T23:02:32.933489+0000","last_peered":"2024-09-13T23:02:32.933489+0000","last_clean":"2024-09-13T23:02:32.933489+0000","last_became_active":"2024-09-13T23:02:08.113149+0000","last_became_peered":"2024-09-13T23:02:08.113149+0000","last_unstale":"2024-09-13T23:02:32.933489+0000","last_undegraded":"2024-09-13T23:02:32.933489+0000","last_fullsized":"2024-09-13T23:02:32.933489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:01:22.863199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:01:22.863199+0000","last_clean_scrub_stamp":"2024-09-13T23:01:22.863199+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:18.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":4,"up_from":33,"seq":141733920785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36799999999999999}]},{"osd":3,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Sep 13 23:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.313},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.24199999999999999}]},{"osd":1,"last update":"Fri Sep 13 23:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.26000000000000001}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.376,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.9900000000000002,"5min":3.9900000000000002,"15min":3.9900000000000002},"last":0.219}]},{"osd":2,"last update":"Fri Sep 13 23:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.246},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.032,"5min":4.032,"15min":4.032},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.547999999999998,"5min":18.547999999999998,"15min":18.547999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 23:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45300000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.51200000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 23:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Sep 13 23:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":7.4870000000000001,"5min":7.4870000000000001,"15min":7.4870000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4989999999999997,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:03:23.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T23:03:23.307 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:23 smithi152 ceph-mon[34465]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:23 smithi152 ceph-mon[34465]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T23:03:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:24.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:23 smithi115 ceph-mon[27601]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:24.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:23 smithi115 ceph-mon[27601]: from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T23:03:24.031 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.877+0000 7f1d4499a640 1 -- 172.21.15.115:0/763248674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d400fe450 msgr2=0x7f1d400fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.877+0000 7f1d4499a640 1 --2- 172.21.15.115:0/763248674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d400fe450 0x7f1d400fe820 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d300048d0 tx=0x7f1d30009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- 172.21.15.115:0/763248674 shutdown_connections 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 --2- 172.21.15.115:0/763248674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d40064fe0 0x7f1d40065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 --2- 172.21.15.115:0/763248674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d400fe450 0x7f1d400fe820 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:24.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- 172.21.15.115:0/763248674 >> 172.21.15.115:0/763248674 conn(0x7f1d400723b0 msgr2=0x7f1d400727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- 172.21.15.115:0/763248674 shutdown_connections 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- 172.21.15.115:0/763248674 wait complete. 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 Processor -- start 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- start start 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d400fe450 0x7f1d400fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400fc070 con 0x7f1d40064fe0 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.878+0000 7f1d4499a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400fc1e0 con 0x7f1d400fe450 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40648/0 (socket says 172.21.15.115:40648) 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 -- 172.21.15.115:0/3552426238 learned_addr learned my addr 172.21.15.115:0/3552426238 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3dd9b640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d400fe450 0x7f1d400fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 -- 172.21.15.115:0/3552426238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d400fe450 msgr2=0x7f1d400fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:24.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d400fe450 0x7f1d400fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 -- 172.21.15.115:0/3552426238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30005040 con 0x7f1d40064fe0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d3e59c640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d30003080 tx=0x7f1d30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d30038070 con 0x7f1d40064fe0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1d300097e0 con 0x7f1d40064fe0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d40119570 con 0x7f1d40064fe0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d3003d420 con 0x7f1d40064fe0 2024-09-13T23:03:24.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.879+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d401198f0 con 0x7f1d40064fe0 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.881+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d400fdce0 con 0x7f1d40064fe0 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.881+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f1d30030020 con 0x7f1d40064fe0 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.881+0000 7f1d36ffd640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 0x7f1d2c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.881+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1d300ae370 con 0x7f1d40064fe0 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.881+0000 7f1d3dd9b640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 0x7f1d2c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:24.884 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.882+0000 7f1d3dd9b640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 0x7f1d2c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d400fcea0 tx=0x7f1d28009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:24.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:24.885+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1d3007b7d0 con 0x7f1d40064fe0 2024-09-13T23:03:25.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.109+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d4004b790 con 0x7f1d2c06ed60 2024-09-13T23:03:25.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.111+0000 7f1d36ffd640 1 -- 172.21.15.115:0/3552426238 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27951 (secure 0 0 0) 0x7f1d4004b790 con 0x7f1d2c06ed60 2024-09-13T23:03:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:25.113 INFO:teuthology.orchestra.run.smithi115.stderr:dumped all 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 msgr2=0x7f1d2c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 0x7f1d2c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d400fcea0 tx=0x7f1d28009120 comp rx=0 tx=0).stop 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 msgr2=0x7f1d400fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d30003080 tx=0x7f1d30009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 shutdown_connections 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f1d2c06ed60 0x7f1d2c071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d400fe450 0x7f1d400fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 --2- 172.21.15.115:0/3552426238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d40064fe0 0x7f1d400fb560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:25.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 >> 172.21.15.115:0/3552426238 conn(0x7f1d400723b0 msgr2=0x7f1d400fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:25.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 shutdown_connections 2024-09-13T23:03:25.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:25.113+0000 7f1d4499a640 1 -- 172.21.15.115:0/3552426238 wait complete. 2024-09-13T23:03:25.815 INFO:teuthology.orchestra.run.smithi115.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T23:03:24.211183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787980,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682932,"statfs":{"total":575970213888,"available":574139322368,"internally_reserved":0,"allocated":3919872,"data_stored":2576304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002284"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T23:02:32.933489+0000","last_change":"2024-09-13T23:02:08.113448+0000","last_active":"2024-09-13T23:02:32.933489+0000","last_peered":"2024-09-13T23:02:32.933489+0000","last_clean":"2024-09-13T23:02:32.933489+0000","last_became_active":"2024-09-13T23:02:08.113149+0000","last_became_peered":"2024-09-13T23:02:08.113149+0000","last_unstale":"2024-09-13T23:02:32.933489+0000","last_undegraded":"2024-09-13T23:02:32.933489+0000","last_fullsized":"2024-09-13T23:02:32.933489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:01:22.863199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:01:22.863199+0000","last_clean_scrub_stamp":"2024-09-13T23:01:22.863199+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:18.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Sep 13 23:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":0.313},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.24199999999999999}]},{"osd":1,"last update":"Fri Sep 13 23:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.26000000000000001}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298292,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446860,"statfs":{"total":95995035648,"available":95689584640,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 23:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":3.9700000000000002,"5min":3.9700000000000002,"15min":3.9700000000000002},"last":0.219},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.376,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":3.9900000000000002,"5min":3.9900000000000002,"15min":3.9900000000000002},"last":0.23499999999999999}]},{"osd":2,"last update":"Fri Sep 13 23:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.254},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.032,"5min":4.032,"15min":4.032},"last":0.26300000000000001}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.9209999999999998,"5min":3.9209999999999998,"15min":3.9209999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 23:03:09 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":18.547999999999998,"5min":18.547999999999998,"15min":18.547999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298284,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446868,"statfs":{"total":95995035648,"available":95689592832,"internally_reserved":0,"allocated":950272,"data_stored":724568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 23:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45300000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.32700000000000001,"15min":0.32300000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.51200000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.37}]},{"osd":2,"last update":"Fri Sep 13 23:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Sep 13 23:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Sep 13 23:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":7.4870000000000001,"5min":7.4870000000000001,"15min":7.4870000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4989999999999997,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:03:25.816 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T23:03:25.816 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T23:03:25.816 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T23:03:25.816 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T23:03:25.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:25 smithi152 ceph-mon[34465]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:25.982 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:25 smithi115 ceph-mon[27601]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:26.074 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:26 smithi115 ceph-mon[27601]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T23:03:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:26 smithi152 ceph-mon[34465]: from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.555+0000 7f9c587bf640 1 -- 172.21.15.115:0/2498404666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 msgr2=0x7f9c50102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2498404666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50102a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c440048d0 tx=0x7f9c44009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- 172.21.15.115:0/2498404666 shutdown_connections 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2498404666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 0x7f9c500fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2498404666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50102a30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- 172.21.15.115:0/2498404666 >> 172.21.15.115:0/2498404666 conn(0x7f9c50070ce0 msgr2=0x7f9c500710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- 172.21.15.115:0/2498404666 shutdown_connections 2024-09-13T23:03:27.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- 172.21.15.115:0/2498404666 wait complete. 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 Processor -- start 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- start start 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 0x7f9c501131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50113d10 con 0x7f9c50102660 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.556+0000 7f9c587bf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5010d150 con 0x7f9c500fac80 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54282/0 (socket says 172.21.15.115:54282) 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 -- 172.21.15.115:0/2775460584 learned_addr learned my addr 172.21.15.115:0/2775460584 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:27.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c5655b640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 0x7f9c501131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 -- 172.21.15.115:0/2775460584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 msgr2=0x7f9c501131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 0x7f9c501131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 -- 172.21.15.115:0/2775460584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44005040 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c55d5a640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c810 tx=0x7f9c400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4000a7a0 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c4000ada0 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5010d430 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c40011380 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.557+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5010d9d0 con 0x7f9c50102660 2024-09-13T23:03:27.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.558+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c500657d0 con 0x7f9c50102660 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.559+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9c400127d0 con 0x7f9c50102660 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.559+0000 7f9c4effd640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 0x7f9c38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.559+0000 7f9c5655b640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 0x7f9c38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.559+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9c4008e300 con 0x7f9c50102660 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.560+0000 7f9c5655b640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 0x7f9c38071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ac0 tx=0x7f9c44035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:27.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.563+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c4005b2e0 con 0x7f9c50102660 2024-09-13T23:03:27.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.755+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9c50109690 con 0x7f9c50102660 2024-09-13T23:03:27.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.756+0000 7f9c4effd640 1 -- 172.21.15.115:0/2775460584 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9c4005b100 con 0x7f9c50102660 2024-09-13T23:03:27.757 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:27.757 INFO:teuthology.orchestra.run.smithi115.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T23:03:27.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.757+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 msgr2=0x7f9c38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:27.760 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.757+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 0x7f9c38071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009ac0 tx=0x7f9c44035040 comp rx=0 tx=0).stop 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.757+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 msgr2=0x7f9c50113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.757+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c810 tx=0x7f9c400043c0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 shutdown_connections 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c3806ed60 0x7f9c38071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c50102660 0x7f9c50113710 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 --2- 172.21.15.115:0/2775460584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c500fac80 0x7f9c501131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 >> 172.21.15.115:0/2775460584 conn(0x7f9c50070ce0 msgr2=0x7f9c500fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 shutdown_connections 2024-09-13T23:03:27.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:27.758+0000 7f9c587bf640 1 -- 172.21.15.115:0/2775460584 wait complete. 2024-09-13T23:03:27.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:27 smithi152 ceph-mon[34465]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:28.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:27 smithi115 ceph-mon[27601]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:28.419 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T23:03:28.419 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T23:03:28.419 INFO:teuthology.run_tasks:Running task print... 2024-09-13T23:03:28.430 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-13T23:03:28.430 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:03:28.455 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:03:28.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T23:03:28.703 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:28.927 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:28 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2775460584' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T23:03:28.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:28 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2775460584' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T23:03:29.792 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:29 smithi115 ceph-mon[27601]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:29.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:29 smithi152 ceph-mon[34465]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:30.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- 172.21.15.115:0/3772713275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fb430 msgr2=0x7fed180fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:30.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/3772713275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fb430 0x7fed180fb840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed080048d0 tx=0x7fed08009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- 172.21.15.115:0/3772713275 shutdown_connections 2024-09-13T23:03:30.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/3772713275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fc700 0x7fed180fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/3772713275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fb430 0x7fed180fb840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- 172.21.15.115:0/3772713275 >> 172.21.15.115:0/3772713275 conn(0x7fed180f6c10 msgr2=0x7fed180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- 172.21.15.115:0/3772713275 shutdown_connections 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- 172.21.15.115:0/3772713275 wait complete. 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 Processor -- start 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- start start 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fb430 0x7fed1810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.284+0000 7fed1dfd1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1810cb20 con 0x7fed180fc700 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed1dfd1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1810d340 con 0x7fed180fb430 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:30.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54304/0 (socket says 172.21.15.115:54304) 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 -- 172.21.15.115:0/2878909714 learned_addr learned my addr 172.21.15.115:0/2878909714 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed177fe640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fb430 0x7fed1810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 -- 172.21.15.115:0/2878909714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fb430 msgr2=0x7fed1810bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fb430 0x7fed1810bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 -- 172.21.15.115:0/2878909714 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08005040 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed0effd640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c790 tx=0x7fed000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0000a820 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed0000ae20 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed000113a0 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1810d5d0 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.285+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1810db70 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.286+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed180fa890 con 0x7fed180fc700 2024-09-13T23:03:30.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.287+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fed00012400 con 0x7fed180fc700 2024-09-13T23:03:30.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.287+0000 7fed14ff9640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 0x7fed04071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:30.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.287+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fed0008def0 con 0x7fed180fc700 2024-09-13T23:03:30.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.287+0000 7fed177fe640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 0x7fed04071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:30.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.288+0000 7fed177fe640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 0x7fed04071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed08007ac0 tx=0x7fed08035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:30.298 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.291+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fed0005b470 con 0x7fed180fc700 2024-09-13T23:03:30.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.450+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fed1804b720 con 0x7fed180fc700 2024-09-13T23:03:30.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.455+0000 7fed14ff9640 1 -- 172.21.15.115:0/2878909714 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fed0005ae10 con 0x7fed180fc700 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 msgr2=0x7fed04071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 0x7fed04071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed08007ac0 tx=0x7fed08035040 comp rx=0 tx=0).stop 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 msgr2=0x7fed1810c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c790 tx=0x7fed000043c0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 shutdown_connections 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fed0406ed60 0x7fed04071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed180fc700 0x7fed1810c4d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 --2- 172.21.15.115:0/2878909714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed180fb430 0x7fed1810bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 >> 172.21.15.115:0/2878909714 conn(0x7fed180f6c10 msgr2=0x7fed180f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 shutdown_connections 2024-09-13T23:03:30.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:30.457+0000 7fed1dfd1640 1 -- 172.21.15.115:0/2878909714 wait complete. 2024-09-13T23:03:31.269 INFO:teuthology.run_tasks:Running task print... 2024-09-13T23:03:31.282 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T23:03:31.283 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:03:31.342 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:03:31.342 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T23:03:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2878909714' entity='client.admin' 2024-09-13T23:03:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:31.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:31.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:31 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:31.589 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2878909714' entity='client.admin' 2024-09-13T23:03:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:31.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:31 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 -- 172.21.15.115:0/3207263156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 msgr2=0x7fdbc40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 --2- 172.21.15.115:0/3207263156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc40fdc90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80048d0 tx=0x7fdbb8009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 -- 172.21.15.115:0/3207263156 shutdown_connections 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 --2- 172.21.15.115:0/3207263156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc40fdc90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 --2- 172.21.15.115:0/3207263156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 0x7fdbc40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 -- 172.21.15.115:0/3207263156 >> 172.21.15.115:0/3207263156 conn(0x7fdbc40f7d30 msgr2=0x7fdbc40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 -- 172.21.15.115:0/3207263156 shutdown_connections 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.137+0000 7fdbcc280640 1 -- 172.21.15.115:0/3207263156 wait complete. 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 Processor -- start 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 -- start start 2024-09-13T23:03:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 0x7fdbc410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc410e490 con 0x7fdbc40fd820 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbcc280640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc410e600 con 0x7fdbc40fc550 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbc981b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbc981b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54328/0 (socket says 172.21.15.115:54328) 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbc981b640 1 -- 172.21.15.115:0/1809101380 learned_addr learned my addr 172.21.15.115:0/1809101380 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.138+0000 7fdbca01c640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 0x7fdbc410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc981b640 1 -- 172.21.15.115:0/1809101380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 msgr2=0x7fdbc410d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc981b640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 0x7fdbc410d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc981b640 1 -- 172.21.15.115:0/1809101380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8005040 con 0x7fdbc40fd820 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc981b640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8003080 tx=0x7fdbb8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb8038070 con 0x7fdbc40fd820 2024-09-13T23:03:33.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc410e880 con 0x7fdbc40fd820 2024-09-13T23:03:33.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbb802abd0 con 0x7fdbc40fd820 2024-09-13T23:03:33.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb803e670 con 0x7fdbc40fd820 2024-09-13T23:03:33.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.139+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc410eda0 con 0x7fdbc40fd820 2024-09-13T23:03:33.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.140+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40fb9b0 con 0x7fdbc40fd820 2024-09-13T23:03:33.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.140+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fdbb8030020 con 0x7fdbc40fd820 2024-09-13T23:03:33.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.141+0000 7fdbc2ffd640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 0x7fdbac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:33.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.141+0000 7fdbca01c640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 0x7fdbac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:33.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.141+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdbb80ae250 con 0x7fdbc40fd820 2024-09-13T23:03:33.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.141+0000 7fdbca01c640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 0x7fdbac071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4001250 tx=0x7fdbb4009620 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:33.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.145+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdbb807b6b0 con 0x7fdbc40fd820 2024-09-13T23:03:33.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.314+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc410efc0 con 0x7fdbac06ed60 2024-09-13T23:03:33.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.315+0000 7fdbc2ffd640 1 -- 172.21.15.115:0/1809101380 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fdbc410efc0 con 0x7fdbac06ed60 2024-09-13T23:03:33.316 INFO:teuthology.orchestra.run.smithi115.stdout:Backend: cephadm 2024-09-13T23:03:33.316 INFO:teuthology.orchestra.run.smithi115.stdout:Available: Yes 2024-09-13T23:03:33.316 INFO:teuthology.orchestra.run.smithi115.stdout:Paused: No 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.316+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 msgr2=0x7fdbac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.316+0000 7fdbcc280640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 0x7fdbac071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4001250 tx=0x7fdbb4009620 comp rx=0 tx=0).stop 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.316+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 msgr2=0x7fdbc410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.316+0000 7fdbcc280640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8003080 tx=0x7fdbb8009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 shutdown_connections 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdbac06ed60 0x7fdbac071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc40fd820 0x7fdbc410d620 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 --2- 172.21.15.115:0/1809101380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc40fc550 0x7fdbc410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:33.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 >> 172.21.15.115:0/1809101380 conn(0x7fdbc40f7d30 msgr2=0x7fdbc40f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:33.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 shutdown_connections 2024-09-13T23:03:33.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:33.317+0000 7fdbcc280640 1 -- 172.21.15.115:0/1809101380 wait complete. 2024-09-13T23:03:33.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:33 smithi152 ceph-mon[34465]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:33.746 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:33 smithi115 ceph-mon[27601]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:33.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T23:03:34.158 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:34.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:34 smithi115 ceph-mon[27601]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:34 smithi152 ceph-mon[34465]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:35 smithi115 ceph-mon[27601]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:35 smithi152 ceph-mon[34465]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.786+0000 7fc22d6ec640 1 -- 172.21.15.115:0/1841105614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fc520 msgr2=0x7fc2280fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.786+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/1841105614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fc520 0x7fc2280fc930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc218009c50 tx=0x7fc218004d10 comp rx=0 tx=0).stop 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.786+0000 7fc22d6ec640 1 -- 172.21.15.115:0/1841105614 shutdown_connections 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.786+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/1841105614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fd7f0 0x7fc2280fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.786+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/1841105614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fc520 0x7fc2280fc930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- 172.21.15.115:0/1841105614 >> 172.21.15.115:0/1841105614 conn(0x7fc2280f7ce0 msgr2=0x7fc2280fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- 172.21.15.115:0/1841105614 shutdown_connections 2024-09-13T23:03:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- 172.21.15.115:0/1841105614 wait complete. 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 Processor -- start 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- start start 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fc520 0x7fc22810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22810e450 con 0x7fc2280fd7f0 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc22d6ec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22810e5c0 con 0x7fc2280fc520 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.787+0000 7fc2267fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54346/0 (socket says 172.21.15.115:54346) 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 -- 172.21.15.115:0/336110981 learned_addr learned my addr 172.21.15.115:0/336110981 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc226ffd640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fc520 0x7fc22810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 -- 172.21.15.115:0/336110981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fc520 msgr2=0x7fc22810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fc520 0x7fc22810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 -- 172.21.15.115:0/336110981 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180098b0 con 0x7fc2280fd7f0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc2267fc640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00b790 tx=0x7fc21c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21c00c700 con 0x7fc2280fd7f0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22810e8a0 con 0x7fc2280fd7f0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc21c00cd00 con 0x7fc2280fd7f0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc21c015e70 con 0x7fc2280fd7f0 2024-09-13T23:03:35.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.788+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22810edc0 con 0x7fc2280fd7f0 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.789+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2280fb980 con 0x7fc2280fd7f0 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.790+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc21c012070 con 0x7fc2280fd7f0 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.790+0000 7fc20f7fe640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 0x7fc210071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.790+0000 7fc226ffd640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 0x7fc210071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.790+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc21c08d9c0 con 0x7fc2280fd7f0 2024-09-13T23:03:35.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.791+0000 7fc226ffd640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 0x7fc210071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc218000f80 tx=0x7fc218004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:35.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.794+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc21c05ae20 con 0x7fc2280fd7f0 2024-09-13T23:03:35.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.957+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc22810f040 con 0x7fc21006ed60 2024-09-13T23:03:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.964+0000 7fc20f7fe640 1 -- 172.21.15.115:0/336110981 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7fc22810f040 con 0x7fc21006ed60 2024-09-13T23:03:35.965 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 2m ago 4m 26.4M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (5m) 2m ago 5m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (4m) 64s ago 4m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 2m ago 4m 78.5M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (6m) 2m ago 6m 437M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (4m) 64s ago 4m 400M - 17.2.7-1629-geb16b97b ab51d1bebd12 7d007dcea4b4 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (6m) 2m ago 6m 42.9M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (4m) 64s ago 4m 41.9M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 2m ago 5m 16.1M - 1.5.0 0da6a335fe13 f6758bd48343 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 64s ago 4m 17.0M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 2m ago 3m 35.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 2m ago 2m 36.3M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 2m ago 2m 11.7M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:03:35.966 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (119s) 64s ago 118s 41.3M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:03:35.967 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (94s) 64s ago 94s 35.9M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:03:35.967 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (70s) 64s ago 69s 11.1M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:03:35.967 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 2m ago 4m 35.9M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:03:35.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 msgr2=0x7fc210071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 0x7fc210071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc218000f80 tx=0x7fc218004d10 comp rx=0 tx=0).stop 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 msgr2=0x7fc22810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00b790 tx=0x7fc21c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 shutdown_connections 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc21006ed60 0x7fc210071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2280fd7f0 0x7fc22810d5e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 --2- 172.21.15.115:0/336110981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2280fc520 0x7fc22810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 >> 172.21.15.115:0/336110981 conn(0x7fc2280f7ce0 msgr2=0x7fc2280f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 shutdown_connections 2024-09-13T23:03:35.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:35.967+0000 7fc22d6ec640 1 -- 172.21.15.115:0/336110981 wait complete. 2024-09-13T23:03:36.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T23:03:36.934 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:37 smithi152 ceph-mon[34465]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:37 smithi152 ceph-mon[34465]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:37.779 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:37 smithi115 ceph-mon[27601]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:37.780 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:37 smithi115 ceph-mon[27601]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 -- 172.21.15.115:0/3839536538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 msgr2=0x7f52880fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3839536538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880fb850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52840048d0 tx=0x7f5284009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 -- 172.21.15.115:0/3839536538 shutdown_connections 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3839536538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 0x7f52880fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3839536538 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880fb850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 -- 172.21.15.115:0/3839536538 >> 172.21.15.115:0/3839536538 conn(0x7f52880f6c20 msgr2=0x7f52880f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 -- 172.21.15.115:0/3839536538 shutdown_connections 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.526+0000 7f528fcf7640 1 -- 172.21.15.115:0/3839536538 wait complete. 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 Processor -- start 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 -- start start 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 0x7f52880fda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880fdf90 con 0x7f52880fb440 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528fcf7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880fe100 con 0x7f52880fc710 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46720/0 (socket says 172.21.15.115:46720) 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 -- 172.21.15.115:0/3309299376 learned_addr learned my addr 172.21.15.115:0/3309299376 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528d292640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 0x7f52880fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 -- 172.21.15.115:0/3309299376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 msgr2=0x7f52880fda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 0x7f52880fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 -- 172.21.15.115:0/3309299376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284005040 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.527+0000 7f528da93640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.528+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5284038070 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.528+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f528402ae90 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.528+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880fe380 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.528+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f528403d420 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.528+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52880fe840 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.529+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52880fa8a0 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.529+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5284030020 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.530+0000 7f527e7fc640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 0x7f5274071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.530+0000 7f528d292640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 0x7f5274071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.530+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f52840ae600 con 0x7f52880fb440 2024-09-13T23:03:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.530+0000 7f528d292640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 0x7f5274071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5278004bc0 tx=0x7f5278009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.534+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f528407ba60 con 0x7f52880fb440 2024-09-13T23:03:38.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.695+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5288103fd0 con 0x7f527406ed60 2024-09-13T23:03:38.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.699+0000 7f527e7fc640 1 -- 172.21.15.115:0/3309299376 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f5288103fd0 con 0x7f527406ed60 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:crash 2/2 2m ago 5m * 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:mon 2/2 2m ago 4m smithi115:172.21.15.115=smithi115;smithi152:172.21.15.152=smithi152;count:2 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:osd 6 2m ago - 2024-09-13T23:03:38.700 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T23:03:38.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 msgr2=0x7f5274071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:38.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 0x7f5274071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5278004bc0 tx=0x7f5278009040 comp rx=0 tx=0).stop 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 msgr2=0x7f52880ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 shutdown_connections 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f527406ed60 0x7f5274071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52880fc710 0x7f52880fda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 --2- 172.21.15.115:0/3309299376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52880fb440 0x7f52880ff4c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 >> 172.21.15.115:0/3309299376 conn(0x7f52880f6c20 msgr2=0x7f52880660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 shutdown_connections 2024-09-13T23:03:38.702 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:38.701+0000 7f528fcf7640 1 -- 172.21.15.115:0/3309299376 wait complete. 2024-09-13T23:03:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:39.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T23:03:39.794 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:39 smithi115 ceph-mon[27601]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:39 smithi115 ceph-mon[27601]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:39 smithi152 ceph-mon[34465]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:39 smithi152 ceph-mon[34465]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 -- 172.21.15.115:0/1409846488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 msgr2=0x7f57040faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 --2- 172.21.15.115:0/1409846488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f57040faff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f57000049c0 tx=0x7f570000aeb0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 -- 172.21.15.115:0/1409846488 shutdown_connections 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 --2- 172.21.15.115:0/1409846488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f57040fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 --2- 172.21.15.115:0/1409846488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f57040faff0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 -- 172.21.15.115:0/1409846488 >> 172.21.15.115:0/1409846488 conn(0x7f57040f63a0 msgr2=0x7f57040f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 -- 172.21.15.115:0/1409846488 shutdown_connections 2024-09-13T23:03:41.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.314+0000 7f570bdb8640 1 -- 172.21.15.115:0/1409846488 wait complete. 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 Processor -- start 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 -- start start 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f570410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570410dbe0 con 0x7f57040fabe0 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f570bdb8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570410e400 con 0x7f57040fbeb0 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46728/0 (socket says 172.21.15.115:46728) 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 -- 172.21.15.115:0/118478238 learned_addr learned my addr 172.21.15.115:0/118478238 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709353640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f570410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 -- 172.21.15.115:0/118478238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 msgr2=0x7f570410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:41.348 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f570410d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709b54640 1 -- 172.21.15.115:0/118478238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700005040 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.315+0000 7f5709353640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f570410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f5709b54640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5700000c00 tx=0x7f570000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5700033920 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5700034420 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570410e630 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570003c620 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.316+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570410ebd0 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.317+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57040fa040 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.317+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5700031020 con 0x7f57040fabe0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.318+0000 7f56fa7fc640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 0x7f56f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.318+0000 7f5709353640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 0x7f56f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:41.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.318+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f57000ae550 con 0x7f57040fabe0 2024-09-13T23:03:41.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.318+0000 7f5709353640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 0x7f56f0071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009af0 tx=0x7f56f400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:41.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.322+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f570007ba30 con 0x7f57040fabe0 2024-09-13T23:03:41.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.484+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f570410ef80 con 0x7f56f006ed60 2024-09-13T23:03:41.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.486+0000 7f56fa7fc640 1 -- 172.21.15.115:0/118478238 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f570410ef80 con 0x7f56f006ed60 2024-09-13T23:03:41.487 INFO:teuthology.orchestra.run.smithi115.stdout:HOST ADDR LABELS STATUS 2024-09-13T23:03:41.487 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 172.21.15.115 2024-09-13T23:03:41.487 INFO:teuthology.orchestra.run.smithi115.stdout:smithi152 172.21.15.152 2024-09-13T23:03:41.487 INFO:teuthology.orchestra.run.smithi115.stdout:2 hosts in cluster 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 msgr2=0x7f56f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 0x7f56f0071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009af0 tx=0x7f56f400b040 comp rx=0 tx=0).stop 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 msgr2=0x7f570410d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5700000c00 tx=0x7f570000aeb0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 shutdown_connections 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f56f006ed60 0x7f56f0071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57040fbeb0 0x7f570410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 --2- 172.21.15.115:0/118478238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57040fabe0 0x7f570410d050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:41.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 >> 172.21.15.115:0/118478238 conn(0x7f57040f63a0 msgr2=0x7f57040f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:41.490 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:41 smithi115 ceph-mon[27601]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:41.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 shutdown_connections 2024-09-13T23:03:41.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:41.488+0000 7f570bdb8640 1 -- 172.21.15.115:0/118478238 wait complete. 2024-09-13T23:03:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:41 smithi152 ceph-mon[34465]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:42.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T23:03:42.418 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:42.753 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:42 smithi115 ceph-mon[27601]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:42 smithi152 ceph-mon[34465]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:43.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:43 smithi115 ceph-mon[27601]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:43.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:43 smithi152 ceph-mon[34465]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:43.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 -- 172.21.15.115:0/4066236533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 msgr2=0x7f89940fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 --2- 172.21.15.115:0/4066236533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f89940fcb90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f89880048d0 tx=0x7f8988009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 -- 172.21.15.115:0/4066236533 shutdown_connections 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 --2- 172.21.15.115:0/4066236533 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f89940fcb90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 --2- 172.21.15.115:0/4066236533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 0x7f89940fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 -- 172.21.15.115:0/4066236533 >> 172.21.15.115:0/4066236533 conn(0x7f89940f6c10 msgr2=0x7f89940f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 -- 172.21.15.115:0/4066236533 shutdown_connections 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.979+0000 7f899a1f0640 1 -- 172.21.15.115:0/4066236533 wait complete. 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 Processor -- start 2024-09-13T23:03:43.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 -- start start 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 0x7f8994112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899410dcb0 con 0x7f89940fc720 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f899a1f0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940666a0 con 0x7f89940fb450 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f8992ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f8992ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:46740/0 (socket says 172.21.15.115:46740) 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f8992ffd640 1 -- 172.21.15.115:0/2801607239 learned_addr learned my addr 172.21.15.115:0/2801607239 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:43.984 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.980+0000 7f89937fe640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 0x7f8994112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f8992ffd640 1 -- 172.21.15.115:0/2801607239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 msgr2=0x7f8994112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f8992ffd640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 0x7f8994112200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f8992ffd640 1 -- 172.21.15.115:0/2801607239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8988005040 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f8992ffd640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8988000c00 tx=0x7f8988009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8988038070 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f898802ae90 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8994066920 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898803d420 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.981+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8994114fc0 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.982+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940fa8b0 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.982+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8988030020 con 0x7f89940fc720 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.983+0000 7f897bfff640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 0x7f897c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:43.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.983+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f89880ae600 con 0x7f89940fc720 2024-09-13T23:03:43.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.983+0000 7f89937fe640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 0x7f897c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:43.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.983+0000 7f89937fe640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 0x7f897c071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8984004550 tx=0x7f8984009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:43.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:43.987+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f898807ba60 con 0x7f89940fc720 2024-09-13T23:03:44.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.150+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8994100b70 con 0x7f897c06ed60 2024-09-13T23:03:44.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.152+0000 7f897bfff640 1 -- 172.21.15.115:0/2801607239 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f8994100b70 con 0x7f897c06ed60 2024-09-13T23:03:44.153 INFO:teuthology.orchestra.run.smithi115.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T23:03:44.153 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T23:03:44.153 INFO:teuthology.orchestra.run.smithi115.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-09-13T23:03:44.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 msgr2=0x7f897c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 0x7f897c071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8984004550 tx=0x7f8984009040 comp rx=0 tx=0).stop 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 msgr2=0x7f8994114750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8988000c00 tx=0x7f8988009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 shutdown_connections 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f897c06ed60 0x7f897c071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89940fc720 0x7f8994114750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 --2- 172.21.15.115:0/2801607239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89940fb450 0x7f8994112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 >> 172.21.15.115:0/2801607239 conn(0x7f89940f6c10 msgr2=0x7f89940f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 shutdown_connections 2024-09-13T23:03:44.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:44.154+0000 7f899a1f0640 1 -- 172.21.15.115:0/2801607239 wait complete. 2024-09-13T23:03:44.780 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:03:44.790 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:03:44.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T23:03:45.034 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:45.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:45 smithi115 ceph-mon[27601]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:45 smithi115 ceph-mon[27601]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:45 smithi152 ceph-mon[34465]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:45 smithi152 ceph-mon[34465]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:46.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 -- 172.21.15.115:0/1371792860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fd800 msgr2=0x7fe1180fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 --2- 172.21.15.115:0/1371792860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fd800 0x7fe1180fdc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1000048d0 tx=0x7fe100009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 -- 172.21.15.115:0/1371792860 shutdown_connections 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 --2- 172.21.15.115:0/1371792860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fd800 0x7fe1180fdc70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 --2- 172.21.15.115:0/1371792860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fc530 0x7fe1180fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 -- 172.21.15.115:0/1371792860 >> 172.21.15.115:0/1371792860 conn(0x7fe1180f7d10 msgr2=0x7fe1180fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 -- 172.21.15.115:0/1371792860 shutdown_connections 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.552+0000 7fe11d734640 1 -- 172.21.15.115:0/1371792860 wait complete. 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 Processor -- start 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 -- start start 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 0x7fe11810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11810dc00 con 0x7fe1180fc530 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe11d734640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11810e420 con 0x7fe1180fd800 2024-09-13T23:03:46.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe116ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe116ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34372/0 (socket says 172.21.15.115:34372) 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.553+0000 7fe116ffd640 1 -- 172.21.15.115:0/830370934 learned_addr learned my addr 172.21.15.115:0/830370934 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe10e7fc640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 0x7fe11810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe116ffd640 1 -- 172.21.15.115:0/830370934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 msgr2=0x7fe11810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe116ffd640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 0x7fe11810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe116ffd640 1 -- 172.21.15.115:0/830370934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100005040 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe10e7fc640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 0x7fe11810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe116ffd640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe108002a50 tx=0x7fe108004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe108007c30 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe10800f040 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11810e6b0 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe10800db50 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.554+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11810ec50 con 0x7fe1180fc530 2024-09-13T23:03:46.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.555+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1180fb990 con 0x7fe1180fc530 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.556+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe10800dcb0 con 0x7fe1180fc530 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.556+0000 7fe10ffff640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 0x7fe104071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.556+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe10808ddb0 con 0x7fe1180fc530 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.556+0000 7fe10e7fc640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 0x7fe104071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.557+0000 7fe10e7fc640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 0x7fe104071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10000b020 tx=0x7fe100009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:46.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.560+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe10805b210 con 0x7fe1180fc530 2024-09-13T23:03:46.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:46.737+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe11810efb0 con 0x7fe10406ed60 2024-09-13T23:03:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:47 smithi152 ceph-mon[34465]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:47 smithi152 ceph-mon[34465]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:47 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T23:03:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:47 smithi115 ceph-mon[27601]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:47 smithi115 ceph-mon[27601]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:47 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T23:03:48.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.521+0000 7fe10ffff640 1 -- 172.21.15.115:0/830370934 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe11810efb0 con 0x7fe10406ed60 2024-09-13T23:03:48.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 msgr2=0x7fe104071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:48.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 0x7fe104071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe10000b020 tx=0x7fe100009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:48.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 msgr2=0x7fe11810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:48.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe108002a50 tx=0x7fe108004600 comp rx=0 tx=0).stop 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 shutdown_connections 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe10406ed60 0x7fe104071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1180fd800 0x7fe11810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 --2- 172.21.15.115:0/830370934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1180fc530 0x7fe11810d070 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 >> 172.21.15.115:0/830370934 conn(0x7fe1180f7d10 msgr2=0x7fe1180f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 shutdown_connections 2024-09-13T23:03:48.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:48.525+0000 7fe11d734640 1 -- 172.21.15.115:0/830370934 wait complete. 2024-09-13T23:03:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:48 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T23:03:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:48 smithi115 ceph-mon[27601]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T23:03:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:48 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T23:03:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:48 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[27597]: 2024-09-13T23:03:48.502+0000 7f5ae1cda640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:03:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:48 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T23:03:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:48 smithi152 ceph-mon[34465]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T23:03:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:48 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T23:03:49.076 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: pgmap v168: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:03:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: fsmap cephfs:0 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: Saving service mds.cephfs spec with placement count:4 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:49.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:49.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:49 smithi115 ceph-mon[27601]: Deploying daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:03:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: pgmap v168: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:03:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: fsmap cephfs:0 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: Saving service mds.cephfs spec with placement count:4 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:49.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:49.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:49 smithi152 ceph-mon[34465]: Deploying daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:03:50.303 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:50.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:50 smithi115 ceph-mon[27601]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T23:03:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:50 smithi152 ceph-mon[34465]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T23:03:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:51 smithi115 ceph-mon[27601]: pgmap v172: 65 pgs: 17 active+clean, 19 creating+peering, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:51 smithi115 ceph-mon[27601]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T23:03:51.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:51 smithi115 ceph-mon[27601]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T23:03:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:51 smithi152 ceph-mon[34465]: pgmap v172: 65 pgs: 17 active+clean, 19 creating+peering, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:51 smithi152 ceph-mon[34465]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T23:03:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:51 smithi152 ceph-mon[34465]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T23:03:52.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- 172.21.15.115:0/3892712278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fdba0 msgr2=0x7f37340fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:52.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3892712278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fdba0 0x7f37340fdfb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37240048d0 tx=0x7f3724009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- 172.21.15.115:0/3892712278 shutdown_connections 2024-09-13T23:03:52.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3892712278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fe4f0 0x7f37340fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3892712278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fdba0 0x7f37340fdfb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- 172.21.15.115:0/3892712278 >> 172.21.15.115:0/3892712278 conn(0x7f37340f63a0 msgr2=0x7f37340f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- 172.21.15.115:0/3892712278 shutdown_connections 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- 172.21.15.115:0/3892712278 wait complete. 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 Processor -- start 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.046+0000 7f373a2d4640 1 -- start start 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fdba0 0x7f373410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373410dc00 con 0x7f37340fe4f0 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373410e420 con 0x7f37340fdba0 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:52.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34398/0 (socket says 172.21.15.115:34398) 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 -- 172.21.15.115:0/3643575217 learned_addr learned my addr 172.21.15.115:0/3643575217 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 -- 172.21.15.115:0/3643575217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fdba0 msgr2=0x7f373410d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f3733fff640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fdba0 0x7f373410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fdba0 0x7f373410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 -- 172.21.15.115:0/3643575217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724005040 con 0x7f37340fe4f0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f37337fe640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f372800c760 tx=0x7f37280043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372800a790 con 0x7f37340fe4f0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373410e6b0 con 0x7f37340fe4f0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f372800ad90 con 0x7f37340fe4f0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37280113a0 con 0x7f37340fe4f0 2024-09-13T23:03:52.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.047+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373410ec50 con 0x7f37340fe4f0 2024-09-13T23:03:52.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.048+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340fa040 con 0x7f37340fe4f0 2024-09-13T23:03:52.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.049+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3728012400 con 0x7f37340fe4f0 2024-09-13T23:03:52.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.049+0000 7f3730ff9640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 0x7f371c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:52.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.049+0000 7f3733fff640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 0x7f371c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:52.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.049+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f372808e2d0 con 0x7f37340fe4f0 2024-09-13T23:03:52.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.050+0000 7f3733fff640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 0x7f371c071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3724000c00 tx=0x7f3724009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:52.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.053+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f372805b470 con 0x7f37340fe4f0 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.251+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f373404b720 con 0x7f37340fe4f0 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.251+0000 7f3730ff9640 1 -- 172.21.15.115:0/3643575217 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f372805ae10 con 0x7f37340fe4f0 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:e2 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:52.252 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 2 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:03:48.502828+0000 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:03:52.253 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 0 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:in 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:up {} 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 0 2024-09-13T23:03:52.254 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:52.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:03:52.255 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 2 2024-09-13T23:03:52.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 msgr2=0x7f371c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:52.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 0x7f371c071210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3724000c00 tx=0x7f3724009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.255 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 msgr2=0x7f373410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f372800c760 tx=0x7f37280043c0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 shutdown_connections 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f371c06ed60 0x7f371c071210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37340fe4f0 0x7f373410d5b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 --2- 172.21.15.115:0/3643575217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37340fdba0 0x7f373410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 >> 172.21.15.115:0/3643575217 conn(0x7f37340f63a0 msgr2=0x7f37340f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 shutdown_connections 2024-09-13T23:03:52.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:52.253+0000 7f373a2d4640 1 -- 172.21.15.115:0/3643575217 wait complete. 2024-09-13T23:03:52.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:52 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3643575217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:52.850 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:03:52.863 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:03:52.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T23:03:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:52 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3643575217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:53.122 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:53.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: pgmap v174: 65 pgs: 35 active+clean, 19 creating+peering, 11 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:53.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:53.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:53.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:53.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: pgmap v174: 65 pgs: 35 active+clean, 19 creating+peering, 11 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:53.838 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:53.839 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:54.627 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 -- 172.21.15.115:0/3699878270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c066450 msgr2=0x7f366c0ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 --2- 172.21.15.115:0/3699878270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c066450 0x7f366c0ff1b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36600048d0 tx=0x7f3660009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 -- 172.21.15.115:0/3699878270 shutdown_connections 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 --2- 172.21.15.115:0/3699878270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c0ff6f0 0x7f366c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 --2- 172.21.15.115:0/3699878270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c066450 0x7f366c0ff1b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 -- 172.21.15.115:0/3699878270 >> 172.21.15.115:0/3699878270 conn(0x7f366c0f6c00 msgr2=0x7f366c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 -- 172.21.15.115:0/3699878270 shutdown_connections 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.626+0000 7f36738e0640 1 -- 172.21.15.115:0/3699878270 wait complete. 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 Processor -- start 2024-09-13T23:03:54.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 -- start start 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c066450 0x7f366c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c10dc30 con 0x7f366c0ff6f0 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f36738e0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c10e3e0 con 0x7f366c066450 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f3670e7b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f367167c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c066450 0x7f366c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f3670e7b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34452/0 (socket says 172.21.15.115:34452) 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.627+0000 7f3670e7b640 1 -- 172.21.15.115:0/3762649496 learned_addr learned my addr 172.21.15.115:0/3762649496 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:54.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f3670e7b640 1 -- 172.21.15.115:0/3762649496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c066450 msgr2=0x7f366c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f3670e7b640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c066450 0x7f366c10d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f3670e7b640 1 -- 172.21.15.115:0/3762649496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3660005040 con 0x7f366c0ff6f0 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f3670e7b640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f366800c7e0 tx=0x7f36680043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f366800a7a0 con 0x7f366c0ff6f0 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c10e670 con 0x7f366c0ff6f0 2024-09-13T23:03:54.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f366800ada0 con 0x7f366c0ff6f0 2024-09-13T23:03:54.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36680113a0 con 0x7f366c0ff6f0 2024-09-13T23:03:54.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.628+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c10ec10 con 0x7f366c0ff6f0 2024-09-13T23:03:54.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.630+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0fa880 con 0x7f366c0ff6f0 2024-09-13T23:03:54.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.630+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3668012400 con 0x7f366c0ff6f0 2024-09-13T23:03:54.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.630+0000 7f365dffb640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 0x7f3658071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:54.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.630+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f366808e110 con 0x7f366c0ff6f0 2024-09-13T23:03:54.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.630+0000 7f367167c640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 0x7f3658071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:54.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.631+0000 7f367167c640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 0x7f3658071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3660000c00 tx=0x7f3660035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:54.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.634+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f366805b350 con 0x7f366c0ff6f0 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: Deploying daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6826/2293557563,v1:172.21.15.115:6827/2293557563] up:boot 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: daemon mds.cephfs.smithi115.ywbcks assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: Cluster is now healthy 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: fsmap cephfs:0 1 up:standby 2024-09-13T23:03:54.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:03:54.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:creating} 2024-09-13T23:03:54.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:54 smithi115 ceph-mon[27601]: daemon mds.cephfs.smithi115.ywbcks is now active in filesystem cephfs as rank 0 2024-09-13T23:03:54.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: Deploying daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6826/2293557563,v1:172.21.15.115:6827/2293557563] up:boot 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: daemon mds.cephfs.smithi115.ywbcks assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: Cluster is now healthy 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: fsmap cephfs:0 1 up:standby 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:creating} 2024-09-13T23:03:54.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:54 smithi152 ceph-mon[34465]: daemon mds.cephfs.smithi115.ywbcks is now active in filesystem cephfs as rank 0 2024-09-13T23:03:54.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:54.856+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f366c10ef80 con 0x7f366c0ff6f0 2024-09-13T23:03:55.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.541+0000 7f365dffb640 1 -- 172.21.15.115:0/3762649496 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f366805acf0 con 0x7f366c0ff6f0 2024-09-13T23:03:55.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 msgr2=0x7f3658071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:55.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 0x7f3658071210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3660000c00 tx=0x7f3660035040 comp rx=0 tx=0).stop 2024-09-13T23:03:55.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 msgr2=0x7f366c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:55.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f366800c7e0 tx=0x7f36680043c0 comp rx=0 tx=0).stop 2024-09-13T23:03:55.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 shutdown_connections 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f365806ed60 0x7f3658071210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f366c0ff6f0 0x7f366c10d5e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 --2- 172.21.15.115:0/3762649496 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f366c066450 0x7f366c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 >> 172.21.15.115:0/3762649496 conn(0x7f366c0f6c00 msgr2=0x7f366c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 shutdown_connections 2024-09-13T23:03:55.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:55.543+0000 7f36738e0640 1 -- 172.21.15.115:0/3762649496 wait complete. 2024-09-13T23:03:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:55 smithi115 ceph-mon[27601]: pgmap v175: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 358 B/s wr, 0 op/s 2024-09-13T23:03:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:55 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6826/2293557563,v1:172.21.15.115:6827/2293557563] up:active 2024-09-13T23:03:55.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:55 smithi115 ceph-mon[27601]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2024-09-13T23:03:55.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:55 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3762649496' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T23:03:55.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:55 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:55 smithi152 ceph-mon[34465]: pgmap v175: 65 pgs: 59 active+clean, 6 creating+peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 358 B/s wr, 0 op/s 2024-09-13T23:03:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:55 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6826/2293557563,v1:172.21.15.115:6827/2293557563] up:active 2024-09-13T23:03:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:55 smithi152 ceph-mon[34465]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2024-09-13T23:03:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:55 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3762649496' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T23:03:55.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:55 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:56.183 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:03:56.196 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:03:56.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T23:03:56.776 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:03:56.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:56.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3762649496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:boot 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: daemon mds.cephfs.smithi152.cmykpw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 1 up:standby 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:creating} 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: Deploying daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:03:56.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:56 smithi115 ceph-mon[27601]: daemon mds.cephfs.smithi152.cmykpw is now active in filesystem cephfs as rank 1 2024-09-13T23:03:56.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:56.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T23:03:56.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3762649496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T23:03:56.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:boot 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: daemon mds.cephfs.smithi152.cmykpw assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 1 up:standby 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:creating} 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: Deploying daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:03:56.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:56 smithi152 ceph-mon[34465]: daemon mds.cephfs.smithi152.cmykpw is now active in filesystem cephfs as rank 1 2024-09-13T23:03:57.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:57 smithi115 ceph-mon[27601]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2024-09-13T23:03:57.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:57 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:active 2024-09-13T23:03:57.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:57 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2024-09-13T23:03:57.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:57 smithi152 ceph-mon[34465]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 3 op/s 2024-09-13T23:03:57.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:57 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:active 2024-09-13T23:03:57.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:57 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 -- 172.21.15.115:0/2911323820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 msgr2=0x7f0b680fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 --2- 172.21.15.115:0/2911323820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b680fc960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b640048d0 tx=0x7f0b64009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 -- 172.21.15.115:0/2911323820 shutdown_connections 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 --2- 172.21.15.115:0/2911323820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b680fd820 0x7f0b680fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 --2- 172.21.15.115:0/2911323820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b680fc960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.100 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 -- 172.21.15.115:0/2911323820 >> 172.21.15.115:0/2911323820 conn(0x7f0b680f7d30 msgr2=0x7f0b680fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.080+0000 7f0b7041f640 1 -- 172.21.15.115:0/2911323820 shutdown_connections 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 -- 172.21.15.115:0/2911323820 wait complete. 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 Processor -- start 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 -- start start 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:59.101 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b680fd820 0x7f0b6810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6810dc10 con 0x7f0b680fc550 2024-09-13T23:03:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b7041f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6810e430 con 0x7f0b680fd820 2024-09-13T23:03:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41698/0 (socket says 172.21.15.115:41698) 2024-09-13T23:03:59.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 -- 172.21.15.115:0/3679748412 learned_addr learned my addr 172.21.15.115:0/3679748412 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 -- 172.21.15.115:0/3679748412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b680fd820 msgr2=0x7f0b6810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b680fd820 0x7f0b6810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.081+0000 7f0b6e1bb640 1 -- 172.21.15.115:0/3679748412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64005040 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b6e1bb640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0b64003080 tx=0x7f0b64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b64038070 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b6402abd0 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6810e660 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6403e670 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.082+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6810ec00 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.083+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680fb9b0 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.083+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f0b64030020 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.084+0000 7f0b5effd640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 0x7f0b54071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.084+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0b640ae4d0 con 0x7f0b680fc550 2024-09-13T23:03:59.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.084+0000 7f0b6d9ba640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 0x7f0b54071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.084+0000 7f0b6d9ba640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 0x7f0b54071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b6810ce30 tx=0x7f0b58007cb0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:59.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.088+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0b6407b670 con 0x7f0b680fc550 2024-09-13T23:03:59.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.284+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f0b6804b720 con 0x7f0b680fc550 2024-09-13T23:03:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.560+0000 7f0b5effd640 1 -- 172.21.15.115:0/3679748412 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f0b6407b010 con 0x7f0b680fc550 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.562+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 msgr2=0x7f0b54071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.562+0000 7f0b7041f640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 0x7f0b54071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b6810ce30 tx=0x7f0b58007cb0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.562+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 msgr2=0x7f0b6810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.562+0000 7f0b7041f640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0b64003080 tx=0x7f0b64009da0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 shutdown_connections 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0b5406ed60 0x7f0b54071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b680fd820 0x7f0b6810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 --2- 172.21.15.115:0/3679748412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b680fc550 0x7f0b6810d080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 >> 172.21.15.115:0/3679748412 conn(0x7f0b680f7d30 msgr2=0x7f0b680f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 shutdown_connections 2024-09-13T23:03:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:03:59.563+0000 7f0b7041f640 1 -- 172.21.15.115:0/3679748412 wait complete. 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3679748412' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:59.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:59.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:03:59 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:59.957 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-13T23:03:59.957 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3679748412' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T23:03:59.957 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.957 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.958 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:03:59.958 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:03:59.958 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T23:03:59.958 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:03:59 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:00.263 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:04:00.275 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:04:00.275 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-13T23:04:00.523 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: Deploying daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: Cluster is now healthy 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3679748412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:boot 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:04:00.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:00 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: Deploying daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: Cluster is now healthy 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3679748412' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:boot 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby 2024-09-13T23:04:00.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:04:00.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:00 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 2024-09-13T23:04:01.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:01 smithi115 ceph-mon[27601]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T23:04:01.830 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:01 smithi152 ceph-mon[34465]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-13T23:04:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- 172.21.15.115:0/4282094830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 msgr2=0x7fe17c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:02.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 --2- 172.21.15.115:0/4282094830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c0fcb70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe1680048d0 tx=0x7fe168009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- 172.21.15.115:0/4282094830 shutdown_connections 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 --2- 172.21.15.115:0/4282094830 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c0fcb70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 --2- 172.21.15.115:0/4282094830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 0x7fe17c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- 172.21.15.115:0/4282094830 >> 172.21.15.115:0/4282094830 conn(0x7fe17c0f6c10 msgr2=0x7fe17c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- 172.21.15.115:0/4282094830 shutdown_connections 2024-09-13T23:04:02.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- 172.21.15.115:0/4282094830 wait complete. 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 Processor -- start 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.331+0000 7fe182a8e640 1 -- start start 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe182a8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 0x7fe17c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe182a8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe182a8e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c10cb10 con 0x7fe17c0fc700 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe182a8e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c10d2c0 con 0x7fe17c0fb430 2024-09-13T23:04:02.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41726/0 (socket says 172.21.15.115:41726) 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 -- 172.21.15.115:0/682321467 learned_addr learned my addr 172.21.15.115:0/682321467 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe18082a640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 0x7fe17c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 -- 172.21.15.115:0/682321467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 msgr2=0x7fe17c10bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 0x7fe17c10bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 -- 172.21.15.115:0/682321467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168005040 con 0x7fe17c0fc700 2024-09-13T23:04:02.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.332+0000 7fe17bfff640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1680043d0 tx=0x7fe168009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.333+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe168038070 con 0x7fe17c0fc700 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.333+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c10d4f0 con 0x7fe17c0fc700 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.333+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe16802ae90 con 0x7fe17c0fc700 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.333+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16803e670 con 0x7fe17c0fc700 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.333+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c10da90 con 0x7fe17c0fc700 2024-09-13T23:04:02.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.334+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0fa890 con 0x7fe17c0fc700 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.334+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fe168030020 con 0x7fe17c0fc700 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.335+0000 7fe1797fa640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 0x7fe16c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.335+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe1680ae380 con 0x7fe17c0fc700 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.335+0000 7fe18082a640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 0x7fe16c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.335+0000 7fe18082a640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 0x7fe16c071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe170004ed0 tx=0x7fe17000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:02.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.339+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe16807b550 con 0x7fe17c0fc700 2024-09-13T23:04:02.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.547+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fe17c04b720 con 0x7fe17c0fc700 2024-09-13T23:04:02.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.571+0000 7fe1797fa640 1 -- 172.21.15.115:0/682321467 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe16807aef0 con 0x7fe17c0fc700 2024-09-13T23:04:02.573 INFO:teuthology.orchestra.run.smithi115.stderr:inline data disabled 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 msgr2=0x7fe16c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 0x7fe16c071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe170004ed0 tx=0x7fe17000b040 comp rx=0 tx=0).stop 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 msgr2=0x7fe17c10c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1680043d0 tx=0x7fe168009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 shutdown_connections 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fe16c06ed60 0x7fe16c071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe17c0fc700 0x7fe17c10c4c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 --2- 172.21.15.115:0/682321467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe17c0fb430 0x7fe17c10bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:02.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 >> 172.21.15.115:0/682321467 conn(0x7fe17c0f6c10 msgr2=0x7fe17c0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:02.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 shutdown_connections 2024-09-13T23:04:02.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:02.574+0000 7fe182a8e640 1 -- 172.21.15.115:0/682321467 wait complete. 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.215 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 174 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/682321467' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] up:boot 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/682321467' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:04:03.216 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:03 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:03.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 174 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/682321467' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] up:boot 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/682321467' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:04:03.407 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:03 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:03.799 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:04:03.810 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:04:03.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T23:04:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:04 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:04 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:04 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:04.590 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:04.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:04 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:04.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:04 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:04.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:04 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:05.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T23:04:05.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:standby-replay 2024-09-13T23:04:05.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:active 2024-09-13T23:04:05.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: Dropping low affinity active daemon mds.cephfs.smithi115.ywbcks in favor of higher affinity standby. 2024-09-13T23:04:05.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: Replacing daemon mds.cephfs.smithi115.ywbcks as rank 0 with standby daemon mds.cephfs.smithi115.vlvabd 2024-09-13T23:04:05.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:04:05.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:05.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T23:04:05.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:05 smithi115 ceph-mon[27601]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:replay,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:standby-replay 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] up:active 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: Dropping low affinity active daemon mds.cephfs.smithi115.ywbcks in favor of higher affinity standby. 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: Replacing daemon mds.cephfs.smithi115.ywbcks as rank 0 with standby daemon mds.cephfs.smithi115.vlvabd 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:05.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T23:04:05.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:05 smithi152 ceph-mon[34465]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:replay,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 2024-09-13T23:04:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] up:boot 2024-09-13T23:04:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:resolve 2024-09-13T23:04:06.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:resolve,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:04:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:reconnect 2024-09-13T23:04:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] up:standby-replay 2024-09-13T23:04:06.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:06 smithi115 ceph-mon[27601]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:reconnect,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] up:boot 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:resolve 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:resolve,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:reconnect 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] up:standby-replay 2024-09-13T23:04:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:06 smithi152 ceph-mon[34465]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:reconnect,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:06.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 -- 172.21.15.115:0/1523481509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fd800 msgr2=0x7f12b40fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 --2- 172.21.15.115:0/1523481509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fd800 0x7f12b40fdc70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12a40048d0 tx=0x7f12a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 -- 172.21.15.115:0/1523481509 shutdown_connections 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 --2- 172.21.15.115:0/1523481509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fd800 0x7f12b40fdc70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 --2- 172.21.15.115:0/1523481509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fc530 0x7f12b40fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 -- 172.21.15.115:0/1523481509 >> 172.21.15.115:0/1523481509 conn(0x7f12b40f7d10 msgr2=0x7f12b40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 -- 172.21.15.115:0/1523481509 shutdown_connections 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.767+0000 7f12bc169640 1 -- 172.21.15.115:0/1523481509 wait complete. 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 Processor -- start 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 -- start start 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fd800 0x7f12b410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:06.791 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b410dc30 con 0x7f12b40fc530 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12bc169640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b410e450 con 0x7f12b40fd800 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59510/0 (socket says 172.21.15.115:59510) 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 -- 172.21.15.115:0/428003054 learned_addr learned my addr 172.21.15.115:0/428003054 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9704640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fd800 0x7f12b410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 -- 172.21.15.115:0/428003054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fd800 msgr2=0x7f12b410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fd800 0x7f12b410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 -- 172.21.15.115:0/428003054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4005040 con 0x7f12b40fc530 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.768+0000 7f12b9f05640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f12b0002a50 tx=0x7f12b0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.769+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b0007c30 con 0x7f12b40fc530 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.769+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12b000f040 con 0x7f12b40fc530 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.769+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b410e6e0 con 0x7f12b40fc530 2024-09-13T23:04:06.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.769+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b000da10 con 0x7f12b40fc530 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.769+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b410ec80 con 0x7f12b40fc530 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.770+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b40fb990 con 0x7f12b40fc530 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.770+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f12b000dbb0 con 0x7f12b40fc530 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.771+0000 7f12aa7fc640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 0x7f12a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.771+0000 7f12b9704640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 0x7f12a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.771+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f12b008d8c0 con 0x7f12b40fc530 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.771+0000 7f12b9704640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 0x7f12a0071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12b410ce50 tx=0x7f12a4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:06.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.775+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f12b004d2a0 con 0x7f12b40fc530 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.965+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12b410efc0 con 0x7f12b40fc530 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.966+0000 7f12aa7fc640 1 -- 172.21.15.115:0/428003054 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f12b005ab80 con 0x7f12b40fc530 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stdout:e16 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:04:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 16 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:04:06.260955+0000 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:04:06.968 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:04:06.969 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:reconnect seq 4 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:06.970 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{-1:14474} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 16 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 msgr2=0x7f12a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 0x7f12a0071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12b410ce50 tx=0x7f12a4035040 comp rx=0 tx=0).stop 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 msgr2=0x7f12b410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f12b0002a50 tx=0x7f12b0004600 comp rx=0 tx=0).stop 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 shutdown_connections 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f12a006ed60 0x7f12a0071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b40fd800 0x7f12b410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 --2- 172.21.15.115:0/428003054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b40fc530 0x7f12b410d0a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:06.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 >> 172.21.15.115:0/428003054 conn(0x7f12b40f7d10 msgr2=0x7f12b40f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:06.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 shutdown_connections 2024-09-13T23:04:06.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:06.968+0000 7f12bc169640 1 -- 172.21.15.115:0/428003054 wait complete. 2024-09-13T23:04:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:07 smithi115 ceph-mon[27601]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-13T23:04:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:07 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/428003054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:07 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:rejoin 2024-09-13T23:04:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:07 smithi115 ceph-mon[27601]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:rejoin,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:07 smithi115 ceph-mon[27601]: daemon mds.cephfs.smithi115.vlvabd is now active in filesystem cephfs as rank 0 2024-09-13T23:04:07.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T23:04:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:07 smithi152 ceph-mon[34465]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-13T23:04:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:07 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/428003054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:07 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:rejoin 2024-09-13T23:04:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:07 smithi152 ceph-mon[34465]: fsmap cephfs:2/2 {0=cephfs.smithi115.vlvabd=up:rejoin,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:07.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:07 smithi152 ceph-mon[34465]: daemon mds.cephfs.smithi115.vlvabd is now active in filesystem cephfs as rank 0 2024-09-13T23:04:08.902 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:09.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: Cluster is now healthy 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:active 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:09.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:09 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: Cluster is now healthy 2024-09-13T23:04:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: mds.? [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] up:active 2024-09-13T23:04:09.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T23:04:09.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:09 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:04:10.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- 172.21.15.115:0/465505043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c300ff6e0 msgr2=0x7f8c30101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:10.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 --2- 172.21.15.115:0/465505043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c300ff6e0 0x7f8c30101ac0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c240048d0 tx=0x7f8c24009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- 172.21.15.115:0/465505043 shutdown_connections 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 --2- 172.21.15.115:0/465505043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c300ff6e0 0x7f8c30101ac0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 --2- 172.21.15.115:0/465505043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c30065be0 0x7f8c300ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- 172.21.15.115:0/465505043 >> 172.21.15.115:0/465505043 conn(0x7f8c300f6c10 msgr2=0x7f8c300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- 172.21.15.115:0/465505043 shutdown_connections 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- 172.21.15.115:0/465505043 wait complete. 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 Processor -- start 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- start start 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c300ff6e0 0x7f8c3010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3010dbe0 con 0x7f8c30065be0 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.538+0000 7f8c358c7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3010e400 con 0x7f8c300ff6e0 2024-09-13T23:04:10.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59524/0 (socket says 172.21.15.115:59524) 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 -- 172.21.15.115:0/427306077 learned_addr learned my addr 172.21.15.115:0/427306077 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2e7fc640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c300ff6e0 0x7f8c3010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 -- 172.21.15.115:0/427306077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c300ff6e0 msgr2=0x7f8c3010d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c300ff6e0 0x7f8c3010d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 -- 172.21.15.115:0/427306077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24005040 con 0x7f8c30065be0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c2effd640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c7e0 tx=0x7f8c200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2000a820 con 0x7f8c30065be0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c2000ae20 con 0x7f8c30065be0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3010e690 con 0x7f8c30065be0 2024-09-13T23:04:10.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c200113a0 con 0x7f8c30065be0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.539+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3010ec30 con 0x7f8c30065be0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.540+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300fa890 con 0x7f8c30065be0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.541+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8c20012400 con 0x7f8c30065be0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.541+0000 7f8c177fe640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 0x7f8c18071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.541+0000 7f8c2e7fc640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 0x7f8c18071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.541+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8c2008e2c0 con 0x7f8c30065be0 2024-09-13T23:04:10.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.542+0000 7f8c2e7fc640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 0x7f8c18071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8c3010ce00 tx=0x7f8c24009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:10.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.545+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c2005af90 con 0x7f8c30065be0 2024-09-13T23:04:10.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.749+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3004b720 con 0x7f8c30065be0 2024-09-13T23:04:10.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.750+0000 7f8c177fe640 1 -- 172.21.15.115:0/427306077 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f8c2005adb0 con 0x7f8c30065be0 2024-09-13T23:04:10.751 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 msgr2=0x7f8c18071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 0x7f8c18071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8c3010ce00 tx=0x7f8c24009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 msgr2=0x7f8c3010d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c7e0 tx=0x7f8c200043c0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 shutdown_connections 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8c1806ed60 0x7f8c18071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c300ff6e0 0x7f8c3010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 --2- 172.21.15.115:0/427306077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8c30065be0 0x7f8c3010d050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:10.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.752+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 >> 172.21.15.115:0/427306077 conn(0x7f8c300f6c10 msgr2=0x7f8c300f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:10.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.753+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 shutdown_connections 2024-09-13T23:04:10.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:10.753+0000 7f8c358c7640 1 -- 172.21.15.115:0/427306077 wait complete. 2024-09-13T23:04:10.763 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:04:11.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:11.880 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:11.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:11 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/427306077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:11.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:11.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:11.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:11 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/427306077' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:04:12.239 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:13.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:13 smithi115 ceph-mon[27601]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:13.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:13.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:13.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:13 smithi152 ceph-mon[34465]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:13.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:13.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 -- 172.21.15.115:0/3611906728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fc710 msgr2=0x7fd9740fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3611906728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fc710 0x7fd9740fcb80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9680048d0 tx=0x7fd968009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 -- 172.21.15.115:0/3611906728 shutdown_connections 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3611906728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fc710 0x7fd9740fcb80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3611906728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fb440 0x7fd9740fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:13.972 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 -- 172.21.15.115:0/3611906728 >> 172.21.15.115:0/3611906728 conn(0x7fd9740f6c00 msgr2=0x7fd9740f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 -- 172.21.15.115:0/3611906728 shutdown_connections 2024-09-13T23:04:13.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.970+0000 7fd97a22b640 1 -- 172.21.15.115:0/3611906728 wait complete. 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 Processor -- start 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 -- start start 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fc710 0x7fd9741122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740667b0 con 0x7fd9740fb440 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd97a22b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974066920 con 0x7fd9740fc710 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd9737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:13.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd9737fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59538/0 (socket says 172.21.15.115:59538) 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd9737fe640 1 -- 172.21.15.115:0/3563987468 learned_addr learned my addr 172.21.15.115:0/3563987468 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.971+0000 7fd972ffd640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fc710 0x7fd9741122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd9737fe640 1 -- 172.21.15.115:0/3563987468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fc710 msgr2=0x7fd9741122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd9737fe640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fc710 0x7fd9741122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd9737fe640 1 -- 172.21.15.115:0/3563987468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968005040 con 0x7fd9740fb440 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd9737fe640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd96400fe60 tx=0x7fd964004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd964014070 con 0x7fd9740fb440 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97410bb70 con 0x7fd9740fb440 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd964004e50 con 0x7fd9740fb440 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd964018650 con 0x7fd9740fb440 2024-09-13T23:04:13.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.972+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97410c110 con 0x7fd9740fb440 2024-09-13T23:04:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.973+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9740fa8a0 con 0x7fd9740fb440 2024-09-13T23:04:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.974+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd964018800 con 0x7fd9740fb440 2024-09-13T23:04:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.974+0000 7fd95bfff640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 0x7fd95c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.974+0000 7fd972ffd640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 0x7fd95c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:13.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.974+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd964091f90 con 0x7fd9740fb440 2024-09-13T23:04:13.977 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.975+0000 7fd972ffd640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 0x7fd95c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd96800b020 tx=0x7fd968035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:13.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:13.978+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd9640512a0 con 0x7fd9740fb440 2024-09-13T23:04:14.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.196+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fd97410c3d0 con 0x7fd9740fb440 2024-09-13T23:04:14.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.197+0000 7fd95bfff640 1 -- 172.21.15.115:0/3563987468 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+100 (secure 0 0 0) 0x7fd96405f110 con 0x7fd9740fb440 2024-09-13T23:04:14.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 msgr2=0x7fd95c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 0x7fd95c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd96800b020 tx=0x7fd968035040 comp rx=0 tx=0).stop 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 msgr2=0x7fd97410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd96400fe60 tx=0x7fd964004600 comp rx=0 tx=0).stop 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 shutdown_connections 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd95c06ed60 0x7fd95c071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9740fc710 0x7fd9741122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 --2- 172.21.15.115:0/3563987468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9740fb440 0x7fd97410fd90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 >> 172.21.15.115:0/3563987468 conn(0x7fd9740f6c00 msgr2=0x7fd9740f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 shutdown_connections 2024-09-13T23:04:14.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:14.199+0000 7fd97a22b640 1 -- 172.21.15.115:0/3563987468 wait complete. 2024-09-13T23:04:14.209 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:04:14.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:14 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3563987468' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T23:04:14.973 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:14 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3563987468' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T23:04:15.486 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T23:04:15.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T23:04:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:15 smithi115 ceph-mon[27601]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:04:15.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:15 smithi152 ceph-mon[34465]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:04:16.246 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:17.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:17 smithi115 ceph-mon[27601]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:17.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:17 smithi152 ceph-mon[34465]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/808488914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 msgr2=0x7f9c580fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/808488914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c580fb910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0048d0 tx=0x7f9c4c009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/808488914 shutdown_connections 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/808488914 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c580fb910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/808488914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 0x7f9c581018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/808488914 >> 172.21.15.115:0/808488914 conn(0x7f9c580f7060 msgr2=0x7f9c580f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/808488914 shutdown_connections 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.780+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/808488914 wait complete. 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 Processor -- start 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 -- start start 2024-09-13T23:04:18.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 0x7f9c58113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58113d80 con 0x7f9c580fb4a0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5cbbe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5810d1c0 con 0x7f9c581014e0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59480/0 (socket says 172.21.15.115:59480) 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 -- 172.21.15.115:0/3861238508 learned_addr learned my addr 172.21.15.115:0/3861238508 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c55d9b640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 0x7f9c58113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 -- 172.21.15.115:0/3861238508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 msgr2=0x7f9c58113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 0x7f9c58113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 -- 172.21.15.115:0/3861238508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c005040 con 0x7f9c580fb4a0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.781+0000 7f9c5659c640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c48002a50 tx=0x7f9c48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.782+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c48007c30 con 0x7f9c580fb4a0 2024-09-13T23:04:18.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.782+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c4800f040 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.782+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5810d4a0 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.782+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c4800dad0 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.782+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5810d990 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.783+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c580fcbe0 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.783+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f9c4800dc30 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.784+0000 7f9c46ffd640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 0x7f9c40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.784+0000 7f9c55d9b640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 0x7f9c40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.784+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9c4808e020 con 0x7f9c580fb4a0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.784+0000 7f9c55d9b640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 0x7f9c40071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009ac0 tx=0x7f9c4c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.788+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9c4805b0f0 con 0x7f9c580fb4a0 2024-09-13T23:04:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.976+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c580fac60 con 0x7f9c580fb4a0 2024-09-13T23:04:18.978 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.976+0000 7f9c46ffd640 1 -- 172.21.15.115:0/3861238508 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f9c4805aa90 con 0x7f9c580fb4a0 2024-09-13T23:04:18.978 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:18.979 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:04:08.269431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/3700826071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3700826071},{"type":"v1","addr":"172.21.15.115:6827","nonce":3700826071}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24261":{"gid":24261,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6827/510740987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":510740987},{"type":"v1","addr":"172.21.15.152:6827","nonce":510740987}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-13T23:04:18.979 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T23:04:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 msgr2=0x7f9c40071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 0x7f9c40071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009ac0 tx=0x7f9c4c035040 comp rx=0 tx=0).stop 2024-09-13T23:04:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 msgr2=0x7f9c58113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c48002a50 tx=0x7f9c48004600 comp rx=0 tx=0).stop 2024-09-13T23:04:18.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 shutdown_connections 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f9c4006ed60 0x7f9c40071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c581014e0 0x7f9c58113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 --2- 172.21.15.115:0/3861238508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c580fb4a0 0x7f9c58113240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.978+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 >> 172.21.15.115:0/3861238508 conn(0x7f9c580f7060 msgr2=0x7f9c58065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.979+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 shutdown_connections 2024-09-13T23:04:18.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:18.979+0000 7f9c5cbbe640 1 -- 172.21.15.115:0/3861238508 wait complete. 2024-09-13T23:04:19.602 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-13T23:04:19.603 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T23:04:19.634 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T23:04:19.634 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T23:04:19.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:19.634 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T23:04:19.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:19.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-09-13T23:04:19.720 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2024-09-13T23:04:19.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:04:19.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:19.722 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-13T23:04:19.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:19.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:19 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3861238508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:04:19.808 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-09-13T23:04:19.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:04:19.810 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T23:04:19.810 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T23:04:19.810 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:19.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T23:04:19.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T23:04:19.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:19.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:19.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:19.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:19 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3861238508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:04:20.053 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:21.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.611+0000 7f42a52b1640 1 -- 172.21.15.115:0/523154685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 msgr2=0x7f42a00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:21.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.611+0000 7f42a52b1640 1 --2- 172.21.15.115:0/523154685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a00fc5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f42940048d0 tx=0x7f4294009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.611+0000 7f42a52b1640 1 -- 172.21.15.115:0/523154685 shutdown_connections 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.611+0000 7f42a52b1640 1 --2- 172.21.15.115:0/523154685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a00fc5b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.611+0000 7f42a52b1640 1 --2- 172.21.15.115:0/523154685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 0x7f42a0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- 172.21.15.115:0/523154685 >> 172.21.15.115:0/523154685 conn(0x7f42a00f80f0 msgr2=0x7f42a00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- 172.21.15.115:0/523154685 shutdown_connections 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- 172.21.15.115:0/523154685 wait complete. 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 Processor -- start 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- start start 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 0x7f42a006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0070490 con 0x7f42a0102ef0 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.612+0000 7f42a52b1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a0070600 con 0x7f42a0102550 2024-09-13T23:04:21.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59502/0 (socket says 172.21.15.115:59502) 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 -- 172.21.15.115:0/3305491670 learned_addr learned my addr 172.21.15.115:0/3305491670 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429effd640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 0x7f42a006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 -- 172.21.15.115:0/3305491670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 msgr2=0x7f42a006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 0x7f42a006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 -- 172.21.15.115:0/3305491670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4294005040 con 0x7f42a0102ef0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f429e7fc640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4294003080 tx=0x7f4294009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4294038070 con 0x7f42a0102ef0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4294009760 con 0x7f42a0102ef0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a0070830 con 0x7f42a0102ef0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4294033420 con 0x7f42a0102ef0 2024-09-13T23:04:21.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.613+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a0119b20 con 0x7f42a0102ef0 2024-09-13T23:04:21.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.614+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a00fdcd0 con 0x7f42a0102ef0 2024-09-13T23:04:21.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.615+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4294030020 con 0x7f42a0102ef0 2024-09-13T23:04:21.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.615+0000 7f42877fe640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 0x7f4288071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:21.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.616+0000 7f429effd640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 0x7f4288071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:21.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.616+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f42940adf00 con 0x7f42a0102ef0 2024-09-13T23:04:21.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.616+0000 7f429effd640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 0x7f4288071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4290004c40 tx=0x7f4290009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:21.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.620+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f429407afd0 con 0x7f42a0102ef0 2024-09-13T23:04:21.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.811+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42a00fbd50 con 0x7f42a0102ef0 2024-09-13T23:04:21.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.811+0000 7f42877fe640 1 -- 172.21.15.115:0/3305491670 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f429407a970 con 0x7f42a0102ef0 2024-09-13T23:04:21.813 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T23:04:21.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 msgr2=0x7f4288071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 0x7f4288071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4290004c40 tx=0x7f4290009040 comp rx=0 tx=0).stop 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 msgr2=0x7f42a006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4294003080 tx=0x7f4294009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 shutdown_connections 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f428806ed60 0x7f4288071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42a0102ef0 0x7f42a006ff50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 --2- 172.21.15.115:0/3305491670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a0102550 0x7f42a006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 >> 172.21.15.115:0/3305491670 conn(0x7f42a00f80f0 msgr2=0x7f42a00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 shutdown_connections 2024-09-13T23:04:21.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:21.814+0000 7f42a52b1640 1 -- 172.21.15.115:0/3305491670 wait complete. 2024-09-13T23:04:21.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:21 smithi152 ceph-mon[34465]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:22.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:21 smithi115 ceph-mon[27601]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T23:04:22.396 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T23:04:22.397 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T23:04:22.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:22.397 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2024-09-13T23:04:22.414 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42318sec preferred_lft 42318sec 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link noprefixroute 2024-09-13T23:04:22.415 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:22.416 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T23:04:22.416 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T23:04:22.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:22.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:22.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:22.629 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T23:04:22.654 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-09-13T23:04:22.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:22.656 DEBUG:teuthology.orchestra.run.smithi115:> route 2024-09-13T23:04:22.733 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2024-09-13T23:04:22.733 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T23:04:22.733 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T23:04:22.733 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T23:04:22.733 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T23:04:22.734 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T23:04:22.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:22.927 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:22 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3305491670' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T23:04:22.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:22 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3305491670' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T23:04:23.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:23.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:23.042 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T23:04:23.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:23.058 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2024-09-13T23:04:23.113 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:23.113 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T23:04:23.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T23:04:23.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T23:04:23.113 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T23:04:23.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:23.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:23.250 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T23:04:23.251 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T23:04:23.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:23.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T23:04:23.378 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-09-13T23:04:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:23.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T23:04:23.455 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:23.484 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T23:04:23.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T23:04:23.485 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:23.542 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T23:04:23.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:23.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T23:04:23.655 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T23:04:23.655 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T23:04:23.655 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T23:04:23.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:23 smithi115 ceph-mon[27601]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T23:04:23.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:23.775 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:23.783 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T23:04:23.784 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T23:04:23.784 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T23:04:23.784 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.152:3300" 2024-09-13T23:04:23.784 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.152:3300" 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T23:04:23.789 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.115:6789,172.21.15.152:6789" 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.115:6789,172.21.15.152:6789:/ 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=62d5ccce-7223-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T23:04:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T23:04:23.792 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T23:04:23.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:23.792 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:23.821 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:23.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:23.916 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:23.922 INFO:teuthology.orchestra.run.smithi115.stdout:client14496 2024-09-13T23:04:23.922 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T23:04:23.922 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:04:23.942 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:23 smithi152 ceph-mon[34465]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T23:04:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:23.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:24.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:24.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:24.042 INFO:teuthology.orchestra.run.smithi115.stdout:client14496 2024-09-13T23:04:24.042 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:24.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:24.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:24.101 INFO:teuthology.orchestra.run.smithi115.stdout:client14496 2024-09-13T23:04:24.102 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62d5ccce-7223-11ef-bceb-c7b262605968.client14496/status') 2024-09-13T23:04:24.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:24.163 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.14496 (3)192.168.0.1:0/1701520229 2024-09-13T23:04:24.163 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2024-09-13T23:04:24.163 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2024-09-13T23:04:24.163 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2024-09-13T23:04:24.163 INFO:teuthology.orchestra.run.smithi115.stderr:70 bytes copied, 2.3733e-05 s, 2.9 MB/s 2024-09-13T23:04:24.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:24.170 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T23:04:24.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T23:04:24.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:24.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T23:04:24.426 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:25.754 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:25 smithi115 ceph-mon[27601]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- 172.21.15.115:0/1762323579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d441014e0 msgr2=0x7f8d441018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/1762323579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d441014e0 0x7f8d441018b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8d380048d0 tx=0x7f8d38009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- 172.21.15.115:0/1762323579 shutdown_connections 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/1762323579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d440fb4a0 0x7f8d440fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/1762323579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d441014e0 0x7f8d441018b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- 172.21.15.115:0/1762323579 >> 172.21.15.115:0/1762323579 conn(0x7f8d440f7060 msgr2=0x7f8d440f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- 172.21.15.115:0/1762323579 shutdown_connections 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- 172.21.15.115:0/1762323579 wait complete. 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 Processor -- start 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.935+0000 7f8d4b10d640 1 -- start start 2024-09-13T23:04:25.938 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d4b10d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d4b10d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d441014e0 0x7f8d441125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d4b10d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44112be0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d4b10d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4410c020 con 0x7f8d441014e0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:59526/0 (socket says 172.21.15.115:59526) 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 -- 172.21.15.115:0/2504279191 learned_addr learned my addr 172.21.15.115:0/2504279191 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d43fff640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d441014e0 0x7f8d441125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 -- 172.21.15.115:0/2504279191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d441014e0 msgr2=0x7f8d441125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d441014e0 0x7f8d441125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 -- 172.21.15.115:0/2504279191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38005040 con 0x7f8d440fb4a0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.936+0000 7f8d48ea9640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d38003080 tx=0x7f8d38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.937+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d38038070 con 0x7f8d440fb4a0 2024-09-13T23:04:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.937+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d380097e0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.937+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4410c2a0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.937+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3803d420 con 0x7f8d440fb4a0 2024-09-13T23:04:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.937+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4410c7e0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.938+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d440fcbe0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.938+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f8d38030020 con 0x7f8d440fb4a0 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.939+0000 7f8d417fa640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 0x7f8d34071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.939+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8d380ae700 con 0x7f8d440fb4a0 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.939+0000 7f8d43fff640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 0x7f8d34071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:25.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.939+0000 7f8d43fff640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 0x7f8d34071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d4410d960 tx=0x7f8d30009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:25.943+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8d3807b7d0 con 0x7f8d440fb4a0 2024-09-13T23:04:25.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:25 smithi152 ceph-mon[34465]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T23:04:26.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.132+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d4404b720 con 0x7f8d440fb4a0 2024-09-13T23:04:26.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.133+0000 7f8d417fa640 1 -- 172.21.15.115:0/2504279191 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8d3807b170 con 0x7f8d440fb4a0 2024-09-13T23:04:26.134 INFO:teuthology.orchestra.run.smithi115.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 msgr2=0x7f8d34071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 0x7f8d34071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d4410d960 tx=0x7f8d30009040 comp rx=0 tx=0).stop 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 msgr2=0x7f8d441120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d38003080 tx=0x7f8d38009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 shutdown_connections 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f8d3406ed60 0x7f8d34071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d441014e0 0x7f8d441125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 --2- 172.21.15.115:0/2504279191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d440fb4a0 0x7f8d441120a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 >> 172.21.15.115:0/2504279191 conn(0x7f8d440f7060 msgr2=0x7f8d440f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:26.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 shutdown_connections 2024-09-13T23:04:26.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:26.135+0000 7f8d4b10d640 1 -- 172.21.15.115:0/2504279191 wait complete. 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T23:04:26.814 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T23:04:26.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:26.815 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-09-13T23:04:26.835 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:26.836 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42358sec preferred_lft 42358sec 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link noprefixroute 2024-09-13T23:04:26.837 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-09-13T23:04:26.837 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T23:04:26.837 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T23:04:26.838 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-13T23:04:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:26.940 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:26 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2504279191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T23:04:27.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:27.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:26 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2504279191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T23:04:27.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:27.054 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T23:04:27.080 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-09-13T23:04:27.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:27.082 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-09-13T23:04:27.155 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-09-13T23:04:27.156 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T23:04:27.156 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T23:04:27.156 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T23:04:27.156 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T23:04:27.157 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-13T23:04:27.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:27.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:27.474 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-13T23:04:27.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:27.491 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-09-13T23:04:27.546 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:27.547 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-13T23:04:27.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T23:04:27.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T23:04:27.547 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-13T23:04:27.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:27.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:27.663 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T23:04:27.664 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-13T23:04:27.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:27.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:27.786 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T23:04:27.786 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-09-13T23:04:27.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-09-13T23:04:27.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T23:04:27.787 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-09-13T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:27.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T23:04:27.869 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T23:04:27.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T23:04:27.885 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:27.939 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T23:04:27.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:27.940 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T23:04:27.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:27 smithi152 ceph-mon[34465]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:04:28.015 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T23:04:28.015 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T23:04:28.015 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-13T23:04:28.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:27 smithi115 ceph-mon[27601]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-13T23:04:28.146 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T23:04:28.146 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T23:04:28.146 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-13T23:04:28.146 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.152:3300" 2024-09-13T23:04:28.146 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.115:3300,172.21.15.152:3300" 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.115:6789,172.21.15.152:6789" 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.115:6789,172.21.15.152:6789:/ 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=62d5ccce-7223-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T23:04:28.151 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T23:04:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-09-13T23:04:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T23:04:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T23:04:28.152 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T23:04:28.153 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T23:04:28.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:04:28.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:28.178 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:28.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:28.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:28.274 INFO:teuthology.orchestra.run.smithi152.stdout:client24289 2024-09-13T23:04:28.274 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T23:04:28.274 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:04:28.291 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:28.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:28.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:28.386 INFO:teuthology.orchestra.run.smithi152.stdout:client24289 2024-09-13T23:04:28.386 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T23:04:28.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T23:04:28.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:28.441 INFO:teuthology.orchestra.run.smithi152.stdout:client24289 2024-09-13T23:04:28.442 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/62d5ccce-7223-11ef-bceb-c7b262605968.client24289/status') 2024-09-13T23:04:28.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T23:04:28.499 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.24289 (3)192.168.0.1:0/2880520886 2024-09-13T23:04:28.499 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-09-13T23:04:28.499 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-09-13T23:04:28.500 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-09-13T23:04:28.500 INFO:teuthology.orchestra.run.smithi152.stderr:70 bytes copied, 2.5872e-05 s, 2.7 MB/s 2024-09-13T23:04:28.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-13T23:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T23:04:28.507 INFO:teuthology.run_tasks:Running task print... 2024-09-13T23:04:28.519 INFO:teuthology.task.print:**** done client 2024-09-13T23:04:28.519 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T23:04:28.529 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T23:04:28.529 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T23:04:28.530 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T23:04:28.530 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:04:28.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-13T23:04:28.531 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T23:04:28.531 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T23:04:28.536 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:28.536 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T23:04:28.536 INFO:tasks.workunit:timeout=3h 2024-09-13T23:04:28.536 INFO:tasks.workunit:cleanup=True 2024-09-13T23:04:28.536 DEBUG:teuthology.orchestra.run.smithi115:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:28.557 INFO:teuthology.orchestra.run.smithi115.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:28.557 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T23:04:28.557 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 7eh/126d Inode: 1 Links: 2 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-13 23:03:53.533583253 +0000 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-13 23:04:23.815756435 +0000 2024-09-13T23:04:28.558 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-13 23:03:53.533583253 +0000 2024-09-13T23:04:28.559 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T23:04:28.559 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T23:04:28.627 DEBUG:teuthology.orchestra.run.smithi152:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-13 23:04:28.622663799 +0000 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-13 23:04:28.622663799 +0000 2024-09-13T23:04:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-13 23:03:53.533583253 +0000 2024-09-13T23:04:28.648 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T23:04:28.648 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T23:04:28.715 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:28.716 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:28.732 INFO:tasks.workunit.client.0.smithi115.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T23:04:28.771 INFO:tasks.workunit.client.1.smithi152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T23:04:28.807 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:29.841 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:29 smithi115 ceph-mon[27601]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T23:04:29.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:29 smithi152 ceph-mon[34465]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T23:04:30.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- 172.21.15.115:0/4076271009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fc530 msgr2=0x7fc7500fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:30.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 --2- 172.21.15.115:0/4076271009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fc530 0x7fc7500fc940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc7400048d0 tx=0x7fc740009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:30.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- 172.21.15.115:0/4076271009 shutdown_connections 2024-09-13T23:04:30.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 --2- 172.21.15.115:0/4076271009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7500fd800 0x7fc7500fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:30.358 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 --2- 172.21.15.115:0/4076271009 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fc530 0x7fc7500fc940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- 172.21.15.115:0/4076271009 >> 172.21.15.115:0/4076271009 conn(0x7fc7500f7d10 msgr2=0x7fc7500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- 172.21.15.115:0/4076271009 shutdown_connections 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- 172.21.15.115:0/4076271009 wait complete. 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 Processor -- start 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.346+0000 7fc75684f640 1 -- start start 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7500fc530 0x7fc75010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fd800 0x7fc75010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75010dc20 con 0x7fc7500fd800 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75010e440 con 0x7fc7500fc530 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fd800 0x7fc75010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fd800 0x7fc75010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44888/0 (socket says 172.21.15.115:44888) 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 -- 172.21.15.115:0/1761969392 learned_addr learned my addr 172.21.15.115:0/1761969392 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:30.359 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc74ffff640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7500fc530 0x7fc75010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 -- 172.21.15.115:0/1761969392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7500fc530 msgr2=0x7fc75010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7500fc530 0x7fc75010d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 -- 172.21.15.115:0/1761969392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740005040 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc747fff640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7500fd800 0x7fc75010d5d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc738002a50 tx=0x7fc738004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc738007c30 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc73800f040 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 -- 172.21.15.115:0/1761969392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75010e6d0 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73800da10 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.347+0000 7fc75684f640 1 -- 172.21.15.115:0/1761969392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75010ec70 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.348+0000 7fc75684f640 1 -- 172.21.15.115:0/1761969392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500fb990 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.349+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc73800dc80 con 0x7fc7500fd800 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.350+0000 7fc74d7fa640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc73c06ed60 0x7fc73c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:30.360 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.350+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc73808d990 con 0x7fc7500fd800 2024-09-13T23:04:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.350+0000 7fc74ffff640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc73c06ed60 0x7fc73c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.350+0000 7fc74ffff640 1 --2- 172.21.15.115:0/1761969392 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc73c06ed60 0x7fc73c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc74000b020 tx=0x7fc740035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.354+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc73804d2a0 con 0x7fc7500fd800 2024-09-13T23:04:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.517+0000 7fc75684f640 1 -- 172.21.15.115:0/1761969392 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fc75004b720 con 0x7fc7500fd800 2024-09-13T23:04:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:30.517+0000 7fc74d7fa640 1 -- 172.21.15.115:0/1761969392 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7fc75004b720 con 0x7fc7500fd800 2024-09-13T23:04:30.518 INFO:teuthology.orchestra.run.smithi115.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-13T23:04:31.214 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T23:04:31.214 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:04:31.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T23:04:31.500 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:31.916 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:31 smithi115 ceph-mon[27601]: pgmap v194: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:04:31.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:31 smithi152 ceph-mon[34465]: pgmap v194: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:04:33.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 -- 172.21.15.115:0/4213725926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fd7f0 msgr2=0x7f53b40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/4213725926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fd7f0 0x7f53b40fdc60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f539c0048d0 tx=0x7f539c009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 -- 172.21.15.115:0/4213725926 shutdown_connections 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/4213725926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fd7f0 0x7f53b40fdc60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/4213725926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fc520 0x7f53b40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 -- 172.21.15.115:0/4213725926 >> 172.21.15.115:0/4213725926 conn(0x7f53b40f7ce0 msgr2=0x7f53b40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:33.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 -- 172.21.15.115:0/4213725926 shutdown_connections 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 -- 172.21.15.115:0/4213725926 wait complete. 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.024+0000 7f53b9bdf640 1 Processor -- start 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b9bdf640 1 -- start start 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b9bdf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b9bdf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fd7f0 0x7f53b410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b9bdf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b410dbf0 con 0x7f53b40fc520 2024-09-13T23:04:33.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b9bdf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b410e410 con 0x7f53b40fd7f0 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44916/0 (socket says 172.21.15.115:44916) 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 -- 172.21.15.115:0/1958402361 learned_addr learned my addr 172.21.15.115:0/1958402361 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53aaffd640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fd7f0 0x7f53b410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 -- 172.21.15.115:0/1958402361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fd7f0 msgr2=0x7f53b410d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fd7f0 0x7f53b410d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 -- 172.21.15.115:0/1958402361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c005040 con 0x7f53b40fc520 2024-09-13T23:04:33.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.025+0000 7f53b37fe640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53a4002a50 tx=0x7f53a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.026+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a4007c30 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.026+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53a400f040 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.026+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b410e6a0 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.026+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a400dad0 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.026+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b410ec40 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.027+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b40fb980 con 0x7f53b40fc520 2024-09-13T23:04:33.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.027+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f53a400dc30 con 0x7f53b40fc520 2024-09-13T23:04:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.028+0000 7f53b0ff9640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 0x7f53a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.028+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f53a408e020 con 0x7f53b40fc520 2024-09-13T23:04:33.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.028+0000 7f53aaffd640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 0x7f53a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.028+0000 7f53aaffd640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 0x7f53a0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53b410ce10 tx=0x7f539c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.032+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f53a405b0f0 con 0x7f53b40fc520 2024-09-13T23:04:33.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.188+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f53b404b720 con 0x7f53b40fc520 2024-09-13T23:04:33.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.188+0000 7f53b0ff9640 1 -- 172.21.15.115:0/1958402361 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f53a405aa90 con 0x7f53b40fc520 2024-09-13T23:04:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 msgr2=0x7f53a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 0x7f53a0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53b410ce10 tx=0x7f539c035040 comp rx=0 tx=0).stop 2024-09-13T23:04:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 msgr2=0x7f53b410d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f53a4002a50 tx=0x7f53a4004600 comp rx=0 tx=0).stop 2024-09-13T23:04:33.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 shutdown_connections 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f53a006ed60 0x7f53a0071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53b40fd7f0 0x7f53b410d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 --2- 172.21.15.115:0/1958402361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53b40fc520 0x7f53b410d060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 >> 172.21.15.115:0/1958402361 conn(0x7f53b40f7ce0 msgr2=0x7f53b40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 shutdown_connections 2024-09-13T23:04:33.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:33.190+0000 7f53b9bdf640 1 -- 172.21.15.115:0/1958402361 wait complete. 2024-09-13T23:04:33.843 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:33 smithi115 ceph-mon[27601]: pgmap v195: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T23:04:33.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T23:04:33.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:33 smithi152 ceph-mon[34465]: pgmap v195: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T23:04:34.128 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:35.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 -- 172.21.15.115:0/2674063076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 msgr2=0x7fb0d00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:35.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 --2- 172.21.15.115:0/2674063076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d00fc960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00048d0 tx=0x7fb0c0009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 -- 172.21.15.115:0/2674063076 shutdown_connections 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 --2- 172.21.15.115:0/2674063076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0d00fd820 0x7fb0d00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 --2- 172.21.15.115:0/2674063076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d00fc960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 -- 172.21.15.115:0/2674063076 >> 172.21.15.115:0/2674063076 conn(0x7fb0d00f7d30 msgr2=0x7fb0d00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 -- 172.21.15.115:0/2674063076 shutdown_connections 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.710+0000 7fb0d687e640 1 -- 172.21.15.115:0/2674063076 wait complete. 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 Processor -- start 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 -- start start 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0d00fd820 0x7fb0d010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d010dc30 con 0x7fb0d00fc550 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0d687e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d010e450 con 0x7fb0d00fd820 2024-09-13T23:04:35.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:44932/0 (socket says 172.21.15.115:44932) 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 -- 172.21.15.115:0/3815523956 learned_addr learned my addr 172.21.15.115:0/3815523956 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 -- 172.21.15.115:0/3815523956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0d00fd820 msgr2=0x7fb0d010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0d00fd820 0x7fb0d010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.711+0000 7fb0cffff640 1 -- 172.21.15.115:0/3815523956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0005040 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0cffff640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00043d0 tx=0x7fb0c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c0038070 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb0c002ae90 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d010e680 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0c003e670 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.712+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d010ec20 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.713+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d00fb9b0 con 0x7fb0d00fc550 2024-09-13T23:04:35.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.713+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fb0c0030020 con 0x7fb0d00fc550 2024-09-13T23:04:35.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.714+0000 7fb0ccff9640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 0x7fb0b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:35.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.714+0000 7fb0cf7fe640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 0x7fb0b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:35.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.714+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb0c00ae480 con 0x7fb0d00fc550 2024-09-13T23:04:35.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.714+0000 7fb0cf7fe640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 0x7fb0b8071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb0d010ce50 tx=0x7fb0c4009c50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:35.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.718+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb0c007b550 con 0x7fb0d00fc550 2024-09-13T23:04:35.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:35 smithi115 ceph-mon[27601]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T23:04:35.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.874+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb0d004b720 con 0x7fb0d00fc550 2024-09-13T23:04:35.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.875+0000 7fb0ccff9640 1 -- 172.21.15.115:0/3815523956 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb0c007aef0 con 0x7fb0d00fc550 2024-09-13T23:04:35.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 msgr2=0x7fb0b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:35.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 0x7fb0b8071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb0d010ce50 tx=0x7fb0c4009c50 comp rx=0 tx=0).stop 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 msgr2=0x7fb0d010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00043d0 tx=0x7fb0c0009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 shutdown_connections 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fb0b806ed60 0x7fb0b8071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb0d00fd820 0x7fb0d010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 --2- 172.21.15.115:0/3815523956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0d00fc550 0x7fb0d010d0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 >> 172.21.15.115:0/3815523956 conn(0x7fb0d00f7d30 msgr2=0x7fb0d00f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 shutdown_connections 2024-09-13T23:04:35.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:35.877+0000 7fb0d687e640 1 -- 172.21.15.115:0/3815523956 wait complete. 2024-09-13T23:04:35.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:35 smithi152 ceph-mon[34465]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T23:04:36.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T23:04:36.860 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:37.906 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:37 smithi115 ceph-mon[27601]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T23:04:37.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:37 smithi152 ceph-mon[34465]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-13T23:04:38.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 -- 172.21.15.115:0/649008222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fb430 msgr2=0x7f5c740fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:38.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 --2- 172.21.15.115:0/649008222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fb430 0x7f5c740fb840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c640048d0 tx=0x7f5c64009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 -- 172.21.15.115:0/649008222 shutdown_connections 2024-09-13T23:04:38.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 --2- 172.21.15.115:0/649008222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fc700 0x7f5c740fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 --2- 172.21.15.115:0/649008222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fb430 0x7f5c740fb840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 -- 172.21.15.115:0/649008222 >> 172.21.15.115:0/649008222 conn(0x7f5c740f6c10 msgr2=0x7f5c740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 -- 172.21.15.115:0/649008222 shutdown_connections 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.399+0000 7f5c79066640 1 -- 172.21.15.115:0/649008222 wait complete. 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 Processor -- start 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 -- start start 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 0x7f5c7410bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 0x7f5c7410c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7410cb00 con 0x7f5c740fc700 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c79066640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7410d320 con 0x7f5c740fb430 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c7259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 0x7f5c7410c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c7259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 0x7f5c7410c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52072/0 (socket says 172.21.15.115:52072) 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c7259c640 1 -- 172.21.15.115:0/387245011 learned_addr learned my addr 172.21.15.115:0/387245011 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:38.402 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c72d9d640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 0x7f5c7410bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:38.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.400+0000 7f5c72d9d640 1 -- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 msgr2=0x7f5c7410c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c72d9d640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 0x7f5c7410c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c72d9d640 1 -- 172.21.15.115:0/387245011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64005040 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c72d9d640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 0x7f5c7410bf70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c64003080 tx=0x7f5c64009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c64038070 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7410d550 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c6402ae90 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c6402c070 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.401+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7410da90 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.402+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c740fa890 con 0x7f5c740fb430 2024-09-13T23:04:38.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.403+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5c64030020 con 0x7f5c740fb430 2024-09-13T23:04:38.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.403+0000 7f5c5b7fe640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 0x7f5c5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:38.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.403+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5c640b2580 con 0x7f5c740fb430 2024-09-13T23:04:38.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.403+0000 7f5c7259c640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 0x7f5c5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:38.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.404+0000 7f5c7259c640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 0x7f5c5c071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5c7410bd20 tx=0x7f5c68009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:38.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.407+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c6407f5b0 con 0x7f5c740fb430 2024-09-13T23:04:38.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.563+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5c7404b720 con 0x7f5c740fb430 2024-09-13T23:04:38.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.564+0000 7f5c5b7fe640 1 -- 172.21.15.115:0/387245011 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5c6407ef50 con 0x7f5c740fb430 2024-09-13T23:04:38.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 msgr2=0x7f5c5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:38.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 0x7f5c5c071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5c7410bd20 tx=0x7f5c68009040 comp rx=0 tx=0).stop 2024-09-13T23:04:38.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 msgr2=0x7f5c7410bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:38.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 0x7f5c7410bf70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c64003080 tx=0x7f5c64009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 shutdown_connections 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f5c5c06ed60 0x7f5c5c071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c740fc700 0x7f5c7410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 --2- 172.21.15.115:0/387245011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c740fb430 0x7f5c7410bf70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.566+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 >> 172.21.15.115:0/387245011 conn(0x7f5c740f6c10 msgr2=0x7f5c740f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.567+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 shutdown_connections 2024-09-13T23:04:38.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:38.567+0000 7f5c79066640 1 -- 172.21.15.115:0/387245011 wait complete. 2024-09-13T23:04:38.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:39.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T23:04:39.380 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:39 smithi152 ceph-mon[34465]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T23:04:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:39 smithi115 ceph-mon[27601]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T23:04:41.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 -- 172.21.15.115:0/3859156096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 msgr2=0x7ff0800fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:41.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 --2- 172.21.15.115:0/3859156096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff0800fb860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0700048d0 tx=0x7ff070009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.021 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 -- 172.21.15.115:0/3859156096 shutdown_connections 2024-09-13T23:04:41.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 --2- 172.21.15.115:0/3859156096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff0800fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 --2- 172.21.15.115:0/3859156096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff0800fb860 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 -- 172.21.15.115:0/3859156096 >> 172.21.15.115:0/3859156096 conn(0x7ff0800f6c10 msgr2=0x7ff0800f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:41.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 -- 172.21.15.115:0/3859156096 shutdown_connections 2024-09-13T23:04:41.022 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.020+0000 7ff084cb5640 1 -- 172.21.15.115:0/3859156096 wait complete. 2024-09-13T23:04:41.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 Processor -- start 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 -- start start 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff080112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0800667c0 con 0x7ff0800fb450 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff084cb5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080066930 con 0x7ff0800fc720 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52090/0 (socket says 172.21.15.115:52090) 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 -- 172.21.15.115:0/4262597744 learned_addr learned my addr 172.21.15.115:0/4262597744 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07dd9b640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff080112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 -- 172.21.15.115:0/4262597744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 msgr2=0x7ff080112410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff080112410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 -- 172.21.15.115:0/4262597744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070005040 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07dd9b640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff080112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.021+0000 7ff07e59c640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff070000c00 tx=0x7ff070009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.022+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070038070 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.022+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff07002ae90 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.022+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0801129b0 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.022+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07003d420 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.022+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff080112ed0 con 0x7ff0800fb450 2024-09-13T23:04:41.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.023+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0800fa8b0 con 0x7ff0800fb450 2024-09-13T23:04:41.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.023+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ff070030020 con 0x7ff0800fb450 2024-09-13T23:04:41.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.024+0000 7ff06effd640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 0x7ff068071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:41.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.024+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff0700ae8d0 con 0x7ff0800fb450 2024-09-13T23:04:41.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.024+0000 7ff07dd9b640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 0x7ff068071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:41.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.024+0000 7ff07dd9b640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 0x7ff068071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff074009a80 tx=0x7ff074008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:41.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.028+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff07007ba20 con 0x7ff0800fb450 2024-09-13T23:04:41.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.195+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7ff080100c70 con 0x7ff06806ed60 2024-09-13T23:04:41.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.201+0000 7ff06effd640 1 -- 172.21.15.115:0/4262597744 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff080100c70 con 0x7ff06806ed60 2024-09-13T23:04:41.202 INFO:teuthology.orchestra.run.smithi115.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 msgr2=0x7ff068071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 0x7ff068071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff074009a80 tx=0x7ff074008040 comp rx=0 tx=0).stop 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 msgr2=0x7ff08010fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff070000c00 tx=0x7ff070009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 shutdown_connections 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff06806ed60 0x7ff068071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0800fc720 0x7ff080112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 --2- 172.21.15.115:0/4262597744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0800fb450 0x7ff08010fec0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 >> 172.21.15.115:0/4262597744 conn(0x7ff0800f6c10 msgr2=0x7ff0800f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 shutdown_connections 2024-09-13T23:04:41.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:41.203+0000 7ff084cb5640 1 -- 172.21.15.115:0/4262597744 wait complete. 2024-09-13T23:04:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:41 smithi152 ceph-mon[34465]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-13T23:04:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:41 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:42.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:41 smithi115 ceph-mon[27601]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-13T23:04:42.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:42.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:41 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:42.123 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T23:04:42.123 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:04:42.124 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T23:04:42.377 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:04:42.765 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:42.766 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:42.766 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:42.766 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:42.766 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:42.767 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:42 smithi115 ceph-mon[27601]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:04:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:42 smithi152 ceph-mon[34465]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:04:43.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:43 smithi115 ceph-mon[27601]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:04:43.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:43 smithi152 ceph-mon[34465]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:04:44.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- 172.21.15.115:0/274708320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fb430 msgr2=0x7f07c00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 --2- 172.21.15.115:0/274708320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fb430 0x7f07c00fb840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07b40048d0 tx=0x7f07b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- 172.21.15.115:0/274708320 shutdown_connections 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 --2- 172.21.15.115:0/274708320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fc700 0x7f07c00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 --2- 172.21.15.115:0/274708320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fb430 0x7f07c00fb840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- 172.21.15.115:0/274708320 >> 172.21.15.115:0/274708320 conn(0x7f07c00f6c10 msgr2=0x7f07c00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- 172.21.15.115:0/274708320 shutdown_connections 2024-09-13T23:04:44.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- 172.21.15.115:0/274708320 wait complete. 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 Processor -- start 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.194+0000 7f07c7111640 1 -- start start 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07c7111640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fb430 0x7f07c010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07c7111640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07c7111640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0065cf0 con 0x7f07c00fc700 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07c7111640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0065e60 con 0x7f07c00fb430 2024-09-13T23:04:44.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52098/0 (socket says 172.21.15.115:52098) 2024-09-13T23:04:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 -- 172.21.15.115:0/4053699600 learned_addr learned my addr 172.21.15.115:0/4053699600 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07c4ead640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fb430 0x7f07c010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 -- 172.21.15.115:0/4053699600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fb430 msgr2=0x7f07c010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fb430 0x7f07c010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 -- 172.21.15.115:0/4053699600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4005040 con 0x7f07c00fc700 2024-09-13T23:04:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.195+0000 7f07bffff640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00b790 tx=0x7f07ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.196+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ac00c700 con 0x7f07c00fc700 2024-09-13T23:04:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.196+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07ac00cd00 con 0x7f07c00fc700 2024-09-13T23:04:44.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.196+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c0112970 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.196+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07ac015e70 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.196+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c0112e90 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.197+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00fa890 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.197+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f07ac012070 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.198+0000 7f07bd7fa640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 0x7f07b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.198+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f07ac08dd50 con 0x7f07c00fc700 2024-09-13T23:04:44.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.198+0000 7f07c4ead640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 0x7f07b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.198+0000 7f07c4ead640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 0x7f07b0071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007ac0 tx=0x7f07b4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.203+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f07ac05ae40 con 0x7f07c00fc700 2024-09-13T23:04:44.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.402+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07c0100b20 con 0x7f07b006ed60 2024-09-13T23:04:44.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.403+0000 7f07bd7fa640 1 -- 172.21.15.115:0/4053699600 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f07c0100b20 con 0x7f07b006ed60 2024-09-13T23:04:44.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 msgr2=0x7f07b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 0x7f07b0071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007ac0 tx=0x7f07b4035040 comp rx=0 tx=0).stop 2024-09-13T23:04:44.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 msgr2=0x7f07c0112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00b790 tx=0x7f07ac0091d0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 shutdown_connections 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f07b006ed60 0x7f07b0071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00fc700 0x7f07c0112370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 --2- 172.21.15.115:0/4053699600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f07c00fb430 0x7f07c010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.405+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 >> 172.21.15.115:0/4053699600 conn(0x7f07c00f6c10 msgr2=0x7f07c00f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.406+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 shutdown_connections 2024-09-13T23:04:44.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.406+0000 7f07c7111640 1 -- 172.21.15.115:0/4053699600 wait complete. 2024-09-13T23:04:44.415 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:04:44.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 -- 172.21.15.115:0/2977566188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac8101b30 msgr2=0x7f2ac8103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2977566188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac8101b30 0x7f2ac8103f10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0048d0 tx=0x7f2abc009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 -- 172.21.15.115:0/2977566188 shutdown_connections 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2977566188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac8101b30 0x7f2ac8103f10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2977566188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac80666b0 0x7f2ac81015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 -- 172.21.15.115:0/2977566188 >> 172.21.15.115:0/2977566188 conn(0x7f2ac80f6c40 msgr2=0x7f2ac80f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 -- 172.21.15.115:0/2977566188 shutdown_connections 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.493+0000 7f2acdef5640 1 -- 172.21.15.115:0/2977566188 wait complete. 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 Processor -- start 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 -- start start 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac8101b30 0x7f2ac810f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac810fed0 con 0x7f2ac80666b0 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2acdef5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81106a0 con 0x7f2ac8101b30 2024-09-13T23:04:44.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2ac77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2ac77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52118/0 (socket says 172.21.15.115:52118) 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2ac77fe640 1 -- 172.21.15.115:0/2807072398 learned_addr learned my addr 172.21.15.115:0/2807072398 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.494+0000 7f2ac6ffd640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac8101b30 0x7f2ac810f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2ac77fe640 1 -- 172.21.15.115:0/2807072398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac8101b30 msgr2=0x7f2ac810f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2ac77fe640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac8101b30 0x7f2ac810f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2ac77fe640 1 -- 172.21.15.115:0/2807072398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc005040 con 0x7f2ac80666b0 2024-09-13T23:04:44.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2ac77fe640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8002a80 tx=0x7f2ab8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab8007c30 con 0x7f2ac80666b0 2024-09-13T23:04:44.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8110930 con 0x7f2ac80666b0 2024-09-13T23:04:44.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ab800f040 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab800dad0 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.495+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8110ea0 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.496+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac81079a0 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.497+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f2ab800dc30 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.497+0000 7f2aaffff640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 0x7f2ab0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.497+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2ab808dfe0 con 0x7f2ac80666b0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.497+0000 7f2ac6ffd640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 0x7f2ab0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.498+0000 7f2ac6ffd640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 0x7f2ab0071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0043d0 tx=0x7f2abc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.502+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ab805b0b0 con 0x7f2ac80666b0 2024-09-13T23:04:44.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.708+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ac8111200 con 0x7f2ab006ed60 2024-09-13T23:04:44.710 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.709+0000 7f2aaffff640 1 -- 172.21.15.115:0/2807072398 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2ac8111200 con 0x7f2ab006ed60 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.711+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 msgr2=0x7f2ab0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.711+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 0x7f2ab0071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0043d0 tx=0x7f2abc035040 comp rx=0 tx=0).stop 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.711+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 msgr2=0x7f2ac810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.711+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8002a80 tx=0x7f2ab8004570 comp rx=0 tx=0).stop 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 shutdown_connections 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f2ab006ed60 0x7f2ab0071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ac8101b30 0x7f2ac810f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 --2- 172.21.15.115:0/2807072398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ac80666b0 0x7f2ac810f340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 >> 172.21.15.115:0/2807072398 conn(0x7f2ac80f6c40 msgr2=0x7f2ac80f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 shutdown_connections 2024-09-13T23:04:44.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.712+0000 7f2acdef5640 1 -- 172.21.15.115:0/2807072398 wait complete. 2024-09-13T23:04:44.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 -- 172.21.15.115:0/2005049312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fc700 msgr2=0x7ffaf40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 --2- 172.21.15.115:0/2005049312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fc700 0x7ffaf40fcb70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffae40048d0 tx=0x7ffae4009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 -- 172.21.15.115:0/2005049312 shutdown_connections 2024-09-13T23:04:44.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 --2- 172.21.15.115:0/2005049312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fc700 0x7ffaf40fcb70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 --2- 172.21.15.115:0/2005049312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fb430 0x7ffaf40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 -- 172.21.15.115:0/2005049312 >> 172.21.15.115:0/2005049312 conn(0x7ffaf40f6c10 msgr2=0x7ffaf40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:44.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 -- 172.21.15.115:0/2005049312 shutdown_connections 2024-09-13T23:04:44.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.798+0000 7ffafc79a640 1 -- 172.21.15.115:0/2005049312 wait complete. 2024-09-13T23:04:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 Processor -- start 2024-09-13T23:04:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 -- start start 2024-09-13T23:04:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fc700 0x7ffaf410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf410e490 con 0x7ffaf40fb430 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafc79a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf410e600 con 0x7ffaf40fc700 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafa536640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafa536640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52136/0 (socket says 172.21.15.115:52136) 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffafa536640 1 -- 172.21.15.115:0/3982801516 learned_addr learned my addr 172.21.15.115:0/3982801516 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.799+0000 7ffaf9d35640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fc700 0x7ffaf410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafa536640 1 -- 172.21.15.115:0/3982801516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fc700 msgr2=0x7ffaf410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafa536640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fc700 0x7ffaf410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafa536640 1 -- 172.21.15.115:0/3982801516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4005040 con 0x7ffaf40fb430 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafa536640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000b790 tx=0x7ffaf00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf000c700 con 0x7ffaf40fb430 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf410e8e0 con 0x7ffaf40fb430 2024-09-13T23:04:44.802 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffaf000cd00 con 0x7ffaf40fb430 2024-09-13T23:04:44.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf0015e80 con 0x7ffaf40fb430 2024-09-13T23:04:44.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.800+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf410ee00 con 0x7ffaf40fb430 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.801+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf41057c0 con 0x7ffaf40fb430 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.802+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7ffaf0012070 con 0x7ffaf40fb430 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.802+0000 7ffaeaffd640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 0x7ffae0075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.802+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffaf008daa0 con 0x7ffaf40fb430 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.802+0000 7ffaf9d35640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 0x7ffae0075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:44.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.803+0000 7ffaf9d35640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 0x7ffae0075620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaf410ce90 tx=0x7ffae4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:44.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:44.807+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffaf005ab10 con 0x7ffaf40fb430 2024-09-13T23:04:45.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.000+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaf410f0e0 con 0x7ffae0073170 2024-09-13T23:04:45.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.011+0000 7ffaeaffd640 1 -- 172.21.15.115:0/3982801516 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ffaf410f0e0 con 0x7ffae0073170 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (4m) 26s ago 6m 25.5M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (6m) 26s ago 6m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (5m) 32s ago 5m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (4m) 26s ago 5m 86.6M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (46s) 26s ago 45s 15.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (52s) 26s ago 51s 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (49s) 32s ago 49s 17.2M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (43s) 32s ago 42s 16.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (7m) 26s ago 7m 449M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:04:45.012 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (5m) 32s ago 5m 401M - 17.2.7-1629-geb16b97b ab51d1bebd12 7d007dcea4b4 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (7m) 26s ago 7m 44.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (5m) 32s ago 5m 35.7M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 26s ago 6m 15.8M - 1.5.0 0da6a335fe13 f6758bd48343 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 32s ago 5m 17.2M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 26s ago 4m 44.1M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (3m) 26s ago 3m 45.0M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 26s ago 3m 44.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (3m) 32s ago 3m 47.0M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (2m) 32s ago 2m 42.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (2m) 32s ago 2m 41.7M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:04:45.013 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (4m) 26s ago 5m 55.2M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 msgr2=0x7ffae0075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 0x7ffae0075620 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaf410ce90 tx=0x7ffae4035040 comp rx=0 tx=0).stop 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 msgr2=0x7ffaf410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000b790 tx=0x7ffaf00091d0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 shutdown_connections 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ffae0073170 0x7ffae0075620 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffaf40fc700 0x7ffaf410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 --2- 172.21.15.115:0/3982801516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffaf40fb430 0x7ffaf410d0e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 >> 172.21.15.115:0/3982801516 conn(0x7ffaf40f6c10 msgr2=0x7ffaf40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 shutdown_connections 2024-09-13T23:04:45.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.013+0000 7ffafc79a640 1 -- 172.21.15.115:0/3982801516 wait complete. 2024-09-13T23:04:45.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 -- 172.21.15.115:0/105862459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fb430 msgr2=0x7fc8680fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.104 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 --2- 172.21.15.115:0/105862459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fb430 0x7fc8680fb840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8580048d0 tx=0x7fc858009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 -- 172.21.15.115:0/105862459 shutdown_connections 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 --2- 172.21.15.115:0/105862459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fc700 0x7fc8680fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 --2- 172.21.15.115:0/105862459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fb430 0x7fc8680fb840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.103+0000 7fc86de29640 1 -- 172.21.15.115:0/105862459 >> 172.21.15.115:0/105862459 conn(0x7fc8680f6c10 msgr2=0x7fc8680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.104+0000 7fc86de29640 1 -- 172.21.15.115:0/105862459 shutdown_connections 2024-09-13T23:04:45.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.104+0000 7fc86de29640 1 -- 172.21.15.115:0/105862459 wait complete. 2024-09-13T23:04:45.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.104+0000 7fc86de29640 1 Processor -- start 2024-09-13T23:04:45.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.104+0000 7fc86de29640 1 -- start start 2024-09-13T23:04:45.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc86de29640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fb430 0x7fc86810aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc86de29640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc86de29640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86810c160 con 0x7fc8680fc700 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc86de29640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86810c2d0 con 0x7fc8680fb430 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52158/0 (socket says 172.21.15.115:52158) 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 -- 172.21.15.115:0/1375690055 learned_addr learned my addr 172.21.15.115:0/1375690055 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc8677fe640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fb430 0x7fc86810aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 -- 172.21.15.115:0/1375690055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fb430 msgr2=0x7fc86810aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fb430 0x7fc86810aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 -- 172.21.15.115:0/1375690055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858005040 con 0x7fc8680fc700 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.105+0000 7fc866ffd640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00eb70 tx=0x7fc85c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.106+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85c007c30 con 0x7fc8680fc700 2024-09-13T23:04:45.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.106+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc85c00f040 con 0x7fc8680fc700 2024-09-13T23:04:45.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.106+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85c009550 con 0x7fc8680fc700 2024-09-13T23:04:45.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.106+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86810c550 con 0x7fc8680fc700 2024-09-13T23:04:45.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.106+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86810ca30 con 0x7fc8680fc700 2024-09-13T23:04:45.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.107+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8680fa890 con 0x7fc8680fc700 2024-09-13T23:04:45.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.108+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fc85c00cca0 con 0x7fc8680fc700 2024-09-13T23:04:45.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.108+0000 7fc84ffff640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 0x7fc850073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.109+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc85c08dd90 con 0x7fc8680fc700 2024-09-13T23:04:45.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.109+0000 7fc8677fe640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 0x7fc850073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.109+0000 7fc8677fe640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 0x7fc850073400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc858007ac0 tx=0x7fc858035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.113+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc85c04e2a0 con 0x7fc8680fc700 2024-09-13T23:04:45.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.388+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc86804b720 con 0x7fc8680fc700 2024-09-13T23:04:45.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.389+0000 7fc84ffff640 1 -- 172.21.15.115:0/1375690055 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fc85c05ab10 con 0x7fc8680fc700 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:04:45.390 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:04:45.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:04:45.391 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:04:45.391 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 14 2024-09-13T23:04:45.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:04:45.391 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 msgr2=0x7fc850073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 0x7fc850073400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc858007ac0 tx=0x7fc858035040 comp rx=0 tx=0).stop 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 msgr2=0x7fc86810b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00eb70 tx=0x7fc85c00b040 comp rx=0 tx=0).stop 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 shutdown_connections 2024-09-13T23:04:45.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fc850070f50 0x7fc850073400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8680fc700 0x7fc86810b430 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 --2- 172.21.15.115:0/1375690055 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8680fb430 0x7fc86810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 >> 172.21.15.115:0/1375690055 conn(0x7fc8680f6c10 msgr2=0x7fc8680f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 shutdown_connections 2024-09-13T23:04:45.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.391+0000 7fc86de29640 1 -- 172.21.15.115:0/1375690055 wait complete. 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- 172.21.15.115:0/2752312953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fb430 msgr2=0x7f75a80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 --2- 172.21.15.115:0/2752312953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fb430 0x7f75a80fb840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75a40048d0 tx=0x7f75a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- 172.21.15.115:0/2752312953 shutdown_connections 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 --2- 172.21.15.115:0/2752312953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fc700 0x7f75a80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 --2- 172.21.15.115:0/2752312953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fb430 0x7f75a80fb840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- 172.21.15.115:0/2752312953 >> 172.21.15.115:0/2752312953 conn(0x7f75a80f6c10 msgr2=0x7f75a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- 172.21.15.115:0/2752312953 shutdown_connections 2024-09-13T23:04:45.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- 172.21.15.115:0/2752312953 wait complete. 2024-09-13T23:04:45.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 Processor -- start 2024-09-13T23:04:45.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.484+0000 7f75aff94640 1 -- start start 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75aff94640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 0x7f75a810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75aff94640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75aff94640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810dc50 con 0x7f75a80fc700 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75aff94640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810e470 con 0x7f75a80fb430 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75ad52f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75add30640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 0x7f75a810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75ad52f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52170/0 (socket says 172.21.15.115:52170) 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75ad52f640 1 -- 172.21.15.115:0/2264851862 learned_addr learned my addr 172.21.15.115:0/2264851862 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75add30640 1 -- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 msgr2=0x7f75a810d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75add30640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.487 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75add30640 1 -- 172.21.15.115:0/2264851862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4005040 con 0x7f75a80fb430 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75ad52f640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.485+0000 7f75add30640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 0x7f75a810d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75a402a530 tx=0x7f75a4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.486+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a4038070 con 0x7f75a80fb430 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.486+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a810e6a0 con 0x7f75a80fb430 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.486+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f75a402ae90 con 0x7f75a80fb430 2024-09-13T23:04:45.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.486+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a403e670 con 0x7f75a80fb430 2024-09-13T23:04:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.486+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a810ec40 con 0x7f75a80fb430 2024-09-13T23:04:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.487+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80fa890 con 0x7f75a80fb430 2024-09-13T23:04:45.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.487+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f75a4030020 con 0x7f75a80fb430 2024-09-13T23:04:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.488+0000 7f759e7fc640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 0x7f7594071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.488+0000 7f75ad52f640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 0x7f7594071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.488+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f75a40ae240 con 0x7f75a80fb430 2024-09-13T23:04:45.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.488+0000 7f75ad52f640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 0x7f7594071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75a810ce70 tx=0x7f759800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.492+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f75a407b3d0 con 0x7f75a80fb430 2024-09-13T23:04:45.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.729+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75a802aa40 con 0x7f75a80fb430 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.729+0000 7f759e7fc640 1 -- 172.21.15.115:0/2264851862 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f75a407ad70 con 0x7f75a80fb430 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:04:08.269431+0000 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:04:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T23:04:45.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 msgr2=0x7f7594071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 0x7f7594071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75a810ce70 tx=0x7f759800b040 comp rx=0 tx=0).stop 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 msgr2=0x7f75a810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 0x7f75a810d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75a402a530 tx=0x7f75a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 shutdown_connections 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f759406ed60 0x7f7594071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75a80fc700 0x7f75a810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 --2- 172.21.15.115:0/2264851862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75a80fb430 0x7f75a810d0c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 >> 172.21.15.115:0/2264851862 conn(0x7f75a80f6c10 msgr2=0x7f75a8065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.731+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 shutdown_connections 2024-09-13T23:04:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.732+0000 7f75aff94640 1 -- 172.21.15.115:0/2264851862 wait complete. 2024-09-13T23:04:45.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 -- 172.21.15.115:0/3930824951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 msgr2=0x7f51580fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 --2- 172.21.15.115:0/3930824951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f51580fb840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51480048d0 tx=0x7f5148009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 -- 172.21.15.115:0/3930824951 shutdown_connections 2024-09-13T23:04:45.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 --2- 172.21.15.115:0/3930824951 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51580fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 --2- 172.21.15.115:0/3930824951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f51580fb840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 -- 172.21.15.115:0/3930824951 >> 172.21.15.115:0/3930824951 conn(0x7f51580f6c10 msgr2=0x7f51580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:45.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 -- 172.21.15.115:0/3930824951 shutdown_connections 2024-09-13T23:04:45.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.822+0000 7f515cfb7640 1 -- 172.21.15.115:0/3930824951 wait complete. 2024-09-13T23:04:45.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 Processor -- start 2024-09-13T23:04:45.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 -- start start 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51581122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158065c80 con 0x7f51580fb430 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515cfb7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158065df0 con 0x7f51580fc700 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.823+0000 7f515659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52194/0 (socket says 172.21.15.115:52194) 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 -- 172.21.15.115:0/651532467 learned_addr learned my addr 172.21.15.115:0/651532467 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f514dd9b640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51581122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 -- 172.21.15.115:0/651532467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 msgr2=0x7f51581122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51581122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 -- 172.21.15.115:0/651532467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148005040 con 0x7f51580fb430 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f514dd9b640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51581122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:04:45.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515659c640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51480048a0 tx=0x7f5148009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5148038070 con 0x7f51580fb430 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5158112810 con 0x7f51580fb430 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5148004290 con 0x7f51580fb430 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5148033660 con 0x7f51580fb430 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.824+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5158112db0 con 0x7f51580fb430 2024-09-13T23:04:45.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.826+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51580fa890 con 0x7f51580fb430 2024-09-13T23:04:45.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.826+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f5148030020 con 0x7f51580fb430 2024-09-13T23:04:45.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.827+0000 7f514f7fe640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 0x7f5144071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:45.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.827+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f51480ae260 con 0x7f51580fb430 2024-09-13T23:04:45.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.827+0000 7f514dd9b640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 0x7f5144071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:45.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.828+0000 7f514dd9b640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 0x7f5144071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5140004fd0 tx=0x7f514000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:45.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:45.832+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f514807b460 con 0x7f51580fb430 2024-09-13T23:04:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:45 smithi152 ceph-mon[34465]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:04:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:45 smithi152 ceph-mon[34465]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:45 smithi152 ceph-mon[34465]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:45.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:45 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1375690055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.041 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.040+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5158100b60 con 0x7f514406ed60 2024-09-13T23:04:46.041 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:45 smithi115 ceph-mon[27601]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T23:04:46.042 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:45 smithi115 ceph-mon[27601]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:46.042 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:45 smithi115 ceph-mon[27601]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:46.042 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:45 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1375690055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.042 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.041+0000 7f514f7fe640 1 -- 172.21.15.115:0/651532467 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f5158100b60 con 0x7f514406ed60 2024-09-13T23:04:46.042 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:04:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", 2024-09-13T23:04:46.042 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "", 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 image", 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:04:46.043 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 msgr2=0x7f5144071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 0x7f5144071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5140004fd0 tx=0x7f514000b040 comp rx=0 tx=0).stop 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 msgr2=0x7f515810fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f51480048a0 tx=0x7f5148009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 shutdown_connections 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f514406ed60 0x7f5144071210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51580fc700 0x7f51581122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 --2- 172.21.15.115:0/651532467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51580fb430 0x7f515810fd80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 >> 172.21.15.115:0/651532467 conn(0x7f51580f6c10 msgr2=0x7f51580f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:46.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 shutdown_connections 2024-09-13T23:04:46.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.044+0000 7f515cfb7640 1 -- 172.21.15.115:0/651532467 wait complete. 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/3422283304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 msgr2=0x7f7ec00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/3422283304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00ff140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00048d0 tx=0x7f7eb0009da0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/3422283304 shutdown_connections 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/3422283304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/3422283304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00ff140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/3422283304 >> 172.21.15.115:0/3422283304 conn(0x7f7ec00f6c10 msgr2=0x7f7ec00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/3422283304 shutdown_connections 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.136+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/3422283304 wait complete. 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 Processor -- start 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 -- start start 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec00fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0110d30 con 0x7f7ec0065c40 2024-09-13T23:04:46.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.137+0000 7f7ec5c9b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0110e70 con 0x7f7ec00ff680 2024-09-13T23:04:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55096/0 (socket says 172.21.15.115:55096) 2024-09-13T23:04:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebf7fe640 1 -- 172.21.15.115:0/2732384312 learned_addr learned my addr 172.21.15.115:0/2732384312 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:04:46.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebeffd640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec00fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebeffd640 1 -- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 msgr2=0x7f7ec00fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebeffd640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebeffd640 1 -- 172.21.15.115:0/2732384312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0005040 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebf7fe640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ebeffd640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec00fb040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400e910 tx=0x7f7eb400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb400eea0 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7eb400f040 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec00fb580 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb4009410 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.138+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec00fbaf0 con 0x7f7ec00ff680 2024-09-13T23:04:46.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.140+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec00fa890 con 0x7f7ec00ff680 2024-09-13T23:04:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.140+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f7eb4009640 con 0x7f7ec00ff680 2024-09-13T23:04:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.141+0000 7f7ea7fff640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 0x7f7ea8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.141+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7eb408dd10 con 0x7f7ec00ff680 2024-09-13T23:04:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.141+0000 7f7ebf7fe640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 0x7f7ea8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:46.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.141+0000 7f7ebf7fe640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 0x7f7ea8071200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000b020 tx=0x7f7eb0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:46.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.145+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7eb404e2a0 con 0x7f7ec00ff680 2024-09-13T23:04:46.419 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.419+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ec004b720 con 0x7f7ec00ff680 2024-09-13T23:04:46.420 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.419+0000 7f7ea7fff640 1 -- 172.21.15.115:0/2732384312 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7eb405ae90 con 0x7f7ec00ff680 2024-09-13T23:04:46.420 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 msgr2=0x7f7ea8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 0x7f7ea8071200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000b020 tx=0x7f7eb0035040 comp rx=0 tx=0).stop 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 msgr2=0x7f7ec00fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec00fb040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400e910 tx=0x7f7eb400b040 comp rx=0 tx=0).stop 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 shutdown_connections 2024-09-13T23:04:46.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f7ea806ed50 0x7f7ea8071200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec00ff680 0x7f7ec00fb040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 --2- 172.21.15.115:0/2732384312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ec0065c40 0x7f7ec00fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:46.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 >> 172.21.15.115:0/2732384312 conn(0x7f7ec00f6c10 msgr2=0x7f7ec00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:46.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.421+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 shutdown_connections 2024-09-13T23:04:46.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:04:46.422+0000 7f7ec5c9b640 1 -- 172.21.15.115:0/2732384312 wait complete. 2024-09-13T23:04:46.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:46 smithi152 ceph-mon[34465]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:46.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:46 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2264851862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:46.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:46 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2732384312' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:46 smithi115 ceph-mon[27601]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:46 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2264851862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:46 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2732384312' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:47 smithi152 ceph-mon[34465]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:47.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:47 smithi152 ceph-mon[34465]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:04:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:47 smithi115 ceph-mon[27601]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:47 smithi115 ceph-mon[27601]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:04:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:49 smithi152 ceph-mon[34465]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:04:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:49 smithi115 ceph-mon[27601]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:04:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:51 smithi152 ceph-mon[34465]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:04:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:51 smithi115 ceph-mon[27601]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:04:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:53 smithi115 ceph-mon[27601]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:04:54.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:53 smithi152 ceph-mon[34465]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:04:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:55 smithi115 ceph-mon[27601]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:04:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:55 smithi152 ceph-mon[34465]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:04:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:57 smithi115 ceph-mon[27601]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:04:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:57 smithi152 ceph-mon[34465]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:05:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:04:59 smithi115 ceph-mon[27601]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:04:59 smithi152 ceph-mon[34465]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:01 smithi115 ceph-mon[27601]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:05:02.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:01 smithi152 ceph-mon[34465]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:05:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:03 smithi115 ceph-mon[27601]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:04.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:03 smithi152 ceph-mon[34465]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:06.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:05 smithi115 ceph-mon[27601]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:05:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:05 smithi152 ceph-mon[34465]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:05:08.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:07 smithi115 ceph-mon[27601]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T23:05:08.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:07 smithi152 ceph-mon[34465]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T23:05:09.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:09.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:09 smithi115 ceph-mon[27601]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T23:05:10.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:09 smithi152 ceph-mon[34465]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T23:05:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:05:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T23:05:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T23:05:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: Upgrade: Need to upgrade myself (mgr.smithi115.eqesbc) 2024-09-13T23:05:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:11 smithi152 ceph-mon[34465]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi152 2024-09-13T23:05:11.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:05:11.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:11.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T23:05:11.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T23:05:11.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:11.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:11.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: Upgrade: Need to upgrade myself (mgr.smithi115.eqesbc) 2024-09-13T23:05:11.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:11 smithi115 ceph-mon[27601]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi152 2024-09-13T23:05:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:13 smithi152 ceph-mon[34465]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:05:13.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:13 smithi115 ceph-mon[27601]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:05:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:15 smithi152 ceph-mon[34465]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T23:05:15.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:15 smithi115 ceph-mon[27601]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 -- 172.21.15.115:0/1317041499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 msgr2=0x7fd4ac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 --2- 172.21.15.115:0/1317041499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac0fcb70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0048d0 tx=0x7fd49c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 -- 172.21.15.115:0/1317041499 shutdown_connections 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 --2- 172.21.15.115:0/1317041499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac0fcb70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 --2- 172.21.15.115:0/1317041499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 -- 172.21.15.115:0/1317041499 >> 172.21.15.115:0/1317041499 conn(0x7fd4ac0f6c10 msgr2=0x7fd4ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 -- 172.21.15.115:0/1317041499 shutdown_connections 2024-09-13T23:05:16.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.546+0000 7fd4b3915640 1 -- 172.21.15.115:0/1317041499 wait complete. 2024-09-13T23:05:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.547+0000 7fd4b3915640 1 Processor -- start 2024-09-13T23:05:16.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.547+0000 7fd4b3915640 1 -- start start 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.547+0000 7fd4b3915640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b3915640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b3915640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac10cb10 con 0x7fd4ac0fc700 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b3915640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac10d330 con 0x7fd4ac0fb430 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:16.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:36278/0 (socket says 172.21.15.115:36278) 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 -- 172.21.15.115:0/3547084336 learned_addr learned my addr 172.21.15.115:0/3547084336 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b0eb0640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 -- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 msgr2=0x7fd4ac10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 -- 172.21.15.115:0/3547084336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c005040 con 0x7fd4ac0fb430 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b0eb0640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.548+0000 7fd4b16b1640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800eb70 tx=0x7fd4a800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.549+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a8007c30 con 0x7fd4ac0fb430 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.549+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd4a800f040 con 0x7fd4ac0fb430 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.549+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a80094e0 con 0x7fd4ac0fb430 2024-09-13T23:05:16.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.549+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac10d560 con 0x7fd4ac0fb430 2024-09-13T23:05:16.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.549+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac10d9f0 con 0x7fd4ac0fb430 2024-09-13T23:05:16.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.551+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac0fa890 con 0x7fd4ac0fb430 2024-09-13T23:05:16.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.551+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fd4a8009660 con 0x7fd4ac0fb430 2024-09-13T23:05:16.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.552+0000 7fd4a1ffb640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 0x7fd498071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:16.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.552+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd4a808dfb0 con 0x7fd4ac0fb430 2024-09-13T23:05:16.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.552+0000 7fd4b0eb0640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 0x7fd498071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:16.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.553+0000 7fd4b0eb0640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 0x7fd498071200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007ac0 tx=0x7fd49c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:16.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.560+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd4a805afe0 con 0x7fd4ac0fb430 2024-09-13T23:05:16.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.890+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac10ddd0 con 0x7fd49806ed50 2024-09-13T23:05:16.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.891+0000 7fd4a1ffb640 1 -- 172.21.15.115:0/3547084336 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fd4ac10ddd0 con 0x7fd49806ed50 2024-09-13T23:05:16.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 msgr2=0x7fd498071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:16.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 0x7fd498071200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd49c007ac0 tx=0x7fd49c035040 comp rx=0 tx=0).stop 2024-09-13T23:05:16.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 msgr2=0x7fd4ac10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:16.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800eb70 tx=0x7fd4a800b040 comp rx=0 tx=0).stop 2024-09-13T23:05:16.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 shutdown_connections 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fd49806ed50 0x7fd498071200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 --2- 172.21.15.115:0/3547084336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10bf80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 >> 172.21.15.115:0/3547084336 conn(0x7fd4ac0f6c10 msgr2=0x7fd4ac0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 shutdown_connections 2024-09-13T23:05:16.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:16.893+0000 7fd4b3915640 1 -- 172.21.15.115:0/3547084336 wait complete. 2024-09-13T23:05:16.903 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 -- 172.21.15.115:0/1518602955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fe4c0 msgr2=0x7f4a740fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 --2- 172.21.15.115:0/1518602955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fa620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0048d0 tx=0x7f4a5c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 -- 172.21.15.115:0/1518602955 shutdown_connections 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 --2- 172.21.15.115:0/1518602955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fa620 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 --2- 172.21.15.115:0/1518602955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fdb70 0x7f4a740fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 -- 172.21.15.115:0/1518602955 >> 172.21.15.115:0/1518602955 conn(0x7f4a740f6390 msgr2=0x7f4a740f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 -- 172.21.15.115:0/1518602955 shutdown_connections 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.011+0000 7f4a79770640 1 -- 172.21.15.115:0/1518602955 wait complete. 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 Processor -- start 2024-09-13T23:05:17.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 -- start start 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fdb70 0x7f4a740fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740fbde0 con 0x7f4a740fe4c0 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a79770640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740fbf20 con 0x7f4a740fdb70 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49872/0 (socket says 172.21.15.115:49872) 2024-09-13T23:05:17.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 -- 172.21.15.115:0/3313677486 learned_addr learned my addr 172.21.15.115:0/3313677486 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a72ffd640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fdb70 0x7f4a740fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 -- 172.21.15.115:0/3313677486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fdb70 msgr2=0x7f4a740fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fdb70 0x7f4a740fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.012+0000 7f4a6bfff640 1 -- 172.21.15.115:0/3313677486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c005040 con 0x7f4a740fe4c0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a6bfff640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02d040 tx=0x7f4a5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5c038070 con 0x7f4a740fe4c0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740fc1a0 con 0x7f4a740fe4c0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74115100 con 0x7f4a740fe4c0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a5c02ae90 con 0x7f4a740fe4c0 2024-09-13T23:05:17.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.013+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5c03e430 con 0x7f4a740fe4c0 2024-09-13T23:05:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.014+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54005240 con 0x7f4a740fe4c0 2024-09-13T23:05:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.015+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f4a5c030020 con 0x7f4a740fe4c0 2024-09-13T23:05:17.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.016+0000 7f4a6b7fe640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 0x7f4a60071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.016+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4a5c0ae150 con 0x7f4a740fe4c0 2024-09-13T23:05:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.016+0000 7f4a72ffd640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 0x7f4a60071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.016+0000 7f4a72ffd640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 0x7f4a60071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a740fd110 tx=0x7f4a6400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.020 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.020+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4a5c07b2d0 con 0x7f4a740fe4c0 2024-09-13T23:05:17.197 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.196+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a54000bf0 con 0x7f4a6006ed60 2024-09-13T23:05:17.198 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.198+0000 7f4a6b7fe640 1 -- 172.21.15.115:0/3313677486 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f4a54000bf0 con 0x7f4a6006ed60 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 msgr2=0x7f4a60071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 0x7f4a60071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a740fd110 tx=0x7f4a6400b040 comp rx=0 tx=0).stop 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 msgr2=0x7f4a740fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c02d040 tx=0x7f4a5c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 shutdown_connections 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f4a6006ed60 0x7f4a60071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a740fe4c0 0x7f4a740fb850 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 --2- 172.21.15.115:0/3313677486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a740fdb70 0x7f4a740fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 >> 172.21.15.115:0/3313677486 conn(0x7f4a740f6390 msgr2=0x7f4a740f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:17.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 shutdown_connections 2024-09-13T23:05:17.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.201+0000 7f4a79770640 1 -- 172.21.15.115:0/3313677486 wait complete. 2024-09-13T23:05:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/184258777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 msgr2=0x7f3e480ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/184258777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e480ff140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e380048d0 tx=0x7f3e38009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/184258777 shutdown_connections 2024-09-13T23:05:17.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/184258777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e48101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/184258777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e480ff140 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/184258777 >> 172.21.15.115:0/184258777 conn(0x7f3e480f6c10 msgr2=0x7f3e480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:17.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/184258777 shutdown_connections 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.285+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/184258777 wait complete. 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.286+0000 7f3e4e9d1640 1 Processor -- start 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.286+0000 7f3e4e9d1640 1 -- start start 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.286+0000 7f3e4e9d1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e4810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.286+0000 7f3e4e9d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.286+0000 7f3e4e9d1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4810dca0 con 0x7f3e48065c40 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e4e9d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4810e470 con 0x7f3e480ff680 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:36320/0 (socket says 172.21.15.115:36320) 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 -- 172.21.15.115:0/2112851759 learned_addr learned my addr 172.21.15.115:0/2112851759 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e47fff640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e4810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 -- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 msgr2=0x7f3e4810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.291 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e4810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 -- 172.21.15.115:0/2112851759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e38005040 con 0x7f3e480ff680 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e47fff640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e4810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.287+0000 7f3e477fe640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00eb70 tx=0x7f3e3c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.288+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c007c30 con 0x7f3e480ff680 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.288+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e3c00f040 con 0x7f3e480ff680 2024-09-13T23:05:17.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.288+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c009490 con 0x7f3e480ff680 2024-09-13T23:05:17.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.288+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4810e6a0 con 0x7f3e480ff680 2024-09-13T23:05:17.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.288+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4810ebc0 con 0x7f3e480ff680 2024-09-13T23:05:17.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.289+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480fa890 con 0x7f3e480ff680 2024-09-13T23:05:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.291+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f3e3c00cc40 con 0x7f3e480ff680 2024-09-13T23:05:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.291+0000 7f3e44ff9640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 0x7f3e30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.292+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3e3c08e3d0 con 0x7f3e480ff680 2024-09-13T23:05:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.292+0000 7f3e47fff640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 0x7f3e30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.294 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.292+0000 7f3e47fff640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 0x7f3e30071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e38007ac0 tx=0x7f3e38035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.295+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3e3c05b540 con 0x7f3e480ff680 2024-09-13T23:05:17.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.467+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e4810efb0 con 0x7f3e3006ed60 2024-09-13T23:05:17.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:17 smithi115 ceph-mon[27601]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T23:05:17.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:17 smithi115 ceph-mon[27601]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:17.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.486+0000 7f3e44ff9640 1 -- 172.21.15.115:0/2112851759 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3e4810efb0 con 0x7f3e3006ed60 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 58s ago 6m 25.5M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (6m) 58s ago 6m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (5m) 64s ago 5m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 58s ago 6m 86.6M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (78s) 58s ago 77s 15.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (85s) 58s ago 84s 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (82s) 64s ago 81s 17.2M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (75s) 64s ago 75s 16.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:05:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (7m) 58s ago 7m 449M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (5m) 64s ago 5m 401M - 17.2.7-1629-geb16b97b ab51d1bebd12 7d007dcea4b4 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (7m) 58s ago 8m 44.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (5m) 64s ago 5m 35.7M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 58s ago 6m 15.8M - 1.5.0 0da6a335fe13 f6758bd48343 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 64s ago 5m 17.2M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 58s ago 4m 44.1M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (4m) 58s ago 4m 45.0M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (4m) 58s ago 4m 44.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (3m) 64s ago 3m 47.0M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (3m) 64s ago 3m 42.4M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (2m) 64s ago 2m 41.7M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:05:17.488 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 58s ago 6m 55.2M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:05:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.488+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 msgr2=0x7f3e30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.488+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 0x7f3e30071210 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e38007ac0 tx=0x7f3e38035040 comp rx=0 tx=0).stop 2024-09-13T23:05:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.488+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 msgr2=0x7f3e4810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.488+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00eb70 tx=0x7f3e3c00b040 comp rx=0 tx=0).stop 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 shutdown_connections 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f3e3006ed60 0x7f3e30071210 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e480ff680 0x7f3e4810d650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 --2- 172.21.15.115:0/2112851759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e48065c40 0x7f3e4810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 >> 172.21.15.115:0/2112851759 conn(0x7f3e480f6c10 msgr2=0x7f3e480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 shutdown_connections 2024-09-13T23:05:17.490 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.489+0000 7f3e4e9d1640 1 -- 172.21.15.115:0/2112851759 wait complete. 2024-09-13T23:05:17.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:17 smithi152 ceph-mon[34465]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T23:05:17.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:17 smithi152 ceph-mon[34465]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:17.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 -- 172.21.15.115:0/3179618501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 msgr2=0x7fefe40fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 --2- 172.21.15.115:0/3179618501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe40fc950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefe00048d0 tx=0x7fefe0009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 -- 172.21.15.115:0/3179618501 shutdown_connections 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 --2- 172.21.15.115:0/3179618501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 0x7fefe40fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 --2- 172.21.15.115:0/3179618501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe40fc950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 -- 172.21.15.115:0/3179618501 >> 172.21.15.115:0/3179618501 conn(0x7fefe40f7d00 msgr2=0x7fefe40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 -- 172.21.15.115:0/3179618501 shutdown_connections 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.608+0000 7fefebce7640 1 -- 172.21.15.115:0/3179618501 wait complete. 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.609+0000 7fefebce7640 1 Processor -- start 2024-09-13T23:05:17.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.609+0000 7fefebce7640 1 -- start start 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefebce7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefebce7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 0x7fefe410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefebce7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe410dc10 con 0x7fefe40fc540 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefebce7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe410e430 con 0x7fefe40fd810 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49916/0 (socket says 172.21.15.115:49916) 2024-09-13T23:05:17.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 -- 172.21.15.115:0/1932405025 learned_addr learned my addr 172.21.15.115:0/1932405025 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:17.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9282640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 0x7fefe410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 -- 172.21.15.115:0/1932405025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 msgr2=0x7fefe410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:17.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 0x7fefe410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:17.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.610+0000 7fefe9a83640 1 -- 172.21.15.115:0/1932405025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0005040 con 0x7fefe40fc540 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.611+0000 7fefe9a83640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fefe00043d0 tx=0x7fefe0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.611+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe0038070 con 0x7fefe40fc540 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.611+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe410e660 con 0x7fefe40fc540 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.611+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe410ec00 con 0x7fefe40fc540 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.611+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefe002ae90 con 0x7fefe40fc540 2024-09-13T23:05:17.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.612+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe003e670 con 0x7fefe40fc540 2024-09-13T23:05:17.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.612+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40fb9a0 con 0x7fefe40fc540 2024-09-13T23:05:17.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.613+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7fefe0030020 con 0x7fefe40fc540 2024-09-13T23:05:17.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.614+0000 7fefda7fc640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 0x7fefd0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:17.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.614+0000 7fefe9282640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 0x7fefd0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:17.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.615+0000 7fefe9282640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 0x7fefd0071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefe410ce30 tx=0x7fefd400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:17.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.615+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fefe007b830 con 0x7fefe40fc540 2024-09-13T23:05:17.622 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:17.622+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefe00b3060 con 0x7fefe40fc540 2024-09-13T23:05:18.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.070+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fefe4104f70 con 0x7fefe40fc540 2024-09-13T23:05:18.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.071+0000 7fefda7fc640 1 -- 172.21.15.115:0/1932405025 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fefe007baf0 con 0x7fefe40fc540 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:05:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:05:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:05:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 14 2024-09-13T23:05:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:05:18.073 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:05:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.073+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 msgr2=0x7fefd0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.073+0000 7fefebce7640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 0x7fefd0071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fefe410ce30 tx=0x7fefd400b040 comp rx=0 tx=0).stop 2024-09-13T23:05:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.073+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 msgr2=0x7fefe410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.073+0000 7fefebce7640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fefe00043d0 tx=0x7fefe0009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 shutdown_connections 2024-09-13T23:05:18.075 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fefd006ed60 0x7fefd0071210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fefe40fd810 0x7fefe410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 --2- 172.21.15.115:0/1932405025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefe40fc540 0x7fefe410d080 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 >> 172.21.15.115:0/1932405025 conn(0x7fefe40f7d00 msgr2=0x7fefe40f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 shutdown_connections 2024-09-13T23:05:18.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.074+0000 7fefebce7640 1 -- 172.21.15.115:0/1932405025 wait complete. 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3808022148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 msgr2=0x7f64e80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3808022148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e80ff140 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f64d80048d0 tx=0x7f64d8009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3808022148 shutdown_connections 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3808022148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3808022148 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e80ff140 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3808022148 >> 172.21.15.115:0/3808022148 conn(0x7f64e80f6c10 msgr2=0x7f64e80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3808022148 shutdown_connections 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.190+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3808022148 wait complete. 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 Processor -- start 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 -- start start 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e810dca0 con 0x7f64e8065c40 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.191+0000 7f64ed7c5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e810e470 con 0x7f64e80ff680 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:36364/0 (socket says 172.21.15.115:36364) 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 -- 172.21.15.115:0/3766050592 learned_addr learned my addr 172.21.15.115:0/3766050592 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e6ffd640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 -- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 msgr2=0x7f64e810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 -- 172.21.15.115:0/3766050592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8005040 con 0x7f64e80ff680 2024-09-13T23:05:18.194 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e6ffd640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.192+0000 7f64e67fc640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00eb70 tx=0x7f64dc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.193+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc007c30 con 0x7f64e80ff680 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.193+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e810e6a0 con 0x7f64e80ff680 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.193+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64dc00f040 con 0x7f64e80ff680 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.193+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64dc009450 con 0x7f64e80ff680 2024-09-13T23:05:18.195 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.193+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e810ec40 con 0x7f64e80ff680 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.194+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e80fa890 con 0x7f64e80ff680 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.195+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f64dc00cbd0 con 0x7f64e80ff680 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.195+0000 7f64cf7fe640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 0x7f64d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.195+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f64dc08dde0 con 0x7f64e80ff680 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.195+0000 7f64e6ffd640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 0x7f64d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.196 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.196+0000 7f64e6ffd640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 0x7f64d0071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007ac0 tx=0x7f64d8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.203+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f64dc04e2a0 con 0x7f64e80ff680 2024-09-13T23:05:18.445 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:18 smithi115 ceph-mon[27601]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:18.445 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:18 smithi115 ceph-mon[27601]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:18.446 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:18 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1932405025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:18.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.462+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64e8104f50 con 0x7f64e80ff680 2024-09-13T23:05:18.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.463+0000 7f64cf7fe640 1 -- 172.21.15.115:0/3766050592 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f64dc019020 con 0x7f64e80ff680 2024-09-13T23:05:18.464 INFO:teuthology.orchestra.run.smithi115.stdout:e19 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:05:18.465 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:05:18.466 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 19 2024-09-13T23:05:18.466 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:05:18.466 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:05:18.466 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:04:08.269431+0000 2024-09-13T23:05:18.466 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:05:18.467 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:05:18.468 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:18.469 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:18.470 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:18.470 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:18.470 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:18.471 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 19 2024-09-13T23:05:18.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 msgr2=0x7f64d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 0x7f64d0071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007ac0 tx=0x7f64d8035040 comp rx=0 tx=0).stop 2024-09-13T23:05:18.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 msgr2=0x7f64e810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00eb70 tx=0x7f64dc00b040 comp rx=0 tx=0).stop 2024-09-13T23:05:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 shutdown_connections 2024-09-13T23:05:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f64d006ed60 0x7f64d0071210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64e80ff680 0x7f64e810d650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 --2- 172.21.15.115:0/3766050592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64e8065c40 0x7f64e810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.465+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 >> 172.21.15.115:0/3766050592 conn(0x7f64e80f6c10 msgr2=0x7f64e80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.466+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 shutdown_connections 2024-09-13T23:05:18.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.466+0000 7f64ed7c5640 1 -- 172.21.15.115:0/3766050592 wait complete. 2024-09-13T23:05:18.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 -- 172.21.15.115:0/3140026568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040ff6e0 msgr2=0x7f2104101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 --2- 172.21.15.115:0/3140026568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040ff6e0 0x7f2104101ac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0048d0 tx=0x7f20ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 -- 172.21.15.115:0/3140026568 shutdown_connections 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 --2- 172.21.15.115:0/3140026568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040ff6e0 0x7f2104101ac0 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0048d0 tx=0x7f20ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 --2- 172.21.15.115:0/3140026568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 0x7f21040ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.546+0000 7f2109f2f640 1 -- 172.21.15.115:0/3140026568 >> 172.21.15.115:0/3140026568 conn(0x7f21040f6c10 msgr2=0x7f21040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.547+0000 7f2109f2f640 1 -- 172.21.15.115:0/3140026568 shutdown_connections 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.547+0000 7f2109f2f640 1 -- 172.21.15.115:0/3140026568 wait complete. 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.547+0000 7f2109f2f640 1 Processor -- start 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.547+0000 7f2109f2f640 1 -- start start 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2109f2f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 0x7f21040fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2109f2f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2109f2f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040fba50 con 0x7f21040fb0a0 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2109f2f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040fbbc0 con 0x7f2104065be0 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49944/0 (socket says 172.21.15.115:49944) 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 -- 172.21.15.115:0/602421946 learned_addr learned my addr 172.21.15.115:0/602421946 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:18.550 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f21037fe640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 0x7f21040fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 -- 172.21.15.115:0/602421946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 msgr2=0x7f21040fcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 0x7f21040fcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.548+0000 7f2102ffd640 1 -- 172.21.15.115:0/602421946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec005040 con 0x7f21040fb0a0 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f2102ffd640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0048a0 tx=0x7f20ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ec038070 con 0x7f21040fb0a0 2024-09-13T23:05:18.551 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20ec032b20 con 0x7f21040fb0a0 2024-09-13T23:05:18.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21040fbe40 con 0x7f21040fb0a0 2024-09-13T23:05:18.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20ec033660 con 0x7f21040fb0a0 2024-09-13T23:05:18.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.550+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2104115450 con 0x7f21040fb0a0 2024-09-13T23:05:18.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.551+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21040fa890 con 0x7f21040fb0a0 2024-09-13T23:05:18.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.552+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f20ec030020 con 0x7f21040fb0a0 2024-09-13T23:05:18.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.552+0000 7f20fbfff640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 0x7f20f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.552+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f20ec0ae110 con 0x7f21040fb0a0 2024-09-13T23:05:18.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.553+0000 7f21037fe640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 0x7f20f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.553+0000 7f21037fe640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 0x7f20f0071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21040fc960 tx=0x7f20f400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.560+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f20ec07b290 con 0x7f21040fb0a0 2024-09-13T23:05:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:18 smithi152 ceph-mon[34465]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:18 smithi152 ceph-mon[34465]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:18 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1932405025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:18.737 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.736+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21040fe700 con 0x7f20f006ed60 2024-09-13T23:05:18.738 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:05:18.738 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:05:18.738 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi152", 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:05:18.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.737+0000 7f20fbfff640 1 -- 172.21.15.115:0/602421946 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f21040fe700 con 0x7f20f006ed60 2024-09-13T23:05:18.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 msgr2=0x7f20f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 0x7f20f0071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21040fc960 tx=0x7f20f400b040 comp rx=0 tx=0).stop 2024-09-13T23:05:18.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 msgr2=0x7f21040fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.740 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0048a0 tx=0x7f20ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 shutdown_connections 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.739+0000 7f2109f2f640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f20f006ed60 0x7f20f0071210 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.740+0000 7f2109f2f640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21040fb0a0 0x7f21040fb510 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.740+0000 7f2109f2f640 1 --2- 172.21.15.115:0/602421946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2104065be0 0x7f21040fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.740+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 >> 172.21.15.115:0/602421946 conn(0x7f21040f6c10 msgr2=0x7f21040f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.740+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 shutdown_connections 2024-09-13T23:05:18.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.740+0000 7f2109f2f640 1 -- 172.21.15.115:0/602421946 wait complete. 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.822+0000 7f41940f2640 1 -- 172.21.15.115:0/1296652398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fd810 msgr2=0x7f418c0fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.822+0000 7f41940f2640 1 --2- 172.21.15.115:0/1296652398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fd810 0x7f418c0fdc80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f417c0048d0 tx=0x7f417c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 -- 172.21.15.115:0/1296652398 shutdown_connections 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 --2- 172.21.15.115:0/1296652398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fd810 0x7f418c0fdc80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 --2- 172.21.15.115:0/1296652398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fc540 0x7f418c0fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 -- 172.21.15.115:0/1296652398 >> 172.21.15.115:0/1296652398 conn(0x7f418c0f7ce0 msgr2=0x7f418c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:18.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 -- 172.21.15.115:0/1296652398 shutdown_connections 2024-09-13T23:05:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 -- 172.21.15.115:0/1296652398 wait complete. 2024-09-13T23:05:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 Processor -- start 2024-09-13T23:05:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 -- start start 2024-09-13T23:05:18.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.823+0000 7f41940f2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f41940f2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 0x7f418c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f41940f2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c10dc30 con 0x7f418c0fc540 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f41940f2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c10e450 con 0x7f418c0fd810 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f419168d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 0x7f418c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49958/0 (socket says 172.21.15.115:49958) 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 -- 172.21.15.115:0/1090026645 learned_addr learned my addr 172.21.15.115:0/1090026645 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 -- 172.21.15.115:0/1090026645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 msgr2=0x7f418c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 0x7f418c10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f4191e8e640 1 -- 172.21.15.115:0/1090026645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c005040 con 0x7f418c0fc540 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.824+0000 7f419168d640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 0x7f418c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:05:18.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f4191e8e640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4188002a50 tx=0x7f4188004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4188007c30 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f418800f040 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c10e680 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f418800da10 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.825+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c10ec20 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.826+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0fb9a0 con 0x7f418c0fc540 2024-09-13T23:05:18.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.827+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 90869+0+0 (secure 0 0 0) 0x7f418800db70 con 0x7f418c0fc540 2024-09-13T23:05:18.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.827+0000 7f41827fc640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 0x7f4178071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:18.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.828+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f418808daf0 con 0x7f418c0fc540 2024-09-13T23:05:18.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.828+0000 7f419168d640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 0x7f4178071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:18.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.828+0000 7f419168d640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 0x7f4178071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f418c10ce50 tx=0x7f417c039040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:18.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:18.835+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f418805ad90 con 0x7f418c0fc540 2024-09-13T23:05:19.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.060+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f418c104f70 con 0x7f418c0fc540 2024-09-13T23:05:19.062 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.061+0000 7f41827fc640 1 -- 172.21.15.115:0/1090026645 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f418c104f70 con 0x7f418c0fc540 2024-09-13T23:05:19.062 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:05:19.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 msgr2=0x7f4178071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:19.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 0x7f4178071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f418c10ce50 tx=0x7f417c039040 comp rx=0 tx=0).stop 2024-09-13T23:05:19.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 msgr2=0x7f418c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:19.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4188002a50 tx=0x7f4188004600 comp rx=0 tx=0).stop 2024-09-13T23:05:19.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 shutdown_connections 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f417806ed60 0x7f4178071210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f418c0fd810 0x7f418c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 --2- 172.21.15.115:0/1090026645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f418c0fc540 0x7f418c10d0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 >> 172.21.15.115:0/1090026645 conn(0x7f418c0f7ce0 msgr2=0x7f418c0f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.063+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 shutdown_connections 2024-09-13T23:05:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:19.064+0000 7f41940f2640 1 -- 172.21.15.115:0/1090026645 wait complete. 2024-09-13T23:05:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:19 smithi152 ceph-mon[34465]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:05:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:19 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3766050592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:19 smithi152 ceph-mon[34465]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:19 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1090026645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:19 smithi115 ceph-mon[27601]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:05:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:19 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3766050592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:19 smithi115 ceph-mon[27601]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:19.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:19 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1090026645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:21 smithi152 ceph-mon[34465]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:05:21.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:21 smithi115 ceph-mon[27601]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:05:23.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:23 smithi152 ceph-mon[34465]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T23:05:23.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:23 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:23.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:23 smithi115 ceph-mon[27601]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T23:05:23.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:23 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:25 smithi152 ceph-mon[34465]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T23:05:25.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:25 smithi115 ceph-mon[27601]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T23:05:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:27 smithi152 ceph-mon[34465]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:05:27.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:27 smithi115 ceph-mon[27601]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:05:29.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:29 smithi152 ceph-mon[34465]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:29.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:29 smithi115 ceph-mon[27601]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:29.961 INFO:tasks.workunit.client.1.smithi152.stderr:Updating files: 87% (11248/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T23:05:30.942 INFO:tasks.workunit.client.1.smithi152.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T23:05:30.942 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: git switch -c 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr:Or undo this operation with: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: git switch - 2024-09-13T23:05:30.943 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.944 INFO:tasks.workunit.client.1.smithi152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T23:05:30.944 INFO:tasks.workunit.client.1.smithi152.stderr: 2024-09-13T23:05:30.944 INFO:tasks.workunit.client.1.smithi152.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T23:05:30.948 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T23:05:31.012 INFO:tasks.workunit.client.1.smithi152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T23:05:31.014 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T23:05:31.014 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.436 INFO:tasks.workunit.client.0.smithi115.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: git switch -c 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr:Or undo this operation with: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: git switch - 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr: 2024-09-13T23:05:31.437 INFO:tasks.workunit.client.0.smithi115.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T23:05:31.442 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T23:05:31.469 INFO:tasks.workunit.client.0.smithi115.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T23:05:31.472 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T23:05:31.472 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T23:05:31.691 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T23:05:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:31 smithi152 ceph-mon[34465]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:05:31.762 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T23:05:31.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:31 smithi115 ceph-mon[27601]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:05:31.807 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T23:05:31.809 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T23:05:31.809 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T23:05:31.854 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T23:05:31.858 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T23:05:31.858 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T23:05:31.915 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T23:05:31.917 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T23:05:31.917 DEBUG:teuthology.orchestra.run.smithi152:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T23:05:31.978 INFO:tasks.workunit.client.1.smithi152.stderr:+ mkdir -p fsstress 2024-09-13T23:05:31.980 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd fsstress 2024-09-13T23:05:31.980 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T23:05:31.980 INFO:tasks.workunit.client.1.smithi152.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T23:05:32.125 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T23:05:32.190 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T23:05:32.230 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T23:05:32.232 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T23:05:32.232 INFO:tasks.workunit.client.0.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T23:05:32.270 INFO:tasks.workunit.client.0.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T23:05:32.274 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T23:05:32.274 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T23:05:32.331 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T23:05:32.332 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T23:05:32.332 DEBUG:teuthology.orchestra.run.smithi115:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T23:05:32.391 INFO:tasks.workunit.client.0.smithi115.stderr:+ mkdir -p fsstress 2024-09-13T23:05:32.393 INFO:tasks.workunit.client.0.smithi115.stderr:+ pushd fsstress 2024-09-13T23:05:32.393 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T23:05:32.393 INFO:tasks.workunit.client.0.smithi115.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T23:05:32.537 INFO:tasks.workunit.client.1.smithi152.stderr:+ tar xzf ltp-full.tgz 2024-09-13T23:05:33.321 INFO:tasks.workunit.client.0.smithi115.stderr:+ tar xzf ltp-full.tgz 2024-09-13T23:05:33.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:33 smithi152 ceph-mon[34465]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:33.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:33 smithi115 ceph-mon[27601]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:05:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:35 smithi152 ceph-mon[34465]: pgmap v226: 65 pgs: 65 active+clean; 755 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-09-13T23:05:35.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:35 smithi115 ceph-mon[27601]: pgmap v226: 65 pgs: 65 active+clean; 755 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 14 KiB/s wr, 4 op/s 2024-09-13T23:05:37.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:37 smithi152 ceph-mon[34465]: pgmap v227: 65 pgs: 65 active+clean; 4.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 355 KiB/s wr, 5 op/s 2024-09-13T23:05:37.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:37 smithi115 ceph-mon[27601]: pgmap v227: 65 pgs: 65 active+clean; 4.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s rd, 355 KiB/s wr, 5 op/s 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: Upgrade: Updating mgr.smithi152.ntylos 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: Deploying daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:05:38.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:38 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: Upgrade: Updating mgr.smithi152.ntylos 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: Deploying daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:05:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:38 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:40.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:39 smithi115 ceph-mon[27601]: pgmap v228: 65 pgs: 65 active+clean; 6.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 497 KiB/s wr, 39 op/s 2024-09-13T23:05:40.063 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:39 smithi152 ceph-mon[34465]: pgmap v228: 65 pgs: 65 active+clean; 6.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 497 KiB/s wr, 39 op/s 2024-09-13T23:05:41.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:41 smithi152 ceph-mon[34465]: pgmap v229: 65 pgs: 65 active+clean; 44 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 258 op/s 2024-09-13T23:05:42.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:41 smithi115 ceph-mon[27601]: pgmap v229: 65 pgs: 65 active+clean; 44 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 258 op/s 2024-09-13T23:05:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:42 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:42.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:42 smithi152 ceph-mon[34465]: pgmap v230: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 379 op/s 2024-09-13T23:05:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:42 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:43.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:42 smithi115 ceph-mon[27601]: pgmap v230: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 379 op/s 2024-09-13T23:05:45.544 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:45 smithi152 ceph-mon[34465]: pgmap v231: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 380 op/s 2024-09-13T23:05:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:45 smithi115 ceph-mon[27601]: pgmap v231: 65 pgs: 65 active+clean; 61 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 380 op/s 2024-09-13T23:05:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:46 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:05:46.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:46 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:05:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: pgmap v232: 65 pgs: 65 active+clean; 77 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 391 op/s 2024-09-13T23:05:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:05:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:05:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:05:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:05:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:05:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:47 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: pgmap v232: 65 pgs: 65 active+clean; 77 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 391 op/s 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:05:47.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:05:47.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:47 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:05:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:48 smithi152 ceph-mon[34465]: mgrmap e20: smithi115.eqesbc(active, since 6m), standbys: smithi152.ntylos 2024-09-13T23:05:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:48 smithi115 ceph-mon[27601]: mgrmap e20: smithi115.eqesbc(active, since 6m), standbys: smithi152.ntylos 2024-09-13T23:05:49.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.215+0000 7f21f2956640 1 -- 172.21.15.115:0/2377361668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 msgr2=0x7f21ec06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.215+0000 7f21f2956640 1 --2- 172.21.15.115:0/2377361668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec06e000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0048d0 tx=0x7f21dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.220+0000 7f21f2956640 1 -- 172.21.15.115:0/2377361668 shutdown_connections 2024-09-13T23:05:49.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.220+0000 7f21f2956640 1 --2- 172.21.15.115:0/2377361668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21ec06e540 0x7f21ec10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.220+0000 7f21f2956640 1 --2- 172.21.15.115:0/2377361668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec06e000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.220+0000 7f21f2956640 1 -- 172.21.15.115:0/2377361668 >> 172.21.15.115:0/2377361668 conn(0x7f21ec069560 msgr2=0x7f21ec06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:49.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.224+0000 7f21f2956640 1 -- 172.21.15.115:0/2377361668 shutdown_connections 2024-09-13T23:05:49.225 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.225+0000 7f21f2956640 1 -- 172.21.15.115:0/2377361668 wait complete. 2024-09-13T23:05:49.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.225+0000 7f21f2956640 1 Processor -- start 2024-09-13T23:05:49.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.225+0000 7f21f2956640 1 -- start start 2024-09-13T23:05:49.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.226+0000 7f21f2956640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.226+0000 7f21f2956640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21ec06e540 0x7f21ec117ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.226+0000 7f21f2956640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec118540 con 0x7f21ec06dbf0 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.226+0000 7f21f2956640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec118d60 con 0x7f21ec06e540 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.227+0000 7f21ebfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.227+0000 7f21ebfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52544/0 (socket says 172.21.15.115:52544) 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.227+0000 7f21ebfff640 1 -- 172.21.15.115:0/3890387975 learned_addr learned my addr 172.21.15.115:0/3890387975 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.228+0000 7f21ebfff640 1 -- 172.21.15.115:0/3890387975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21ec06e540 msgr2=0x7f21ec117ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T23:05:49.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.228+0000 7f21ebfff640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21ec06e540 0x7f21ec117ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.228+0000 7f21ebfff640 1 -- 172.21.15.115:0/3890387975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc005040 con 0x7f21ec06dbf0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.228+0000 7f21ebfff640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21dc02a620 tx=0x7f21dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.229+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc040070 con 0x7f21ec06dbf0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.229+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f21dc004290 con 0x7f21ec06dbf0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.229+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc0443c0 con 0x7f21ec06dbf0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.229+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec118f90 con 0x7f21ec06dbf0 2024-09-13T23:05:49.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.229+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec119450 con 0x7f21ec06dbf0 2024-09-13T23:05:49.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.230+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec04b720 con 0x7f21ec06dbf0 2024-09-13T23:05:49.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.231+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f21dc030020 con 0x7f21ec06dbf0 2024-09-13T23:05:49.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.231+0000 7f21e97fa640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 0x7f21d8070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.231+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f21dc0b7120 con 0x7f21ec06dbf0 2024-09-13T23:05:49.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.231+0000 7f21e3fff640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 0x7f21d8070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:49.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.232+0000 7f21e3fff640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 0x7f21d8070ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21ec117760 tx=0x7f21d4009c50 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:49.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.235+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f21dc084270 con 0x7f21ec06dbf0 2024-09-13T23:05:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:49 smithi115 ceph-mon[27601]: pgmap v233: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.4 MiB/s wr, 410 op/s 2024-09-13T23:05:49.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.586+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21ec119a20 con 0x7f21d806e620 2024-09-13T23:05:49.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.587+0000 7f21e97fa640 1 -- 172.21.15.115:0/3890387975 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f21ec119a20 con 0x7f21d806e620 2024-09-13T23:05:49.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 msgr2=0x7f21d8070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 0x7f21d8070ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21ec117760 tx=0x7f21d4009c50 comp rx=0 tx=0).stop 2024-09-13T23:05:49.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 msgr2=0x7f21ec1179b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21dc02a620 tx=0x7f21dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 shutdown_connections 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.591+0000 7f21f2956640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f21d806e620 0x7f21d8070ad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.592+0000 7f21f2956640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21ec06e540 0x7f21ec117ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.592+0000 7f21f2956640 1 --2- 172.21.15.115:0/3890387975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21ec06dbf0 0x7f21ec1179b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.592+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 >> 172.21.15.115:0/3890387975 conn(0x7f21ec069560 msgr2=0x7f21ec108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.592+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 shutdown_connections 2024-09-13T23:05:49.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.592+0000 7f21f2956640 1 -- 172.21.15.115:0/3890387975 wait complete. 2024-09-13T23:05:49.607 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:05:49.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.711+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2967127828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fd470 msgr2=0x7ff5a80ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.711+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2967127828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fd470 0x7ff5a80ff8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff598004830 tx=0x7ff59801adb0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2967127828 shutdown_connections 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2967127828 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fd470 0x7ff5a80ff8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2967127828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a8065c40 0x7ff5a80fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2967127828 >> 172.21.15.115:0/2967127828 conn(0x7ff5a80f6c10 msgr2=0x7ff5a80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2967127828 shutdown_connections 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2967127828 wait complete. 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.712+0000 7ff5af7d3640 1 Processor -- start 2024-09-13T23:05:49.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5af7d3640 1 -- start start 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5af7d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a8065c40 0x7ff5a810ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5af7d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5af7d3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a810ba00 con 0x7ff5a80fd470 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5af7d3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a810c140 con 0x7ff5a8065c40 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5acd6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5acd6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52564/0 (socket says 172.21.15.115:52564) 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5acd6e640 1 -- 172.21.15.115:0/2010382289 learned_addr learned my addr 172.21.15.115:0/2010382289 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:49.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.713+0000 7ff5ad56f640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a8065c40 0x7ff5a810ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff5acd6e640 1 -- 172.21.15.115:0/2010382289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a8065c40 msgr2=0x7ff5a810ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff5acd6e640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a8065c40 0x7ff5a810ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff5acd6e640 1 -- 172.21.15.115:0/2010382289 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598005040 con 0x7ff5a80fd470 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff5acd6e640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff598003080 tx=0x7ff59801adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff598049070 con 0x7ff5a80fd470 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff59803bdc0 con 0x7ff5a80fd470 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5980438a0 con 0x7ff5a80fd470 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.714+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a810c370 con 0x7ff5a80fd470 2024-09-13T23:05:49.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.715+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a810c7d0 con 0x7ff5a80fd470 2024-09-13T23:05:49.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:49 smithi152 ceph-mon[34465]: pgmap v233: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.4 MiB/s wr, 410 op/s 2024-09-13T23:05:49.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.716+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80fa890 con 0x7ff5a80fd470 2024-09-13T23:05:49.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.717+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7ff598041020 con 0x7ff5a80fd470 2024-09-13T23:05:49.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.718+0000 7ff59dffb640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 0x7ff594070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:49.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.718+0000 7ff5ad56f640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 0x7ff594070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:49.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.718+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff5980be8e0 con 0x7ff5a80fd470 2024-09-13T23:05:49.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.719+0000 7ff5ad56f640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 0x7ff594070b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810ac00 tx=0x7ff5a400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:49.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.722+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff59808b990 con 0x7ff5a80fd470 2024-09-13T23:05:49.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.926+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a810ccb0 con 0x7ff59406e690 2024-09-13T23:05:49.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.927+0000 7ff59dffb640 1 -- 172.21.15.115:0/2010382289 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff5a810ccb0 con 0x7ff59406e690 2024-09-13T23:05:49.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 msgr2=0x7ff594070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 0x7ff594070b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810ac00 tx=0x7ff5a400b040 comp rx=0 tx=0).stop 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 msgr2=0x7ff5a810b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff598003080 tx=0x7ff59801adb0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 shutdown_connections 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff59406e690 0x7ff594070b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fd470 0x7ff5a810b3b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 --2- 172.21.15.115:0/2010382289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a8065c40 0x7ff5a810ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.929+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 >> 172.21.15.115:0/2010382289 conn(0x7ff5a80f6c10 msgr2=0x7ff5a80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.930+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 shutdown_connections 2024-09-13T23:05:49.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:49.930+0000 7ff5af7d3640 1 -- 172.21.15.115:0/2010382289 wait complete. 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- 172.21.15.115:0/4155227893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740ffa10 msgr2=0x7f37740ffe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 --2- 172.21.15.115:0/4155227893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740ffa10 0x7f37740ffe80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f375c0048d0 tx=0x7f375c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- 172.21.15.115:0/4155227893 shutdown_connections 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 --2- 172.21.15.115:0/4155227893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740ffa10 0x7f37740ffe80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 --2- 172.21.15.115:0/4155227893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740fe740 0x7f37740feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- 172.21.15.115:0/4155227893 >> 172.21.15.115:0/4155227893 conn(0x7f37740fa060 msgr2=0x7f37740fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- 172.21.15.115:0/4155227893 shutdown_connections 2024-09-13T23:05:50.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- 172.21.15.115:0/4155227893 wait complete. 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 Processor -- start 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.028+0000 7f3778fdd640 1 -- start start 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f3778fdd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f3778fdd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740ffa10 0x7f377410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f3778fdd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377410fe00 con 0x7f37740fe740 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f3778fdd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774110620 con 0x7f37740ffa10 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52578/0 (socket says 172.21.15.115:52578) 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 -- 172.21.15.115:0/3472992356 learned_addr learned my addr 172.21.15.115:0/3472992356 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f376bfff640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740ffa10 0x7f377410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 -- 172.21.15.115:0/3472992356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740ffa10 msgr2=0x7f377410f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740ffa10 0x7f377410f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 -- 172.21.15.115:0/3472992356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c005040 con 0x7f37740fe740 2024-09-13T23:05:50.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.029+0000 7f377259c640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f376400eb70 tx=0x7f376400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.030+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3764007c30 con 0x7f37740fe740 2024-09-13T23:05:50.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.030+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774110850 con 0x7f37740fe740 2024-09-13T23:05:50.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.030+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f376400f040 con 0x7f37740fe740 2024-09-13T23:05:50.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.030+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376400ca60 con 0x7f37740fe740 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.030+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774110df0 con 0x7f37740fe740 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.031+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740fdba0 con 0x7f37740fe740 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.031+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f376400cbc0 con 0x7f37740fe740 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.032+0000 7f376affd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 0x7f3760070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.032+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f376408d740 con 0x7f37740fe740 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.032+0000 7f376bfff640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 0x7f3760070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.032+0000 7f376bfff640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 0x7f3760070a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f375c007ac0 tx=0x7f375c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.039 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.039+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f376405a940 con 0x7f37740fe740 2024-09-13T23:05:50.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.241+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3774111170 con 0x7f376006e5c0 2024-09-13T23:05:50.257 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.256+0000 7f376affd640 1 -- 172.21.15.115:0/3472992356 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f3774111170 con 0x7f376006e5c0 2024-09-13T23:05:50.257 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 91s ago 7m 25.5M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (7m) 91s ago 7m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (6m) 0s ago 6m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 91s ago 6m 86.6M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (111s) 91s ago 110s 15.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (118s) 91s ago 117s 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (115s) 0s ago 114s 20.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (108s) 0s ago 108s 20.2M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (8m) 91s ago 8m 449M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (8s) 0s ago 6m 68.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 718f6398c5ee 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (8m) 91s ago 8m 44.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (6m) 0s ago 6m 37.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:05:50.258 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 91s ago 7m 15.8M - 1.5.0 0da6a335fe13 f6758bd48343 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 0s ago 6m 17.2M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (5m) 91s ago 5m 44.1M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (5m) 91s ago 5m 45.0M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (4m) 91s ago 4m 44.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (4m) 0s ago 4m 83.2M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (3m) 0s ago 3m 73.1M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (3m) 0s ago 3m 76.2M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:05:50.259 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 91s ago 6m 55.2M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 msgr2=0x7f3760070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 0x7f3760070a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f375c007ac0 tx=0x7f375c035040 comp rx=0 tx=0).stop 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 msgr2=0x7f377410f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f376400eb70 tx=0x7f376400b040 comp rx=0 tx=0).stop 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 shutdown_connections 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f376006e5c0 0x7f3760070a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37740ffa10 0x7f377410f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 --2- 172.21.15.115:0/3472992356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37740fe740 0x7f377410f270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.260 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 >> 172.21.15.115:0/3472992356 conn(0x7f37740fa060 msgr2=0x7f37740fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 shutdown_connections 2024-09-13T23:05:50.261 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.258+0000 7f3778fdd640 1 -- 172.21.15.115:0/3472992356 wait complete. 2024-09-13T23:05:50.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 -- 172.21.15.115:0/3373677326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fc700 msgr2=0x7efc3c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 --2- 172.21.15.115:0/3373677326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fcb70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0048d0 tx=0x7efc2c009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 -- 172.21.15.115:0/3373677326 shutdown_connections 2024-09-13T23:05:50.341 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 --2- 172.21.15.115:0/3373677326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fcb70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 --2- 172.21.15.115:0/3373677326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fb430 0x7efc3c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 -- 172.21.15.115:0/3373677326 >> 172.21.15.115:0/3373677326 conn(0x7efc3c0f6c10 msgr2=0x7efc3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 -- 172.21.15.115:0/3373677326 shutdown_connections 2024-09-13T23:05:50.342 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.340+0000 7efc441af640 1 -- 172.21.15.115:0/3373677326 wait complete. 2024-09-13T23:05:50.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 Processor -- start 2024-09-13T23:05:50.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 -- start start 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0fdfd0 con 0x7efc3c0fb430 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc441af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0fe110 con 0x7efc3c0fc700 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc41f4b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc41f4b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52598/0 (socket says 172.21.15.115:52598) 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc41f4b640 1 -- 172.21.15.115:0/1251230498 learned_addr learned my addr 172.21.15.115:0/1251230498 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.341+0000 7efc4174a640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc41f4b640 1 -- 172.21.15.115:0/1251230498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fc700 msgr2=0x7efc3c0fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc41f4b640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc41f4b640 1 -- 172.21.15.115:0/1251230498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c005040 con 0x7efc3c0fb430 2024-09-13T23:05:50.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc41f4b640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc38002a80 tx=0x7efc38004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc38007c30 con 0x7efc3c0fb430 2024-09-13T23:05:50.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc3800f040 con 0x7efc3c0fb430 2024-09-13T23:05:50.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc3800dab0 con 0x7efc3c0fb430 2024-09-13T23:05:50.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0fe3f0 con 0x7efc3c0fb430 2024-09-13T23:05:50.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.342+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0fe800 con 0x7efc3c0fb430 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.344+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c0fa890 con 0x7efc3c0fb430 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.344+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7efc3800dc10 con 0x7efc3c0fb430 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.345+0000 7efc327fc640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 0x7efc28070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.345+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efc3808d430 con 0x7efc3c0fb430 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.345+0000 7efc4174a640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 0x7efc28070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.346+0000 7efc4174a640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 0x7efc28070a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00b020 tx=0x7efc2c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.350+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efc3805a5b0 con 0x7efc3c0fb430 2024-09-13T23:05:50.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.602+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc3c02aa40 con 0x7efc3c0fb430 2024-09-13T23:05:50.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.603+0000 7efc327fc640 1 -- 172.21.15.115:0/1251230498 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7efc38059f50 con 0x7efc3c0fb430 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:50.604 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:05:50.605 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 msgr2=0x7efc28070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 0x7efc28070a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00b020 tx=0x7efc2c035040 comp rx=0 tx=0).stop 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 msgr2=0x7efc3c0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc38002a80 tx=0x7efc38004600 comp rx=0 tx=0).stop 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 shutdown_connections 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7efc2806e5c0 0x7efc28070a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc3c0fc700 0x7efc3c0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 --2- 172.21.15.115:0/1251230498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c0fb430 0x7efc3c0ff550 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 >> 172.21.15.115:0/1251230498 conn(0x7efc3c0f6c10 msgr2=0x7efc3c0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 shutdown_connections 2024-09-13T23:05:50.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.605+0000 7efc441af640 1 -- 172.21.15.115:0/1251230498 wait complete. 2024-09-13T23:05:50.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 -- 172.21.15.115:0/756373544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 msgr2=0x7ff9100fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 --2- 172.21.15.115:0/756373544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff9100fcb70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9040048d0 tx=0x7ff904009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 -- 172.21.15.115:0/756373544 shutdown_connections 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 --2- 172.21.15.115:0/756373544 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff9100fcb70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 --2- 172.21.15.115:0/756373544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 0x7ff9100fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 -- 172.21.15.115:0/756373544 >> 172.21.15.115:0/756373544 conn(0x7ff9100f6c10 msgr2=0x7ff9100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 -- 172.21.15.115:0/756373544 shutdown_connections 2024-09-13T23:05:50.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.686+0000 7ff914a05640 1 -- 172.21.15.115:0/756373544 wait complete. 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 Processor -- start 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 -- start start 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 0x7ff91010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91010cb10 con 0x7ff9100fc700 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff914a05640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91010d330 con 0x7ff9100fb430 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.687+0000 7ff90dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52610/0 (socket says 172.21.15.115:52610) 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 -- 172.21.15.115:0/3561201820 learned_addr learned my addr 172.21.15.115:0/3561201820 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90e59c640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 0x7ff91010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 -- 172.21.15.115:0/3561201820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 msgr2=0x7ff91010bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 0x7ff91010bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 -- 172.21.15.115:0/3561201820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff904005040 con 0x7ff9100fc700 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff90dd9b640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff9040048a0 tx=0x7ff904009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff904038070 con 0x7ff9100fc700 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff904004290 con 0x7ff9100fc700 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff904033660 con 0x7ff9100fc700 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91010d530 con 0x7ff9100fc700 2024-09-13T23:05:50.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.688+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91010dad0 con 0x7ff9100fc700 2024-09-13T23:05:50.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.689+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9100fa890 con 0x7ff9100fc700 2024-09-13T23:05:50.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.690+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7ff904030020 con 0x7ff9100fc700 2024-09-13T23:05:50.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.691+0000 7ff8feffd640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 0x7ff8f8070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:50.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.691+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff9040adc00 con 0x7ff9100fc700 2024-09-13T23:05:50.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.691+0000 7ff90e59c640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 0x7ff8f8070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:50.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.691+0000 7ff90e59c640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 0x7ff8f8070a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff900009af0 tx=0x7ff90000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:50.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.695+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff9040b3020 con 0x7ff9100fc700 2024-09-13T23:05:50.909 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.908+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff91004b720 con 0x7ff9100fc700 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:50.909 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:50 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1251230498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.908+0000 7ff8feffd640 1 -- 172.21.15.115:0/3561201820 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1847 (secure 0 0 0) 0x7ff90407ae00 con 0x7ff9100fc700 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout:e20 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:50.910 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 20 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:05:45.291299+0000 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:05:50.911 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:05:50.912 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:50.913 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:50.913 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:50.913 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:50.913 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:50.913 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 20 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 msgr2=0x7ff8f8070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 0x7ff8f8070a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff900009af0 tx=0x7ff90000b040 comp rx=0 tx=0).stop 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 msgr2=0x7ff91010c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff9040048a0 tx=0x7ff904009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 shutdown_connections 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7ff8f806e5c0 0x7ff8f8070a70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9100fc700 0x7ff91010c4c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 --2- 172.21.15.115:0/3561201820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9100fb430 0x7ff91010bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 >> 172.21.15.115:0/3561201820 conn(0x7ff9100f6c10 msgr2=0x7ff9100f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 shutdown_connections 2024-09-13T23:05:50.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.911+0000 7ff914a05640 1 -- 172.21.15.115:0/3561201820 wait complete. 2024-09-13T23:05:51.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 -- 172.21.15.115:0/484886432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 msgr2=0x7f0f880fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/484886432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f880fdca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f780048d0 tx=0x7f0f78009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 -- 172.21.15.115:0/484886432 shutdown_connections 2024-09-13T23:05:51.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/484886432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f880fdca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/484886432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f880fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:50.999+0000 7f0f8fa08640 1 -- 172.21.15.115:0/484886432 >> 172.21.15.115:0/484886432 conn(0x7f0f880f7d20 msgr2=0x7f0f880fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.000+0000 7f0f8fa08640 1 -- 172.21.15.115:0/484886432 shutdown_connections 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.000+0000 7f0f8fa08640 1 -- 172.21.15.115:0/484886432 wait complete. 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 Processor -- start 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 -- start start 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f8810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f8810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8810dbe0 con 0x7f0f880fd830 2024-09-13T23:05:51.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8fa08640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8810e400 con 0x7f0f880fc560 2024-09-13T23:05:51.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8cfa3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f8810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8cfa3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f8810d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52638/0 (socket says 172.21.15.115:52638) 2024-09-13T23:05:51.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8cfa3640 1 -- 172.21.15.115:0/361098146 learned_addr learned my addr 172.21.15.115:0/361098146 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:51.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8d7a4640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f8810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.001+0000 7f0f8d7a4640 1 -- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 msgr2=0x7f0f8810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f8d7a4640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f8810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f8d7a4640 1 -- 172.21.15.115:0/361098146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78005040 con 0x7f0f880fc560 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f8d7a4640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f8810d050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c7e0 tx=0x7f0f84007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f8400a820 con 0x7f0f880fc560 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8810e690 con 0x7f0f880fc560 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f8400ae20 con 0x7f0f880fc560 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f840113a0 con 0x7f0f880fc560 2024-09-13T23:05:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.002+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8810ec30 con 0x7f0f880fc560 2024-09-13T23:05:51.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.004+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f880fb9c0 con 0x7f0f880fc560 2024-09-13T23:05:51.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.004+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7f0f8400a980 con 0x7f0f880fc560 2024-09-13T23:05:51.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.005+0000 7f0f7dffb640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 0x7f0f74070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.005+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0f8408dc70 con 0x7f0f880fc560 2024-09-13T23:05:51.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.005+0000 7f0f8cfa3640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 0x7f0f74070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.005+0000 7f0f8cfa3640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 0x7f0f74070a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f8810ce00 tx=0x7f0f78035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:51.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.009+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0f8405a940 con 0x7f0f880fc560 2024-09-13T23:05:51.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.209+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 --> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f8810ef70 con 0x7f0f7406e5c0 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.210+0000 7f0f7dffb640 1 -- 172.21.15.115:0/361098146 <== mgr.14206 v2:172.21.15.115:6800/3265730915 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f0f8810ef70 con 0x7f0f7406e5c0 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T23:05:51.211 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T23:05:51.212 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:05:51.212 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 msgr2=0x7f0f74070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 0x7f0f74070a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f8810ce00 tx=0x7f0f78035040 comp rx=0 tx=0).stop 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 msgr2=0x7f0f8810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f8810d050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c7e0 tx=0x7f0f84007f20 comp rx=0 tx=0).stop 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 shutdown_connections 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7f0f7406e5c0 0x7f0f74070a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f880fd830 0x7f0f8810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 --2- 172.21.15.115:0/361098146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f880fc560 0x7f0f8810d050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 >> 172.21.15.115:0/361098146 conn(0x7f0f880f7d20 msgr2=0x7f0f880f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:51.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 shutdown_connections 2024-09-13T23:05:51.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.213+0000 7f0f8fa08640 1 -- 172.21.15.115:0/361098146 wait complete. 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:05:51.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:50 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1251230498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:51.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 -- 172.21.15.115:0/2280511096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fd7f0 msgr2=0x7fdadc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2280511096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc0fdc60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdad00048d0 tx=0x7fdad0009da0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 -- 172.21.15.115:0/2280511096 shutdown_connections 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2280511096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc0fdc60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2280511096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fc520 0x7fdadc0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 -- 172.21.15.115:0/2280511096 >> 172.21.15.115:0/2280511096 conn(0x7fdadc0f7ce0 msgr2=0x7fdadc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 -- 172.21.15.115:0/2280511096 shutdown_connections 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.303+0000 7fdae22cf640 1 -- 172.21.15.115:0/2280511096 wait complete. 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 Processor -- start 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 -- start start 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc10dc10 con 0x7fdadc0fc520 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdae22cf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc10e430 con 0x7fdadc0fd7f0 2024-09-13T23:05:51.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52648/0 (socket says 172.21.15.115:52648) 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.304+0000 7fdadbfff640 1 -- 172.21.15.115:0/2471259351 learned_addr learned my addr 172.21.15.115:0/2471259351 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdadb7fe640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdadbfff640 1 -- 172.21.15.115:0/2471259351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fd7f0 msgr2=0x7fdadc10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdadbfff640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdadbfff640 1 -- 172.21.15.115:0/2471259351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0005040 con 0x7fdadc0fc520 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdadbfff640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00eb70 tx=0x7fdacc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdacc007c30 con 0x7fdadc0fc520 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc10e660 con 0x7fdadc0fc520 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdacc00f040 con 0x7fdadc0fc520 2024-09-13T23:05:51.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdacc00ca60 con 0x7fdadc0fc520 2024-09-13T23:05:51.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.305+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc10ec00 con 0x7fdadc0fc520 2024-09-13T23:05:51.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.306+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc0fb980 con 0x7fdadc0fc520 2024-09-13T23:05:51.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.307+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 20) v1 ==== 91584+0+0 (secure 0 0 0) 0x7fdacc00cbc0 con 0x7fdadc0fc520 2024-09-13T23:05:51.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.307+0000 7fdad8ff9640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 0x7fdac4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:51.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.307+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdacc08d7e0 con 0x7fdadc0fc520 2024-09-13T23:05:51.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.307+0000 7fdadb7fe640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 0x7fdac4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:51.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.308+0000 7fdadb7fe640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 0x7fdac4070a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007ac0 tx=0x7fdad0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:51.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.314+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdacc05a960 con 0x7fdadc0fc520 2024-09-13T23:05:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.585+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdadc04b720 con 0x7fdadc0fc520 2024-09-13T23:05:51.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.586+0000 7fdad8ff9640 1 -- 172.21.15.115:0/2471259351 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdacc05a300 con 0x7fdadc0fc520 2024-09-13T23:05:51.587 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 msgr2=0x7fdac4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 0x7fdac4070a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdad0007ac0 tx=0x7fdad0035040 comp rx=0 tx=0).stop 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 msgr2=0x7fdadc10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00eb70 tx=0x7fdacc00b040 comp rx=0 tx=0).stop 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 shutdown_connections 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:6800/3265730915,v1:172.21.15.115:6801/3265730915] conn(0x7fdac406e5c0 0x7fdac4070a70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc0fd7f0 0x7fdadc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 --2- 172.21.15.115:0/2471259351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc0fc520 0x7fdadc10d080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 >> 172.21.15.115:0/2471259351 conn(0x7fdadc0f7ce0 msgr2=0x7fdadc0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 shutdown_connections 2024-09-13T23:05:51.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:05:51.588+0000 7fdae22cf640 1 -- 172.21.15.115:0/2471259351 wait complete. 2024-09-13T23:05:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:51 smithi115 ceph-mon[27601]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:51 smithi115 ceph-mon[27601]: pgmap v234: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 598 op/s 2024-09-13T23:05:52.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:51 smithi115 ceph-mon[27601]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:52.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:51 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3561201820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:52.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:51 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2471259351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:52.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:51 smithi152 ceph-mon[34465]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:52.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:51 smithi152 ceph-mon[34465]: pgmap v234: 65 pgs: 65 active+clean; 102 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 598 op/s 2024-09-13T23:05:52.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:51 smithi152 ceph-mon[34465]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:52.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:51 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3561201820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:52.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:51 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2471259351' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:52.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:52 smithi152 ceph-mon[34465]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:53.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:52 smithi115 ceph-mon[27601]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:53 smithi115 ceph-mon[27601]: pgmap v235: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 574 op/s 2024-09-13T23:05:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:53 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:53 smithi152 ceph-mon[34465]: pgmap v235: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 574 op/s 2024-09-13T23:05:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:53 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:55 smithi115 ceph-mon[27601]: pgmap v236: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 6.8 MiB/s wr, 630 op/s 2024-09-13T23:05:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:55 smithi152 ceph-mon[34465]: pgmap v236: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 6.8 MiB/s wr, 630 op/s 2024-09-13T23:05:56.265 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T23:05:56.265 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T23:05:56.266 INFO:tasks.workunit.client.1.smithi152.stderr:+ make 2024-09-13T23:05:56.588 INFO:tasks.workunit.client.1.smithi152.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T23:05:58.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:57 smithi115 ceph-mon[27601]: pgmap v237: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.4 MiB/s wr, 637 op/s 2024-09-13T23:05:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:57 smithi152 ceph-mon[34465]: pgmap v237: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 7.4 MiB/s wr, 637 op/s 2024-09-13T23:05:58.380 INFO:tasks.workunit.client.1.smithi152.stderr:++ readlink -f fsstress 2024-09-13T23:05:58.381 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T23:05:58.382 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T23:05:58.382 INFO:tasks.workunit.client.1.smithi152.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T23:05:58.382 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2024-09-13T23:05:58.382 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2024-09-13T23:05:58.382 INFO:tasks.workunit.client.1.smithi152.stderr:++ mktemp -d -p . 2024-09-13T23:05:58.388 INFO:tasks.workunit.client.1.smithi152.stderr:+ T=./tmp.mlr0wowVNt 2024-09-13T23:05:58.388 INFO:tasks.workunit.client.1.smithi152.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.mlr0wowVNt -l 1 -n 1000 -p 10 -v 2024-09-13T23:05:58.390 INFO:tasks.workunit.client.1.smithi152.stdout:seed = 1726034456 2024-09-13T23:05:58.398 INFO:tasks.workunit.client.1.smithi152.stdout:1/0: read - no filename 2024-09-13T23:05:58.398 INFO:tasks.workunit.client.1.smithi152.stdout:1/1: dwrite - no filename 2024-09-13T23:05:58.399 INFO:tasks.workunit.client.1.smithi152.stdout:0/0: creat f0 x:0 0 0 2024-09-13T23:05:58.399 INFO:tasks.workunit.client.1.smithi152.stdout:0/1: creat f1 x:0 0 0 2024-09-13T23:05:58.399 INFO:tasks.workunit.client.1.smithi152.stdout:0/2: creat f2 x:0 0 0 2024-09-13T23:05:58.399 INFO:tasks.workunit.client.1.smithi152.stdout:0/3: truncate f0 561823 0 2024-09-13T23:05:58.401 INFO:tasks.workunit.client.1.smithi152.stdout:2/0: chown . 99248879 1 2024-09-13T23:05:58.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/2: creat f0 x:0 0 0 2024-09-13T23:05:58.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/3: write f0 [857693,38894] 0 2024-09-13T23:05:58.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/4: rmdir - no directory 2024-09-13T23:05:58.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/5: creat f1 x:0 0 0 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/1: mkdir d0 0 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/2: chown d0 21 1 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/3: read - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/0: dread - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/1: dwrite - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/2: dread - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/3: readlink - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:4/4: truncate - no filename 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/4: creat d0/f1 x:0 0 0 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/5: chown d0/f1 94 1 2024-09-13T23:05:58.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/6: fdatasync d0/f1 0 2024-09-13T23:05:58.412 INFO:tasks.workunit.client.1.smithi152.stdout:4/5: symlink l0 0 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:4/6: dread - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:4/7: dread - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:4/8: write - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/0: chown . 1920281 1 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/1: fsync - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/2: write - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/3: write - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/4: chown . 22 1 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/5: readlink - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/6: write - no filename 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/7: unlink - no file 2024-09-13T23:05:58.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/8: link - no file 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/9: mknod c1 0 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/10: dread - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/11: dread - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/12: dwrite - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/13: write - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/14: write - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/15: fdatasync - no filename 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/9: creat f0 x:0 0 0 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/16: rename c1 to c2 0 2024-09-13T23:05:58.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/10: mknod c1 0 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:7/0: creat f0 x:0 0 0 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:8/0: chown . 243220151 1 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:8/1: dread - no filename 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/11: rename c1 to c2 0 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:4/17: mkdir d3 0 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:4/18: chown l0 3791 1 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:8/2: creat f0 x:0 0 0 2024-09-13T23:05:58.418 INFO:tasks.workunit.client.1.smithi152.stdout:8/3: chown f0 0 1 2024-09-13T23:05:58.419 INFO:tasks.workunit.client.1.smithi152.stdout:8/4: mknod c1 0 2024-09-13T23:05:58.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/0: creat f0 x:0 0 0 2024-09-13T23:05:58.421 INFO:tasks.workunit.client.1.smithi152.stdout:4/19: mkdir d3/d4 0 2024-09-13T23:05:58.421 INFO:tasks.workunit.client.1.smithi152.stdout:4/20: stat d3/d4 0 2024-09-13T23:05:58.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/0: dwrite - no filename 2024-09-13T23:05:58.428 INFO:tasks.workunit.client.1.smithi152.stdout:8/5: symlink l2 0 2024-09-13T23:05:58.429 INFO:tasks.workunit.client.1.smithi152.stdout:4/21: unlink l0 0 2024-09-13T23:05:58.429 INFO:tasks.workunit.client.1.smithi152.stdout:9/1: mknod c1 0 2024-09-13T23:05:58.430 INFO:tasks.workunit.client.1.smithi152.stdout:9/2: truncate f0 807970 0 2024-09-13T23:05:58.430 INFO:tasks.workunit.client.1.smithi152.stdout:9/3: stat c1 0 2024-09-13T23:05:58.430 INFO:tasks.workunit.client.1.smithi152.stdout:6/0: dread - no filename 2024-09-13T23:05:58.430 INFO:tasks.workunit.client.1.smithi152.stdout:6/1: dwrite - no filename 2024-09-13T23:05:58.431 INFO:tasks.workunit.client.1.smithi152.stdout:6/2: readlink - no filename 2024-09-13T23:05:58.431 INFO:tasks.workunit.client.1.smithi152.stdout:4/22: mkdir d3/d4/d5 0 2024-09-13T23:05:58.559 INFO:tasks.workunit.client.1.smithi152.stdout:0/4: dwrite f2 [0,4194304] 0 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/23: unlink c2 0 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/24: write - no filename 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/25: write - no filename 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/26: write - no filename 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/27: dread - no filename 2024-09-13T23:05:58.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/28: stat d3 0 2024-09-13T23:05:58.731 INFO:tasks.workunit.client.1.smithi152.stdout:9/4: truncate f0 185495 0 2024-09-13T23:05:58.819 INFO:tasks.workunit.client.1.smithi152.stdout:4/29: mkdir d3/d4/d6 0 2024-09-13T23:05:58.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/30: dread - no filename 2024-09-13T23:05:58.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/31: dwrite - no filename 2024-09-13T23:05:58.951 INFO:tasks.workunit.client.1.smithi152.stdout:4/32: creat d3/d4/d5/f7 x:0 0 0 2024-09-13T23:05:58.955 INFO:tasks.workunit.client.1.smithi152.stdout:8/6: dwrite f0 [0,4194304] 0 2024-09-13T23:05:58.955 INFO:tasks.workunit.client.1.smithi152.stdout:8/7: chown l2 249 1 2024-09-13T23:05:59.125 INFO:tasks.workunit.client.1.smithi152.stdout:8/8: dread f0 [0,4194304] 0 2024-09-13T23:05:59.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/33: mkdir d3/d4/d6/d8 0 2024-09-13T23:05:59.623 INFO:tasks.workunit.client.1.smithi152.stdout:4/34: mknod d3/d4/d5/c9 0 2024-09-13T23:05:59.623 INFO:tasks.workunit.client.1.smithi152.stdout:4/35: chown d3/d4/d5 267267645 1 2024-09-13T23:05:59.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/6: dread f0 [0,4194304] 0 2024-09-13T23:05:59.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/7: creat f2 x:0 0 0 2024-09-13T23:05:59.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/5: dread f0 [0,4194304] 0 2024-09-13T23:05:59.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/6: write f2 [5052294,11835] 0 2024-09-13T23:05:59.970 INFO:tasks.workunit.client.1.smithi152.stdout:9/5: dread f0 [0,4194304] 0 2024-09-13T23:06:00.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:05:59 smithi115 ceph-mon[27601]: pgmap v238: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 628 op/s 2024-09-13T23:06:00.062 INFO:tasks.workunit.client.1.smithi152.stdout:4/36: dwrite d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/12: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.081 INFO:tasks.workunit.client.1.smithi152.stdout:5/13: dread f0 [0,4194304] 0 2024-09-13T23:06:00.086 INFO:tasks.workunit.client.1.smithi152.stdout:5/14: dread f0 [0,4194304] 0 2024-09-13T23:06:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:05:59 smithi152 ceph-mon[34465]: pgmap v238: 65 pgs: 65 active+clean; 149 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 628 op/s 2024-09-13T23:06:00.328 INFO:tasks.workunit.client.1.smithi152.stdout:1/8: symlink l3 0 2024-09-13T23:06:00.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/7: link f0 f3 0 2024-09-13T23:06:00.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/8: creat f4 x:0 0 0 2024-09-13T23:06:00.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/37: mknod d3/d4/d6/d8/ca 0 2024-09-13T23:06:00.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/38: fsync d3/d4/d5/f7 0 2024-09-13T23:06:00.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/39: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/40: fdatasync d3/d4/d5/f7 0 2024-09-13T23:06:00.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/41: chown d3/d4/d6/d8/ca 60 1 2024-09-13T23:06:00.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/9: mkdir d4 0 2024-09-13T23:06:00.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/10: chown f2 63 1 2024-09-13T23:06:00.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/11: getdents d4 0 2024-09-13T23:06:00.622 INFO:tasks.workunit.client.1.smithi152.stdout:9/6: getdents . 0 2024-09-13T23:06:00.622 INFO:tasks.workunit.client.1.smithi152.stdout:9/7: truncate f0 543982 0 2024-09-13T23:06:00.622 INFO:tasks.workunit.client.1.smithi152.stdout:9/8: fdatasync f0 0 2024-09-13T23:06:00.622 INFO:tasks.workunit.client.1.smithi152.stdout:1/12: dread f0 [0,4194304] 0 2024-09-13T23:06:00.622 INFO:tasks.workunit.client.1.smithi152.stdout:1/13: write f2 [277993,116938] 0 2024-09-13T23:06:00.623 INFO:tasks.workunit.client.1.smithi152.stdout:1/14: read f2 [174397,76429] 0 2024-09-13T23:06:00.623 INFO:tasks.workunit.client.1.smithi152.stdout:1/15: truncate f2 966016 0 2024-09-13T23:06:00.623 INFO:tasks.workunit.client.1.smithi152.stdout:9/9: dread f0 [0,4194304] 0 2024-09-13T23:06:00.623 INFO:tasks.workunit.client.1.smithi152.stdout:4/42: symlink d3/d4/lb 0 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/43: chown d3/d4/d5 0 1 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/44: fdatasync d3/d4/d5/f7 0 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/45: chown d3 956794 1 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/10: read f0 [104329,130415] 0 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:9/11: rmdir - no directory 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:5/15: getdents . 0 2024-09-13T23:06:00.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/9: rename f4 to f5 0 2024-09-13T23:06:00.625 INFO:tasks.workunit.client.1.smithi152.stdout:9/12: symlink l2 0 2024-09-13T23:06:00.625 INFO:tasks.workunit.client.1.smithi152.stdout:9/13: chown l2 7523568 1 2024-09-13T23:06:00.626 INFO:tasks.workunit.client.1.smithi152.stdout:0/10: symlink l6 0 2024-09-13T23:06:00.626 INFO:tasks.workunit.client.1.smithi152.stdout:0/11: stat f3 0 2024-09-13T23:06:00.629 INFO:tasks.workunit.client.1.smithi152.stdout:5/16: dread f0 [0,4194304] 0 2024-09-13T23:06:00.629 INFO:tasks.workunit.client.1.smithi152.stdout:0/12: read f0 [558228,50646] 0 2024-09-13T23:06:00.630 INFO:tasks.workunit.client.1.smithi152.stdout:0/13: write f2 [4692560,95468] 0 2024-09-13T23:06:00.630 INFO:tasks.workunit.client.1.smithi152.stdout:5/17: mknod c3 0 2024-09-13T23:06:00.664 INFO:tasks.workunit.client.1.smithi152.stdout:1/16: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.664 INFO:tasks.workunit.client.1.smithi152.stdout:4/46: dwrite d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/14: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/18: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.665 INFO:tasks.workunit.client.1.smithi152.stdout:1/17: write f2 [526466,90235] 0 2024-09-13T23:06:00.668 INFO:tasks.workunit.client.1.smithi152.stdout:9/15: mkdir d3 0 2024-09-13T23:06:00.669 INFO:tasks.workunit.client.1.smithi152.stdout:1/18: mknod d4/c5 0 2024-09-13T23:06:00.671 INFO:tasks.workunit.client.1.smithi152.stdout:4/47: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.674 INFO:tasks.workunit.client.1.smithi152.stdout:1/19: dread f2 [0,4194304] 0 2024-09-13T23:06:00.676 INFO:tasks.workunit.client.1.smithi152.stdout:9/16: dread f0 [0,4194304] 0 2024-09-13T23:06:00.677 INFO:tasks.workunit.client.1.smithi152.stdout:9/17: unlink l2 0 2024-09-13T23:06:00.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/18: rename f0 to d3/f4 0 2024-09-13T23:06:00.682 INFO:tasks.workunit.client.1.smithi152.stdout:9/19: write d3/f4 [1626544,96518] 0 2024-09-13T23:06:00.683 INFO:tasks.workunit.client.1.smithi152.stdout:9/20: write d3/f4 [1516418,103416] 0 2024-09-13T23:06:00.691 INFO:tasks.workunit.client.1.smithi152.stdout:4/48: write d3/d4/d5/f7 [4588048,46909] 0 2024-09-13T23:06:00.691 INFO:tasks.workunit.client.1.smithi152.stdout:4/49: chown d3/d4/lb 3 1 2024-09-13T23:06:00.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/50: unlink d3/d4/lb 0 2024-09-13T23:06:00.697 INFO:tasks.workunit.client.1.smithi152.stdout:4/51: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.698 INFO:tasks.workunit.client.1.smithi152.stdout:4/52: rmdir d3/d4/d6 39 2024-09-13T23:06:00.699 INFO:tasks.workunit.client.1.smithi152.stdout:4/53: creat d3/fc x:0 0 0 2024-09-13T23:06:00.734 INFO:tasks.workunit.client.1.smithi152.stdout:5/19: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:00.734 INFO:tasks.workunit.client.1.smithi152.stdout:4/54: dwrite d3/fc [0,4194304] 0 2024-09-13T23:06:00.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/14: unlink f5 0 2024-09-13T23:06:00.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/15: dread f0 [0,4194304] 0 2024-09-13T23:06:00.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/16: chown l6 1571248176 1 2024-09-13T23:06:00.735 INFO:tasks.workunit.client.1.smithi152.stdout:5/20: mknod c4 0 2024-09-13T23:06:00.738 INFO:tasks.workunit.client.1.smithi152.stdout:5/21: mkdir d5 0 2024-09-13T23:06:00.738 INFO:tasks.workunit.client.1.smithi152.stdout:4/55: read d3/d4/d5/f7 [2311342,92513] 0 2024-09-13T23:06:00.740 INFO:tasks.workunit.client.1.smithi152.stdout:1/20: getdents d4 0 2024-09-13T23:06:00.741 INFO:tasks.workunit.client.1.smithi152.stdout:1/21: creat d4/f6 x:0 0 0 2024-09-13T23:06:00.743 INFO:tasks.workunit.client.1.smithi152.stdout:1/22: rename f2 to d4/f7 0 2024-09-13T23:06:00.745 INFO:tasks.workunit.client.1.smithi152.stdout:1/23: symlink d4/l8 0 2024-09-13T23:06:00.746 INFO:tasks.workunit.client.1.smithi152.stdout:9/21: truncate d3/f4 2602273 0 2024-09-13T23:06:00.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/22: dread f0 [4194304,4194304] 0 2024-09-13T23:06:00.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/23: fsync f0 0 2024-09-13T23:06:00.747 INFO:tasks.workunit.client.1.smithi152.stdout:9/22: mkdir d3/d5 0 2024-09-13T23:06:00.748 INFO:tasks.workunit.client.1.smithi152.stdout:0/17: getdents . 0 2024-09-13T23:06:00.750 INFO:tasks.workunit.client.1.smithi152.stdout:9/23: creat d3/f6 x:0 0 0 2024-09-13T23:06:00.751 INFO:tasks.workunit.client.1.smithi152.stdout:0/18: rename l6 to l7 0 2024-09-13T23:06:00.752 INFO:tasks.workunit.client.1.smithi152.stdout:4/56: truncate d3/fc 1027795 0 2024-09-13T23:06:00.753 INFO:tasks.workunit.client.1.smithi152.stdout:9/24: rename c1 to d3/c7 0 2024-09-13T23:06:00.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/19: creat f8 x:0 0 0 2024-09-13T23:06:00.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/20: creat f9 x:0 0 0 2024-09-13T23:06:00.756 INFO:tasks.workunit.client.1.smithi152.stdout:4/57: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/25: unlink d3/f6 0 2024-09-13T23:06:00.759 INFO:tasks.workunit.client.1.smithi152.stdout:0/21: symlink la 0 2024-09-13T23:06:00.760 INFO:tasks.workunit.client.1.smithi152.stdout:9/26: write d3/f4 [1569751,67080] 0 2024-09-13T23:06:00.760 INFO:tasks.workunit.client.1.smithi152.stdout:4/58: mknod d3/d4/d5/cd 0 2024-09-13T23:06:00.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/27: mknod d3/c8 0 2024-09-13T23:06:00.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/28: creat d3/f9 x:0 0 0 2024-09-13T23:06:00.763 INFO:tasks.workunit.client.1.smithi152.stdout:4/59: unlink d3/d4/d6/d8/ca 0 2024-09-13T23:06:00.763 INFO:tasks.workunit.client.1.smithi152.stdout:4/60: fdatasync d3/d4/d5/f7 0 2024-09-13T23:06:00.766 INFO:tasks.workunit.client.1.smithi152.stdout:9/29: creat d3/d5/fa x:0 0 0 2024-09-13T23:06:00.766 INFO:tasks.workunit.client.1.smithi152.stdout:9/30: read d3/f4 [144981,34256] 0 2024-09-13T23:06:00.766 INFO:tasks.workunit.client.1.smithi152.stdout:9/31: dread - d3/f9 zero size 2024-09-13T23:06:00.766 INFO:tasks.workunit.client.1.smithi152.stdout:9/32: creat d3/d5/fb x:0 0 0 2024-09-13T23:06:00.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/33: write d3/f4 [3546836,104194] 0 2024-09-13T23:06:00.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/34: write d3/f9 [60498,62187] 0 2024-09-13T23:06:00.767 INFO:tasks.workunit.client.1.smithi152.stdout:4/61: mknod d3/d4/ce 0 2024-09-13T23:06:00.767 INFO:tasks.workunit.client.1.smithi152.stdout:4/62: readlink - no filename 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:1/24: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/22: write f2 [883275,54769] 0 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/23: readlink l7 0 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:1/25: truncate f0 4928811 0 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/24: chown f1 895146 1 2024-09-13T23:06:00.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/25: rmdir - no directory 2024-09-13T23:06:00.773 INFO:tasks.workunit.client.1.smithi152.stdout:0/26: creat fb x:0 0 0 2024-09-13T23:06:00.773 INFO:tasks.workunit.client.1.smithi152.stdout:5/24: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:00.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/27: rename f9 to fc 0 2024-09-13T23:06:00.777 INFO:tasks.workunit.client.1.smithi152.stdout:5/25: creat d5/f6 x:0 0 0 2024-09-13T23:06:00.777 INFO:tasks.workunit.client.1.smithi152.stdout:5/26: write d5/f6 [801331,28541] 0 2024-09-13T23:06:00.778 INFO:tasks.workunit.client.1.smithi152.stdout:1/26: mkdir d4/d9 0 2024-09-13T23:06:00.779 INFO:tasks.workunit.client.1.smithi152.stdout:0/28: rename f3 to fd 0 2024-09-13T23:06:00.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/27: mknod d4/d9/ca 0 2024-09-13T23:06:00.781 INFO:tasks.workunit.client.1.smithi152.stdout:1/28: write d4/f7 [708946,38428] 0 2024-09-13T23:06:00.783 INFO:tasks.workunit.client.1.smithi152.stdout:1/29: creat d4/d9/fb x:0 0 0 2024-09-13T23:06:00.790 INFO:tasks.workunit.client.1.smithi152.stdout:4/63: dwrite d3/fc [0,4194304] 0 2024-09-13T23:06:00.790 INFO:tasks.workunit.client.1.smithi152.stdout:4/64: fdatasync d3/fc 0 2024-09-13T23:06:00.790 INFO:tasks.workunit.client.1.smithi152.stdout:4/65: stat d3 0 2024-09-13T23:06:00.792 INFO:tasks.workunit.client.1.smithi152.stdout:1/30: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:00.794 INFO:tasks.workunit.client.1.smithi152.stdout:4/66: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.794 INFO:tasks.workunit.client.1.smithi152.stdout:4/67: chown d3/d4/d5 9756 1 2024-09-13T23:06:00.794 INFO:tasks.workunit.client.1.smithi152.stdout:4/68: readlink - no filename 2024-09-13T23:06:00.794 INFO:tasks.workunit.client.1.smithi152.stdout:4/69: chown d3/d4 60 1 2024-09-13T23:06:00.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/70: symlink d3/lf 0 2024-09-13T23:06:00.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/71: chown d3/fc 10806 1 2024-09-13T23:06:00.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/72: mknod d3/d4/d6/d8/c10 0 2024-09-13T23:06:00.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/29: dwrite f1 [0,4194304] 0 2024-09-13T23:06:00.810 INFO:tasks.workunit.client.1.smithi152.stdout:4/73: rmdir d3/d4 39 2024-09-13T23:06:00.811 INFO:tasks.workunit.client.1.smithi152.stdout:4/74: chown d3/d4/d6/d8/c10 66673505 1 2024-09-13T23:06:00.812 INFO:tasks.workunit.client.1.smithi152.stdout:4/75: mknod d3/d4/d6/d8/c11 0 2024-09-13T23:06:00.812 INFO:tasks.workunit.client.1.smithi152.stdout:4/76: chown d3/d4/d5/f7 0 1 2024-09-13T23:06:00.813 INFO:tasks.workunit.client.1.smithi152.stdout:4/77: mknod d3/d4/d5/c12 0 2024-09-13T23:06:00.814 INFO:tasks.workunit.client.1.smithi152.stdout:5/27: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.820 INFO:tasks.workunit.client.1.smithi152.stdout:9/35: dwrite d3/f9 [0,4194304] 0 2024-09-13T23:06:00.823 INFO:tasks.workunit.client.1.smithi152.stdout:4/78: write d3/fc [961595,8671] 0 2024-09-13T23:06:00.826 INFO:tasks.workunit.client.1.smithi152.stdout:5/28: fdatasync d5/f6 0 2024-09-13T23:06:00.827 INFO:tasks.workunit.client.1.smithi152.stdout:0/30: dwrite f0 [0,4194304] 0 2024-09-13T23:06:00.827 INFO:tasks.workunit.client.1.smithi152.stdout:0/31: read - f8 zero size 2024-09-13T23:06:00.829 INFO:tasks.workunit.client.1.smithi152.stdout:1/31: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:00.830 INFO:tasks.workunit.client.1.smithi152.stdout:0/32: mknod ce 0 2024-09-13T23:06:00.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/32: mknod d4/d9/cc 0 2024-09-13T23:06:00.832 INFO:tasks.workunit.client.1.smithi152.stdout:1/33: chown f0 100330 1 2024-09-13T23:06:00.832 INFO:tasks.workunit.client.1.smithi152.stdout:1/34: creat d4/d9/fd x:0 0 0 2024-09-13T23:06:00.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/33: truncate f1 1985364 0 2024-09-13T23:06:00.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/34: creat ff x:0 0 0 2024-09-13T23:06:00.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/35: truncate fc 770014 0 2024-09-13T23:06:00.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/35: mknod d4/ce 0 2024-09-13T23:06:00.839 INFO:tasks.workunit.client.1.smithi152.stdout:5/29: read f0 [72105,84979] 0 2024-09-13T23:06:00.839 INFO:tasks.workunit.client.1.smithi152.stdout:5/30: chown c3 12054 1 2024-09-13T23:06:00.839 INFO:tasks.workunit.client.1.smithi152.stdout:5/31: creat d5/f7 x:0 0 0 2024-09-13T23:06:00.839 INFO:tasks.workunit.client.1.smithi152.stdout:5/32: dread - d5/f7 zero size 2024-09-13T23:06:00.839 INFO:tasks.workunit.client.1.smithi152.stdout:9/36: dwrite d3/f9 [0,4194304] 0 2024-09-13T23:06:00.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/79: dread d3/fc [0,4194304] 0 2024-09-13T23:06:00.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/37: mknod d3/d5/cc 0 2024-09-13T23:06:00.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/38: dread - d3/d5/fb zero size 2024-09-13T23:06:00.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/39: creat d3/fd x:0 0 0 2024-09-13T23:06:00.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/40: chown d3/d5/fb 298 1 2024-09-13T23:06:00.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/41: creat d3/fe x:0 0 0 2024-09-13T23:06:00.847 INFO:tasks.workunit.client.1.smithi152.stdout:4/80: unlink d3/fc 0 2024-09-13T23:06:00.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/33: dread f0 [4194304,4194304] 0 2024-09-13T23:06:00.849 INFO:tasks.workunit.client.1.smithi152.stdout:1/36: rmdir d4 39 2024-09-13T23:06:00.850 INFO:tasks.workunit.client.1.smithi152.stdout:4/81: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:00.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/42: link d3/d5/fa d3/ff 0 2024-09-13T23:06:00.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/43: dread - d3/fe zero size 2024-09-13T23:06:00.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/44: readlink - no filename 2024-09-13T23:06:00.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/45: creat d3/d5/f10 x:0 0 0 2024-09-13T23:06:00.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/46: fdatasync d3/fd 0 2024-09-13T23:06:00.854 INFO:tasks.workunit.client.1.smithi152.stdout:9/47: rename d3/c8 to d3/c11 0 2024-09-13T23:06:00.854 INFO:tasks.workunit.client.1.smithi152.stdout:9/48: write d3/fd [100505,45544] 0 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/37: link d4/c5 d4/cf 0 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/38: chown d4/l8 11 1 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/39: fsync f0 0 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/40: chown d4/c5 242339701 1 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/41: read - f1 zero size 2024-09-13T23:06:00.857 INFO:tasks.workunit.client.1.smithi152.stdout:1/42: truncate f1 425966 0 2024-09-13T23:06:00.858 INFO:tasks.workunit.client.1.smithi152.stdout:1/43: dread f1 [0,4194304] 0 2024-09-13T23:06:00.858 INFO:tasks.workunit.client.1.smithi152.stdout:9/49: dread d3/fd [0,4194304] 0 2024-09-13T23:06:00.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/44: symlink d4/l10 0 2024-09-13T23:06:00.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/45: chown d4/d9 3 1 2024-09-13T23:06:00.860 INFO:tasks.workunit.client.1.smithi152.stdout:1/46: mkdir d4/d9/d11 0 2024-09-13T23:06:00.862 INFO:tasks.workunit.client.1.smithi152.stdout:4/82: truncate d3/d4/d5/f7 1561575 0 2024-09-13T23:06:00.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/83: creat d3/f13 x:0 0 0 2024-09-13T23:06:00.867 INFO:tasks.workunit.client.1.smithi152.stdout:4/84: write d3/d4/d5/f7 [1151839,82859] 0 2024-09-13T23:06:00.867 INFO:tasks.workunit.client.1.smithi152.stdout:4/85: readlink d3/lf 0 2024-09-13T23:06:00.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/47: truncate d4/f7 1721039 0 2024-09-13T23:06:00.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/48: chown d4/l8 0 1 2024-09-13T23:06:00.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/49: fsync f0 0 2024-09-13T23:06:00.869 INFO:tasks.workunit.client.1.smithi152.stdout:4/86: creat d3/d4/d6/f14 x:0 0 0 2024-09-13T23:06:00.869 INFO:tasks.workunit.client.1.smithi152.stdout:4/87: chown d3/d4/d5/c9 108904278 1 2024-09-13T23:06:00.869 INFO:tasks.workunit.client.1.smithi152.stdout:4/88: stat d3/d4/d5/c12 0 2024-09-13T23:06:00.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/50: creat d4/d9/f12 x:0 0 0 2024-09-13T23:06:00.870 INFO:tasks.workunit.client.1.smithi152.stdout:4/89: symlink d3/d4/d6/d8/l15 0 2024-09-13T23:06:00.871 INFO:tasks.workunit.client.1.smithi152.stdout:4/90: rename d3/d4/d6/d8/c10 to d3/d4/d6/d8/c16 0 2024-09-13T23:06:00.872 INFO:tasks.workunit.client.1.smithi152.stdout:4/91: fsync d3/d4/d5/f7 0 2024-09-13T23:06:00.872 INFO:tasks.workunit.client.1.smithi152.stdout:9/50: dwrite d3/fe [0,4194304] 0 2024-09-13T23:06:00.872 INFO:tasks.workunit.client.1.smithi152.stdout:9/51: chown d3/fe 23 1 2024-09-13T23:06:00.875 INFO:tasks.workunit.client.1.smithi152.stdout:9/52: unlink d3/c11 0 2024-09-13T23:06:00.876 INFO:tasks.workunit.client.1.smithi152.stdout:9/53: mknod d3/d5/c12 0 2024-09-13T23:06:00.876 INFO:tasks.workunit.client.1.smithi152.stdout:9/54: mknod d3/d5/c13 0 2024-09-13T23:06:00.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/55: symlink d3/l14 0 2024-09-13T23:06:00.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/56: fdatasync d3/d5/f10 0 2024-09-13T23:06:00.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/57: fdatasync d3/f4 0 2024-09-13T23:06:00.878 INFO:tasks.workunit.client.1.smithi152.stdout:9/58: rename d3/d5/f10 to d3/f15 0 2024-09-13T23:06:00.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/92: getdents d3/d4/d6/d8 0 2024-09-13T23:06:00.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/93: write d3/d4/d5/f7 [938379,17821] 0 2024-09-13T23:06:00.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/94: mkdir d3/d4/d6/d8/d17 0 2024-09-13T23:06:00.883 INFO:tasks.workunit.client.1.smithi152.stdout:4/95: rename d3/d4/d6/d8/c11 to d3/d4/c18 0 2024-09-13T23:06:00.892 INFO:tasks.workunit.client.1.smithi152.stdout:9/59: dwrite d3/ff [0,4194304] 0 2024-09-13T23:06:00.893 INFO:tasks.workunit.client.1.smithi152.stdout:9/60: mknod d3/c16 0 2024-09-13T23:06:00.900 INFO:tasks.workunit.client.1.smithi152.stdout:9/61: read d3/ff [3294613,58127] 0 2024-09-13T23:06:00.919 INFO:tasks.workunit.client.1.smithi152.stdout:9/62: dwrite d3/fd [0,4194304] 0 2024-09-13T23:06:00.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/63: unlink d3/fd 0 2024-09-13T23:06:00.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/64: read - d3/f15 zero size 2024-09-13T23:06:00.922 INFO:tasks.workunit.client.1.smithi152.stdout:9/65: rename d3/d5/fa to d3/f17 0 2024-09-13T23:06:00.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/66: symlink d3/d5/l18 0 2024-09-13T23:06:00.924 INFO:tasks.workunit.client.1.smithi152.stdout:9/67: truncate d3/ff 2514584 0 2024-09-13T23:06:00.934 INFO:tasks.workunit.client.1.smithi152.stdout:9/68: write d3/f9 [3165316,83154] 0 2024-09-13T23:06:00.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/69: link d3/d5/l18 d3/l19 0 2024-09-13T23:06:00.937 INFO:tasks.workunit.client.1.smithi152.stdout:9/70: rename d3/l19 to d3/d5/l1a 0 2024-09-13T23:06:00.938 INFO:tasks.workunit.client.1.smithi152.stdout:9/71: mknod d3/d5/c1b 0 2024-09-13T23:06:00.954 INFO:tasks.workunit.client.1.smithi152.stdout:9/72: dwrite d3/f15 [0,4194304] 0 2024-09-13T23:06:00.956 INFO:tasks.workunit.client.1.smithi152.stdout:9/73: truncate d3/ff 1380390 0 2024-09-13T23:06:00.964 INFO:tasks.workunit.client.1.smithi152.stdout:9/74: write d3/fe [3761603,48108] 0 2024-09-13T23:06:00.965 INFO:tasks.workunit.client.1.smithi152.stdout:9/75: unlink d3/d5/c12 0 2024-09-13T23:06:00.985 INFO:tasks.workunit.client.1.smithi152.stdout:9/76: dwrite d3/fe [0,4194304] 0 2024-09-13T23:06:00.985 INFO:tasks.workunit.client.1.smithi152.stdout:9/77: creat d3/f1c x:0 0 0 2024-09-13T23:06:00.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/78: symlink d3/l1d 0 2024-09-13T23:06:00.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/79: fdatasync d3/f1c 0 2024-09-13T23:06:00.987 INFO:tasks.workunit.client.1.smithi152.stdout:9/80: chown d3/c7 3277 1 2024-09-13T23:06:00.987 INFO:tasks.workunit.client.1.smithi152.stdout:9/81: mkdir d3/d1e 0 2024-09-13T23:06:01.704 INFO:tasks.workunit.client.0.smithi115.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T23:06:01.716 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T23:06:01.716 INFO:tasks.workunit.client.0.smithi115.stderr:+ make 2024-09-13T23:06:01.794 INFO:tasks.workunit.client.0.smithi115.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T23:06:02.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:01 smithi115 ceph-mon[27601]: pgmap v239: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 9.1 MiB/s wr, 791 op/s 2024-09-13T23:06:02.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:01 smithi152 ceph-mon[34465]: pgmap v239: 65 pgs: 65 active+clean; 182 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 9.1 MiB/s wr, 791 op/s 2024-09-13T23:06:03.861 INFO:tasks.workunit.client.0.smithi115.stderr:++ readlink -f fsstress 2024-09-13T23:06:03.862 INFO:tasks.workunit.client.0.smithi115.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T23:06:03.862 INFO:tasks.workunit.client.0.smithi115.stderr:+ popd 2024-09-13T23:06:03.863 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T23:06:03.863 INFO:tasks.workunit.client.0.smithi115.stderr:+ popd 2024-09-13T23:06:03.863 INFO:tasks.workunit.client.0.smithi115.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T23:06:03.864 INFO:tasks.workunit.client.0.smithi115.stderr:++ mktemp -d -p . 2024-09-13T23:06:03.865 INFO:tasks.workunit.client.0.smithi115.stderr:+ T=./tmp.2gYYhn6UjO 2024-09-13T23:06:03.865 INFO:tasks.workunit.client.0.smithi115.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.2gYYhn6UjO -l 1 -n 1000 -p 10 -v 2024-09-13T23:06:03.867 INFO:tasks.workunit.client.0.smithi115.stdout:seed = 1726609845 2024-09-13T23:06:03.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/0: dwrite - no filename 2024-09-13T23:06:03.869 INFO:tasks.workunit.client.0.smithi115.stdout:1/0: fsync - no filename 2024-09-13T23:06:03.870 INFO:tasks.workunit.client.0.smithi115.stdout:1/1: dwrite - no filename 2024-09-13T23:06:03.870 INFO:tasks.workunit.client.0.smithi115.stdout:0/1: creat f0 x:0 0 0 2024-09-13T23:06:03.870 INFO:tasks.workunit.client.0.smithi115.stdout:0/2: fdatasync f0 0 2024-09-13T23:06:03.871 INFO:tasks.workunit.client.0.smithi115.stdout:2/0: dread - no filename 2024-09-13T23:06:03.871 INFO:tasks.workunit.client.0.smithi115.stdout:2/1: write - no filename 2024-09-13T23:06:03.871 INFO:tasks.workunit.client.0.smithi115.stdout:2/2: write - no filename 2024-09-13T23:06:03.871 INFO:tasks.workunit.client.0.smithi115.stdout:2/3: stat - no entries 2024-09-13T23:06:03.871 INFO:tasks.workunit.client.0.smithi115.stdout:1/2: mkdir d0 0 2024-09-13T23:06:03.872 INFO:tasks.workunit.client.0.smithi115.stdout:3/0: write - no filename 2024-09-13T23:06:03.874 INFO:tasks.workunit.client.0.smithi115.stdout:2/4: creat f0 x:0 0 0 2024-09-13T23:06:03.874 INFO:tasks.workunit.client.0.smithi115.stdout:2/5: creat f1 x:0 0 0 2024-09-13T23:06:03.874 INFO:tasks.workunit.client.0.smithi115.stdout:1/3: creat d0/f1 x:0 0 0 2024-09-13T23:06:03.875 INFO:tasks.workunit.client.0.smithi115.stdout:4/0: dwrite - no filename 2024-09-13T23:06:03.875 INFO:tasks.workunit.client.0.smithi115.stdout:4/1: unlink - no file 2024-09-13T23:06:03.876 INFO:tasks.workunit.client.0.smithi115.stdout:3/1: creat f0 x:0 0 0 2024-09-13T23:06:03.879 INFO:tasks.workunit.client.0.smithi115.stdout:5/0: dwrite - no filename 2024-09-13T23:06:03.879 INFO:tasks.workunit.client.0.smithi115.stdout:5/1: truncate - no filename 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/2: mknod c0 0 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/3: write - no filename 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/4: chown c0 347055685 1 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/3: fsync f0 0 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/4: creat f1 x:0 0 0 2024-09-13T23:06:03.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/5: creat f2 x:0 0 0 2024-09-13T23:06:03.881 INFO:tasks.workunit.client.0.smithi115.stdout:6/0: rename - no filename 2024-09-13T23:06:03.881 INFO:tasks.workunit.client.0.smithi115.stdout:6/1: rmdir - no directory 2024-09-13T23:06:03.882 INFO:tasks.workunit.client.0.smithi115.stdout:5/2: mknod c0 0 2024-09-13T23:06:03.882 INFO:tasks.workunit.client.0.smithi115.stdout:5/3: write - no filename 2024-09-13T23:06:03.884 INFO:tasks.workunit.client.0.smithi115.stdout:4/5: creat f1 x:0 0 0 2024-09-13T23:06:03.884 INFO:tasks.workunit.client.0.smithi115.stdout:4/6: stat c0 0 2024-09-13T23:06:03.885 INFO:tasks.workunit.client.0.smithi115.stdout:7/0: unlink - no file 2024-09-13T23:06:03.885 INFO:tasks.workunit.client.0.smithi115.stdout:7/1: rmdir - no directory 2024-09-13T23:06:03.885 INFO:tasks.workunit.client.0.smithi115.stdout:6/2: creat f0 x:0 0 0 2024-09-13T23:06:03.886 INFO:tasks.workunit.client.0.smithi115.stdout:0/6: rename f1 to f3 0 2024-09-13T23:06:03.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/0: chown . 25233258 1 2024-09-13T23:06:03.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/1: write - no filename 2024-09-13T23:06:03.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/2: symlink l0 0 2024-09-13T23:06:03.895 INFO:tasks.workunit.client.0.smithi115.stdout:0/7: unlink f0 0 2024-09-13T23:06:03.898 INFO:tasks.workunit.client.0.smithi115.stdout:8/2: mknod c0 0 2024-09-13T23:06:03.898 INFO:tasks.workunit.client.0.smithi115.stdout:3/2: getdents . 0 2024-09-13T23:06:03.898 INFO:tasks.workunit.client.0.smithi115.stdout:3/3: fsync f0 0 2024-09-13T23:06:03.898 INFO:tasks.workunit.client.0.smithi115.stdout:3/4: dread - f0 zero size 2024-09-13T23:06:03.898 INFO:tasks.workunit.client.0.smithi115.stdout:3/5: fsync f0 0 2024-09-13T23:06:03.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/6: getdents . 0 2024-09-13T23:06:03.901 INFO:tasks.workunit.client.0.smithi115.stdout:7/3: mknod c1 0 2024-09-13T23:06:03.906 INFO:tasks.workunit.client.0.smithi115.stdout:3/6: creat f1 x:0 0 0 2024-09-13T23:06:03.908 INFO:tasks.workunit.client.0.smithi115.stdout:7/4: creat f2 x:0 0 0 2024-09-13T23:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/8: symlink l4 0 2024-09-13T23:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/9: dread - f2 zero size 2024-09-13T23:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/10: chown l4 1158 1 2024-09-13T23:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/11: fdatasync f3 0 2024-09-13T23:06:03.909 INFO:tasks.workunit.client.0.smithi115.stdout:2/7: mkdir d2 0 2024-09-13T23:06:03.910 INFO:tasks.workunit.client.0.smithi115.stdout:3/7: dread - f0 zero size 2024-09-13T23:06:03.911 INFO:tasks.workunit.client.0.smithi115.stdout:0/12: mknod c5 0 2024-09-13T23:06:03.914 INFO:tasks.workunit.client.0.smithi115.stdout:3/8: unlink f1 0 2024-09-13T23:06:03.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/8: rmdir d2 0 2024-09-13T23:06:03.914 INFO:tasks.workunit.client.0.smithi115.stdout:2/9: rmdir - no directory 2024-09-13T23:06:03.917 INFO:tasks.workunit.client.0.smithi115.stdout:0/13: mkdir d6 0 2024-09-13T23:06:03.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/10: mknod c3 0 2024-09-13T23:06:03.919 INFO:tasks.workunit.client.0.smithi115.stdout:2/11: readlink - no filename 2024-09-13T23:06:03.919 INFO:tasks.workunit.client.0.smithi115.stdout:3/9: rename f0 to f2 0 2024-09-13T23:06:03.919 INFO:tasks.workunit.client.0.smithi115.stdout:0/14: creat d6/f7 x:0 0 0 2024-09-13T23:06:03.921 INFO:tasks.workunit.client.0.smithi115.stdout:2/12: unlink f0 0 2024-09-13T23:06:03.923 INFO:tasks.workunit.client.0.smithi115.stdout:0/15: unlink l4 0 2024-09-13T23:06:03.925 INFO:tasks.workunit.client.0.smithi115.stdout:2/13: creat f4 x:0 0 0 2024-09-13T23:06:03.925 INFO:tasks.workunit.client.0.smithi115.stdout:2/14: fsync f1 0 2024-09-13T23:06:03.925 INFO:tasks.workunit.client.0.smithi115.stdout:3/10: mkdir d3 0 2024-09-13T23:06:03.927 INFO:tasks.workunit.client.0.smithi115.stdout:0/16: rename c5 to d6/c8 0 2024-09-13T23:06:03.927 INFO:tasks.workunit.client.0.smithi115.stdout:2/15: link c3 c5 0 2024-09-13T23:06:03.927 INFO:tasks.workunit.client.0.smithi115.stdout:2/16: fsync f1 0 2024-09-13T23:06:03.927 INFO:tasks.workunit.client.0.smithi115.stdout:2/17: write f1 [153599,78942] 0 2024-09-13T23:06:03.928 INFO:tasks.workunit.client.0.smithi115.stdout:3/11: mknod d3/c4 0 2024-09-13T23:06:03.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/4: dwrite d0/f1 [0,4194304] 0 2024-09-13T23:06:03.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/5: creat d0/f2 x:0 0 0 2024-09-13T23:06:03.930 INFO:tasks.workunit.client.0.smithi115.stdout:2/18: mknod c6 0 2024-09-13T23:06:03.930 INFO:tasks.workunit.client.0.smithi115.stdout:3/12: mkdir d3/d5 0 2024-09-13T23:06:03.933 INFO:tasks.workunit.client.0.smithi115.stdout:3/13: symlink d3/d5/l6 0 2024-09-13T23:06:03.934 INFO:tasks.workunit.client.0.smithi115.stdout:3/14: mknod d3/c7 0 2024-09-13T23:06:03.934 INFO:tasks.workunit.client.0.smithi115.stdout:3/15: dread - f2 zero size 2024-09-13T23:06:03.934 INFO:tasks.workunit.client.0.smithi115.stdout:3/16: dread - f2 zero size 2024-09-13T23:06:03.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/17: symlink d3/d5/l8 0 2024-09-13T23:06:03.935 INFO:tasks.workunit.client.0.smithi115.stdout:3/18: write f2 [463025,37911] 0 2024-09-13T23:06:03.937 INFO:tasks.workunit.client.0.smithi115.stdout:3/19: symlink d3/l9 0 2024-09-13T23:06:03.967 INFO:tasks.workunit.client.0.smithi115.stdout:4/7: getdents . 0 2024-09-13T23:06:03.967 INFO:tasks.workunit.client.0.smithi115.stdout:4/8: write f1 [93796,85961] 0 2024-09-13T23:06:03.970 INFO:tasks.workunit.client.0.smithi115.stdout:4/9: unlink c0 0 2024-09-13T23:06:03.971 INFO:tasks.workunit.client.0.smithi115.stdout:6/3: getdents . 0 2024-09-13T23:06:03.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/4: mknod c1 0 2024-09-13T23:06:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:03 smithi115 ceph-mon[27601]: pgmap v240: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 798 op/s 2024-09-13T23:06:04.060 INFO:tasks.workunit.client.0.smithi115.stdout:7/5: dwrite f2 [0,4194304] 0 2024-09-13T23:06:04.063 INFO:tasks.workunit.client.0.smithi115.stdout:7/6: mknod c3 0 2024-09-13T23:06:04.079 INFO:tasks.workunit.client.0.smithi115.stdout:4/10: dwrite f1 [0,4194304] 0 2024-09-13T23:06:04.081 INFO:tasks.workunit.client.0.smithi115.stdout:9/0: getdents . 0 2024-09-13T23:06:04.084 INFO:tasks.workunit.client.0.smithi115.stdout:9/1: mkdir d0 0 2024-09-13T23:06:04.084 INFO:tasks.workunit.client.0.smithi115.stdout:9/2: rename d0 to d0/d1 22 2024-09-13T23:06:04.084 INFO:tasks.workunit.client.0.smithi115.stdout:9/3: read - no filename 2024-09-13T23:06:04.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/4: creat d0/f2 x:0 0 0 2024-09-13T23:06:04.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/5: creat d0/f3 x:0 0 0 2024-09-13T23:06:04.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/6: truncate d0/f3 289575 0 2024-09-13T23:06:04.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/7: chown d0/f3 325426083 1 2024-09-13T23:06:04.088 INFO:tasks.workunit.client.0.smithi115.stdout:4/11: dread f1 [0,4194304] 0 2024-09-13T23:06:04.088 INFO:tasks.workunit.client.0.smithi115.stdout:4/12: fsync f1 0 2024-09-13T23:06:04.088 INFO:tasks.workunit.client.0.smithi115.stdout:6/5: dwrite f0 [0,4194304] 0 2024-09-13T23:06:04.088 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:03 smithi152 ceph-mon[34465]: pgmap v240: 65 pgs: 65 active+clean; 212 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 798 op/s 2024-09-13T23:06:04.090 INFO:tasks.workunit.client.0.smithi115.stdout:4/13: creat f2 x:0 0 0 2024-09-13T23:06:04.091 INFO:tasks.workunit.client.0.smithi115.stdout:1/6: write d0/f1 [3574654,25390] 0 2024-09-13T23:06:04.098 INFO:tasks.workunit.client.0.smithi115.stdout:1/7: dread d0/f1 [0,4194304] 0 2024-09-13T23:06:04.099 INFO:tasks.workunit.client.0.smithi115.stdout:1/8: fsync d0/f1 0 2024-09-13T23:06:04.099 INFO:tasks.workunit.client.0.smithi115.stdout:1/9: chown d0 90422 1 2024-09-13T23:06:04.099 INFO:tasks.workunit.client.0.smithi115.stdout:1/10: stat d0/f2 0 2024-09-13T23:06:04.110 INFO:tasks.workunit.client.0.smithi115.stdout:6/6: dread f0 [0,4194304] 0 2024-09-13T23:06:04.111 INFO:tasks.workunit.client.0.smithi115.stdout:6/7: readlink - no filename 2024-09-13T23:06:04.120 INFO:tasks.workunit.client.0.smithi115.stdout:6/8: write f0 [2210218,91927] 0 2024-09-13T23:06:04.121 INFO:tasks.workunit.client.0.smithi115.stdout:6/9: mknod c2 0 2024-09-13T23:06:04.121 INFO:tasks.workunit.client.0.smithi115.stdout:6/10: chown c1 14034763 1 2024-09-13T23:06:04.123 INFO:tasks.workunit.client.0.smithi115.stdout:2/19: dwrite f1 [0,4194304] 0 2024-09-13T23:06:04.123 INFO:tasks.workunit.client.0.smithi115.stdout:2/20: read - f4 zero size 2024-09-13T23:06:04.126 INFO:tasks.workunit.client.0.smithi115.stdout:9/8: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:04.128 INFO:tasks.workunit.client.0.smithi115.stdout:1/11: dwrite d0/f1 [0,4194304] 0 2024-09-13T23:06:04.128 INFO:tasks.workunit.client.0.smithi115.stdout:1/12: chown d0/f2 43410590 1 2024-09-13T23:06:04.128 INFO:tasks.workunit.client.0.smithi115.stdout:3/20: dwrite f2 [0,4194304] 0 2024-09-13T23:06:04.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/21: link d3/d5/l8 d3/la 0 2024-09-13T23:06:04.139 INFO:tasks.workunit.client.0.smithi115.stdout:6/11: dread f0 [0,4194304] 0 2024-09-13T23:06:04.140 INFO:tasks.workunit.client.0.smithi115.stdout:6/12: creat f3 x:0 0 0 2024-09-13T23:06:04.142 INFO:tasks.workunit.client.0.smithi115.stdout:3/22: dread f2 [0,4194304] 0 2024-09-13T23:06:04.149 INFO:tasks.workunit.client.0.smithi115.stdout:3/23: dread f2 [0,4194304] 0 2024-09-13T23:06:04.149 INFO:tasks.workunit.client.0.smithi115.stdout:3/24: chown d3 0 1 2024-09-13T23:06:04.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/9: rmdir d0 39 2024-09-13T23:06:04.149 INFO:tasks.workunit.client.0.smithi115.stdout:9/10: fdatasync d0/f3 0 2024-09-13T23:06:04.151 INFO:tasks.workunit.client.0.smithi115.stdout:9/11: rename d0/f3 to d0/f4 0 2024-09-13T23:06:04.151 INFO:tasks.workunit.client.0.smithi115.stdout:4/14: getdents . 0 2024-09-13T23:06:04.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/25: write f2 [1307688,71104] 0 2024-09-13T23:06:04.156 INFO:tasks.workunit.client.0.smithi115.stdout:3/26: chown d3/d5 225988718 1 2024-09-13T23:06:04.156 INFO:tasks.workunit.client.0.smithi115.stdout:3/27: readlink d3/l9 0 2024-09-13T23:06:04.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/28: mkdir d3/d5/db 0 2024-09-13T23:06:04.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/29: chown d3/l9 3 1 2024-09-13T23:06:04.159 INFO:tasks.workunit.client.0.smithi115.stdout:3/30: unlink f2 0 2024-09-13T23:06:04.159 INFO:tasks.workunit.client.0.smithi115.stdout:3/31: write - no filename 2024-09-13T23:06:04.162 INFO:tasks.workunit.client.0.smithi115.stdout:9/12: dread d0/f2 [0,4194304] 0 2024-09-13T23:06:04.163 INFO:tasks.workunit.client.0.smithi115.stdout:9/13: mknod d0/c5 0 2024-09-13T23:06:04.163 INFO:tasks.workunit.client.0.smithi115.stdout:9/14: write d0/f4 [36744,125879] 0 2024-09-13T23:06:04.164 INFO:tasks.workunit.client.0.smithi115.stdout:9/15: symlink d0/l6 0 2024-09-13T23:06:04.167 INFO:tasks.workunit.client.0.smithi115.stdout:7/7: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:04.173 INFO:tasks.workunit.client.0.smithi115.stdout:7/8: read f2 [722410,28872] 0 2024-09-13T23:06:04.184 INFO:tasks.workunit.client.0.smithi115.stdout:7/9: dwrite f2 [8388608,4194304] 0 2024-09-13T23:06:04.186 INFO:tasks.workunit.client.0.smithi115.stdout:7/10: mknod c4 0 2024-09-13T23:06:04.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/21: truncate f1 801230 0 2024-09-13T23:06:04.334 INFO:tasks.workunit.client.0.smithi115.stdout:6/13: fsync f3 0 2024-09-13T23:06:04.335 INFO:tasks.workunit.client.0.smithi115.stdout:1/13: dwrite d0/f1 [4194304,4194304] 0 2024-09-13T23:06:04.340 INFO:tasks.workunit.client.0.smithi115.stdout:6/14: dread f0 [0,4194304] 0 2024-09-13T23:06:04.342 INFO:tasks.workunit.client.0.smithi115.stdout:4/15: dwrite f1 [0,4194304] 0 2024-09-13T23:06:04.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/11: dwrite f2 [0,4194304] 0 2024-09-13T23:06:04.342 INFO:tasks.workunit.client.0.smithi115.stdout:7/12: creat f5 x:0 0 0 2024-09-13T23:06:04.349 INFO:tasks.workunit.client.0.smithi115.stdout:2/22: dwrite f4 [0,4194304] 0 2024-09-13T23:06:04.350 INFO:tasks.workunit.client.0.smithi115.stdout:2/23: creat f7 x:0 0 0 2024-09-13T23:06:04.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/24: mknod c8 0 2024-09-13T23:06:04.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/25: fdatasync f7 0 2024-09-13T23:06:04.356 INFO:tasks.workunit.client.0.smithi115.stdout:2/26: symlink l9 0 2024-09-13T23:06:04.356 INFO:tasks.workunit.client.0.smithi115.stdout:1/14: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:04.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/27: mkdir da 0 2024-09-13T23:06:04.359 INFO:tasks.workunit.client.0.smithi115.stdout:4/16: truncate f1 607650 0 2024-09-13T23:06:04.360 INFO:tasks.workunit.client.0.smithi115.stdout:2/28: mknod da/cb 0 2024-09-13T23:06:04.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/29: symlink da/lc 0 2024-09-13T23:06:04.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/30: dread - f7 zero size 2024-09-13T23:06:04.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/15: dwrite f0 [0,4194304] 0 2024-09-13T23:06:04.373 INFO:tasks.workunit.client.0.smithi115.stdout:7/13: dwrite f5 [0,4194304] 0 2024-09-13T23:06:04.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/14: mknod c6 0 2024-09-13T23:06:04.378 INFO:tasks.workunit.client.0.smithi115.stdout:7/15: mknod c7 0 2024-09-13T23:06:04.378 INFO:tasks.workunit.client.0.smithi115.stdout:7/16: readlink l0 0 2024-09-13T23:06:04.382 INFO:tasks.workunit.client.0.smithi115.stdout:6/16: dread f0 [0,4194304] 0 2024-09-13T23:06:04.382 INFO:tasks.workunit.client.0.smithi115.stdout:6/17: dread - f3 zero size 2024-09-13T23:06:04.383 INFO:tasks.workunit.client.0.smithi115.stdout:6/18: mkdir d4 0 2024-09-13T23:06:04.384 INFO:tasks.workunit.client.0.smithi115.stdout:6/19: rename d4 to d4/d5 22 2024-09-13T23:06:04.384 INFO:tasks.workunit.client.0.smithi115.stdout:6/20: readlink - no filename 2024-09-13T23:06:04.385 INFO:tasks.workunit.client.0.smithi115.stdout:7/17: write f2 [4921447,114163] 0 2024-09-13T23:06:04.385 INFO:tasks.workunit.client.0.smithi115.stdout:7/18: chown c1 884160 1 2024-09-13T23:06:04.386 INFO:tasks.workunit.client.0.smithi115.stdout:7/19: rename f5 to f8 0 2024-09-13T23:06:04.386 INFO:tasks.workunit.client.0.smithi115.stdout:7/20: fdatasync f8 0 2024-09-13T23:06:04.389 INFO:tasks.workunit.client.0.smithi115.stdout:6/21: dread f0 [0,4194304] 0 2024-09-13T23:06:04.389 INFO:tasks.workunit.client.0.smithi115.stdout:6/22: write f3 [688191,75819] 0 2024-09-13T23:06:04.389 INFO:tasks.workunit.client.0.smithi115.stdout:4/17: dread f1 [0,4194304] 0 2024-09-13T23:06:04.391 INFO:tasks.workunit.client.0.smithi115.stdout:4/18: symlink l3 0 2024-09-13T23:06:04.391 INFO:tasks.workunit.client.0.smithi115.stdout:4/19: chown f1 282575 1 2024-09-13T23:06:04.391 INFO:tasks.workunit.client.0.smithi115.stdout:4/20: stat f2 0 2024-09-13T23:06:04.392 INFO:tasks.workunit.client.0.smithi115.stdout:1/15: dwrite d0/f1 [4194304,4194304] 0 2024-09-13T23:06:04.392 INFO:tasks.workunit.client.0.smithi115.stdout:4/21: rename l3 to l4 0 2024-09-13T23:06:04.393 INFO:tasks.workunit.client.0.smithi115.stdout:1/16: truncate d0/f2 1189117 0 2024-09-13T23:06:04.394 INFO:tasks.workunit.client.0.smithi115.stdout:2/31: dwrite f4 [0,4194304] 0 2024-09-13T23:06:04.394 INFO:tasks.workunit.client.0.smithi115.stdout:2/32: read - f7 zero size 2024-09-13T23:06:04.394 INFO:tasks.workunit.client.0.smithi115.stdout:4/22: creat f5 x:0 0 0 2024-09-13T23:06:04.394 INFO:tasks.workunit.client.0.smithi115.stdout:2/33: truncate f1 389188 0 2024-09-13T23:06:04.395 INFO:tasks.workunit.client.0.smithi115.stdout:4/23: mknod c6 0 2024-09-13T23:06:04.397 INFO:tasks.workunit.client.0.smithi115.stdout:2/34: mkdir da/dd 0 2024-09-13T23:06:04.402 INFO:tasks.workunit.client.0.smithi115.stdout:1/17: write d0/f2 [2118995,69138] 0 2024-09-13T23:06:04.402 INFO:tasks.workunit.client.0.smithi115.stdout:1/18: creat d0/f3 x:0 0 0 2024-09-13T23:06:04.405 INFO:tasks.workunit.client.0.smithi115.stdout:6/23: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:04.418 INFO:tasks.workunit.client.0.smithi115.stdout:2/35: dread f1 [0,4194304] 0 2024-09-13T23:06:04.419 INFO:tasks.workunit.client.0.smithi115.stdout:2/36: mkdir da/de 0 2024-09-13T23:06:04.423 INFO:tasks.workunit.client.0.smithi115.stdout:4/24: dwrite f5 [0,4194304] 0 2024-09-13T23:06:04.423 INFO:tasks.workunit.client.0.smithi115.stdout:1/19: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:04.423 INFO:tasks.workunit.client.0.smithi115.stdout:4/25: creat f7 x:0 0 0 2024-09-13T23:06:04.423 INFO:tasks.workunit.client.0.smithi115.stdout:4/26: readlink l4 0 2024-09-13T23:06:04.426 INFO:tasks.workunit.client.0.smithi115.stdout:4/27: mknod c8 0 2024-09-13T23:06:04.426 INFO:tasks.workunit.client.0.smithi115.stdout:1/20: getdents d0 0 2024-09-13T23:06:04.427 INFO:tasks.workunit.client.0.smithi115.stdout:1/21: mknod d0/c4 0 2024-09-13T23:06:04.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/24: dwrite f3 [0,4194304] 0 2024-09-13T23:06:04.431 INFO:tasks.workunit.client.0.smithi115.stdout:2/37: dread f4 [0,4194304] 0 2024-09-13T23:06:04.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/38: dread f1 [0,4194304] 0 2024-09-13T23:06:04.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/39: stat da/de 0 2024-09-13T23:06:04.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/40: chown da 4173 1 2024-09-13T23:06:04.433 INFO:tasks.workunit.client.0.smithi115.stdout:6/25: symlink d4/l6 0 2024-09-13T23:06:04.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/26: truncate f0 6760448 0 2024-09-13T23:06:04.439 INFO:tasks.workunit.client.0.smithi115.stdout:6/27: getdents d4 0 2024-09-13T23:06:04.445 INFO:tasks.workunit.client.0.smithi115.stdout:2/41: write f4 [1579568,113469] 0 2024-09-13T23:06:04.445 INFO:tasks.workunit.client.0.smithi115.stdout:2/42: truncate f7 580985 0 2024-09-13T23:06:04.445 INFO:tasks.workunit.client.0.smithi115.stdout:2/43: symlink da/dd/lf 0 2024-09-13T23:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:4/28: dwrite f2 [0,4194304] 0 2024-09-13T23:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:1/22: dwrite d0/f3 [0,4194304] 0 2024-09-13T23:06:04.452 INFO:tasks.workunit.client.0.smithi115.stdout:2/44: fdatasync f4 0 2024-09-13T23:06:04.453 INFO:tasks.workunit.client.0.smithi115.stdout:6/28: truncate f3 999303 0 2024-09-13T23:06:04.453 INFO:tasks.workunit.client.0.smithi115.stdout:6/29: fsync f0 0 2024-09-13T23:06:04.453 INFO:tasks.workunit.client.0.smithi115.stdout:4/29: dread f1 [0,4194304] 0 2024-09-13T23:06:04.458 INFO:tasks.workunit.client.0.smithi115.stdout:1/23: link d0/f1 d0/f5 0 2024-09-13T23:06:04.462 INFO:tasks.workunit.client.0.smithi115.stdout:2/45: truncate f4 347718 0 2024-09-13T23:06:04.469 INFO:tasks.workunit.client.0.smithi115.stdout:4/30: write f5 [617313,98731] 0 2024-09-13T23:06:04.469 INFO:tasks.workunit.client.0.smithi115.stdout:4/31: creat f9 x:0 0 0 2024-09-13T23:06:04.473 INFO:tasks.workunit.client.0.smithi115.stdout:2/46: write f4 [308420,50945] 0 2024-09-13T23:06:04.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/47: write f1 [144828,61837] 0 2024-09-13T23:06:04.475 INFO:tasks.workunit.client.0.smithi115.stdout:2/48: rmdir da 39 2024-09-13T23:06:04.480 INFO:tasks.workunit.client.0.smithi115.stdout:1/24: dwrite d0/f3 [0,4194304] 0 2024-09-13T23:06:04.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/30: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:04.481 INFO:tasks.workunit.client.0.smithi115.stdout:6/31: chown c2 1 1 2024-09-13T23:06:04.481 INFO:tasks.workunit.client.0.smithi115.stdout:1/25: creat d0/f6 x:0 0 0 2024-09-13T23:06:04.482 INFO:tasks.workunit.client.0.smithi115.stdout:6/32: creat d4/f7 x:0 0 0 2024-09-13T23:06:04.482 INFO:tasks.workunit.client.0.smithi115.stdout:6/33: readlink d4/l6 0 2024-09-13T23:06:04.482 INFO:tasks.workunit.client.0.smithi115.stdout:6/34: chown d4 5532214 1 2024-09-13T23:06:04.485 INFO:tasks.workunit.client.0.smithi115.stdout:2/49: dread f4 [0,4194304] 0 2024-09-13T23:06:04.494 INFO:tasks.workunit.client.0.smithi115.stdout:1/26: rmdir d0 39 2024-09-13T23:06:04.495 INFO:tasks.workunit.client.0.smithi115.stdout:1/27: chown d0 0 1 2024-09-13T23:06:04.495 INFO:tasks.workunit.client.0.smithi115.stdout:1/28: stat d0 0 2024-09-13T23:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/35: write f0 [4463215,36468] 0 2024-09-13T23:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/36: dread - d4/f7 zero size 2024-09-13T23:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:4/32: dwrite f7 [0,4194304] 0 2024-09-13T23:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/37: chown f3 24 1 2024-09-13T23:06:04.496 INFO:tasks.workunit.client.0.smithi115.stdout:4/33: readlink l4 0 2024-09-13T23:06:04.501 INFO:tasks.workunit.client.0.smithi115.stdout:1/29: write d0/f5 [503675,17966] 0 2024-09-13T23:06:04.504 INFO:tasks.workunit.client.0.smithi115.stdout:1/30: creat d0/f7 x:0 0 0 2024-09-13T23:06:04.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/50: dwrite f4 [0,4194304] 0 2024-09-13T23:06:04.508 INFO:tasks.workunit.client.0.smithi115.stdout:1/31: write d0/f1 [4752725,19664] 0 2024-09-13T23:06:04.509 INFO:tasks.workunit.client.0.smithi115.stdout:1/32: symlink d0/l8 0 2024-09-13T23:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:4/34: dread f5 [0,4194304] 0 2024-09-13T23:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:4/35: write f9 [251190,86940] 0 2024-09-13T23:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:4/36: truncate f9 1135930 0 2024-09-13T23:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:4/37: chown f7 3088 1 2024-09-13T23:06:04.517 INFO:tasks.workunit.client.0.smithi115.stdout:4/38: rmdir - no directory 2024-09-13T23:06:04.518 INFO:tasks.workunit.client.0.smithi115.stdout:4/39: creat fa x:0 0 0 2024-09-13T23:06:04.518 INFO:tasks.workunit.client.0.smithi115.stdout:4/40: stat f2 0 2024-09-13T23:06:04.518 INFO:tasks.workunit.client.0.smithi115.stdout:1/33: dread d0/f1 [0,4194304] 0 2024-09-13T23:06:04.518 INFO:tasks.workunit.client.0.smithi115.stdout:4/41: mkdir db 0 2024-09-13T23:06:04.519 INFO:tasks.workunit.client.0.smithi115.stdout:4/42: getdents db 0 2024-09-13T23:06:04.519 INFO:tasks.workunit.client.0.smithi115.stdout:1/34: creat d0/f9 x:0 0 0 2024-09-13T23:06:04.519 INFO:tasks.workunit.client.0.smithi115.stdout:4/43: symlink db/lc 0 2024-09-13T23:06:04.520 INFO:tasks.workunit.client.0.smithi115.stdout:4/44: write f2 [4797123,5733] 0 2024-09-13T23:06:04.520 INFO:tasks.workunit.client.0.smithi115.stdout:2/51: dread f4 [0,4194304] 0 2024-09-13T23:06:04.521 INFO:tasks.workunit.client.0.smithi115.stdout:4/45: mkdir db/dd 0 2024-09-13T23:06:04.522 INFO:tasks.workunit.client.0.smithi115.stdout:2/52: symlink da/l10 0 2024-09-13T23:06:04.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/35: symlink d0/la 0 2024-09-13T23:06:04.523 INFO:tasks.workunit.client.0.smithi115.stdout:4/46: mknod db/dd/ce 0 2024-09-13T23:06:04.524 INFO:tasks.workunit.client.0.smithi115.stdout:6/38: dread f0 [0,4194304] 0 2024-09-13T23:06:04.524 INFO:tasks.workunit.client.0.smithi115.stdout:2/53: creat da/f11 x:0 0 0 2024-09-13T23:06:04.524 INFO:tasks.workunit.client.0.smithi115.stdout:2/54: stat da 0 2024-09-13T23:06:04.525 INFO:tasks.workunit.client.0.smithi115.stdout:4/47: symlink db/lf 0 2024-09-13T23:06:04.526 INFO:tasks.workunit.client.0.smithi115.stdout:6/39: mknod d4/c8 0 2024-09-13T23:06:04.526 INFO:tasks.workunit.client.0.smithi115.stdout:6/40: chown d4/f7 9527356 1 2024-09-13T23:06:04.527 INFO:tasks.workunit.client.0.smithi115.stdout:6/41: truncate d4/f7 140424 0 2024-09-13T23:06:04.552 INFO:tasks.workunit.client.0.smithi115.stdout:4/48: dwrite f5 [0,4194304] 0 2024-09-13T23:06:04.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/42: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:04.559 INFO:tasks.workunit.client.0.smithi115.stdout:4/49: getdents db/dd 0 2024-09-13T23:06:04.561 INFO:tasks.workunit.client.0.smithi115.stdout:6/43: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:04.561 INFO:tasks.workunit.client.0.smithi115.stdout:6/44: chown c1 120 1 2024-09-13T23:06:04.567 INFO:tasks.workunit.client.0.smithi115.stdout:4/50: write f7 [1927461,98869] 0 2024-09-13T23:06:04.568 INFO:tasks.workunit.client.0.smithi115.stdout:4/51: chown db 29763185 1 2024-09-13T23:06:04.577 INFO:tasks.workunit.client.0.smithi115.stdout:4/52: dread f5 [0,4194304] 0 2024-09-13T23:06:04.577 INFO:tasks.workunit.client.0.smithi115.stdout:4/53: dread - fa zero size 2024-09-13T23:06:04.578 INFO:tasks.workunit.client.0.smithi115.stdout:4/54: rename f7 to db/f10 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:6/45: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:4/55: dread f1 [0,4194304] 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:6/46: rename d4 to d4/d9 22 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:6/47: creat d4/fa x:0 0 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:6/48: write f0 [4543016,74261] 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:6/49: creat d4/fb x:0 0 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:4/56: mkdir db/d11 0 2024-09-13T23:06:04.580 INFO:tasks.workunit.client.0.smithi115.stdout:4/57: write f9 [1729213,120263] 0 2024-09-13T23:06:04.582 INFO:tasks.workunit.client.0.smithi115.stdout:6/50: symlink d4/lc 0 2024-09-13T23:06:04.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/51: unlink d4/fa 0 2024-09-13T23:06:04.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/52: chown d4/fb 1 1 2024-09-13T23:06:04.584 INFO:tasks.workunit.client.0.smithi115.stdout:6/53: mknod d4/cd 0 2024-09-13T23:06:04.584 INFO:tasks.workunit.client.0.smithi115.stdout:6/54: dread - d4/fb zero size 2024-09-13T23:06:04.584 INFO:tasks.workunit.client.0.smithi115.stdout:4/58: write f5 [36573,64069] 0 2024-09-13T23:06:04.585 INFO:tasks.workunit.client.0.smithi115.stdout:4/59: symlink db/d11/l12 0 2024-09-13T23:06:04.605 INFO:tasks.workunit.client.0.smithi115.stdout:6/55: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:04.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/60: dwrite fa [0,4194304] 0 2024-09-13T23:06:04.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/61: getdents db/dd 0 2024-09-13T23:06:04.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/62: truncate f9 2495911 0 2024-09-13T23:06:04.605 INFO:tasks.workunit.client.0.smithi115.stdout:4/63: chown db/f10 173669 1 2024-09-13T23:06:04.606 INFO:tasks.workunit.client.0.smithi115.stdout:4/64: read f2 [4677342,75661] 0 2024-09-13T23:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:4/65: dread fa [0,4194304] 0 2024-09-13T23:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:4/66: chown f5 0 1 2024-09-13T23:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:4/67: write f9 [2711950,24156] 0 2024-09-13T23:06:04.613 INFO:tasks.workunit.client.0.smithi115.stdout:4/68: read f5 [2537062,51908] 0 2024-09-13T23:06:04.620 INFO:tasks.workunit.client.0.smithi115.stdout:6/56: dwrite d4/fb [0,4194304] 0 2024-09-13T23:06:04.621 INFO:tasks.workunit.client.0.smithi115.stdout:6/57: write f3 [1174600,21146] 0 2024-09-13T23:06:04.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/58: symlink d4/le 0 2024-09-13T23:06:04.623 INFO:tasks.workunit.client.0.smithi115.stdout:6/59: mkdir d4/df 0 2024-09-13T23:06:04.631 INFO:tasks.workunit.client.0.smithi115.stdout:6/60: dread f0 [0,4194304] 0 2024-09-13T23:06:04.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/61: unlink d4/fb 0 2024-09-13T23:06:04.633 INFO:tasks.workunit.client.0.smithi115.stdout:4/69: dwrite f9 [0,4194304] 0 2024-09-13T23:06:04.633 INFO:tasks.workunit.client.0.smithi115.stdout:6/62: rename d4/lc to d4/l10 0 2024-09-13T23:06:04.642 INFO:tasks.workunit.client.0.smithi115.stdout:4/70: dread f5 [0,4194304] 0 2024-09-13T23:06:04.644 INFO:tasks.workunit.client.0.smithi115.stdout:4/71: symlink db/dd/l13 0 2024-09-13T23:06:04.646 INFO:tasks.workunit.client.0.smithi115.stdout:6/63: dread f0 [4194304,4194304] 0 2024-09-13T23:06:04.646 INFO:tasks.workunit.client.0.smithi115.stdout:6/64: symlink d4/l11 0 2024-09-13T23:06:04.646 INFO:tasks.workunit.client.0.smithi115.stdout:6/65: chown c1 0 1 2024-09-13T23:06:04.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/66: unlink d4/f7 0 2024-09-13T23:06:04.653 INFO:tasks.workunit.client.0.smithi115.stdout:4/72: write f9 [2691678,113830] 0 2024-09-13T23:06:04.653 INFO:tasks.workunit.client.0.smithi115.stdout:4/73: write f5 [4655428,83574] 0 2024-09-13T23:06:04.653 INFO:tasks.workunit.client.0.smithi115.stdout:4/74: chown db/f10 1488037072 1 2024-09-13T23:06:04.654 INFO:tasks.workunit.client.0.smithi115.stdout:4/75: truncate f2 5628418 0 2024-09-13T23:06:04.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/76: creat db/d11/f14 x:0 0 0 2024-09-13T23:06:04.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/77: fsync db/f10 0 2024-09-13T23:06:04.655 INFO:tasks.workunit.client.0.smithi115.stdout:4/78: mkdir db/d15 0 2024-09-13T23:06:04.656 INFO:tasks.workunit.client.0.smithi115.stdout:4/79: unlink db/d11/l12 0 2024-09-13T23:06:04.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/80: unlink db/dd/ce 0 2024-09-13T23:06:04.658 INFO:tasks.workunit.client.0.smithi115.stdout:4/81: mkdir db/d16 0 2024-09-13T23:06:04.659 INFO:tasks.workunit.client.0.smithi115.stdout:4/82: mkdir db/dd/d17 0 2024-09-13T23:06:04.660 INFO:tasks.workunit.client.0.smithi115.stdout:4/83: symlink db/d11/l18 0 2024-09-13T23:06:04.662 INFO:tasks.workunit.client.0.smithi115.stdout:4/84: fdatasync f9 0 2024-09-13T23:06:04.662 INFO:tasks.workunit.client.0.smithi115.stdout:4/85: fsync f1 0 2024-09-13T23:06:04.662 INFO:tasks.workunit.client.0.smithi115.stdout:4/86: mkdir db/d19 0 2024-09-13T23:06:04.663 INFO:tasks.workunit.client.0.smithi115.stdout:4/87: readlink db/dd/l13 0 2024-09-13T23:06:04.663 INFO:tasks.workunit.client.0.smithi115.stdout:4/88: mknod db/dd/d17/c1a 0 2024-09-13T23:06:04.663 INFO:tasks.workunit.client.0.smithi115.stdout:4/89: mknod db/d11/c1b 0 2024-09-13T23:06:04.664 INFO:tasks.workunit.client.0.smithi115.stdout:4/90: link db/dd/l13 db/d15/l1c 0 2024-09-13T23:06:04.665 INFO:tasks.workunit.client.0.smithi115.stdout:4/91: mkdir db/d19/d1d 0 2024-09-13T23:06:04.665 INFO:tasks.workunit.client.0.smithi115.stdout:4/92: mknod db/d19/d1d/c1e 0 2024-09-13T23:06:04.675 INFO:tasks.workunit.client.0.smithi115.stdout:4/93: rmdir db/d11 39 2024-09-13T23:06:04.676 INFO:tasks.workunit.client.0.smithi115.stdout:4/94: stat db/d19/d1d/c1e 0 2024-09-13T23:06:04.676 INFO:tasks.workunit.client.0.smithi115.stdout:4/95: chown fa 1 1 2024-09-13T23:06:04.676 INFO:tasks.workunit.client.0.smithi115.stdout:4/96: creat db/d15/f1f x:0 0 0 2024-09-13T23:06:04.699 INFO:tasks.workunit.client.0.smithi115.stdout:4/97: dwrite db/d15/f1f [0,4194304] 0 2024-09-13T23:06:04.699 INFO:tasks.workunit.client.0.smithi115.stdout:4/98: write f5 [2851594,88356] 0 2024-09-13T23:06:04.702 INFO:tasks.workunit.client.0.smithi115.stdout:4/99: unlink db/d15/l1c 0 2024-09-13T23:06:05.694 INFO:tasks.workunit.client.0.smithi115.stdout:8/3: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:8/4: dread - no filename 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:8/5: dwrite - no filename 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:1/36: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:3/32: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:2/55: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:6/67: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:5/4: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:5/5: write - no filename 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:5/6: readlink - no filename 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:0/17: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:4/100: sync 2024-09-13T23:06:05.695 INFO:tasks.workunit.client.0.smithi115.stdout:7/21: sync 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:9/16: sync 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:8/6: mknod c1 0 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/33: symlink d3/lc 0 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/34: chown d3/d5/l6 22178788 1 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/35: fdatasync - no filename 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/36: truncate - no filename 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/37: fdatasync - no filename 2024-09-13T23:06:05.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/38: write - no filename 2024-09-13T23:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:3/39: fsync - no filename 2024-09-13T23:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:6/68: read f3 [639810,117268] 0 2024-09-13T23:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:6/69: creat d4/f12 x:0 0 0 2024-09-13T23:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:2/56: creat da/de/f12 x:0 0 0 2024-09-13T23:06:05.697 INFO:tasks.workunit.client.0.smithi115.stdout:2/57: stat da 0 2024-09-13T23:06:05.699 INFO:tasks.workunit.client.0.smithi115.stdout:5/7: rename c0 to c1 0 2024-09-13T23:06:05.700 INFO:tasks.workunit.client.0.smithi115.stdout:7/22: unlink f8 0 2024-09-13T23:06:05.701 INFO:tasks.workunit.client.0.smithi115.stdout:4/101: symlink db/d19/l20 0 2024-09-13T23:06:05.701 INFO:tasks.workunit.client.0.smithi115.stdout:9/17: symlink d0/l7 0 2024-09-13T23:06:05.702 INFO:tasks.workunit.client.0.smithi115.stdout:8/7: creat f2 x:0 0 0 2024-09-13T23:06:05.703 INFO:tasks.workunit.client.0.smithi115.stdout:3/40: rmdir d3 39 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:0/18: rmdir d6 39 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:9/18: creat d0/f8 x:0 0 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:8/8: mkdir d3 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:4/102: dread db/f10 [0,4194304] 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:0/19: write f2 [401525,12161] 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:0/20: write d6/f7 [849997,20477] 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:9/19: creat d0/f9 x:0 0 0 2024-09-13T23:06:05.709 INFO:tasks.workunit.client.0.smithi115.stdout:3/41: getdents d3 0 2024-09-13T23:06:05.710 INFO:tasks.workunit.client.0.smithi115.stdout:4/103: truncate f9 3825386 0 2024-09-13T23:06:05.712 INFO:tasks.workunit.client.0.smithi115.stdout:8/9: creat d3/f4 x:0 0 0 2024-09-13T23:06:05.712 INFO:tasks.workunit.client.0.smithi115.stdout:6/70: dread f0 [0,4194304] 0 2024-09-13T23:06:05.712 INFO:tasks.workunit.client.0.smithi115.stdout:6/71: stat f0 0 2024-09-13T23:06:05.714 INFO:tasks.workunit.client.0.smithi115.stdout:3/42: symlink d3/d5/db/ld 0 2024-09-13T23:06:05.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/20: rename d0/c5 to d0/ca 0 2024-09-13T23:06:05.715 INFO:tasks.workunit.client.0.smithi115.stdout:3/43: dread - no filename 2024-09-13T23:06:05.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/21: readlink d0/l7 0 2024-09-13T23:06:05.715 INFO:tasks.workunit.client.0.smithi115.stdout:8/10: unlink d3/f4 0 2024-09-13T23:06:05.716 INFO:tasks.workunit.client.0.smithi115.stdout:6/72: symlink d4/df/l13 0 2024-09-13T23:06:05.716 INFO:tasks.workunit.client.0.smithi115.stdout:6/73: write f3 [2016704,52127] 0 2024-09-13T23:06:05.716 INFO:tasks.workunit.client.0.smithi115.stdout:7/23: dread f2 [8388608,4194304] 0 2024-09-13T23:06:05.718 INFO:tasks.workunit.client.0.smithi115.stdout:3/44: symlink d3/d5/db/le 0 2024-09-13T23:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:9/22: symlink d0/lb 0 2024-09-13T23:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:9/23: chown d0/l7 7169759 1 2024-09-13T23:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:9/24: stat d0 0 2024-09-13T23:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:8/11: mkdir d3/d5 0 2024-09-13T23:06:05.719 INFO:tasks.workunit.client.0.smithi115.stdout:8/12: readlink - no filename 2024-09-13T23:06:05.720 INFO:tasks.workunit.client.0.smithi115.stdout:6/74: stat d4/l10 0 2024-09-13T23:06:05.720 INFO:tasks.workunit.client.0.smithi115.stdout:7/24: mknod c9 0 2024-09-13T23:06:05.721 INFO:tasks.workunit.client.0.smithi115.stdout:3/45: mknod d3/d5/cf 0 2024-09-13T23:06:05.721 INFO:tasks.workunit.client.0.smithi115.stdout:3/46: chown d3/c4 15 1 2024-09-13T23:06:05.721 INFO:tasks.workunit.client.0.smithi115.stdout:3/47: dread - no filename 2024-09-13T23:06:05.722 INFO:tasks.workunit.client.0.smithi115.stdout:1/37: dwrite d0/f1 [4194304,4194304] 0 2024-09-13T23:06:05.722 INFO:tasks.workunit.client.0.smithi115.stdout:1/38: dread - d0/f6 zero size 2024-09-13T23:06:05.723 INFO:tasks.workunit.client.0.smithi115.stdout:9/25: symlink d0/lc 0 2024-09-13T23:06:05.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/13: link c0 d3/d5/c6 0 2024-09-13T23:06:05.729 INFO:tasks.workunit.client.0.smithi115.stdout:6/75: unlink f0 0 2024-09-13T23:06:05.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/48: unlink d3/d5/l6 0 2024-09-13T23:06:05.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/49: rename d3/d5/db to d3/d5/db/d10 22 2024-09-13T23:06:05.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/14: mkdir d3/d5/d7 0 2024-09-13T23:06:05.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/15: truncate f2 415081 0 2024-09-13T23:06:05.734 INFO:tasks.workunit.client.0.smithi115.stdout:6/76: unlink d4/l11 0 2024-09-13T23:06:05.735 INFO:tasks.workunit.client.0.smithi115.stdout:8/16: dread f2 [0,4194304] 0 2024-09-13T23:06:05.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/50: symlink d3/l11 0 2024-09-13T23:06:05.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/51: truncate - no filename 2024-09-13T23:06:05.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/52: truncate - no filename 2024-09-13T23:06:05.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/53: write - no filename 2024-09-13T23:06:05.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/54: mknod d3/c12 0 2024-09-13T23:06:05.737 INFO:tasks.workunit.client.0.smithi115.stdout:3/55: fsync - no filename 2024-09-13T23:06:05.737 INFO:tasks.workunit.client.0.smithi115.stdout:3/56: readlink d3/la 0 2024-09-13T23:06:05.739 INFO:tasks.workunit.client.0.smithi115.stdout:3/57: creat d3/f13 x:0 0 0 2024-09-13T23:06:05.739 INFO:tasks.workunit.client.0.smithi115.stdout:2/58: dwrite da/f11 [0,4194304] 0 2024-09-13T23:06:05.739 INFO:tasks.workunit.client.0.smithi115.stdout:3/58: rmdir d3/d5/db 39 2024-09-13T23:06:05.740 INFO:tasks.workunit.client.0.smithi115.stdout:2/59: truncate f7 527955 0 2024-09-13T23:06:05.741 INFO:tasks.workunit.client.0.smithi115.stdout:1/39: write d0/f2 [2009597,108131] 0 2024-09-13T23:06:05.742 INFO:tasks.workunit.client.0.smithi115.stdout:0/21: dwrite f3 [0,4194304] 0 2024-09-13T23:06:05.744 INFO:tasks.workunit.client.0.smithi115.stdout:4/104: dwrite f1 [0,4194304] 0 2024-09-13T23:06:05.744 INFO:tasks.workunit.client.0.smithi115.stdout:7/25: dwrite f2 [0,4194304] 0 2024-09-13T23:06:05.750 INFO:tasks.workunit.client.0.smithi115.stdout:4/105: unlink db/d11/f14 0 2024-09-13T23:06:05.750 INFO:tasks.workunit.client.0.smithi115.stdout:4/106: write f9 [2118192,10055] 0 2024-09-13T23:06:05.750 INFO:tasks.workunit.client.0.smithi115.stdout:4/107: symlink db/l21 0 2024-09-13T23:06:05.754 INFO:tasks.workunit.client.0.smithi115.stdout:7/26: dread f2 [0,4194304] 0 2024-09-13T23:06:05.756 INFO:tasks.workunit.client.0.smithi115.stdout:7/27: mkdir da 0 2024-09-13T23:06:05.756 INFO:tasks.workunit.client.0.smithi115.stdout:7/28: write f2 [13572227,123917] 0 2024-09-13T23:06:05.763 INFO:tasks.workunit.client.0.smithi115.stdout:3/59: dwrite d3/f13 [0,4194304] 0 2024-09-13T23:06:05.764 INFO:tasks.workunit.client.0.smithi115.stdout:8/17: dwrite f2 [0,4194304] 0 2024-09-13T23:06:05.767 INFO:tasks.workunit.client.0.smithi115.stdout:7/29: dread f2 [8388608,4194304] 0 2024-09-13T23:06:05.770 INFO:tasks.workunit.client.0.smithi115.stdout:7/30: mknod da/cb 0 2024-09-13T23:06:05.770 INFO:tasks.workunit.client.0.smithi115.stdout:7/31: creat da/fc x:0 0 0 2024-09-13T23:06:05.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/32: dread f2 [0,4194304] 0 2024-09-13T23:06:05.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/33: chown l0 1 1 2024-09-13T23:06:05.775 INFO:tasks.workunit.client.0.smithi115.stdout:7/34: mkdir da/dd 0 2024-09-13T23:06:05.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/60: write da/f11 [4104860,114397] 0 2024-09-13T23:06:05.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/61: write da/f11 [2265098,124532] 0 2024-09-13T23:06:05.780 INFO:tasks.workunit.client.0.smithi115.stdout:2/62: mknod da/de/c13 0 2024-09-13T23:06:05.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/63: link c5 da/dd/c14 0 2024-09-13T23:06:05.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/22: dwrite f2 [0,4194304] 0 2024-09-13T23:06:05.784 INFO:tasks.workunit.client.0.smithi115.stdout:1/40: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:05.784 INFO:tasks.workunit.client.0.smithi115.stdout:2/64: rename f1 to da/f15 0 2024-09-13T23:06:05.785 INFO:tasks.workunit.client.0.smithi115.stdout:3/60: dwrite d3/f13 [0,4194304] 0 2024-09-13T23:06:05.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/23: link f2 d6/f9 0 2024-09-13T23:06:05.788 INFO:tasks.workunit.client.0.smithi115.stdout:4/108: dwrite f2 [0,4194304] 0 2024-09-13T23:06:05.788 INFO:tasks.workunit.client.0.smithi115.stdout:4/109: readlink l4 0 2024-09-13T23:06:05.788 INFO:tasks.workunit.client.0.smithi115.stdout:4/110: truncate f5 4743622 0 2024-09-13T23:06:05.791 INFO:tasks.workunit.client.0.smithi115.stdout:3/61: mknod d3/d5/c14 0 2024-09-13T23:06:05.793 INFO:tasks.workunit.client.0.smithi115.stdout:0/24: rename f3 to d6/fa 0 2024-09-13T23:06:05.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/41: symlink d0/lb 0 2024-09-13T23:06:05.795 INFO:tasks.workunit.client.0.smithi115.stdout:3/62: link d3/d5/l8 d3/d5/l15 0 2024-09-13T23:06:05.796 INFO:tasks.workunit.client.0.smithi115.stdout:4/111: rmdir db/dd 39 2024-09-13T23:06:05.797 INFO:tasks.workunit.client.0.smithi115.stdout:4/112: creat db/d19/d1d/f22 x:0 0 0 2024-09-13T23:06:05.799 INFO:tasks.workunit.client.0.smithi115.stdout:7/35: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:05.799 INFO:tasks.workunit.client.0.smithi115.stdout:1/42: link d0/f9 d0/fc 0 2024-09-13T23:06:05.801 INFO:tasks.workunit.client.0.smithi115.stdout:4/113: link db/l21 db/l23 0 2024-09-13T23:06:05.802 INFO:tasks.workunit.client.0.smithi115.stdout:7/36: symlink da/dd/le 0 2024-09-13T23:06:05.802 INFO:tasks.workunit.client.0.smithi115.stdout:7/37: truncate f2 13905232 0 2024-09-13T23:06:05.802 INFO:tasks.workunit.client.0.smithi115.stdout:7/38: chown da 8 1 2024-09-13T23:06:05.804 INFO:tasks.workunit.client.0.smithi115.stdout:0/25: dread d6/fa [0,4194304] 0 2024-09-13T23:06:05.804 INFO:tasks.workunit.client.0.smithi115.stdout:0/26: chown d6 413 1 2024-09-13T23:06:05.805 INFO:tasks.workunit.client.0.smithi115.stdout:0/27: creat d6/fb x:0 0 0 2024-09-13T23:06:05.805 INFO:tasks.workunit.client.0.smithi115.stdout:0/28: truncate d6/fb 737201 0 2024-09-13T23:06:05.806 INFO:tasks.workunit.client.0.smithi115.stdout:0/29: link d6/c8 d6/cc 0 2024-09-13T23:06:05.807 INFO:tasks.workunit.client.0.smithi115.stdout:0/30: rename d6/f7 to d6/fd 0 2024-09-13T23:06:05.807 INFO:tasks.workunit.client.0.smithi115.stdout:0/31: creat d6/fe x:0 0 0 2024-09-13T23:06:05.808 INFO:tasks.workunit.client.0.smithi115.stdout:0/32: creat d6/ff x:0 0 0 2024-09-13T23:06:05.809 INFO:tasks.workunit.client.0.smithi115.stdout:0/33: creat d6/f10 x:0 0 0 2024-09-13T23:06:05.809 INFO:tasks.workunit.client.0.smithi115.stdout:0/34: chown d6/fb 0 1 2024-09-13T23:06:05.809 INFO:tasks.workunit.client.0.smithi115.stdout:0/35: chown d6/c8 1936 1 2024-09-13T23:06:05.809 INFO:tasks.workunit.client.0.smithi115.stdout:4/114: write fa [2263804,102557] 0 2024-09-13T23:06:05.812 INFO:tasks.workunit.client.0.smithi115.stdout:3/63: dwrite d3/f13 [0,4194304] 0 2024-09-13T23:06:05.814 INFO:tasks.workunit.client.0.smithi115.stdout:3/64: unlink d3/f13 0 2024-09-13T23:06:05.814 INFO:tasks.workunit.client.0.smithi115.stdout:3/65: chown d3/d5/db 59 1 2024-09-13T23:06:05.843 INFO:tasks.workunit.client.0.smithi115.stdout:1/43: dwrite d0/f1 [0,4194304] 0 2024-09-13T23:06:05.844 INFO:tasks.workunit.client.0.smithi115.stdout:1/44: write d0/f9 [1048195,18902] 0 2024-09-13T23:06:05.845 INFO:tasks.workunit.client.0.smithi115.stdout:1/45: mkdir d0/dd 0 2024-09-13T23:06:05.845 INFO:tasks.workunit.client.0.smithi115.stdout:1/46: write d0/fc [1390929,95460] 0 2024-09-13T23:06:05.846 INFO:tasks.workunit.client.0.smithi115.stdout:1/47: mkdir d0/de 0 2024-09-13T23:06:05.849 INFO:tasks.workunit.client.0.smithi115.stdout:7/39: dwrite f2 [8388608,4194304] 0 2024-09-13T23:06:05.849 INFO:tasks.workunit.client.0.smithi115.stdout:7/40: write da/fc [854174,14747] 0 2024-09-13T23:06:05.850 INFO:tasks.workunit.client.0.smithi115.stdout:4/115: dwrite f1 [0,4194304] 0 2024-09-13T23:06:05.850 INFO:tasks.workunit.client.0.smithi115.stdout:0/36: dwrite d6/f10 [0,4194304] 0 2024-09-13T23:06:05.851 INFO:tasks.workunit.client.0.smithi115.stdout:3/66: getdents d3/d5 0 2024-09-13T23:06:05.851 INFO:tasks.workunit.client.0.smithi115.stdout:3/67: write - no filename 2024-09-13T23:06:05.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/37: dread d6/fa [0,4194304] 0 2024-09-13T23:06:05.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/38: creat d6/f11 x:0 0 0 2024-09-13T23:06:05.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/39: chown d6/ff 0 1 2024-09-13T23:06:05.856 INFO:tasks.workunit.client.0.smithi115.stdout:0/40: creat d6/f12 x:0 0 0 2024-09-13T23:06:05.860 INFO:tasks.workunit.client.0.smithi115.stdout:7/41: dread da/fc [0,4194304] 0 2024-09-13T23:06:05.860 INFO:tasks.workunit.client.0.smithi115.stdout:7/42: chown c3 110092698 1 2024-09-13T23:06:05.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/68: mkdir d3/d16 0 2024-09-13T23:06:05.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/69: read - no filename 2024-09-13T23:06:05.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/43: mkdir da/df 0 2024-09-13T23:06:05.866 INFO:tasks.workunit.client.0.smithi115.stdout:3/70: creat d3/d5/db/f17 x:0 0 0 2024-09-13T23:06:05.867 INFO:tasks.workunit.client.0.smithi115.stdout:3/71: rename d3/d5/db/ld to d3/d5/l18 0 2024-09-13T23:06:05.868 INFO:tasks.workunit.client.0.smithi115.stdout:3/72: creat d3/d16/f19 x:0 0 0 2024-09-13T23:06:05.869 INFO:tasks.workunit.client.0.smithi115.stdout:3/73: mkdir d3/d16/d1a 0 2024-09-13T23:06:05.869 INFO:tasks.workunit.client.0.smithi115.stdout:3/74: creat d3/f1b x:0 0 0 2024-09-13T23:06:05.870 INFO:tasks.workunit.client.0.smithi115.stdout:1/48: dwrite d0/fc [0,4194304] 0 2024-09-13T23:06:05.873 INFO:tasks.workunit.client.0.smithi115.stdout:4/116: dwrite db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:05.873 INFO:tasks.workunit.client.0.smithi115.stdout:4/117: write fa [2532491,18636] 0 2024-09-13T23:06:05.873 INFO:tasks.workunit.client.0.smithi115.stdout:1/49: mknod d0/cf 0 2024-09-13T23:06:05.876 INFO:tasks.workunit.client.0.smithi115.stdout:4/118: creat db/dd/d17/f24 x:0 0 0 2024-09-13T23:06:05.877 INFO:tasks.workunit.client.0.smithi115.stdout:1/50: creat d0/dd/f10 x:0 0 0 2024-09-13T23:06:05.877 INFO:tasks.workunit.client.0.smithi115.stdout:1/51: chown d0/l8 40290 1 2024-09-13T23:06:05.879 INFO:tasks.workunit.client.0.smithi115.stdout:4/119: unlink c8 0 2024-09-13T23:06:05.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/120: mknod db/d16/c25 0 2024-09-13T23:06:05.882 INFO:tasks.workunit.client.0.smithi115.stdout:1/52: rename d0/c4 to d0/c11 0 2024-09-13T23:06:05.882 INFO:tasks.workunit.client.0.smithi115.stdout:1/53: creat d0/dd/f12 x:0 0 0 2024-09-13T23:06:05.882 INFO:tasks.workunit.client.0.smithi115.stdout:1/54: write d0/dd/f12 [898445,103368] 0 2024-09-13T23:06:05.882 INFO:tasks.workunit.client.0.smithi115.stdout:1/55: getdents d0/de 0 2024-09-13T23:06:05.883 INFO:tasks.workunit.client.0.smithi115.stdout:4/121: link db/d19/d1d/c1e db/d19/d1d/c26 0 2024-09-13T23:06:05.885 INFO:tasks.workunit.client.0.smithi115.stdout:1/56: truncate d0/f3 2840730 0 2024-09-13T23:06:05.885 INFO:tasks.workunit.client.0.smithi115.stdout:1/57: chown d0/dd 15365088 1 2024-09-13T23:06:05.887 INFO:tasks.workunit.client.0.smithi115.stdout:4/122: rename f2 to db/d19/f27 0 2024-09-13T23:06:05.887 INFO:tasks.workunit.client.0.smithi115.stdout:3/75: dwrite d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:05.888 INFO:tasks.workunit.client.0.smithi115.stdout:3/76: truncate d3/d5/db/f17 789599 0 2024-09-13T23:06:05.888 INFO:tasks.workunit.client.0.smithi115.stdout:0/41: rmdir d6 39 2024-09-13T23:06:05.888 INFO:tasks.workunit.client.0.smithi115.stdout:7/44: getdents da 0 2024-09-13T23:06:05.889 INFO:tasks.workunit.client.0.smithi115.stdout:1/58: truncate d0/f1 5751024 0 2024-09-13T23:06:05.891 INFO:tasks.workunit.client.0.smithi115.stdout:4/123: rename db/dd/l13 to db/d11/l28 0 2024-09-13T23:06:05.891 INFO:tasks.workunit.client.0.smithi115.stdout:4/124: fdatasync f9 0 2024-09-13T23:06:05.891 INFO:tasks.workunit.client.0.smithi115.stdout:4/125: write db/f10 [365826,109641] 0 2024-09-13T23:06:05.893 INFO:tasks.workunit.client.0.smithi115.stdout:3/77: mkdir d3/d16/d1c 0 2024-09-13T23:06:05.894 INFO:tasks.workunit.client.0.smithi115.stdout:0/42: creat d6/f13 x:0 0 0 2024-09-13T23:06:05.895 INFO:tasks.workunit.client.0.smithi115.stdout:7/45: rmdir da 39 2024-09-13T23:06:05.902 INFO:tasks.workunit.client.0.smithi115.stdout:1/59: truncate d0/f5 6282392 0 2024-09-13T23:06:05.902 INFO:tasks.workunit.client.0.smithi115.stdout:3/78: write d3/d16/f19 [382311,109725] 0 2024-09-13T23:06:05.903 INFO:tasks.workunit.client.0.smithi115.stdout:7/46: read f2 [5452240,120511] 0 2024-09-13T23:06:05.903 INFO:tasks.workunit.client.0.smithi115.stdout:7/47: fsync da/fc 0 2024-09-13T23:06:05.905 INFO:tasks.workunit.client.0.smithi115.stdout:0/43: rmdir d6 39 2024-09-13T23:06:05.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/44: mknod d6/c14 0 2024-09-13T23:06:05.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/45: truncate d6/fe 469515 0 2024-09-13T23:06:05.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/46: write d6/f13 [316302,65524] 0 2024-09-13T23:06:05.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/47: mknod d6/c15 0 2024-09-13T23:06:05.909 INFO:tasks.workunit.client.0.smithi115.stdout:0/48: rename d6/c8 to d6/c16 0 2024-09-13T23:06:05.910 INFO:tasks.workunit.client.0.smithi115.stdout:0/49: chown d6/fa 117907502 1 2024-09-13T23:06:05.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/60: write d0/fc [3685100,38810] 0 2024-09-13T23:06:05.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/61: creat d0/dd/f13 x:0 0 0 2024-09-13T23:06:05.913 INFO:tasks.workunit.client.0.smithi115.stdout:1/62: mkdir d0/d14 0 2024-09-13T23:06:05.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/63: rename d0/lb to d0/l15 0 2024-09-13T23:06:05.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/64: stat d0/dd/f13 0 2024-09-13T23:06:05.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/65: truncate d0/dd/f12 2014524 0 2024-09-13T23:06:05.915 INFO:tasks.workunit.client.0.smithi115.stdout:1/66: symlink d0/l16 0 2024-09-13T23:06:05.922 INFO:tasks.workunit.client.0.smithi115.stdout:3/79: dwrite d3/f1b [0,4194304] 0 2024-09-13T23:06:05.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/50: read d6/f9 [1917525,14478] 0 2024-09-13T23:06:05.925 INFO:tasks.workunit.client.0.smithi115.stdout:0/51: mknod d6/c17 0 2024-09-13T23:06:05.925 INFO:tasks.workunit.client.0.smithi115.stdout:0/52: chown d6/c17 30931 1 2024-09-13T23:06:05.925 INFO:tasks.workunit.client.0.smithi115.stdout:1/67: write d0/f2 [3218347,67084] 0 2024-09-13T23:06:05.925 INFO:tasks.workunit.client.0.smithi115.stdout:1/68: write d0/f6 [628981,8939] 0 2024-09-13T23:06:05.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/53: rename d6/c17 to d6/c18 0 2024-09-13T23:06:05.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/54: write f2 [4387085,113063] 0 2024-09-13T23:06:05.926 INFO:tasks.workunit.client.0.smithi115.stdout:5/8: sync 2024-09-13T23:06:05.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/9: write - no filename 2024-09-13T23:06:05.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/10: fsync - no filename 2024-09-13T23:06:05.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/11: write - no filename 2024-09-13T23:06:05.927 INFO:tasks.workunit.client.0.smithi115.stdout:5/12: dread - no filename 2024-09-13T23:06:05.928 INFO:tasks.workunit.client.0.smithi115.stdout:3/80: dread d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:05.928 INFO:tasks.workunit.client.0.smithi115.stdout:3/81: chown d3/d5/l15 105695930 1 2024-09-13T23:06:05.928 INFO:tasks.workunit.client.0.smithi115.stdout:3/82: chown d3/f1b 181 1 2024-09-13T23:06:05.929 INFO:tasks.workunit.client.0.smithi115.stdout:3/83: readlink d3/l11 0 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/13: unlink c1 0 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/14: chown . 128081 1 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/15: dread - no filename 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/16: chown . 1085 1 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/17: symlink l2 0 2024-09-13T23:06:05.932 INFO:tasks.workunit.client.0.smithi115.stdout:5/18: dread - no filename 2024-09-13T23:06:05.933 INFO:tasks.workunit.client.0.smithi115.stdout:5/19: fsync - no filename 2024-09-13T23:06:05.933 INFO:tasks.workunit.client.0.smithi115.stdout:1/69: write d0/f5 [1273510,28844] 0 2024-09-13T23:06:05.934 INFO:tasks.workunit.client.0.smithi115.stdout:0/55: truncate d6/f9 3232382 0 2024-09-13T23:06:05.936 INFO:tasks.workunit.client.0.smithi115.stdout:5/20: symlink l3 0 2024-09-13T23:06:05.936 INFO:tasks.workunit.client.0.smithi115.stdout:5/21: write - no filename 2024-09-13T23:06:05.936 INFO:tasks.workunit.client.0.smithi115.stdout:5/22: dread - no filename 2024-09-13T23:06:05.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/70: symlink d0/de/l17 0 2024-09-13T23:06:05.938 INFO:tasks.workunit.client.0.smithi115.stdout:0/56: creat d6/f19 x:0 0 0 2024-09-13T23:06:05.939 INFO:tasks.workunit.client.0.smithi115.stdout:5/23: symlink l4 0 2024-09-13T23:06:05.939 INFO:tasks.workunit.client.0.smithi115.stdout:5/24: stat l4 0 2024-09-13T23:06:05.939 INFO:tasks.workunit.client.0.smithi115.stdout:5/25: chown l4 165 1 2024-09-13T23:06:05.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/71: mknod d0/dd/c18 0 2024-09-13T23:06:05.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/72: write d0/f2 [3177856,54382] 0 2024-09-13T23:06:05.940 INFO:tasks.workunit.client.0.smithi115.stdout:1/73: write d0/dd/f13 [106029,73094] 0 2024-09-13T23:06:05.940 INFO:tasks.workunit.client.0.smithi115.stdout:5/26: creat f5 x:0 0 0 2024-09-13T23:06:05.940 INFO:tasks.workunit.client.0.smithi115.stdout:5/27: chown l4 3 1 2024-09-13T23:06:05.940 INFO:tasks.workunit.client.0.smithi115.stdout:5/28: stat l3 0 2024-09-13T23:06:05.943 INFO:tasks.workunit.client.0.smithi115.stdout:5/29: symlink l6 0 2024-09-13T23:06:05.943 INFO:tasks.workunit.client.0.smithi115.stdout:5/30: stat l3 0 2024-09-13T23:06:05.943 INFO:tasks.workunit.client.0.smithi115.stdout:5/31: creat f7 x:0 0 0 2024-09-13T23:06:05.945 INFO:tasks.workunit.client.0.smithi115.stdout:5/32: mkdir d8 0 2024-09-13T23:06:05.947 INFO:tasks.workunit.client.0.smithi115.stdout:5/33: creat d8/f9 x:0 0 0 2024-09-13T23:06:05.947 INFO:tasks.workunit.client.0.smithi115.stdout:5/34: write f7 [688430,106662] 0 2024-09-13T23:06:05.947 INFO:tasks.workunit.client.0.smithi115.stdout:5/35: fdatasync f5 0 2024-09-13T23:06:05.947 INFO:tasks.workunit.client.0.smithi115.stdout:5/36: creat d8/fa x:0 0 0 2024-09-13T23:06:05.947 INFO:tasks.workunit.client.0.smithi115.stdout:5/37: write f5 [396818,80812] 0 2024-09-13T23:06:05.949 INFO:tasks.workunit.client.0.smithi115.stdout:5/38: unlink f7 0 2024-09-13T23:06:05.949 INFO:tasks.workunit.client.0.smithi115.stdout:5/39: creat d8/fb x:0 0 0 2024-09-13T23:06:05.966 INFO:tasks.workunit.client.0.smithi115.stdout:1/74: dwrite d0/f3 [0,4194304] 0 2024-09-13T23:06:05.966 INFO:tasks.workunit.client.0.smithi115.stdout:1/75: write d0/f1 [903851,49659] 0 2024-09-13T23:06:05.967 INFO:tasks.workunit.client.0.smithi115.stdout:5/40: fsync f5 0 2024-09-13T23:06:05.967 INFO:tasks.workunit.client.0.smithi115.stdout:0/57: dwrite d6/f9 [0,4194304] 0 2024-09-13T23:06:05.967 INFO:tasks.workunit.client.0.smithi115.stdout:0/58: read - d6/ff zero size 2024-09-13T23:06:05.980 INFO:tasks.workunit.client.0.smithi115.stdout:1/76: write d0/f3 [1355028,55469] 0 2024-09-13T23:06:05.982 INFO:tasks.workunit.client.0.smithi115.stdout:1/77: rmdir d0 39 2024-09-13T23:06:05.983 INFO:tasks.workunit.client.0.smithi115.stdout:1/78: truncate d0/dd/f12 597804 0 2024-09-13T23:06:05.984 INFO:tasks.workunit.client.0.smithi115.stdout:1/79: rmdir d0/dd 39 2024-09-13T23:06:05.984 INFO:tasks.workunit.client.0.smithi115.stdout:1/80: chown d0/dd/f12 1825750 1 2024-09-13T23:06:05.986 INFO:tasks.workunit.client.0.smithi115.stdout:5/41: dwrite f5 [0,4194304] 0 2024-09-13T23:06:05.986 INFO:tasks.workunit.client.0.smithi115.stdout:5/42: chown d8 169721548 1 2024-09-13T23:06:05.988 INFO:tasks.workunit.client.0.smithi115.stdout:1/81: dread d0/f6 [0,4194304] 0 2024-09-13T23:06:05.989 INFO:tasks.workunit.client.0.smithi115.stdout:1/82: creat d0/de/f19 x:0 0 0 2024-09-13T23:06:05.989 INFO:tasks.workunit.client.0.smithi115.stdout:1/83: mkdir d0/de/d1a 0 2024-09-13T23:06:05.998 INFO:tasks.workunit.client.0.smithi115.stdout:0/59: dwrite d6/f9 [4194304,4194304] 0 2024-09-13T23:06:06.001 INFO:tasks.workunit.client.0.smithi115.stdout:0/60: mknod d6/c1a 0 2024-09-13T23:06:06.002 INFO:tasks.workunit.client.0.smithi115.stdout:0/61: creat d6/f1b x:0 0 0 2024-09-13T23:06:06.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/43: dread f5 [0,4194304] 0 2024-09-13T23:06:06.003 INFO:tasks.workunit.client.0.smithi115.stdout:1/84: read d0/dd/f12 [534030,92988] 0 2024-09-13T23:06:06.003 INFO:tasks.workunit.client.0.smithi115.stdout:5/44: rename l3 to d8/lc 0 2024-09-13T23:06:06.004 INFO:tasks.workunit.client.0.smithi115.stdout:5/45: truncate d8/fb 438664 0 2024-09-13T23:06:06.004 INFO:tasks.workunit.client.0.smithi115.stdout:1/85: mkdir d0/de/d1b 0 2024-09-13T23:06:06.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/46: mkdir d8/dd 0 2024-09-13T23:06:06.005 INFO:tasks.workunit.client.0.smithi115.stdout:0/62: dread d6/fa [0,4194304] 0 2024-09-13T23:06:06.006 INFO:tasks.workunit.client.0.smithi115.stdout:0/63: write d6/fe [51243,129228] 0 2024-09-13T23:06:06.006 INFO:tasks.workunit.client.0.smithi115.stdout:0/64: creat d6/f1c x:0 0 0 2024-09-13T23:06:06.006 INFO:tasks.workunit.client.0.smithi115.stdout:0/65: creat d6/f1d x:0 0 0 2024-09-13T23:06:06.006 INFO:tasks.workunit.client.0.smithi115.stdout:5/47: mknod d8/dd/ce 0 2024-09-13T23:06:06.008 INFO:tasks.workunit.client.0.smithi115.stdout:9/26: sync 2024-09-13T23:06:06.008 INFO:tasks.workunit.client.0.smithi115.stdout:6/77: sync 2024-09-13T23:06:06.009 INFO:tasks.workunit.client.0.smithi115.stdout:0/66: mknod d6/c1e 0 2024-09-13T23:06:06.009 INFO:tasks.workunit.client.0.smithi115.stdout:5/48: creat d8/dd/ff x:0 0 0 2024-09-13T23:06:06.011 INFO:tasks.workunit.client.0.smithi115.stdout:9/27: rename d0/f8 to d0/fd 0 2024-09-13T23:06:06.012 INFO:tasks.workunit.client.0.smithi115.stdout:6/78: mkdir d4/df/d14 0 2024-09-13T23:06:06.012 INFO:tasks.workunit.client.0.smithi115.stdout:6/79: dread - d4/f12 zero size 2024-09-13T23:06:06.013 INFO:tasks.workunit.client.0.smithi115.stdout:6/80: write d4/f12 [760479,16573] 0 2024-09-13T23:06:06.013 INFO:tasks.workunit.client.0.smithi115.stdout:9/28: dread d0/f4 [0,4194304] 0 2024-09-13T23:06:06.020 INFO:tasks.workunit.client.0.smithi115.stdout:6/81: dread f3 [0,4194304] 0 2024-09-13T23:06:06.021 INFO:tasks.workunit.client.0.smithi115.stdout:6/82: mknod d4/df/c15 0 2024-09-13T23:06:06.023 INFO:tasks.workunit.client.0.smithi115.stdout:6/83: getdents d4 0 2024-09-13T23:06:06.024 INFO:tasks.workunit.client.0.smithi115.stdout:1/86: dwrite d0/dd/f12 [0,4194304] 0 2024-09-13T23:06:06.024 INFO:tasks.workunit.client.0.smithi115.stdout:1/87: truncate d0/dd/f13 310996 0 2024-09-13T23:06:06.027 INFO:tasks.workunit.client.0.smithi115.stdout:6/84: dread f3 [0,4194304] 0 2024-09-13T23:06:06.030 INFO:tasks.workunit.client.0.smithi115.stdout:6/85: truncate f3 50769 0 2024-09-13T23:06:06.030 INFO:tasks.workunit.client.0.smithi115.stdout:6/86: rmdir d4 39 2024-09-13T23:06:06.032 INFO:tasks.workunit.client.0.smithi115.stdout:6/87: mknod d4/df/c16 0 2024-09-13T23:06:06.033 INFO:tasks.workunit.client.0.smithi115.stdout:0/67: truncate f2 3176268 0 2024-09-13T23:06:06.035 INFO:tasks.workunit.client.0.smithi115.stdout:0/68: rename d6/c18 to d6/c1f 0 2024-09-13T23:06:06.035 INFO:tasks.workunit.client.0.smithi115.stdout:0/69: creat d6/f20 x:0 0 0 2024-09-13T23:06:06.036 INFO:tasks.workunit.client.0.smithi115.stdout:0/70: mknod d6/c21 0 2024-09-13T23:06:06.037 INFO:tasks.workunit.client.0.smithi115.stdout:0/71: rename d6/c15 to d6/c22 0 2024-09-13T23:06:06.040 INFO:tasks.workunit.client.0.smithi115.stdout:1/88: write d0/dd/f12 [3556617,127592] 0 2024-09-13T23:06:06.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/89: mknod d0/c1c 0 2024-09-13T23:06:06.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/90: write d0/de/f19 [626633,28489] 0 2024-09-13T23:06:06.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/91: write d0/dd/f12 [542582,112968] 0 2024-09-13T23:06:06.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/29: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:06.044 INFO:tasks.workunit.client.0.smithi115.stdout:5/49: dwrite d8/fa [0,4194304] 0 2024-09-13T23:06:06.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:05 smithi115 ceph-mon[27601]: pgmap v241: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 16 MiB/s wr, 892 op/s 2024-09-13T23:06:06.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/30: read d0/f2 [1123778,53835] 0 2024-09-13T23:06:06.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/31: link d0/lb d0/le 0 2024-09-13T23:06:06.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/32: readlink d0/lb 0 2024-09-13T23:06:06.058 INFO:tasks.workunit.client.0.smithi115.stdout:9/33: link d0/lc d0/lf 0 2024-09-13T23:06:06.058 INFO:tasks.workunit.client.0.smithi115.stdout:9/34: write d0/f4 [944998,67467] 0 2024-09-13T23:06:06.059 INFO:tasks.workunit.client.0.smithi115.stdout:1/92: dwrite d0/f6 [0,4194304] 0 2024-09-13T23:06:06.059 INFO:tasks.workunit.client.0.smithi115.stdout:6/88: dread f3 [0,4194304] 0 2024-09-13T23:06:06.061 INFO:tasks.workunit.client.0.smithi115.stdout:9/35: mknod d0/c10 0 2024-09-13T23:06:06.063 INFO:tasks.workunit.client.0.smithi115.stdout:6/89: mkdir d4/d17 0 2024-09-13T23:06:06.064 INFO:tasks.workunit.client.0.smithi115.stdout:9/36: mknod d0/c11 0 2024-09-13T23:06:06.064 INFO:tasks.workunit.client.0.smithi115.stdout:9/37: write d0/f2 [1043086,54396] 0 2024-09-13T23:06:06.064 INFO:tasks.workunit.client.0.smithi115.stdout:9/38: read - d0/f9 zero size 2024-09-13T23:06:06.065 INFO:tasks.workunit.client.0.smithi115.stdout:6/90: dread f3 [0,4194304] 0 2024-09-13T23:06:06.081 INFO:tasks.workunit.client.0.smithi115.stdout:0/72: dwrite d6/f9 [0,4194304] 0 2024-09-13T23:06:06.083 INFO:tasks.workunit.client.0.smithi115.stdout:0/73: mknod d6/c23 0 2024-09-13T23:06:06.083 INFO:tasks.workunit.client.0.smithi115.stdout:0/74: chown d6/c22 1356643 1 2024-09-13T23:06:06.084 INFO:tasks.workunit.client.0.smithi115.stdout:0/75: mkdir d6/d24 0 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:0/76: read - d6/f12 zero size 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:0/77: write d6/f10 [4195976,43803] 0 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:5/50: dwrite d8/dd/ff [0,4194304] 0 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:5/51: stat l6 0 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:0/78: chown d6/f1c 3 1 2024-09-13T23:06:06.085 INFO:tasks.workunit.client.0.smithi115.stdout:6/91: dwrite f3 [0,4194304] 0 2024-09-13T23:06:06.090 INFO:tasks.workunit.client.0.smithi115.stdout:0/79: mkdir d6/d24/d25 0 2024-09-13T23:06:06.091 INFO:tasks.workunit.client.0.smithi115.stdout:6/92: link d4/f12 d4/df/d14/f18 0 2024-09-13T23:06:06.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/52: write d8/fb [237771,52839] 0 2024-09-13T23:06:06.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/53: creat d8/dd/f10 x:0 0 0 2024-09-13T23:06:06.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/54: chown d8/lc 2264 1 2024-09-13T23:06:06.093 INFO:tasks.workunit.client.0.smithi115.stdout:5/55: readlink l2 0 2024-09-13T23:06:06.093 INFO:tasks.workunit.client.0.smithi115.stdout:0/80: rename d6/f1b to d6/d24/f26 0 2024-09-13T23:06:06.095 INFO:tasks.workunit.client.0.smithi115.stdout:6/93: mknod d4/df/d14/c19 0 2024-09-13T23:06:06.097 INFO:tasks.workunit.client.0.smithi115.stdout:5/56: symlink d8/l11 0 2024-09-13T23:06:06.098 INFO:tasks.workunit.client.0.smithi115.stdout:6/94: rmdir d4 39 2024-09-13T23:06:06.099 INFO:tasks.workunit.client.0.smithi115.stdout:4/126: sync 2024-09-13T23:06:06.100 INFO:tasks.workunit.client.0.smithi115.stdout:2/65: sync 2024-09-13T23:06:06.100 INFO:tasks.workunit.client.0.smithi115.stdout:3/84: sync 2024-09-13T23:06:06.100 INFO:tasks.workunit.client.0.smithi115.stdout:4/127: fsync f9 0 2024-09-13T23:06:06.101 INFO:tasks.workunit.client.0.smithi115.stdout:8/18: sync 2024-09-13T23:06:06.101 INFO:tasks.workunit.client.0.smithi115.stdout:6/95: mknod d4/df/c1a 0 2024-09-13T23:06:06.101 INFO:tasks.workunit.client.0.smithi115.stdout:6/96: read d4/df/d14/f18 [151847,6953] 0 2024-09-13T23:06:06.101 INFO:tasks.workunit.client.0.smithi115.stdout:7/48: sync 2024-09-13T23:06:06.101 INFO:tasks.workunit.client.0.smithi115.stdout:7/49: write f2 [5687964,25294] 0 2024-09-13T23:06:06.104 INFO:tasks.workunit.client.0.smithi115.stdout:2/66: rename da/dd to da/de/d16 0 2024-09-13T23:06:06.104 INFO:tasks.workunit.client.0.smithi115.stdout:4/128: rename db/d19 to db/d19/d1d/d29 22 2024-09-13T23:06:06.104 INFO:tasks.workunit.client.0.smithi115.stdout:4/129: write f5 [5342588,38593] 0 2024-09-13T23:06:06.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/19: truncate f2 1338278 0 2024-09-13T23:06:06.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/20: creat d3/f8 x:0 0 0 2024-09-13T23:06:06.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/21: readlink - no filename 2024-09-13T23:06:06.105 INFO:tasks.workunit.client.0.smithi115.stdout:6/97: creat d4/d17/f1b x:0 0 0 2024-09-13T23:06:06.105 INFO:tasks.workunit.client.0.smithi115.stdout:0/81: dread d6/f9 [0,4194304] 0 2024-09-13T23:06:06.106 INFO:tasks.workunit.client.0.smithi115.stdout:7/50: creat da/f10 x:0 0 0 2024-09-13T23:06:06.106 INFO:tasks.workunit.client.0.smithi115.stdout:4/130: mkdir db/d19/d1d/d2a 0 2024-09-13T23:06:06.106 INFO:tasks.workunit.client.0.smithi115.stdout:7/51: creat da/f11 x:0 0 0 2024-09-13T23:06:06.109 INFO:tasks.workunit.client.0.smithi115.stdout:6/98: creat d4/df/f1c x:0 0 0 2024-09-13T23:06:06.110 INFO:tasks.workunit.client.0.smithi115.stdout:4/131: truncate db/d15/f1f 1736228 0 2024-09-13T23:06:06.111 INFO:tasks.workunit.client.0.smithi115.stdout:7/52: mknod da/df/c12 0 2024-09-13T23:06:06.111 INFO:tasks.workunit.client.0.smithi115.stdout:7/53: chown c7 14656561 1 2024-09-13T23:06:06.112 INFO:tasks.workunit.client.0.smithi115.stdout:6/99: creat d4/f1d x:0 0 0 2024-09-13T23:06:06.113 INFO:tasks.workunit.client.0.smithi115.stdout:7/54: mkdir da/dd/d13 0 2024-09-13T23:06:06.113 INFO:tasks.workunit.client.0.smithi115.stdout:7/55: dread - da/f11 zero size 2024-09-13T23:06:06.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/100: unlink d4/le 0 2024-09-13T23:06:06.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/101: dread - d4/d17/f1b zero size 2024-09-13T23:06:06.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/102: read d4/df/d14/f18 [70422,36544] 0 2024-09-13T23:06:06.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/103: chown d4/df/l13 7114 1 2024-09-13T23:06:06.114 INFO:tasks.workunit.client.0.smithi115.stdout:6/104: write d4/f1d [63211,14322] 0 2024-09-13T23:06:06.115 INFO:tasks.workunit.client.0.smithi115.stdout:0/82: write d6/f9 [3580613,76462] 0 2024-09-13T23:06:06.115 INFO:tasks.workunit.client.0.smithi115.stdout:7/56: unlink da/f11 0 2024-09-13T23:06:06.116 INFO:tasks.workunit.client.0.smithi115.stdout:0/83: link d6/c21 d6/d24/d25/c27 0 2024-09-13T23:06:06.116 INFO:tasks.workunit.client.0.smithi115.stdout:0/84: rename d6/d24 to d6/d24/d28 22 2024-09-13T23:06:06.116 INFO:tasks.workunit.client.0.smithi115.stdout:0/85: dread - d6/f12 zero size 2024-09-13T23:06:06.120 INFO:tasks.workunit.client.0.smithi115.stdout:9/39: dwrite d0/f4 [0,4194304] 0 2024-09-13T23:06:06.120 INFO:tasks.workunit.client.0.smithi115.stdout:9/40: write d0/f9 [47437,110535] 0 2024-09-13T23:06:06.121 INFO:tasks.workunit.client.0.smithi115.stdout:1/93: dwrite d0/dd/f12 [0,4194304] 0 2024-09-13T23:06:06.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/94: link d0/dd/c18 d0/de/d1a/c1d 0 2024-09-13T23:06:06.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/95: truncate d0/dd/f13 794904 0 2024-09-13T23:06:06.126 INFO:tasks.workunit.client.0.smithi115.stdout:3/85: dwrite d3/f1b [4194304,4194304] 0 2024-09-13T23:06:06.128 INFO:tasks.workunit.client.0.smithi115.stdout:5/57: rmdir d8 39 2024-09-13T23:06:06.128 INFO:tasks.workunit.client.0.smithi115.stdout:3/86: dread d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:06.128 INFO:tasks.workunit.client.0.smithi115.stdout:5/58: truncate d8/fb 735317 0 2024-09-13T23:06:06.128 INFO:tasks.workunit.client.0.smithi115.stdout:5/59: dread - d8/f9 zero size 2024-09-13T23:06:06.129 INFO:tasks.workunit.client.0.smithi115.stdout:5/60: dread d8/fb [0,4194304] 0 2024-09-13T23:06:06.131 INFO:tasks.workunit.client.0.smithi115.stdout:8/22: truncate f2 1885790 0 2024-09-13T23:06:06.133 INFO:tasks.workunit.client.0.smithi115.stdout:4/132: dwrite db/dd/d17/f24 [0,4194304] 0 2024-09-13T23:06:06.134 INFO:tasks.workunit.client.0.smithi115.stdout:8/23: fsync d3/f8 0 2024-09-13T23:06:06.137 INFO:tasks.workunit.client.0.smithi115.stdout:3/87: truncate d3/d16/f19 386615 0 2024-09-13T23:06:06.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/61: getdents d8/dd 0 2024-09-13T23:06:06.141 INFO:tasks.workunit.client.0.smithi115.stdout:0/86: dwrite d6/fd [0,4194304] 0 2024-09-13T23:06:06.141 INFO:tasks.workunit.client.0.smithi115.stdout:5/62: dread d8/fb [0,4194304] 0 2024-09-13T23:06:06.142 INFO:tasks.workunit.client.0.smithi115.stdout:6/105: getdents d4 0 2024-09-13T23:06:06.145 INFO:tasks.workunit.client.0.smithi115.stdout:8/24: rmdir d3/d5/d7 0 2024-09-13T23:06:06.145 INFO:tasks.workunit.client.0.smithi115.stdout:8/25: read - d3/f8 zero size 2024-09-13T23:06:06.146 INFO:tasks.workunit.client.0.smithi115.stdout:7/57: rmdir da 39 2024-09-13T23:06:06.148 INFO:tasks.workunit.client.0.smithi115.stdout:4/133: dwrite fa [4194304,4194304] 0 2024-09-13T23:06:06.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/87: rename d6/f1d to d6/d24/d25/f29 0 2024-09-13T23:06:06.151 INFO:tasks.workunit.client.0.smithi115.stdout:3/88: write d3/f1b [913821,24304] 0 2024-09-13T23:06:06.151 INFO:tasks.workunit.client.0.smithi115.stdout:3/89: chown d3/d5/c14 9 1 2024-09-13T23:06:06.153 INFO:tasks.workunit.client.0.smithi115.stdout:8/26: rename c0 to d3/c9 0 2024-09-13T23:06:06.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/90: mknod d3/d16/d1c/c1d 0 2024-09-13T23:06:06.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/91: chown d3/f1b 214330023 1 2024-09-13T23:06:06.155 INFO:tasks.workunit.client.0.smithi115.stdout:7/58: truncate f2 8253034 0 2024-09-13T23:06:06.157 INFO:tasks.workunit.client.0.smithi115.stdout:8/27: creat d3/d5/fa x:0 0 0 2024-09-13T23:06:06.157 INFO:tasks.workunit.client.0.smithi115.stdout:8/28: dread - d3/f8 zero size 2024-09-13T23:06:06.159 INFO:tasks.workunit.client.0.smithi115.stdout:8/29: rename d3/f8 to d3/d5/fb 0 2024-09-13T23:06:06.159 INFO:tasks.workunit.client.0.smithi115.stdout:8/30: write d3/d5/fa [994942,95156] 0 2024-09-13T23:06:06.159 INFO:tasks.workunit.client.0.smithi115.stdout:8/31: chown d3/d5/fb 493878 1 2024-09-13T23:06:06.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/134: dread db/dd/d17/f24 [0,4194304] 0 2024-09-13T23:06:06.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/135: chown db/l21 0 1 2024-09-13T23:06:06.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/136: chown fa 1 1 2024-09-13T23:06:06.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/137: write fa [9127870,2915] 0 2024-09-13T23:06:06.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/138: readlink db/lf 0 2024-09-13T23:06:06.165 INFO:tasks.workunit.client.0.smithi115.stdout:0/88: write d6/fd [3627841,108221] 0 2024-09-13T23:06:06.170 INFO:tasks.workunit.client.0.smithi115.stdout:0/89: rmdir d6 39 2024-09-13T23:06:06.170 INFO:tasks.workunit.client.0.smithi115.stdout:8/32: dread f2 [0,4194304] 0 2024-09-13T23:06:06.172 INFO:tasks.workunit.client.0.smithi115.stdout:0/90: unlink d6/fe 0 2024-09-13T23:06:06.173 INFO:tasks.workunit.client.0.smithi115.stdout:8/33: mkdir d3/d5/dc 0 2024-09-13T23:06:06.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/34: read - d3/d5/fb zero size 2024-09-13T23:06:06.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/35: creat d3/fd x:0 0 0 2024-09-13T23:06:06.174 INFO:tasks.workunit.client.0.smithi115.stdout:8/36: write d3/d5/fb [314799,74771] 0 2024-09-13T23:06:06.174 INFO:tasks.workunit.client.0.smithi115.stdout:0/91: symlink d6/d24/l2a 0 2024-09-13T23:06:06.176 INFO:tasks.workunit.client.0.smithi115.stdout:7/59: read f2 [3633806,7605] 0 2024-09-13T23:06:06.177 INFO:tasks.workunit.client.0.smithi115.stdout:7/60: creat da/df/f14 x:0 0 0 2024-09-13T23:06:06.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/61: unlink c7 0 2024-09-13T23:06:06.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/62: chown da/dd/le 1 1 2024-09-13T23:06:06.179 INFO:tasks.workunit.client.0.smithi115.stdout:9/41: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T23:06:06.179 INFO:tasks.workunit.client.0.smithi115.stdout:9/42: stat d0/f2 0 2024-09-13T23:06:06.179 INFO:tasks.workunit.client.0.smithi115.stdout:9/43: write d0/f4 [9128811,81164] 0 2024-09-13T23:06:06.181 INFO:tasks.workunit.client.0.smithi115.stdout:6/106: dwrite f3 [0,4194304] 0 2024-09-13T23:06:06.181 INFO:tasks.workunit.client.0.smithi115.stdout:6/107: fdatasync f3 0 2024-09-13T23:06:06.182 INFO:tasks.workunit.client.0.smithi115.stdout:6/108: mknod d4/c1e 0 2024-09-13T23:06:06.182 INFO:tasks.workunit.client.0.smithi115.stdout:6/109: dread - d4/df/f1c zero size 2024-09-13T23:06:06.182 INFO:tasks.workunit.client.0.smithi115.stdout:6/110: dread - d4/df/f1c zero size 2024-09-13T23:06:06.182 INFO:tasks.workunit.client.0.smithi115.stdout:6/111: creat d4/df/f1f x:0 0 0 2024-09-13T23:06:06.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/63: dwrite d8/f9 [0,4194304] 0 2024-09-13T23:06:06.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/92: dwrite d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:06.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/93: readlink d3/l11 0 2024-09-13T23:06:06.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/94: chown d3/d5/cf 27452 1 2024-09-13T23:06:06.186 INFO:tasks.workunit.client.0.smithi115.stdout:6/112: mknod d4/d17/c20 0 2024-09-13T23:06:06.186 INFO:tasks.workunit.client.0.smithi115.stdout:6/113: write d4/df/f1c [422309,88078] 0 2024-09-13T23:06:06.187 INFO:tasks.workunit.client.0.smithi115.stdout:6/114: fdatasync d4/df/f1f 0 2024-09-13T23:06:06.194 INFO:tasks.workunit.client.0.smithi115.stdout:6/115: mknod d4/df/d14/c21 0 2024-09-13T23:06:06.195 INFO:tasks.workunit.client.0.smithi115.stdout:3/95: rmdir d3/d5/db 39 2024-09-13T23:06:06.197 INFO:tasks.workunit.client.0.smithi115.stdout:6/116: rename d4/df/l13 to d4/l22 0 2024-09-13T23:06:06.197 INFO:tasks.workunit.client.0.smithi115.stdout:6/117: creat d4/d17/f23 x:0 0 0 2024-09-13T23:06:06.199 INFO:tasks.workunit.client.0.smithi115.stdout:3/96: mkdir d3/d16/d1a/d1e 0 2024-09-13T23:06:06.199 INFO:tasks.workunit.client.0.smithi115.stdout:3/97: truncate d3/d5/db/f17 1635592 0 2024-09-13T23:06:06.199 INFO:tasks.workunit.client.0.smithi115.stdout:3/98: chown d3/d5/db/le 2633 1 2024-09-13T23:06:06.201 INFO:tasks.workunit.client.0.smithi115.stdout:3/99: creat d3/d16/d1a/f1f x:0 0 0 2024-09-13T23:06:06.201 INFO:tasks.workunit.client.0.smithi115.stdout:3/100: truncate d3/d16/d1a/f1f 642162 0 2024-09-13T23:06:06.201 INFO:tasks.workunit.client.0.smithi115.stdout:3/101: stat d3/d16/f19 0 2024-09-13T23:06:06.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:05 smithi152 ceph-mon[34465]: pgmap v241: 65 pgs: 65 active+clean; 268 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 16 MiB/s wr, 892 op/s 2024-09-13T23:06:06.220 INFO:tasks.workunit.client.0.smithi115.stdout:0/92: dwrite d6/f1c [0,4194304] 0 2024-09-13T23:06:06.223 INFO:tasks.workunit.client.0.smithi115.stdout:0/93: rmdir d6 39 2024-09-13T23:06:06.223 INFO:tasks.workunit.client.0.smithi115.stdout:0/94: truncate d6/ff 257300 0 2024-09-13T23:06:06.223 INFO:tasks.workunit.client.0.smithi115.stdout:0/95: write d6/f12 [269913,115109] 0 2024-09-13T23:06:06.228 INFO:tasks.workunit.client.0.smithi115.stdout:7/63: dwrite da/df/f14 [0,4194304] 0 2024-09-13T23:06:06.228 INFO:tasks.workunit.client.0.smithi115.stdout:8/37: dwrite d3/d5/fa [0,4194304] 0 2024-09-13T23:06:06.229 INFO:tasks.workunit.client.0.smithi115.stdout:9/44: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:06.229 INFO:tasks.workunit.client.0.smithi115.stdout:5/64: dwrite d8/fb [0,4194304] 0 2024-09-13T23:06:06.231 INFO:tasks.workunit.client.0.smithi115.stdout:7/64: mknod da/dd/c15 0 2024-09-13T23:06:06.231 INFO:tasks.workunit.client.0.smithi115.stdout:7/65: write f2 [7399653,130222] 0 2024-09-13T23:06:06.232 INFO:tasks.workunit.client.0.smithi115.stdout:8/38: symlink d3/le 0 2024-09-13T23:06:06.232 INFO:tasks.workunit.client.0.smithi115.stdout:8/39: creat d3/ff x:0 0 0 2024-09-13T23:06:06.232 INFO:tasks.workunit.client.0.smithi115.stdout:8/40: stat d3/d5 0 2024-09-13T23:06:06.234 INFO:tasks.workunit.client.0.smithi115.stdout:6/118: getdents d4/df/d14 0 2024-09-13T23:06:06.236 INFO:tasks.workunit.client.0.smithi115.stdout:5/65: rename f5 to d8/f12 0 2024-09-13T23:06:06.241 INFO:tasks.workunit.client.0.smithi115.stdout:3/102: rmdir d3 39 2024-09-13T23:06:06.241 INFO:tasks.workunit.client.0.smithi115.stdout:3/103: stat d3/d16 0 2024-09-13T23:06:06.242 INFO:tasks.workunit.client.0.smithi115.stdout:9/45: dread d0/f2 [0,4194304] 0 2024-09-13T23:06:06.242 INFO:tasks.workunit.client.0.smithi115.stdout:9/46: readlink d0/lb 0 2024-09-13T23:06:06.243 INFO:tasks.workunit.client.0.smithi115.stdout:3/104: dread d3/d16/d1a/f1f [0,4194304] 0 2024-09-13T23:06:06.243 INFO:tasks.workunit.client.0.smithi115.stdout:3/105: readlink d3/d5/l18 0 2024-09-13T23:06:06.243 INFO:tasks.workunit.client.0.smithi115.stdout:3/106: readlink d3/lc 0 2024-09-13T23:06:06.244 INFO:tasks.workunit.client.0.smithi115.stdout:3/107: chown d3/d16/d1a 732530 1 2024-09-13T23:06:06.246 INFO:tasks.workunit.client.0.smithi115.stdout:7/66: mkdir da/dd/d16 0 2024-09-13T23:06:06.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/41: mknod d3/c10 0 2024-09-13T23:06:06.247 INFO:tasks.workunit.client.0.smithi115.stdout:8/42: write d3/ff [580514,26763] 0 2024-09-13T23:06:06.248 INFO:tasks.workunit.client.0.smithi115.stdout:6/119: rmdir d4 39 2024-09-13T23:06:06.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/66: mkdir d8/dd/d13 0 2024-09-13T23:06:06.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/67: chown d8/l11 14596161 1 2024-09-13T23:06:06.249 INFO:tasks.workunit.client.0.smithi115.stdout:9/47: mknod d0/c12 0 2024-09-13T23:06:06.249 INFO:tasks.workunit.client.0.smithi115.stdout:3/108: truncate d3/f1b 129492 0 2024-09-13T23:06:06.250 INFO:tasks.workunit.client.0.smithi115.stdout:0/96: dwrite d6/fd [0,4194304] 0 2024-09-13T23:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/67: symlink da/dd/d16/l17 0 2024-09-13T23:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/68: chown c9 3 1 2024-09-13T23:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:9/48: dread d0/f9 [0,4194304] 0 2024-09-13T23:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:3/109: dread d3/d16/d1a/f1f [0,4194304] 0 2024-09-13T23:06:06.251 INFO:tasks.workunit.client.0.smithi115.stdout:8/43: mkdir d3/d11 0 2024-09-13T23:06:06.252 INFO:tasks.workunit.client.0.smithi115.stdout:6/120: symlink d4/l24 0 2024-09-13T23:06:06.252 INFO:tasks.workunit.client.0.smithi115.stdout:6/121: chown c1 60 1 2024-09-13T23:06:06.253 INFO:tasks.workunit.client.0.smithi115.stdout:5/68: getdents d8 0 2024-09-13T23:06:06.257 INFO:tasks.workunit.client.0.smithi115.stdout:0/97: mkdir d6/d24/d25/d2b 0 2024-09-13T23:06:06.260 INFO:tasks.workunit.client.0.smithi115.stdout:8/44: dread d3/d5/fa [0,4194304] 0 2024-09-13T23:06:06.260 INFO:tasks.workunit.client.0.smithi115.stdout:3/110: mkdir d3/d5/d20 0 2024-09-13T23:06:06.260 INFO:tasks.workunit.client.0.smithi115.stdout:8/45: read d3/d5/fb [15961,66481] 0 2024-09-13T23:06:06.262 INFO:tasks.workunit.client.0.smithi115.stdout:5/69: mkdir d8/dd/d14 0 2024-09-13T23:06:06.263 INFO:tasks.workunit.client.0.smithi115.stdout:7/69: getdents da/df 0 2024-09-13T23:06:06.265 INFO:tasks.workunit.client.0.smithi115.stdout:5/70: rmdir d8 39 2024-09-13T23:06:06.265 INFO:tasks.workunit.client.0.smithi115.stdout:3/111: fsync d3/f1b 0 2024-09-13T23:06:06.269 INFO:tasks.workunit.client.0.smithi115.stdout:3/112: rename d3/c4 to d3/d5/d20/c21 0 2024-09-13T23:06:06.269 INFO:tasks.workunit.client.0.smithi115.stdout:6/122: getdents d4 0 2024-09-13T23:06:06.282 INFO:tasks.workunit.client.0.smithi115.stdout:6/123: symlink d4/l25 0 2024-09-13T23:06:06.282 INFO:tasks.workunit.client.0.smithi115.stdout:6/124: write d4/df/f1f [265309,58164] 0 2024-09-13T23:06:06.284 INFO:tasks.workunit.client.0.smithi115.stdout:1/96: sync 2024-09-13T23:06:06.284 INFO:tasks.workunit.client.0.smithi115.stdout:4/139: sync 2024-09-13T23:06:06.284 INFO:tasks.workunit.client.0.smithi115.stdout:2/67: sync 2024-09-13T23:06:06.285 INFO:tasks.workunit.client.0.smithi115.stdout:6/125: rename d4/l22 to d4/d17/l26 0 2024-09-13T23:06:06.285 INFO:tasks.workunit.client.0.smithi115.stdout:2/68: creat da/de/d16/f17 x:0 0 0 2024-09-13T23:06:06.285 INFO:tasks.workunit.client.0.smithi115.stdout:5/71: read d8/f9 [2996102,47247] 0 2024-09-13T23:06:06.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/126: dread d4/f1d [0,4194304] 0 2024-09-13T23:06:06.287 INFO:tasks.workunit.client.0.smithi115.stdout:2/69: dread da/f15 [0,4194304] 0 2024-09-13T23:06:06.287 INFO:tasks.workunit.client.0.smithi115.stdout:5/72: unlink d8/f12 0 2024-09-13T23:06:06.289 INFO:tasks.workunit.client.0.smithi115.stdout:1/97: dread d0/f1 [0,4194304] 0 2024-09-13T23:06:06.289 INFO:tasks.workunit.client.0.smithi115.stdout:6/127: truncate d4/f1d 42518 0 2024-09-13T23:06:06.289 INFO:tasks.workunit.client.0.smithi115.stdout:6/128: getdents d4/df/d14 0 2024-09-13T23:06:06.291 INFO:tasks.workunit.client.0.smithi115.stdout:1/98: creat d0/de/d1b/f1e x:0 0 0 2024-09-13T23:06:06.291 INFO:tasks.workunit.client.0.smithi115.stdout:1/99: chown d0/de/d1b/f1e 126677 1 2024-09-13T23:06:06.291 INFO:tasks.workunit.client.0.smithi115.stdout:6/129: mknod d4/d17/c27 0 2024-09-13T23:06:06.293 INFO:tasks.workunit.client.0.smithi115.stdout:2/70: getdents da 0 2024-09-13T23:06:06.294 INFO:tasks.workunit.client.0.smithi115.stdout:1/100: rename d0/dd/f12 to d0/de/f1f 0 2024-09-13T23:06:06.294 INFO:tasks.workunit.client.0.smithi115.stdout:1/101: fsync d0/dd/f13 0 2024-09-13T23:06:06.294 INFO:tasks.workunit.client.0.smithi115.stdout:1/102: fsync d0/f6 0 2024-09-13T23:06:06.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/103: read d0/f2 [1829086,81415] 0 2024-09-13T23:06:06.295 INFO:tasks.workunit.client.0.smithi115.stdout:2/71: unlink c3 0 2024-09-13T23:06:06.295 INFO:tasks.workunit.client.0.smithi115.stdout:2/72: truncate da/de/f12 287919 0 2024-09-13T23:06:06.296 INFO:tasks.workunit.client.0.smithi115.stdout:9/49: dwrite d0/fd [0,4194304] 0 2024-09-13T23:06:06.296 INFO:tasks.workunit.client.0.smithi115.stdout:1/104: creat d0/dd/f20 x:0 0 0 2024-09-13T23:06:06.297 INFO:tasks.workunit.client.0.smithi115.stdout:4/140: dread db/f10 [0,4194304] 0 2024-09-13T23:06:06.298 INFO:tasks.workunit.client.0.smithi115.stdout:9/50: mkdir d0/d13 0 2024-09-13T23:06:06.300 INFO:tasks.workunit.client.0.smithi115.stdout:9/51: link d0/lb d0/d13/l14 0 2024-09-13T23:06:06.301 INFO:tasks.workunit.client.0.smithi115.stdout:9/52: rmdir d0/d13 39 2024-09-13T23:06:06.301 INFO:tasks.workunit.client.0.smithi115.stdout:7/70: dwrite da/f10 [0,4194304] 0 2024-09-13T23:06:06.302 INFO:tasks.workunit.client.0.smithi115.stdout:6/130: fsync d4/df/f1f 0 2024-09-13T23:06:06.302 INFO:tasks.workunit.client.0.smithi115.stdout:6/131: creat d4/df/f28 x:0 0 0 2024-09-13T23:06:06.308 INFO:tasks.workunit.client.0.smithi115.stdout:8/46: dwrite d3/ff [0,4194304] 0 2024-09-13T23:06:06.309 INFO:tasks.workunit.client.0.smithi115.stdout:3/113: dwrite d3/d16/d1a/f1f [0,4194304] 0 2024-09-13T23:06:06.309 INFO:tasks.workunit.client.0.smithi115.stdout:6/132: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:06.309 INFO:tasks.workunit.client.0.smithi115.stdout:0/98: dwrite d6/f1c [0,4194304] 0 2024-09-13T23:06:06.309 INFO:tasks.workunit.client.0.smithi115.stdout:2/73: rmdir da/de/d16 39 2024-09-13T23:06:06.317 INFO:tasks.workunit.client.0.smithi115.stdout:8/47: creat d3/d5/dc/f12 x:0 0 0 2024-09-13T23:06:06.321 INFO:tasks.workunit.client.0.smithi115.stdout:8/48: write d3/d5/fa [3880911,1563] 0 2024-09-13T23:06:06.322 INFO:tasks.workunit.client.0.smithi115.stdout:3/114: mknod d3/d16/d1a/c22 0 2024-09-13T23:06:06.323 INFO:tasks.workunit.client.0.smithi115.stdout:2/74: mknod da/de/c18 0 2024-09-13T23:06:06.324 INFO:tasks.workunit.client.0.smithi115.stdout:9/53: rmdir d0 39 2024-09-13T23:06:06.324 INFO:tasks.workunit.client.0.smithi115.stdout:9/54: chown d0/c11 13376 1 2024-09-13T23:06:06.324 INFO:tasks.workunit.client.0.smithi115.stdout:5/73: dwrite d8/dd/ff [0,4194304] 0 2024-09-13T23:06:06.328 INFO:tasks.workunit.client.0.smithi115.stdout:3/115: creat d3/d5/db/f23 x:0 0 0 2024-09-13T23:06:06.328 INFO:tasks.workunit.client.0.smithi115.stdout:9/55: truncate d0/f2 1226372 0 2024-09-13T23:06:06.329 INFO:tasks.workunit.client.0.smithi115.stdout:5/74: creat d8/dd/f15 x:0 0 0 2024-09-13T23:06:06.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/56: creat d0/f15 x:0 0 0 2024-09-13T23:06:06.331 INFO:tasks.workunit.client.0.smithi115.stdout:5/75: creat d8/f16 x:0 0 0 2024-09-13T23:06:06.332 INFO:tasks.workunit.client.0.smithi115.stdout:9/57: getdents d0/d13 0 2024-09-13T23:06:06.340 INFO:tasks.workunit.client.0.smithi115.stdout:4/141: dwrite db/dd/d17/f24 [4194304,4194304] 0 2024-09-13T23:06:06.340 INFO:tasks.workunit.client.0.smithi115.stdout:4/142: stat db/lc 0 2024-09-13T23:06:06.340 INFO:tasks.workunit.client.0.smithi115.stdout:4/143: chown db/dd/d17 256677737 1 2024-09-13T23:06:06.340 INFO:tasks.workunit.client.0.smithi115.stdout:5/76: write d8/fa [335643,110847] 0 2024-09-13T23:06:06.341 INFO:tasks.workunit.client.0.smithi115.stdout:5/77: write d8/dd/f15 [693571,6766] 0 2024-09-13T23:06:06.343 INFO:tasks.workunit.client.0.smithi115.stdout:4/144: symlink db/d15/l2b 0 2024-09-13T23:06:06.343 INFO:tasks.workunit.client.0.smithi115.stdout:6/133: dwrite d4/f12 [0,4194304] 0 2024-09-13T23:06:06.343 INFO:tasks.workunit.client.0.smithi115.stdout:0/99: dwrite d6/f12 [0,4194304] 0 2024-09-13T23:06:06.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/116: write d3/d16/d1a/f1f [1625395,103157] 0 2024-09-13T23:06:06.345 INFO:tasks.workunit.client.0.smithi115.stdout:4/145: rename f1 to db/d15/f2c 0 2024-09-13T23:06:06.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/78: fdatasync d8/dd/f15 0 2024-09-13T23:06:06.348 INFO:tasks.workunit.client.0.smithi115.stdout:9/58: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T23:06:06.353 INFO:tasks.workunit.client.0.smithi115.stdout:0/100: creat d6/d24/d25/f2c x:0 0 0 2024-09-13T23:06:06.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/134: getdents d4/df 0 2024-09-13T23:06:06.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/135: truncate d4/df/d14/f18 4654842 0 2024-09-13T23:06:06.357 INFO:tasks.workunit.client.0.smithi115.stdout:6/136: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:06.357 INFO:tasks.workunit.client.0.smithi115.stdout:6/137: write d4/df/f28 [43211,51606] 0 2024-09-13T23:06:06.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/101: creat d6/d24/d25/d2b/f2d x:0 0 0 2024-09-13T23:06:06.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/102: write d6/f1c [4369533,64881] 0 2024-09-13T23:06:06.360 INFO:tasks.workunit.client.0.smithi115.stdout:5/79: rename d8/dd/f15 to d8/dd/d13/f17 0 2024-09-13T23:06:06.361 INFO:tasks.workunit.client.0.smithi115.stdout:6/138: rmdir d4 39 2024-09-13T23:06:06.361 INFO:tasks.workunit.client.0.smithi115.stdout:6/139: fsync d4/f12 0 2024-09-13T23:06:06.362 INFO:tasks.workunit.client.0.smithi115.stdout:6/140: mknod d4/df/c29 0 2024-09-13T23:06:06.364 INFO:tasks.workunit.client.0.smithi115.stdout:8/49: dwrite d3/d5/fa [0,4194304] 0 2024-09-13T23:06:06.365 INFO:tasks.workunit.client.0.smithi115.stdout:6/141: unlink d4/l6 0 2024-09-13T23:06:06.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/59: dread d0/f2 [0,4194304] 0 2024-09-13T23:06:06.367 INFO:tasks.workunit.client.0.smithi115.stdout:9/60: rename d0/l6 to d0/l16 0 2024-09-13T23:06:06.367 INFO:tasks.workunit.client.0.smithi115.stdout:8/50: dread f2 [0,4194304] 0 2024-09-13T23:06:06.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/117: dwrite d3/d5/db/f23 [0,4194304] 0 2024-09-13T23:06:06.376 INFO:tasks.workunit.client.0.smithi115.stdout:3/118: mknod d3/d16/d1a/d1e/c24 0 2024-09-13T23:06:06.379 INFO:tasks.workunit.client.0.smithi115.stdout:8/51: write d3/ff [1999924,129033] 0 2024-09-13T23:06:06.382 INFO:tasks.workunit.client.0.smithi115.stdout:8/52: mknod d3/d5/dc/c13 0 2024-09-13T23:06:06.382 INFO:tasks.workunit.client.0.smithi115.stdout:8/53: write d3/ff [4381272,96403] 0 2024-09-13T23:06:06.384 INFO:tasks.workunit.client.0.smithi115.stdout:8/54: creat d3/d11/f14 x:0 0 0 2024-09-13T23:06:06.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/146: dwrite db/dd/d17/f24 [4194304,4194304] 0 2024-09-13T23:06:06.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/147: write db/d15/f1f [1811188,5076] 0 2024-09-13T23:06:06.394 INFO:tasks.workunit.client.0.smithi115.stdout:3/119: dread d3/d16/d1a/f1f [0,4194304] 0 2024-09-13T23:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:3/120: rmdir d3/d5/d20 39 2024-09-13T23:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:3/121: write d3/f1b [1029797,125435] 0 2024-09-13T23:06:06.395 INFO:tasks.workunit.client.0.smithi115.stdout:3/122: symlink d3/d5/d20/l25 0 2024-09-13T23:06:06.397 INFO:tasks.workunit.client.0.smithi115.stdout:0/103: dwrite d6/d24/d25/d2b/f2d [0,4194304] 0 2024-09-13T23:06:06.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/61: dwrite d0/f15 [0,4194304] 0 2024-09-13T23:06:06.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/148: write db/d19/f27 [2193479,44614] 0 2024-09-13T23:06:06.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/149: readlink db/l21 0 2024-09-13T23:06:06.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/150: chown f9 2347 1 2024-09-13T23:06:06.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/142: dwrite d4/df/f1c [0,4194304] 0 2024-09-13T23:06:06.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/143: chown d4 9921264 1 2024-09-13T23:06:06.400 INFO:tasks.workunit.client.0.smithi115.stdout:0/104: getdents d6/d24 0 2024-09-13T23:06:06.400 INFO:tasks.workunit.client.0.smithi115.stdout:0/105: truncate d6/f20 896686 0 2024-09-13T23:06:06.402 INFO:tasks.workunit.client.0.smithi115.stdout:9/62: mkdir d0/d13/d17 0 2024-09-13T23:06:06.402 INFO:tasks.workunit.client.0.smithi115.stdout:5/80: dread d8/fa [0,4194304] 0 2024-09-13T23:06:06.402 INFO:tasks.workunit.client.0.smithi115.stdout:9/63: truncate d0/f9 888637 0 2024-09-13T23:06:06.411 INFO:tasks.workunit.client.0.smithi115.stdout:6/144: mkdir d4/d17/d2a 0 2024-09-13T23:06:06.413 INFO:tasks.workunit.client.0.smithi115.stdout:5/81: mkdir d8/dd/d14/d18 0 2024-09-13T23:06:06.413 INFO:tasks.workunit.client.0.smithi115.stdout:5/82: fsync d8/dd/d13/f17 0 2024-09-13T23:06:06.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/151: rmdir db/d19/d1d 39 2024-09-13T23:06:06.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/152: write db/f10 [106911,28939] 0 2024-09-13T23:06:06.416 INFO:tasks.workunit.client.0.smithi115.stdout:5/83: symlink d8/dd/d13/l19 0 2024-09-13T23:06:06.416 INFO:tasks.workunit.client.0.smithi115.stdout:5/84: truncate d8/f16 670831 0 2024-09-13T23:06:06.417 INFO:tasks.workunit.client.0.smithi115.stdout:5/85: creat d8/dd/d13/f1a x:0 0 0 2024-09-13T23:06:06.418 INFO:tasks.workunit.client.0.smithi115.stdout:5/86: chown d8/dd/d14/d18 12946 1 2024-09-13T23:06:06.418 INFO:tasks.workunit.client.0.smithi115.stdout:5/87: chown d8/f16 118066451 1 2024-09-13T23:06:06.423 INFO:tasks.workunit.client.0.smithi115.stdout:8/55: dwrite d3/ff [4194304,4194304] 0 2024-09-13T23:06:06.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/56: link d3/ff d3/d11/f15 0 2024-09-13T23:06:06.426 INFO:tasks.workunit.client.0.smithi115.stdout:4/153: dread fa [4194304,4194304] 0 2024-09-13T23:06:06.427 INFO:tasks.workunit.client.0.smithi115.stdout:4/154: link c6 db/d16/c2d 0 2024-09-13T23:06:06.427 INFO:tasks.workunit.client.0.smithi115.stdout:4/155: fdatasync db/d15/f1f 0 2024-09-13T23:06:06.427 INFO:tasks.workunit.client.0.smithi115.stdout:7/71: sync 2024-09-13T23:06:06.427 INFO:tasks.workunit.client.0.smithi115.stdout:1/105: sync 2024-09-13T23:06:06.428 INFO:tasks.workunit.client.0.smithi115.stdout:1/106: symlink d0/de/d1a/l21 0 2024-09-13T23:06:06.428 INFO:tasks.workunit.client.0.smithi115.stdout:1/107: read d0/dd/f13 [317737,56816] 0 2024-09-13T23:06:06.429 INFO:tasks.workunit.client.0.smithi115.stdout:0/106: truncate d6/f20 541314 0 2024-09-13T23:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:0/107: write d6/f13 [174959,14630] 0 2024-09-13T23:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/123: dwrite d3/f1b [0,4194304] 0 2024-09-13T23:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/124: chown d3/d16/d1a 971099444 1 2024-09-13T23:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/125: chown d3/lc 262725 1 2024-09-13T23:06:06.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/145: dread f3 [0,4194304] 0 2024-09-13T23:06:06.433 INFO:tasks.workunit.client.0.smithi115.stdout:0/108: mknod d6/d24/d25/d2b/c2e 0 2024-09-13T23:06:06.436 INFO:tasks.workunit.client.0.smithi115.stdout:6/146: symlink d4/l2b 0 2024-09-13T23:06:06.436 INFO:tasks.workunit.client.0.smithi115.stdout:8/57: read d3/d11/f15 [7880737,93909] 0 2024-09-13T23:06:06.439 INFO:tasks.workunit.client.0.smithi115.stdout:8/58: mkdir d3/d5/dc/d16 0 2024-09-13T23:06:06.439 INFO:tasks.workunit.client.0.smithi115.stdout:8/59: creat d3/d11/f17 x:0 0 0 2024-09-13T23:06:06.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/156: dread db/dd/d17/f24 [4194304,4194304] 0 2024-09-13T23:06:06.442 INFO:tasks.workunit.client.0.smithi115.stdout:4/157: truncate db/d15/f1f 2553670 0 2024-09-13T23:06:06.445 INFO:tasks.workunit.client.0.smithi115.stdout:3/126: write d3/f1b [1950587,59668] 0 2024-09-13T23:06:06.447 INFO:tasks.workunit.client.0.smithi115.stdout:3/127: creat d3/d16/d1a/f26 x:0 0 0 2024-09-13T23:06:06.448 INFO:tasks.workunit.client.0.smithi115.stdout:3/128: rename d3/c7 to d3/d16/c27 0 2024-09-13T23:06:06.466 INFO:tasks.workunit.client.0.smithi115.stdout:7/72: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:06.473 INFO:tasks.workunit.client.0.smithi115.stdout:5/88: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:5/89: truncate d8/fa 2548131 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:5/90: write d8/dd/d13/f1a [643188,78625] 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:5/91: fdatasync d8/f16 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:5/92: write d8/dd/f10 [529094,126560] 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:0/109: dwrite d6/f19 [0,4194304] 0 2024-09-13T23:06:06.475 INFO:tasks.workunit.client.0.smithi115.stdout:0/110: chown d6/fb 14300581 1 2024-09-13T23:06:06.480 INFO:tasks.workunit.client.0.smithi115.stdout:3/129: dwrite d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:06.480 INFO:tasks.workunit.client.0.smithi115.stdout:6/147: dwrite d4/f1d [0,4194304] 0 2024-09-13T23:06:06.485 INFO:tasks.workunit.client.0.smithi115.stdout:7/73: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:06.485 INFO:tasks.workunit.client.0.smithi115.stdout:1/108: dwrite d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:06.485 INFO:tasks.workunit.client.0.smithi115.stdout:1/109: truncate d0/dd/f20 88182 0 2024-09-13T23:06:06.485 INFO:tasks.workunit.client.0.smithi115.stdout:4/158: dread db/f10 [0,4194304] 0 2024-09-13T23:06:06.486 INFO:tasks.workunit.client.0.smithi115.stdout:0/111: rmdir d6/d24/d25/d2b 39 2024-09-13T23:06:06.490 INFO:tasks.workunit.client.0.smithi115.stdout:8/60: rmdir d3/d5 39 2024-09-13T23:06:06.491 INFO:tasks.workunit.client.0.smithi115.stdout:7/74: symlink da/dd/d16/l18 0 2024-09-13T23:06:06.491 INFO:tasks.workunit.client.0.smithi115.stdout:7/75: write da/f10 [4247048,1182] 0 2024-09-13T23:06:06.493 INFO:tasks.workunit.client.0.smithi115.stdout:1/110: creat d0/f22 x:0 0 0 2024-09-13T23:06:06.495 INFO:tasks.workunit.client.0.smithi115.stdout:0/112: symlink d6/l2f 0 2024-09-13T23:06:06.495 INFO:tasks.workunit.client.0.smithi115.stdout:0/113: write d6/f11 [327361,29389] 0 2024-09-13T23:06:06.497 INFO:tasks.workunit.client.0.smithi115.stdout:7/76: symlink da/l19 0 2024-09-13T23:06:06.498 INFO:tasks.workunit.client.0.smithi115.stdout:4/159: dread db/dd/d17/f24 [4194304,4194304] 0 2024-09-13T23:06:06.498 INFO:tasks.workunit.client.0.smithi115.stdout:4/160: chown db/l23 3 1 2024-09-13T23:06:06.498 INFO:tasks.workunit.client.0.smithi115.stdout:1/111: mkdir d0/d14/d23 0 2024-09-13T23:06:06.500 INFO:tasks.workunit.client.0.smithi115.stdout:7/77: unlink da/dd/d16/l18 0 2024-09-13T23:06:06.502 INFO:tasks.workunit.client.0.smithi115.stdout:4/161: truncate db/d15/f2c 1907353 0 2024-09-13T23:06:06.506 INFO:tasks.workunit.client.0.smithi115.stdout:1/112: truncate d0/f1 23286 0 2024-09-13T23:06:06.510 INFO:tasks.workunit.client.0.smithi115.stdout:1/113: mknod d0/c24 0 2024-09-13T23:06:06.510 INFO:tasks.workunit.client.0.smithi115.stdout:3/130: dwrite d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:06.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/131: mkdir d3/d5/d20/d28 0 2024-09-13T23:06:06.524 INFO:tasks.workunit.client.0.smithi115.stdout:5/93: dwrite d8/f9 [0,4194304] 0 2024-09-13T23:06:06.524 INFO:tasks.workunit.client.0.smithi115.stdout:5/94: chown d8/fa 62 1 2024-09-13T23:06:06.534 INFO:tasks.workunit.client.0.smithi115.stdout:5/95: dread d8/dd/ff [0,4194304] 0 2024-09-13T23:06:06.537 INFO:tasks.workunit.client.0.smithi115.stdout:5/96: write d8/dd/ff [2774721,73368] 0 2024-09-13T23:06:06.540 INFO:tasks.workunit.client.0.smithi115.stdout:5/97: dread d8/dd/f10 [0,4194304] 0 2024-09-13T23:06:06.541 INFO:tasks.workunit.client.0.smithi115.stdout:3/132: write d3/d16/f19 [4100611,75665] 0 2024-09-13T23:06:06.541 INFO:tasks.workunit.client.0.smithi115.stdout:6/148: dwrite d4/d17/f1b [0,4194304] 0 2024-09-13T23:06:06.541 INFO:tasks.workunit.client.0.smithi115.stdout:5/98: rename l4 to d8/dd/l1b 0 2024-09-13T23:06:06.545 INFO:tasks.workunit.client.0.smithi115.stdout:6/149: rmdir d4/df 39 2024-09-13T23:06:06.546 INFO:tasks.workunit.client.0.smithi115.stdout:0/114: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:06.546 INFO:tasks.workunit.client.0.smithi115.stdout:0/115: write d6/d24/f26 [950606,115771] 0 2024-09-13T23:06:06.546 INFO:tasks.workunit.client.0.smithi115.stdout:8/61: dwrite f2 [0,4194304] 0 2024-09-13T23:06:06.546 INFO:tasks.workunit.client.0.smithi115.stdout:1/114: dwrite d0/f6 [4194304,4194304] 0 2024-09-13T23:06:06.547 INFO:tasks.workunit.client.0.smithi115.stdout:4/162: dwrite db/d15/f1f [0,4194304] 0 2024-09-13T23:06:06.548 INFO:tasks.workunit.client.0.smithi115.stdout:0/116: mknod d6/d24/c30 0 2024-09-13T23:06:06.549 INFO:tasks.workunit.client.0.smithi115.stdout:0/117: dread d6/fb [0,4194304] 0 2024-09-13T23:06:06.549 INFO:tasks.workunit.client.0.smithi115.stdout:0/118: chown d6/f10 1950560 1 2024-09-13T23:06:06.549 INFO:tasks.workunit.client.0.smithi115.stdout:3/133: dread d3/f1b [0,4194304] 0 2024-09-13T23:06:06.550 INFO:tasks.workunit.client.0.smithi115.stdout:8/62: mknod d3/c18 0 2024-09-13T23:06:06.550 INFO:tasks.workunit.client.0.smithi115.stdout:8/63: write d3/fd [370910,39504] 0 2024-09-13T23:06:06.550 INFO:tasks.workunit.client.0.smithi115.stdout:8/64: fdatasync d3/d11/f17 0 2024-09-13T23:06:06.550 INFO:tasks.workunit.client.0.smithi115.stdout:8/65: read - d3/d11/f17 zero size 2024-09-13T23:06:06.552 INFO:tasks.workunit.client.0.smithi115.stdout:1/115: mkdir d0/de/d1b/d25 0 2024-09-13T23:06:06.552 INFO:tasks.workunit.client.0.smithi115.stdout:1/116: chown d0/f9 127 1 2024-09-13T23:06:06.554 INFO:tasks.workunit.client.0.smithi115.stdout:4/163: unlink db/lf 0 2024-09-13T23:06:06.556 INFO:tasks.workunit.client.0.smithi115.stdout:0/119: creat d6/d24/d25/d2b/f31 x:0 0 0 2024-09-13T23:06:06.556 INFO:tasks.workunit.client.0.smithi115.stdout:0/120: write d6/f20 [706732,46269] 0 2024-09-13T23:06:06.558 INFO:tasks.workunit.client.0.smithi115.stdout:3/134: mkdir d3/d16/d1a/d29 0 2024-09-13T23:06:06.558 INFO:tasks.workunit.client.0.smithi115.stdout:3/135: fsync d3/f1b 0 2024-09-13T23:06:06.559 INFO:tasks.workunit.client.0.smithi115.stdout:8/66: truncate d3/d11/f15 7469855 0 2024-09-13T23:06:06.561 INFO:tasks.workunit.client.0.smithi115.stdout:1/117: link d0/f7 d0/de/d1b/f26 0 2024-09-13T23:06:06.561 INFO:tasks.workunit.client.0.smithi115.stdout:1/118: write d0/f9 [1262275,8931] 0 2024-09-13T23:06:06.562 INFO:tasks.workunit.client.0.smithi115.stdout:1/119: truncate d0/de/d1b/f1e 543748 0 2024-09-13T23:06:06.562 INFO:tasks.workunit.client.0.smithi115.stdout:0/121: mkdir d6/d24/d25/d2b/d32 0 2024-09-13T23:06:06.564 INFO:tasks.workunit.client.0.smithi115.stdout:1/120: link d0/dd/f20 d0/d14/d23/f27 0 2024-09-13T23:06:06.565 INFO:tasks.workunit.client.0.smithi115.stdout:0/122: rmdir d6 39 2024-09-13T23:06:06.566 INFO:tasks.workunit.client.0.smithi115.stdout:1/121: mknod d0/dd/c28 0 2024-09-13T23:06:06.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/123: mknod d6/d24/d25/d2b/d32/c33 0 2024-09-13T23:06:06.570 INFO:tasks.workunit.client.0.smithi115.stdout:3/136: read d3/d5/db/f23 [1046031,122154] 0 2024-09-13T23:06:06.570 INFO:tasks.workunit.client.0.smithi115.stdout:4/164: write db/d19/d1d/f22 [2430008,64370] 0 2024-09-13T23:06:06.570 INFO:tasks.workunit.client.0.smithi115.stdout:4/165: read db/d19/d1d/f22 [2231941,10660] 0 2024-09-13T23:06:06.571 INFO:tasks.workunit.client.0.smithi115.stdout:3/137: mknod d3/d5/c2a 0 2024-09-13T23:06:06.572 INFO:tasks.workunit.client.0.smithi115.stdout:4/166: truncate f9 1430891 0 2024-09-13T23:06:06.572 INFO:tasks.workunit.client.0.smithi115.stdout:4/167: fdatasync f9 0 2024-09-13T23:06:06.572 INFO:tasks.workunit.client.0.smithi115.stdout:4/168: readlink db/d19/l20 0 2024-09-13T23:06:06.573 INFO:tasks.workunit.client.0.smithi115.stdout:4/169: chown db/f10 0 1 2024-09-13T23:06:06.573 INFO:tasks.workunit.client.0.smithi115.stdout:2/75: sync 2024-09-13T23:06:06.573 INFO:tasks.workunit.client.0.smithi115.stdout:9/64: sync 2024-09-13T23:06:06.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/150: dwrite f3 [0,4194304] 0 2024-09-13T23:06:06.574 INFO:tasks.workunit.client.0.smithi115.stdout:8/67: fdatasync d3/fd 0 2024-09-13T23:06:06.575 INFO:tasks.workunit.client.0.smithi115.stdout:5/99: dwrite d8/fb [0,4194304] 0 2024-09-13T23:06:06.576 INFO:tasks.workunit.client.0.smithi115.stdout:9/65: mknod d0/d13/c18 0 2024-09-13T23:06:06.576 INFO:tasks.workunit.client.0.smithi115.stdout:6/151: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:06.576 INFO:tasks.workunit.client.0.smithi115.stdout:6/152: chown c2 424 1 2024-09-13T23:06:06.577 INFO:tasks.workunit.client.0.smithi115.stdout:6/153: write d4/df/f1f [501440,69673] 0 2024-09-13T23:06:06.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/124: dread d6/fa [0,4194304] 0 2024-09-13T23:06:06.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/125: chown d6/c14 3239 1 2024-09-13T23:06:06.578 INFO:tasks.workunit.client.0.smithi115.stdout:8/68: rmdir d3/d5 39 2024-09-13T23:06:06.578 INFO:tasks.workunit.client.0.smithi115.stdout:8/69: dread - d3/d11/f17 zero size 2024-09-13T23:06:06.579 INFO:tasks.workunit.client.0.smithi115.stdout:2/76: mkdir da/de/d16/d19 0 2024-09-13T23:06:06.580 INFO:tasks.workunit.client.0.smithi115.stdout:9/66: mkdir d0/d13/d17/d19 0 2024-09-13T23:06:06.582 INFO:tasks.workunit.client.0.smithi115.stdout:4/170: rename db/d15 to db/d11/d2e 0 2024-09-13T23:06:06.584 INFO:tasks.workunit.client.0.smithi115.stdout:0/126: rename d6/ff to d6/f34 0 2024-09-13T23:06:06.585 INFO:tasks.workunit.client.0.smithi115.stdout:2/77: fdatasync f7 0 2024-09-13T23:06:06.585 INFO:tasks.workunit.client.0.smithi115.stdout:1/122: write d0/f6 [5483782,40218] 0 2024-09-13T23:06:06.585 INFO:tasks.workunit.client.0.smithi115.stdout:6/154: read d4/f1d [4193638,26496] 0 2024-09-13T23:06:06.586 INFO:tasks.workunit.client.0.smithi115.stdout:9/67: rename d0/lb to d0/d13/d17/d19/l1a 0 2024-09-13T23:06:06.587 INFO:tasks.workunit.client.0.smithi115.stdout:4/171: mknod db/c2f 0 2024-09-13T23:06:06.588 INFO:tasks.workunit.client.0.smithi115.stdout:0/127: symlink d6/d24/l35 0 2024-09-13T23:06:06.589 INFO:tasks.workunit.client.0.smithi115.stdout:1/123: mkdir d0/de/d1a/d29 0 2024-09-13T23:06:06.591 INFO:tasks.workunit.client.0.smithi115.stdout:6/155: mknod d4/df/c2c 0 2024-09-13T23:06:06.591 INFO:tasks.workunit.client.0.smithi115.stdout:6/156: stat d4/df 0 2024-09-13T23:06:06.592 INFO:tasks.workunit.client.0.smithi115.stdout:2/78: rename da/de/d16/d19 to da/de/d1a 0 2024-09-13T23:06:06.593 INFO:tasks.workunit.client.0.smithi115.stdout:4/172: creat db/d16/f30 x:0 0 0 2024-09-13T23:06:06.594 INFO:tasks.workunit.client.0.smithi115.stdout:4/173: stat db/d16/f30 0 2024-09-13T23:06:06.594 INFO:tasks.workunit.client.0.smithi115.stdout:4/174: fdatasync db/d11/d2e/f2c 0 2024-09-13T23:06:06.595 INFO:tasks.workunit.client.0.smithi115.stdout:6/157: creat d4/df/d14/f2d x:0 0 0 2024-09-13T23:06:06.596 INFO:tasks.workunit.client.0.smithi115.stdout:2/79: dread da/f15 [0,4194304] 0 2024-09-13T23:06:06.598 INFO:tasks.workunit.client.0.smithi115.stdout:9/68: rename d0/c11 to d0/d13/c1b 0 2024-09-13T23:06:06.599 INFO:tasks.workunit.client.0.smithi115.stdout:9/69: write d0/fd [4939875,127195] 0 2024-09-13T23:06:06.599 INFO:tasks.workunit.client.0.smithi115.stdout:9/70: chown d0/d13 147522 1 2024-09-13T23:06:06.600 INFO:tasks.workunit.client.0.smithi115.stdout:2/80: rmdir da 39 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:2/81: fdatasync da/de/d16/f17 0 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/128: write d6/f1c [1963195,52715] 0 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/129: write d6/f13 [1287616,85999] 0 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/130: dread - d6/d24/d25/f2c zero size 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/131: write d6/f20 [1297239,36438] 0 2024-09-13T23:06:06.601 INFO:tasks.workunit.client.0.smithi115.stdout:3/138: dwrite d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:06.602 INFO:tasks.workunit.client.0.smithi115.stdout:3/139: write d3/d5/db/f23 [811442,98508] 0 2024-09-13T23:06:06.603 INFO:tasks.workunit.client.0.smithi115.stdout:5/100: dwrite d8/dd/d13/f17 [0,4194304] 0 2024-09-13T23:06:06.603 INFO:tasks.workunit.client.0.smithi115.stdout:2/82: rename da/lc to da/de/d16/l1b 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:0/132: creat d6/d24/d25/d2b/d32/f36 x:0 0 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/83: dread da/f15 [0,4194304] 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/84: read da/f15 [388223,98258] 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/85: chown da/de/d16/lf 132735100 1 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/86: fsync f7 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/87: readlink da/de/d16/l1b 0 2024-09-13T23:06:06.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/88: chown da/de/d16/l1b 46566991 1 2024-09-13T23:06:06.610 INFO:tasks.workunit.client.0.smithi115.stdout:1/124: dread d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:06.610 INFO:tasks.workunit.client.0.smithi115.stdout:1/125: write d0/f5 [202818,63451] 0 2024-09-13T23:06:06.610 INFO:tasks.workunit.client.0.smithi115.stdout:1/126: stat d0/c24 0 2024-09-13T23:06:06.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/140: dread d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:06.618 INFO:tasks.workunit.client.0.smithi115.stdout:0/133: dread d6/f10 [0,4194304] 0 2024-09-13T23:06:06.619 INFO:tasks.workunit.client.0.smithi115.stdout:3/141: creat d3/d16/d1c/f2b x:0 0 0 2024-09-13T23:06:06.621 INFO:tasks.workunit.client.0.smithi115.stdout:3/142: mkdir d3/d5/d2c 0 2024-09-13T23:06:06.621 INFO:tasks.workunit.client.0.smithi115.stdout:3/143: symlink d3/d16/d1a/d29/l2d 0 2024-09-13T23:06:06.622 INFO:tasks.workunit.client.0.smithi115.stdout:3/144: write d3/d16/d1a/f1f [4614015,97558] 0 2024-09-13T23:06:06.623 INFO:tasks.workunit.client.0.smithi115.stdout:8/70: dwrite d3/d11/f15 [0,4194304] 0 2024-09-13T23:06:06.623 INFO:tasks.workunit.client.0.smithi115.stdout:9/71: dwrite d0/f15 [0,4194304] 0 2024-09-13T23:06:06.624 INFO:tasks.workunit.client.0.smithi115.stdout:3/145: mknod d3/d16/d1c/c2e 0 2024-09-13T23:06:06.624 INFO:tasks.workunit.client.0.smithi115.stdout:3/146: write d3/d5/db/f23 [4781768,87529] 0 2024-09-13T23:06:06.624 INFO:tasks.workunit.client.0.smithi115.stdout:4/175: dwrite db/d19/f27 [4194304,4194304] 0 2024-09-13T23:06:06.624 INFO:tasks.workunit.client.0.smithi115.stdout:4/176: write f5 [129299,34815] 0 2024-09-13T23:06:06.624 INFO:tasks.workunit.client.0.smithi115.stdout:8/71: mknod d3/d5/dc/d16/c19 0 2024-09-13T23:06:06.626 INFO:tasks.workunit.client.0.smithi115.stdout:3/147: mkdir d3/d5/d2c/d2f 0 2024-09-13T23:06:06.628 INFO:tasks.workunit.client.0.smithi115.stdout:4/177: rmdir db/dd 39 2024-09-13T23:06:06.630 INFO:tasks.workunit.client.0.smithi115.stdout:0/134: rename d6/f34 to d6/f37 0 2024-09-13T23:06:06.631 INFO:tasks.workunit.client.0.smithi115.stdout:8/72: rmdir d3/d5/dc/d16 39 2024-09-13T23:06:06.631 INFO:tasks.workunit.client.0.smithi115.stdout:3/148: dread d3/f1b [0,4194304] 0 2024-09-13T23:06:06.631 INFO:tasks.workunit.client.0.smithi115.stdout:3/149: write d3/d16/d1a/f1f [5049977,104671] 0 2024-09-13T23:06:06.632 INFO:tasks.workunit.client.0.smithi115.stdout:8/73: getdents d3/d5/dc 0 2024-09-13T23:06:06.633 INFO:tasks.workunit.client.0.smithi115.stdout:3/150: truncate d3/d16/f19 3357806 0 2024-09-13T23:06:06.634 INFO:tasks.workunit.client.0.smithi115.stdout:3/151: read d3/d5/db/f23 [2814342,15075] 0 2024-09-13T23:06:06.634 INFO:tasks.workunit.client.0.smithi115.stdout:3/152: chown d3/l9 0 1 2024-09-13T23:06:06.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/74: mknod d3/d5/c1a 0 2024-09-13T23:06:06.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/75: chown d3/d5 93 1 2024-09-13T23:06:06.635 INFO:tasks.workunit.client.0.smithi115.stdout:8/76: symlink d3/d5/l1b 0 2024-09-13T23:06:06.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/158: getdents d4/df 0 2024-09-13T23:06:06.636 INFO:tasks.workunit.client.0.smithi115.stdout:8/77: truncate d3/d5/fa 2143311 0 2024-09-13T23:06:06.637 INFO:tasks.workunit.client.0.smithi115.stdout:8/78: stat d3/c9 0 2024-09-13T23:06:06.639 INFO:tasks.workunit.client.0.smithi115.stdout:8/79: mkdir d3/d5/d1c 0 2024-09-13T23:06:06.641 INFO:tasks.workunit.client.0.smithi115.stdout:1/127: dwrite d0/de/d1b/f1e [0,4194304] 0 2024-09-13T23:06:06.641 INFO:tasks.workunit.client.0.smithi115.stdout:1/128: write d0/f22 [832425,28893] 0 2024-09-13T23:06:06.641 INFO:tasks.workunit.client.0.smithi115.stdout:1/129: truncate d0/f1 568896 0 2024-09-13T23:06:06.644 INFO:tasks.workunit.client.0.smithi115.stdout:5/101: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:06.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/89: rename da/de/d16 to da/de/d1a/d1c 0 2024-09-13T23:06:06.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/90: chown da/de/c18 1278 1 2024-09-13T23:06:06.652 INFO:tasks.workunit.client.0.smithi115.stdout:2/91: rename da/de/d1a/d1c/f17 to da/de/d1a/f1d 0 2024-09-13T23:06:06.652 INFO:tasks.workunit.client.0.smithi115.stdout:2/92: write da/f15 [216802,113461] 0 2024-09-13T23:06:06.652 INFO:tasks.workunit.client.0.smithi115.stdout:2/93: chown da/de/d1a/d1c 481939 1 2024-09-13T23:06:06.655 INFO:tasks.workunit.client.0.smithi115.stdout:5/102: dread d8/dd/f10 [0,4194304] 0 2024-09-13T23:06:06.655 INFO:tasks.workunit.client.0.smithi115.stdout:5/103: chown d8/f9 372 1 2024-09-13T23:06:06.656 INFO:tasks.workunit.client.0.smithi115.stdout:9/72: rename d0/f9 to d0/d13/f1c 0 2024-09-13T23:06:06.658 INFO:tasks.workunit.client.0.smithi115.stdout:9/73: write d0/f2 [203418,16221] 0 2024-09-13T23:06:06.658 INFO:tasks.workunit.client.0.smithi115.stdout:2/94: link da/de/d1a/d1c/l1b da/de/l1e 0 2024-09-13T23:06:06.658 INFO:tasks.workunit.client.0.smithi115.stdout:7/78: sync 2024-09-13T23:06:06.659 INFO:tasks.workunit.client.0.smithi115.stdout:5/104: mknod d8/dd/c1c 0 2024-09-13T23:06:06.661 INFO:tasks.workunit.client.0.smithi115.stdout:0/135: rename d6/fb to d6/d24/f38 0 2024-09-13T23:06:06.661 INFO:tasks.workunit.client.0.smithi115.stdout:3/153: rename d3/d5 to d3/d5/d2c/d2f/d30 22 2024-09-13T23:06:06.661 INFO:tasks.workunit.client.0.smithi115.stdout:7/79: rename da/dd/d13 to da/dd/d13/d1a 22 2024-09-13T23:06:06.664 INFO:tasks.workunit.client.0.smithi115.stdout:2/95: creat da/de/d1a/f1f x:0 0 0 2024-09-13T23:06:06.665 INFO:tasks.workunit.client.0.smithi115.stdout:7/80: mknod da/dd/d16/c1b 0 2024-09-13T23:06:06.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/154: mkdir d3/d16/d1c/d31 0 2024-09-13T23:06:06.667 INFO:tasks.workunit.client.0.smithi115.stdout:4/178: dwrite f5 [4194304,4194304] 0 2024-09-13T23:06:06.670 INFO:tasks.workunit.client.0.smithi115.stdout:2/96: link da/de/c18 da/de/d1a/c20 0 2024-09-13T23:06:06.670 INFO:tasks.workunit.client.0.smithi115.stdout:7/81: mkdir da/dd/d1c 0 2024-09-13T23:06:06.670 INFO:tasks.workunit.client.0.smithi115.stdout:6/159: dwrite d4/df/d14/f18 [0,4194304] 0 2024-09-13T23:06:06.671 INFO:tasks.workunit.client.0.smithi115.stdout:3/155: dread d3/d5/db/f23 [4194304,4194304] 0 2024-09-13T23:06:06.673 INFO:tasks.workunit.client.0.smithi115.stdout:5/105: write d8/f16 [1161318,24353] 0 2024-09-13T23:06:06.673 INFO:tasks.workunit.client.0.smithi115.stdout:1/130: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:06.673 INFO:tasks.workunit.client.0.smithi115.stdout:0/136: dread d6/fd [0,4194304] 0 2024-09-13T23:06:06.673 INFO:tasks.workunit.client.0.smithi115.stdout:1/131: chown d0/de/d1b/f26 9833207 1 2024-09-13T23:06:06.673 INFO:tasks.workunit.client.0.smithi115.stdout:1/132: chown d0/de/d1b/f1e 7541 1 2024-09-13T23:06:06.674 INFO:tasks.workunit.client.0.smithi115.stdout:1/133: dread d0/dd/f20 [0,4194304] 0 2024-09-13T23:06:06.677 INFO:tasks.workunit.client.0.smithi115.stdout:2/97: mkdir da/d21 0 2024-09-13T23:06:06.679 INFO:tasks.workunit.client.0.smithi115.stdout:7/82: link da/dd/c15 da/dd/d1c/c1d 0 2024-09-13T23:06:06.683 INFO:tasks.workunit.client.0.smithi115.stdout:3/156: creat d3/d5/d20/d28/f32 x:0 0 0 2024-09-13T23:06:06.684 INFO:tasks.workunit.client.0.smithi115.stdout:0/137: dread d6/d24/d25/d2b/f2d [0,4194304] 0 2024-09-13T23:06:06.684 INFO:tasks.workunit.client.0.smithi115.stdout:0/138: chown d6/c22 14922 1 2024-09-13T23:06:06.686 INFO:tasks.workunit.client.0.smithi115.stdout:5/106: symlink d8/dd/d13/l1d 0 2024-09-13T23:06:06.690 INFO:tasks.workunit.client.0.smithi115.stdout:7/83: mknod da/c1e 0 2024-09-13T23:06:06.691 INFO:tasks.workunit.client.0.smithi115.stdout:7/84: fsync da/fc 0 2024-09-13T23:06:06.693 INFO:tasks.workunit.client.0.smithi115.stdout:3/157: creat d3/d16/f33 x:0 0 0 2024-09-13T23:06:06.695 INFO:tasks.workunit.client.0.smithi115.stdout:0/139: mknod d6/d24/d25/d2b/d32/c39 0 2024-09-13T23:06:06.695 INFO:tasks.workunit.client.0.smithi115.stdout:0/140: readlink d6/d24/l2a 0 2024-09-13T23:06:06.696 INFO:tasks.workunit.client.0.smithi115.stdout:5/107: creat d8/dd/d14/f1e x:0 0 0 2024-09-13T23:06:06.696 INFO:tasks.workunit.client.0.smithi115.stdout:5/108: creat d8/f1f x:0 0 0 2024-09-13T23:06:06.697 INFO:tasks.workunit.client.0.smithi115.stdout:4/179: dwrite f9 [0,4194304] 0 2024-09-13T23:06:06.697 INFO:tasks.workunit.client.0.smithi115.stdout:9/74: getdents d0/d13 0 2024-09-13T23:06:06.697 INFO:tasks.workunit.client.0.smithi115.stdout:2/98: dwrite da/de/d1a/f1f [0,4194304] 0 2024-09-13T23:06:06.699 INFO:tasks.workunit.client.0.smithi115.stdout:1/134: getdents d0/dd 0 2024-09-13T23:06:06.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/85: creat da/dd/d1c/f1f x:0 0 0 2024-09-13T23:06:06.706 INFO:tasks.workunit.client.0.smithi115.stdout:4/180: symlink db/d11/l31 0 2024-09-13T23:06:06.707 INFO:tasks.workunit.client.0.smithi115.stdout:9/75: creat d0/d13/d17/d19/f1d x:0 0 0 2024-09-13T23:06:06.708 INFO:tasks.workunit.client.0.smithi115.stdout:1/135: write d0/dd/f13 [208109,104732] 0 2024-09-13T23:06:06.711 INFO:tasks.workunit.client.0.smithi115.stdout:2/99: symlink da/de/d1a/l22 0 2024-09-13T23:06:06.711 INFO:tasks.workunit.client.0.smithi115.stdout:2/100: dread - da/de/d1a/f1d zero size 2024-09-13T23:06:06.714 INFO:tasks.workunit.client.0.smithi115.stdout:7/86: write da/f10 [3464335,122258] 0 2024-09-13T23:06:06.714 INFO:tasks.workunit.client.0.smithi115.stdout:7/87: dread - da/dd/d1c/f1f zero size 2024-09-13T23:06:06.714 INFO:tasks.workunit.client.0.smithi115.stdout:4/181: unlink f9 0 2024-09-13T23:06:06.715 INFO:tasks.workunit.client.0.smithi115.stdout:4/182: dread - db/d16/f30 zero size 2024-09-13T23:06:06.715 INFO:tasks.workunit.client.0.smithi115.stdout:9/76: dread d0/f2 [0,4194304] 0 2024-09-13T23:06:06.717 INFO:tasks.workunit.client.0.smithi115.stdout:7/88: rmdir da/dd 39 2024-09-13T23:06:06.718 INFO:tasks.workunit.client.0.smithi115.stdout:4/183: truncate db/d19/f27 3621102 0 2024-09-13T23:06:06.719 INFO:tasks.workunit.client.0.smithi115.stdout:6/160: truncate d4/df/d14/f18 297590 0 2024-09-13T23:06:06.722 INFO:tasks.workunit.client.0.smithi115.stdout:6/161: creat d4/df/f2e x:0 0 0 2024-09-13T23:06:06.722 INFO:tasks.workunit.client.0.smithi115.stdout:6/162: stat d4/df/c15 0 2024-09-13T23:06:06.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/158: dwrite d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:06.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/159: truncate d3/d5/d20/d28/f32 230811 0 2024-09-13T23:06:06.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/160: creat d3/d5/d20/d28/f34 x:0 0 0 2024-09-13T23:06:06.723 INFO:tasks.workunit.client.0.smithi115.stdout:3/161: fdatasync d3/d5/db/f17 0 2024-09-13T23:06:06.729 INFO:tasks.workunit.client.0.smithi115.stdout:0/141: dwrite d6/fd [4194304,4194304] 0 2024-09-13T23:06:06.729 INFO:tasks.workunit.client.0.smithi115.stdout:0/142: write d6/d24/d25/f2c [285862,114351] 0 2024-09-13T23:06:06.767 INFO:tasks.workunit.client.0.smithi115.stdout:2/101: dwrite da/de/f12 [0,4194304] 0 2024-09-13T23:06:06.769 INFO:tasks.workunit.client.0.smithi115.stdout:3/162: dread d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:06.769 INFO:tasks.workunit.client.0.smithi115.stdout:3/163: write d3/d5/d20/d28/f34 [402712,40088] 0 2024-09-13T23:06:06.769 INFO:tasks.workunit.client.0.smithi115.stdout:9/77: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:06.769 INFO:tasks.workunit.client.0.smithi115.stdout:9/78: stat d0/fd 0 2024-09-13T23:06:06.769 INFO:tasks.workunit.client.0.smithi115.stdout:1/136: dwrite d0/fc [0,4194304] 0 2024-09-13T23:06:06.770 INFO:tasks.workunit.client.0.smithi115.stdout:7/89: dwrite da/dd/d1c/f1f [0,4194304] 0 2024-09-13T23:06:06.770 INFO:tasks.workunit.client.0.smithi115.stdout:6/163: dwrite d4/df/f1c [0,4194304] 0 2024-09-13T23:06:06.770 INFO:tasks.workunit.client.0.smithi115.stdout:4/184: dwrite db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:06.771 INFO:tasks.workunit.client.0.smithi115.stdout:0/143: dwrite d6/f13 [0,4194304] 0 2024-09-13T23:06:06.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/164: mkdir d3/d5/d35 0 2024-09-13T23:06:06.772 INFO:tasks.workunit.client.0.smithi115.stdout:9/79: stat d0/d13/d17/d19/l1a 0 2024-09-13T23:06:06.772 INFO:tasks.workunit.client.0.smithi115.stdout:2/102: dread da/f15 [0,4194304] 0 2024-09-13T23:06:06.775 INFO:tasks.workunit.client.0.smithi115.stdout:1/137: creat d0/de/d1a/d29/f2a x:0 0 0 2024-09-13T23:06:06.776 INFO:tasks.workunit.client.0.smithi115.stdout:7/90: dread da/f10 [0,4194304] 0 2024-09-13T23:06:06.776 INFO:tasks.workunit.client.0.smithi115.stdout:7/91: chown c3 17380 1 2024-09-13T23:06:06.781 INFO:tasks.workunit.client.0.smithi115.stdout:1/138: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:06.781 INFO:tasks.workunit.client.0.smithi115.stdout:6/164: rename d4/c8 to d4/df/c2f 0 2024-09-13T23:06:06.785 INFO:tasks.workunit.client.0.smithi115.stdout:0/144: getdents d6 0 2024-09-13T23:06:06.785 INFO:tasks.workunit.client.0.smithi115.stdout:0/145: creat d6/d24/d25/f3a x:0 0 0 2024-09-13T23:06:06.785 INFO:tasks.workunit.client.0.smithi115.stdout:0/146: write d6/d24/d25/f3a [523172,74260] 0 2024-09-13T23:06:06.786 INFO:tasks.workunit.client.0.smithi115.stdout:3/165: truncate d3/d5/db/f17 1532749 0 2024-09-13T23:06:06.786 INFO:tasks.workunit.client.0.smithi115.stdout:3/166: readlink d3/la 0 2024-09-13T23:06:06.787 INFO:tasks.workunit.client.0.smithi115.stdout:1/139: dread d0/f22 [0,4194304] 0 2024-09-13T23:06:06.787 INFO:tasks.workunit.client.0.smithi115.stdout:2/103: dread da/de/f12 [0,4194304] 0 2024-09-13T23:06:06.787 INFO:tasks.workunit.client.0.smithi115.stdout:2/104: fdatasync da/de/d1a/f1d 0 2024-09-13T23:06:06.787 INFO:tasks.workunit.client.0.smithi115.stdout:2/105: fsync da/de/f12 0 2024-09-13T23:06:06.787 INFO:tasks.workunit.client.0.smithi115.stdout:6/165: link d4/df/c2c d4/df/d14/c30 0 2024-09-13T23:06:06.789 INFO:tasks.workunit.client.0.smithi115.stdout:9/80: rename d0/f15 to d0/d13/d17/f1e 0 2024-09-13T23:06:06.791 INFO:tasks.workunit.client.0.smithi115.stdout:0/147: creat d6/d24/f3b x:0 0 0 2024-09-13T23:06:06.792 INFO:tasks.workunit.client.0.smithi115.stdout:1/140: dread d0/f2 [0,4194304] 0 2024-09-13T23:06:06.793 INFO:tasks.workunit.client.0.smithi115.stdout:4/185: dwrite db/d11/d2e/f2c [0,4194304] 0 2024-09-13T23:06:06.794 INFO:tasks.workunit.client.0.smithi115.stdout:2/106: mkdir da/d23 0 2024-09-13T23:06:06.797 INFO:tasks.workunit.client.0.smithi115.stdout:0/148: rename d6/d24/l2a to d6/l3c 0 2024-09-13T23:06:06.797 INFO:tasks.workunit.client.0.smithi115.stdout:0/149: chown d6/d24/d25/d2b/d32 51029506 1 2024-09-13T23:06:06.797 INFO:tasks.workunit.client.0.smithi115.stdout:0/150: chown d6/f19 22 1 2024-09-13T23:06:06.797 INFO:tasks.workunit.client.0.smithi115.stdout:1/141: link d0/la d0/de/d1a/l2b 0 2024-09-13T23:06:06.798 INFO:tasks.workunit.client.0.smithi115.stdout:3/167: getdents d3/d5/db 0 2024-09-13T23:06:06.800 INFO:tasks.workunit.client.0.smithi115.stdout:4/186: rename db/dd/d17/c1a to db/d19/d1d/d2a/c32 0 2024-09-13T23:06:06.801 INFO:tasks.workunit.client.0.smithi115.stdout:9/81: dread d0/f4 [0,4194304] 0 2024-09-13T23:06:06.802 INFO:tasks.workunit.client.0.smithi115.stdout:1/142: unlink d0/de/f1f 0 2024-09-13T23:06:06.802 INFO:tasks.workunit.client.0.smithi115.stdout:0/151: dread d6/d24/f26 [0,4194304] 0 2024-09-13T23:06:06.803 INFO:tasks.workunit.client.0.smithi115.stdout:2/107: dread da/f11 [0,4194304] 0 2024-09-13T23:06:06.803 INFO:tasks.workunit.client.0.smithi115.stdout:7/92: dwrite da/dd/d1c/f1f [0,4194304] 0 2024-09-13T23:06:06.803 INFO:tasks.workunit.client.0.smithi115.stdout:7/93: chown c3 12112 1 2024-09-13T23:06:06.804 INFO:tasks.workunit.client.0.smithi115.stdout:6/166: dwrite d4/f12 [0,4194304] 0 2024-09-13T23:06:06.805 INFO:tasks.workunit.client.0.smithi115.stdout:4/187: mkdir db/d11/d2e/d33 0 2024-09-13T23:06:06.805 INFO:tasks.workunit.client.0.smithi115.stdout:9/82: mkdir d0/d13/d17/d1f 0 2024-09-13T23:06:06.805 INFO:tasks.workunit.client.0.smithi115.stdout:6/167: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:06.807 INFO:tasks.workunit.client.0.smithi115.stdout:1/143: link d0/de/d1b/f1e d0/d14/d23/f2c 0 2024-09-13T23:06:06.807 INFO:tasks.workunit.client.0.smithi115.stdout:1/144: creat d0/de/d1a/d29/f2d x:0 0 0 2024-09-13T23:06:06.809 INFO:tasks.workunit.client.0.smithi115.stdout:8/80: sync 2024-09-13T23:06:06.809 INFO:tasks.workunit.client.0.smithi115.stdout:8/81: chown d3/d5/c6 165281 1 2024-09-13T23:06:06.809 INFO:tasks.workunit.client.0.smithi115.stdout:0/152: dread d6/d24/d25/f2c [0,4194304] 0 2024-09-13T23:06:06.813 INFO:tasks.workunit.client.0.smithi115.stdout:4/188: truncate db/d19/f27 2240737 0 2024-09-13T23:06:06.813 INFO:tasks.workunit.client.0.smithi115.stdout:4/189: stat db/d19/d1d/f22 0 2024-09-13T23:06:06.814 INFO:tasks.workunit.client.0.smithi115.stdout:7/94: write da/dd/d1c/f1f [440567,128502] 0 2024-09-13T23:06:06.814 INFO:tasks.workunit.client.0.smithi115.stdout:9/83: unlink d0/d13/c18 0 2024-09-13T23:06:06.814 INFO:tasks.workunit.client.0.smithi115.stdout:9/84: rename d0/d13 to d0/d13/d17/d1f/d20 22 2024-09-13T23:06:06.817 INFO:tasks.workunit.client.0.smithi115.stdout:1/145: mknod d0/d14/c2e 0 2024-09-13T23:06:06.817 INFO:tasks.workunit.client.0.smithi115.stdout:1/146: chown d0/c11 1292 1 2024-09-13T23:06:06.819 INFO:tasks.workunit.client.0.smithi115.stdout:8/82: read d3/d11/f15 [4089847,66798] 0 2024-09-13T23:06:06.820 INFO:tasks.workunit.client.0.smithi115.stdout:0/153: unlink d6/d24/d25/c27 0 2024-09-13T23:06:06.821 INFO:tasks.workunit.client.0.smithi115.stdout:4/190: mkdir db/d19/d34 0 2024-09-13T23:06:06.821 INFO:tasks.workunit.client.0.smithi115.stdout:7/95: rmdir da/dd 39 2024-09-13T23:06:06.821 INFO:tasks.workunit.client.0.smithi115.stdout:7/96: creat da/dd/d1c/f20 x:0 0 0 2024-09-13T23:06:06.823 INFO:tasks.workunit.client.0.smithi115.stdout:9/85: link d0/lc d0/d13/l21 0 2024-09-13T23:06:06.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/154: rmdir d6 39 2024-09-13T23:06:06.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/155: creat d6/d24/f3d x:0 0 0 2024-09-13T23:06:06.825 INFO:tasks.workunit.client.0.smithi115.stdout:8/83: mkdir d3/d5/d1d 0 2024-09-13T23:06:06.826 INFO:tasks.workunit.client.0.smithi115.stdout:4/191: unlink db/d11/d2e/l2b 0 2024-09-13T23:06:06.829 INFO:tasks.workunit.client.0.smithi115.stdout:7/97: creat da/f21 x:0 0 0 2024-09-13T23:06:06.829 INFO:tasks.workunit.client.0.smithi115.stdout:7/98: readlink da/dd/le 0 2024-09-13T23:06:06.830 INFO:tasks.workunit.client.0.smithi115.stdout:2/108: dwrite da/de/d1a/f1d [0,4194304] 0 2024-09-13T23:06:06.830 INFO:tasks.workunit.client.0.smithi115.stdout:2/109: creat da/de/f24 x:0 0 0 2024-09-13T23:06:06.830 INFO:tasks.workunit.client.0.smithi115.stdout:9/86: truncate d0/f4 1179973 0 2024-09-13T23:06:06.831 INFO:tasks.workunit.client.0.smithi115.stdout:9/87: getdents d0/d13/d17/d1f 0 2024-09-13T23:06:06.832 INFO:tasks.workunit.client.0.smithi115.stdout:6/168: dwrite d4/df/f1c [0,4194304] 0 2024-09-13T23:06:06.833 INFO:tasks.workunit.client.0.smithi115.stdout:0/156: rename d6/l2f to d6/d24/d25/d2b/d32/l3e 0 2024-09-13T23:06:06.834 INFO:tasks.workunit.client.0.smithi115.stdout:4/192: mkdir db/d11/d2e/d35 0 2024-09-13T23:06:06.834 INFO:tasks.workunit.client.0.smithi115.stdout:5/109: sync 2024-09-13T23:06:06.835 INFO:tasks.workunit.client.0.smithi115.stdout:7/99: fdatasync da/dd/d1c/f1f 0 2024-09-13T23:06:06.836 INFO:tasks.workunit.client.0.smithi115.stdout:3/168: dwrite d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:06.842 INFO:tasks.workunit.client.0.smithi115.stdout:4/193: mkdir db/d11/d2e/d33/d36 0 2024-09-13T23:06:06.842 INFO:tasks.workunit.client.0.smithi115.stdout:0/157: dread d6/d24/d25/f3a [0,4194304] 0 2024-09-13T23:06:06.850 INFO:tasks.workunit.client.0.smithi115.stdout:2/110: write da/de/d1a/f1d [5195934,62065] 0 2024-09-13T23:06:06.852 INFO:tasks.workunit.client.0.smithi115.stdout:2/111: truncate f4 4070544 0 2024-09-13T23:06:06.854 INFO:tasks.workunit.client.0.smithi115.stdout:2/112: mknod da/c25 0 2024-09-13T23:06:06.855 INFO:tasks.workunit.client.0.smithi115.stdout:4/194: dread db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:06.856 INFO:tasks.workunit.client.0.smithi115.stdout:2/113: rename da/de/d1a/d1c/c14 to da/d21/c26 0 2024-09-13T23:06:06.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/114: readlink l9 0 2024-09-13T23:06:06.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/115: stat da/de/f24 0 2024-09-13T23:06:06.857 INFO:tasks.workunit.client.0.smithi115.stdout:2/116: mknod da/c27 0 2024-09-13T23:06:06.858 INFO:tasks.workunit.client.0.smithi115.stdout:2/117: dread - da/de/f24 zero size 2024-09-13T23:06:06.859 INFO:tasks.workunit.client.0.smithi115.stdout:2/118: chown c5 35 1 2024-09-13T23:06:06.859 INFO:tasks.workunit.client.0.smithi115.stdout:2/119: chown da/de/d1a/f1d 1860 1 2024-09-13T23:06:06.859 INFO:tasks.workunit.client.0.smithi115.stdout:0/158: dread d6/f13 [0,4194304] 0 2024-09-13T23:06:06.859 INFO:tasks.workunit.client.0.smithi115.stdout:2/120: creat da/de/f28 x:0 0 0 2024-09-13T23:06:06.859 INFO:tasks.workunit.client.0.smithi115.stdout:0/159: creat d6/d24/d25/d2b/d32/f3f x:0 0 0 2024-09-13T23:06:06.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/160: rename d6/c1f to d6/d24/d25/d2b/c40 0 2024-09-13T23:06:06.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/161: write d6/d24/d25/f3a [1437196,58493] 0 2024-09-13T23:06:06.862 INFO:tasks.workunit.client.0.smithi115.stdout:0/162: rename d6/c1e to d6/d24/d25/d2b/d32/c41 0 2024-09-13T23:06:06.868 INFO:tasks.workunit.client.0.smithi115.stdout:2/121: dread da/f11 [0,4194304] 0 2024-09-13T23:06:06.869 INFO:tasks.workunit.client.0.smithi115.stdout:0/163: unlink d6/f13 0 2024-09-13T23:06:06.870 INFO:tasks.workunit.client.0.smithi115.stdout:2/122: unlink da/c25 0 2024-09-13T23:06:06.871 INFO:tasks.workunit.client.0.smithi115.stdout:2/123: dread f7 [0,4194304] 0 2024-09-13T23:06:06.872 INFO:tasks.workunit.client.0.smithi115.stdout:2/124: creat da/f29 x:0 0 0 2024-09-13T23:06:06.872 INFO:tasks.workunit.client.0.smithi115.stdout:2/125: symlink da/d21/l2a 0 2024-09-13T23:06:06.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/84: dwrite d3/d11/f17 [0,4194304] 0 2024-09-13T23:06:06.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/85: getdents d3/d5/dc 0 2024-09-13T23:06:06.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/86: write d3/d11/f14 [259481,7722] 0 2024-09-13T23:06:06.881 INFO:tasks.workunit.client.0.smithi115.stdout:5/110: dwrite d8/dd/d13/f1a [0,4194304] 0 2024-09-13T23:06:06.881 INFO:tasks.workunit.client.0.smithi115.stdout:5/111: fsync d8/dd/d14/f1e 0 2024-09-13T23:06:06.881 INFO:tasks.workunit.client.0.smithi115.stdout:5/112: chown d8/dd/l1b 17638 1 2024-09-13T23:06:06.884 INFO:tasks.workunit.client.0.smithi115.stdout:9/88: dread d0/f4 [0,4194304] 0 2024-09-13T23:06:06.884 INFO:tasks.workunit.client.0.smithi115.stdout:7/100: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:06.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/169: dwrite d3/d5/d20/d28/f32 [0,4194304] 0 2024-09-13T23:06:06.885 INFO:tasks.workunit.client.0.smithi115.stdout:4/195: dwrite db/dd/d17/f24 [8388608,4194304] 0 2024-09-13T23:06:06.885 INFO:tasks.workunit.client.0.smithi115.stdout:4/196: fsync db/d11/d2e/f2c 0 2024-09-13T23:06:06.886 INFO:tasks.workunit.client.0.smithi115.stdout:0/164: dread d6/f12 [0,4194304] 0 2024-09-13T23:06:06.886 INFO:tasks.workunit.client.0.smithi115.stdout:6/169: dwrite d4/f12 [0,4194304] 0 2024-09-13T23:06:06.886 INFO:tasks.workunit.client.0.smithi115.stdout:0/165: truncate d6/d24/d25/d2b/d32/f36 871393 0 2024-09-13T23:06:06.887 INFO:tasks.workunit.client.0.smithi115.stdout:3/170: mknod d3/d16/d1a/d29/c36 0 2024-09-13T23:06:06.887 INFO:tasks.workunit.client.0.smithi115.stdout:3/171: creat d3/d16/f37 x:0 0 0 2024-09-13T23:06:06.888 INFO:tasks.workunit.client.0.smithi115.stdout:4/197: symlink db/d19/d1d/l37 0 2024-09-13T23:06:06.888 INFO:tasks.workunit.client.0.smithi115.stdout:4/198: dread - db/d16/f30 zero size 2024-09-13T23:06:06.889 INFO:tasks.workunit.client.0.smithi115.stdout:6/170: mkdir d4/d17/d2a/d31 0 2024-09-13T23:06:06.889 INFO:tasks.workunit.client.0.smithi115.stdout:6/171: dread - d4/df/d14/f2d zero size 2024-09-13T23:06:06.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/172: chown d4/d17/f23 5205743 1 2024-09-13T23:06:06.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/173: chown d4/df/c29 487659 1 2024-09-13T23:06:06.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/174: dread - d4/d17/f23 zero size 2024-09-13T23:06:06.891 INFO:tasks.workunit.client.0.smithi115.stdout:3/172: rmdir d3/d5 39 2024-09-13T23:06:06.891 INFO:tasks.workunit.client.0.smithi115.stdout:3/173: creat d3/d16/d1c/f38 x:0 0 0 2024-09-13T23:06:06.891 INFO:tasks.workunit.client.0.smithi115.stdout:3/174: write d3/d5/db/f23 [5393277,1330] 0 2024-09-13T23:06:06.891 INFO:tasks.workunit.client.0.smithi115.stdout:4/199: creat db/dd/f38 x:0 0 0 2024-09-13T23:06:06.892 INFO:tasks.workunit.client.0.smithi115.stdout:5/113: rename d8/dd/d13 to d8/dd/d20 0 2024-09-13T23:06:06.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/175: truncate d4/df/f1f 427757 0 2024-09-13T23:06:06.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/176: write d4/df/d14/f2d [666179,92931] 0 2024-09-13T23:06:06.894 INFO:tasks.workunit.client.0.smithi115.stdout:3/175: creat d3/d5/d20/f39 x:0 0 0 2024-09-13T23:06:06.895 INFO:tasks.workunit.client.0.smithi115.stdout:6/177: unlink f3 0 2024-09-13T23:06:06.895 INFO:tasks.workunit.client.0.smithi115.stdout:6/178: write d4/df/f2e [788929,50095] 0 2024-09-13T23:06:06.896 INFO:tasks.workunit.client.0.smithi115.stdout:8/87: dread f2 [0,4194304] 0 2024-09-13T23:06:06.896 INFO:tasks.workunit.client.0.smithi115.stdout:8/88: dread - d3/d5/dc/f12 zero size 2024-09-13T23:06:06.897 INFO:tasks.workunit.client.0.smithi115.stdout:6/179: link d4/df/c15 d4/d17/d2a/d31/c32 0 2024-09-13T23:06:06.901 INFO:tasks.workunit.client.0.smithi115.stdout:6/180: rename d4/d17/f1b to d4/d17/d2a/f33 0 2024-09-13T23:06:06.904 INFO:tasks.workunit.client.0.smithi115.stdout:0/166: dread d6/fd [4194304,4194304] 0 2024-09-13T23:06:06.904 INFO:tasks.workunit.client.0.smithi115.stdout:0/167: fdatasync d6/d24/d25/f2c 0 2024-09-13T23:06:06.904 INFO:tasks.workunit.client.0.smithi115.stdout:8/89: dread d3/d5/fa [0,4194304] 0 2024-09-13T23:06:06.904 INFO:tasks.workunit.client.0.smithi115.stdout:2/126: dwrite f7 [0,4194304] 0 2024-09-13T23:06:06.905 INFO:tasks.workunit.client.0.smithi115.stdout:9/89: write d0/f2 [200248,23679] 0 2024-09-13T23:06:06.907 INFO:tasks.workunit.client.0.smithi115.stdout:8/90: write d3/d5/fa [497575,115661] 0 2024-09-13T23:06:06.909 INFO:tasks.workunit.client.0.smithi115.stdout:9/90: stat d0/l16 0 2024-09-13T23:06:06.916 INFO:tasks.workunit.client.0.smithi115.stdout:6/181: dread d4/df/d14/f18 [0,4194304] 0 2024-09-13T23:06:06.916 INFO:tasks.workunit.client.0.smithi115.stdout:6/182: chown d4/df/f1c 175226391 1 2024-09-13T23:06:06.922 INFO:tasks.workunit.client.0.smithi115.stdout:2/127: dread f7 [0,4194304] 0 2024-09-13T23:06:06.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/128: dread f4 [0,4194304] 0 2024-09-13T23:06:06.928 INFO:tasks.workunit.client.0.smithi115.stdout:2/129: symlink da/d23/l2b 0 2024-09-13T23:06:06.929 INFO:tasks.workunit.client.0.smithi115.stdout:2/130: unlink da/f29 0 2024-09-13T23:06:06.930 INFO:tasks.workunit.client.0.smithi115.stdout:2/131: mkdir da/d23/d2c 0 2024-09-13T23:06:06.941 INFO:tasks.workunit.client.0.smithi115.stdout:3/176: dwrite d3/d16/f33 [0,4194304] 0 2024-09-13T23:06:06.941 INFO:tasks.workunit.client.0.smithi115.stdout:4/200: dwrite db/dd/d17/f24 [8388608,4194304] 0 2024-09-13T23:06:06.942 INFO:tasks.workunit.client.0.smithi115.stdout:5/114: dwrite d8/dd/f10 [0,4194304] 0 2024-09-13T23:06:06.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/91: dwrite d0/d13/f1c [0,4194304] 0 2024-09-13T23:06:06.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/183: dwrite d4/df/f1c [0,4194304] 0 2024-09-13T23:06:06.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/92: chown d0/ca 61 1 2024-09-13T23:06:06.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/93: creat d0/f22 x:0 0 0 2024-09-13T23:06:06.943 INFO:tasks.workunit.client.0.smithi115.stdout:0/168: dwrite d6/f12 [0,4194304] 0 2024-09-13T23:06:06.944 INFO:tasks.workunit.client.0.smithi115.stdout:3/177: mknod d3/c3a 0 2024-09-13T23:06:06.945 INFO:tasks.workunit.client.0.smithi115.stdout:4/201: symlink db/d11/d2e/l39 0 2024-09-13T23:06:06.952 INFO:tasks.workunit.client.0.smithi115.stdout:9/94: write d0/d13/f1c [1218383,77181] 0 2024-09-13T23:06:06.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/115: rename d8/dd/l1b to d8/l21 0 2024-09-13T23:06:06.954 INFO:tasks.workunit.client.0.smithi115.stdout:5/116: fsync d8/fb 0 2024-09-13T23:06:06.954 INFO:tasks.workunit.client.0.smithi115.stdout:5/117: chown d8/dd/c1c 122695 1 2024-09-13T23:06:06.956 INFO:tasks.workunit.client.0.smithi115.stdout:4/202: write db/d11/d2e/f1f [3384306,119858] 0 2024-09-13T23:06:06.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/169: dwrite d6/d24/d25/d2b/d32/f3f [0,4194304] 0 2024-09-13T23:06:06.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/170: creat d6/d24/d25/d2b/f42 x:0 0 0 2024-09-13T23:06:06.961 INFO:tasks.workunit.client.0.smithi115.stdout:2/132: rmdir da 39 2024-09-13T23:06:06.962 INFO:tasks.workunit.client.0.smithi115.stdout:3/178: mkdir d3/d16/d1c/d31/d3b 0 2024-09-13T23:06:06.962 INFO:tasks.workunit.client.0.smithi115.stdout:3/179: stat d3/d16/d1c/c1d 0 2024-09-13T23:06:06.963 INFO:tasks.workunit.client.0.smithi115.stdout:4/203: dread db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:06.963 INFO:tasks.workunit.client.0.smithi115.stdout:4/204: write db/dd/f38 [200406,30255] 0 2024-09-13T23:06:06.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/95: creat d0/d13/d17/d1f/f23 x:0 0 0 2024-09-13T23:06:06.964 INFO:tasks.workunit.client.0.smithi115.stdout:9/96: write d0/f22 [19169,41175] 0 2024-09-13T23:06:06.965 INFO:tasks.workunit.client.0.smithi115.stdout:6/184: rename d4/df/d14/f2d to d4/d17/d2a/d31/f34 0 2024-09-13T23:06:06.969 INFO:tasks.workunit.client.0.smithi115.stdout:2/133: stat c5 0 2024-09-13T23:06:06.970 INFO:tasks.workunit.client.0.smithi115.stdout:3/180: mknod d3/d16/d1c/d31/c3c 0 2024-09-13T23:06:06.970 INFO:tasks.workunit.client.0.smithi115.stdout:3/181: truncate d3/d16/d1a/f26 343085 0 2024-09-13T23:06:06.972 INFO:tasks.workunit.client.0.smithi115.stdout:5/118: rename d8/dd/d20/l19 to d8/dd/l22 0 2024-09-13T23:06:06.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/185: mkdir d4/df/d14/d35 0 2024-09-13T23:06:06.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/186: chown d4/df/d14 4403 1 2024-09-13T23:06:06.976 INFO:tasks.workunit.client.0.smithi115.stdout:0/171: rename d6/d24/d25/d2b/d32/c41 to d6/d24/d25/c43 0 2024-09-13T23:06:06.977 INFO:tasks.workunit.client.0.smithi115.stdout:2/134: write f7 [403214,67662] 0 2024-09-13T23:06:06.977 INFO:tasks.workunit.client.0.smithi115.stdout:2/135: write da/de/f24 [372166,129200] 0 2024-09-13T23:06:06.978 INFO:tasks.workunit.client.0.smithi115.stdout:6/187: mknod d4/df/c36 0 2024-09-13T23:06:06.980 INFO:tasks.workunit.client.0.smithi115.stdout:5/119: rename d8/dd/d14/d18 to d8/dd/d20/d23 0 2024-09-13T23:06:06.985 INFO:tasks.workunit.client.0.smithi115.stdout:0/172: unlink d6/d24/d25/f3a 0 2024-09-13T23:06:06.987 INFO:tasks.workunit.client.0.smithi115.stdout:6/188: mknod d4/d17/c37 0 2024-09-13T23:06:06.988 INFO:tasks.workunit.client.0.smithi115.stdout:5/120: mkdir d8/dd/d20/d24 0 2024-09-13T23:06:06.990 INFO:tasks.workunit.client.0.smithi115.stdout:0/173: mkdir d6/d24/d25/d2b/d32/d44 0 2024-09-13T23:06:06.992 INFO:tasks.workunit.client.0.smithi115.stdout:9/97: dwrite d0/d13/d17/f1e [4194304,4194304] 0 2024-09-13T23:06:06.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/121: creat d8/dd/d20/f25 x:0 0 0 2024-09-13T23:06:06.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/122: creat d8/f26 x:0 0 0 2024-09-13T23:06:06.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/123: chown d8/f26 10243971 1 2024-09-13T23:06:06.994 INFO:tasks.workunit.client.0.smithi115.stdout:9/98: mknod d0/d13/c24 0 2024-09-13T23:06:06.996 INFO:tasks.workunit.client.0.smithi115.stdout:1/147: sync 2024-09-13T23:06:06.996 INFO:tasks.workunit.client.0.smithi115.stdout:1/148: truncate d0/f9 4496680 0 2024-09-13T23:06:06.996 INFO:tasks.workunit.client.0.smithi115.stdout:1/149: creat d0/de/d1b/f2f x:0 0 0 2024-09-13T23:06:06.997 INFO:tasks.workunit.client.0.smithi115.stdout:1/150: write d0/f2 [4271704,35454] 0 2024-09-13T23:06:06.997 INFO:tasks.workunit.client.0.smithi115.stdout:1/151: write d0/f3 [4136679,81141] 0 2024-09-13T23:06:06.997 INFO:tasks.workunit.client.0.smithi115.stdout:5/124: mkdir d8/dd/d20/d27 0 2024-09-13T23:06:06.998 INFO:tasks.workunit.client.0.smithi115.stdout:9/99: symlink d0/d13/d17/d19/l25 0 2024-09-13T23:06:06.998 INFO:tasks.workunit.client.0.smithi115.stdout:9/100: write d0/f2 [3891608,102133] 0 2024-09-13T23:06:07.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/125: symlink d8/dd/d20/l28 0 2024-09-13T23:06:07.000 INFO:tasks.workunit.client.0.smithi115.stdout:9/101: symlink d0/l26 0 2024-09-13T23:06:07.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/152: mknod d0/c30 0 2024-09-13T23:06:07.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/153: getdents d0/de/d1b/d25 0 2024-09-13T23:06:07.002 INFO:tasks.workunit.client.0.smithi115.stdout:1/154: stat d0/de/d1b/f1e 0 2024-09-13T23:06:07.002 INFO:tasks.workunit.client.0.smithi115.stdout:1/155: fsync d0/fc 0 2024-09-13T23:06:07.003 INFO:tasks.workunit.client.0.smithi115.stdout:1/156: mkdir d0/d14/d31 0 2024-09-13T23:06:07.007 INFO:tasks.workunit.client.0.smithi115.stdout:5/126: dread d8/dd/ff [0,4194304] 0 2024-09-13T23:06:07.008 INFO:tasks.workunit.client.0.smithi115.stdout:4/205: dwrite db/f10 [0,4194304] 0 2024-09-13T23:06:07.008 INFO:tasks.workunit.client.0.smithi115.stdout:3/182: dwrite d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:07.009 INFO:tasks.workunit.client.0.smithi115.stdout:3/183: symlink d3/d5/d2c/d2f/l3d 0 2024-09-13T23:06:07.010 INFO:tasks.workunit.client.0.smithi115.stdout:3/184: mknod d3/d16/d1c/d31/d3b/c3e 0 2024-09-13T23:06:07.010 INFO:tasks.workunit.client.0.smithi115.stdout:3/185: chown d3/d5/d2c/d2f/l3d 4684 1 2024-09-13T23:06:07.012 INFO:tasks.workunit.client.0.smithi115.stdout:3/186: link d3/d16/d1c/d31/d3b/c3e d3/d5/d20/d28/c3f 0 2024-09-13T23:06:07.013 INFO:tasks.workunit.client.0.smithi115.stdout:2/136: dwrite da/de/f12 [0,4194304] 0 2024-09-13T23:06:07.013 INFO:tasks.workunit.client.0.smithi115.stdout:2/137: write da/de/f24 [725855,12070] 0 2024-09-13T23:06:07.013 INFO:tasks.workunit.client.0.smithi115.stdout:4/206: dread fa [0,4194304] 0 2024-09-13T23:06:07.014 INFO:tasks.workunit.client.0.smithi115.stdout:3/187: creat d3/d5/db/f40 x:0 0 0 2024-09-13T23:06:07.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/157: write d0/d14/d23/f2c [959258,47795] 0 2024-09-13T23:06:07.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/158: chown d0/dd/f13 56275 1 2024-09-13T23:06:07.016 INFO:tasks.workunit.client.0.smithi115.stdout:6/189: dwrite d4/df/f2e [0,4194304] 0 2024-09-13T23:06:07.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/159: creat d0/de/f32 x:0 0 0 2024-09-13T23:06:07.016 INFO:tasks.workunit.client.0.smithi115.stdout:1/160: readlink d0/de/d1a/l21 0 2024-09-13T23:06:07.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/138: mkdir da/d21/d2d 0 2024-09-13T23:06:07.019 INFO:tasks.workunit.client.0.smithi115.stdout:6/190: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:07.019 INFO:tasks.workunit.client.0.smithi115.stdout:6/191: readlink d4/l24 0 2024-09-13T23:06:07.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/174: getdents d6/d24/d25 0 2024-09-13T23:06:07.026 INFO:tasks.workunit.client.0.smithi115.stdout:0/175: chown d6/d24/d25/d2b/c40 0 1 2024-09-13T23:06:07.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/139: write da/de/f12 [1647501,12871] 0 2024-09-13T23:06:07.036 INFO:tasks.workunit.client.0.smithi115.stdout:6/192: write d4/df/d14/f18 [1257872,85094] 0 2024-09-13T23:06:07.036 INFO:tasks.workunit.client.0.smithi115.stdout:6/193: stat d4/d17/d2a 0 2024-09-13T23:06:07.037 INFO:tasks.workunit.client.0.smithi115.stdout:6/194: read d4/df/f28 [32586,96842] 0 2024-09-13T23:06:07.037 INFO:tasks.workunit.client.0.smithi115.stdout:6/195: chown d4/f1d 6072 1 2024-09-13T23:06:07.037 INFO:tasks.workunit.client.0.smithi115.stdout:6/196: fsync d4/f1d 0 2024-09-13T23:06:07.037 INFO:tasks.workunit.client.0.smithi115.stdout:1/161: symlink d0/d14/l33 0 2024-09-13T23:06:07.038 INFO:tasks.workunit.client.0.smithi115.stdout:0/176: mkdir d6/d45 0 2024-09-13T23:06:07.039 INFO:tasks.workunit.client.0.smithi115.stdout:2/140: creat da/d23/d2c/f2e x:0 0 0 2024-09-13T23:06:07.039 INFO:tasks.workunit.client.0.smithi115.stdout:2/141: write f7 [3456783,36334] 0 2024-09-13T23:06:07.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/162: rename d0/de/d1b/f1e to d0/de/f34 0 2024-09-13T23:06:07.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/163: readlink d0/d14/l33 0 2024-09-13T23:06:07.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/164: creat d0/de/d1b/f35 x:0 0 0 2024-09-13T23:06:07.042 INFO:tasks.workunit.client.0.smithi115.stdout:5/127: dwrite d8/fa [0,4194304] 0 2024-09-13T23:06:07.043 INFO:tasks.workunit.client.0.smithi115.stdout:0/177: getdents d6/d24 0 2024-09-13T23:06:07.044 INFO:tasks.workunit.client.0.smithi115.stdout:0/178: truncate d6/fa 1919015 0 2024-09-13T23:06:07.046 INFO:tasks.workunit.client.0.smithi115.stdout:0/179: rmdir d6/d45 0 2024-09-13T23:06:07.047 INFO:tasks.workunit.client.0.smithi115.stdout:0/180: unlink d6/d24/d25/d2b/d32/f3f 0 2024-09-13T23:06:07.047 INFO:tasks.workunit.client.0.smithi115.stdout:0/181: readlink d6/d24/d25/d2b/d32/l3e 0 2024-09-13T23:06:07.047 INFO:tasks.workunit.client.0.smithi115.stdout:0/182: truncate d6/d24/d25/f29 178084 0 2024-09-13T23:06:07.047 INFO:tasks.workunit.client.0.smithi115.stdout:6/197: dread d4/d17/d2a/f33 [0,4194304] 0 2024-09-13T23:06:07.049 INFO:tasks.workunit.client.0.smithi115.stdout:6/198: unlink d4/cd 0 2024-09-13T23:06:07.051 INFO:tasks.workunit.client.0.smithi115.stdout:3/188: dwrite d3/d16/d1a/f1f [0,4194304] 0 2024-09-13T23:06:07.051 INFO:tasks.workunit.client.0.smithi115.stdout:1/165: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:07.051 INFO:tasks.workunit.client.0.smithi115.stdout:4/207: dwrite db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:07.051 INFO:tasks.workunit.client.0.smithi115.stdout:3/189: write d3/d16/d1c/f38 [847114,7927] 0 2024-09-13T23:06:07.051 INFO:tasks.workunit.client.0.smithi115.stdout:3/190: chown d3/d16/d1c/f2b 19956890 1 2024-09-13T23:06:07.052 INFO:tasks.workunit.client.0.smithi115.stdout:5/128: dread d8/dd/d20/f17 [0,4194304] 0 2024-09-13T23:06:07.053 INFO:tasks.workunit.client.0.smithi115.stdout:3/191: mkdir d3/d16/d1c/d31/d41 0 2024-09-13T23:06:07.056 INFO:tasks.workunit.client.0.smithi115.stdout:6/199: rename d4/d17 to d4/df/d14/d38 0 2024-09-13T23:06:07.057 INFO:tasks.workunit.client.0.smithi115.stdout:5/129: mknod d8/dd/d14/c29 0 2024-09-13T23:06:07.058 INFO:tasks.workunit.client.0.smithi115.stdout:3/192: mkdir d3/d16/d1c/d31/d42 0 2024-09-13T23:06:07.059 INFO:tasks.workunit.client.0.smithi115.stdout:4/208: dread db/dd/d17/f24 [8388608,4194304] 0 2024-09-13T23:06:07.060 INFO:tasks.workunit.client.0.smithi115.stdout:6/200: getdents d4/df/d14/d38/d2a 0 2024-09-13T23:06:07.061 INFO:tasks.workunit.client.0.smithi115.stdout:6/201: creat d4/df/d14/d35/f39 x:0 0 0 2024-09-13T23:06:07.062 INFO:tasks.workunit.client.0.smithi115.stdout:6/202: chown d4/f12 2573630 1 2024-09-13T23:06:07.062 INFO:tasks.workunit.client.0.smithi115.stdout:6/203: readlink d4/df/d14/d38/l26 0 2024-09-13T23:06:07.063 INFO:tasks.workunit.client.0.smithi115.stdout:6/204: mkdir d4/df/d3a 0 2024-09-13T23:06:07.063 INFO:tasks.workunit.client.0.smithi115.stdout:6/205: fdatasync d4/df/f1c 0 2024-09-13T23:06:07.063 INFO:tasks.workunit.client.0.smithi115.stdout:6/206: creat d4/df/f3b x:0 0 0 2024-09-13T23:06:07.066 INFO:tasks.workunit.client.0.smithi115.stdout:6/207: stat d4/df/c2f 0 2024-09-13T23:06:07.066 INFO:tasks.workunit.client.0.smithi115.stdout:6/208: fsync d4/df/d14/d38/d2a/f33 0 2024-09-13T23:06:07.066 INFO:tasks.workunit.client.0.smithi115.stdout:6/209: chown d4/f1d 3782 1 2024-09-13T23:06:07.066 INFO:tasks.workunit.client.0.smithi115.stdout:6/210: read d4/f1d [1769085,67227] 0 2024-09-13T23:06:07.070 INFO:tasks.workunit.client.0.smithi115.stdout:2/142: truncate f7 3899779 0 2024-09-13T23:06:07.073 INFO:tasks.workunit.client.0.smithi115.stdout:2/143: dread da/f15 [0,4194304] 0 2024-09-13T23:06:07.073 INFO:tasks.workunit.client.0.smithi115.stdout:2/144: fdatasync da/de/f28 0 2024-09-13T23:06:07.074 INFO:tasks.workunit.client.0.smithi115.stdout:4/209: dread db/dd/d17/f24 [0,4194304] 0 2024-09-13T23:06:07.074 INFO:tasks.workunit.client.0.smithi115.stdout:2/145: creat da/de/d1a/f2f x:0 0 0 2024-09-13T23:06:07.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/101: sync 2024-09-13T23:06:07.079 INFO:tasks.workunit.client.0.smithi115.stdout:8/91: sync 2024-09-13T23:06:07.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/102: chown c6 4819 1 2024-09-13T23:06:07.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/103: stat da/dd 0 2024-09-13T23:06:07.081 INFO:tasks.workunit.client.0.smithi115.stdout:8/92: truncate d3/d11/f15 227819 0 2024-09-13T23:06:07.081 INFO:tasks.workunit.client.0.smithi115.stdout:8/93: chown d3/d5/dc/f12 100 1 2024-09-13T23:06:07.081 INFO:tasks.workunit.client.0.smithi115.stdout:0/183: dwrite d6/d24/d25/f29 [0,4194304] 0 2024-09-13T23:06:07.081 INFO:tasks.workunit.client.0.smithi115.stdout:0/184: truncate d6/d24/f3b 56316 0 2024-09-13T23:06:07.082 INFO:tasks.workunit.client.0.smithi115.stdout:1/166: dwrite d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:07.082 INFO:tasks.workunit.client.0.smithi115.stdout:1/167: creat d0/de/d1b/f36 x:0 0 0 2024-09-13T23:06:07.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/130: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:07.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/131: fdatasync d8/dd/d14/f1e 0 2024-09-13T23:06:07.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/211: dread d4/df/f2e [0,4194304] 0 2024-09-13T23:06:07.083 INFO:tasks.workunit.client.0.smithi115.stdout:8/94: creat d3/d5/f1e x:0 0 0 2024-09-13T23:06:07.084 INFO:tasks.workunit.client.0.smithi115.stdout:8/95: dread - d3/d5/dc/f12 zero size 2024-09-13T23:06:07.084 INFO:tasks.workunit.client.0.smithi115.stdout:0/185: creat d6/d24/d25/d2b/d32/d44/f46 x:0 0 0 2024-09-13T23:06:07.086 INFO:tasks.workunit.client.0.smithi115.stdout:3/193: fdatasync d3/d16/d1c/f38 0 2024-09-13T23:06:07.087 INFO:tasks.workunit.client.0.smithi115.stdout:7/104: dread da/dd/d1c/f1f [0,4194304] 0 2024-09-13T23:06:07.087 INFO:tasks.workunit.client.0.smithi115.stdout:1/168: mkdir d0/d14/d31/d37 0 2024-09-13T23:06:07.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/132: link d8/dd/d20/f1a d8/f2a 0 2024-09-13T23:06:07.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/133: creat d8/dd/f2b x:0 0 0 2024-09-13T23:06:07.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/134: chown d8/dd/ff 1280 1 2024-09-13T23:06:07.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/135: dread - d8/f1f zero size 2024-09-13T23:06:07.091 INFO:tasks.workunit.client.0.smithi115.stdout:5/136: stat d8/dd 0 2024-09-13T23:06:07.091 INFO:tasks.workunit.client.0.smithi115.stdout:8/96: mkdir d3/d5/dc/d16/d1f 0 2024-09-13T23:06:07.091 INFO:tasks.workunit.client.0.smithi115.stdout:0/186: symlink d6/d24/d25/d2b/d32/d44/l47 0 2024-09-13T23:06:07.091 INFO:tasks.workunit.client.0.smithi115.stdout:3/194: mknod d3/c43 0 2024-09-13T23:06:07.092 INFO:tasks.workunit.client.0.smithi115.stdout:1/169: link d0/c30 d0/de/d1b/c38 0 2024-09-13T23:06:07.093 INFO:tasks.workunit.client.0.smithi115.stdout:8/97: dread d3/d5/fb [0,4194304] 0 2024-09-13T23:06:07.095 INFO:tasks.workunit.client.0.smithi115.stdout:8/98: creat d3/d5/d1d/f20 x:0 0 0 2024-09-13T23:06:07.095 INFO:tasks.workunit.client.0.smithi115.stdout:8/99: truncate d3/d11/f14 544537 0 2024-09-13T23:06:07.095 INFO:tasks.workunit.client.0.smithi115.stdout:8/100: fdatasync d3/d11/f14 0 2024-09-13T23:06:07.096 INFO:tasks.workunit.client.0.smithi115.stdout:0/187: dread d6/f10 [0,4194304] 0 2024-09-13T23:06:07.096 INFO:tasks.workunit.client.0.smithi115.stdout:0/188: fdatasync d6/d24/d25/d2b/d32/f36 0 2024-09-13T23:06:07.096 INFO:tasks.workunit.client.0.smithi115.stdout:0/189: creat d6/d24/d25/d2b/d32/f48 x:0 0 0 2024-09-13T23:06:07.096 INFO:tasks.workunit.client.0.smithi115.stdout:0/190: chown d6/d24/d25/d2b/d32 2 1 2024-09-13T23:06:07.099 INFO:tasks.workunit.client.0.smithi115.stdout:0/191: rename d6/f37 to d6/d24/f49 0 2024-09-13T23:06:07.099 INFO:tasks.workunit.client.0.smithi115.stdout:7/105: write f2 [5956506,58471] 0 2024-09-13T23:06:07.103 INFO:tasks.workunit.client.0.smithi115.stdout:0/192: rename d6/d24/l35 to d6/d24/d25/l4a 0 2024-09-13T23:06:07.103 INFO:tasks.workunit.client.0.smithi115.stdout:0/193: dread - d6/d24/f3d zero size 2024-09-13T23:06:07.105 INFO:tasks.workunit.client.0.smithi115.stdout:0/194: unlink d6/f11 0 2024-09-13T23:06:07.109 INFO:tasks.workunit.client.0.smithi115.stdout:8/101: write d3/d11/f17 [1962926,61468] 0 2024-09-13T23:06:07.109 INFO:tasks.workunit.client.0.smithi115.stdout:4/210: dwrite db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:07.109 INFO:tasks.workunit.client.0.smithi115.stdout:8/102: stat d3/d5/l1b 0 2024-09-13T23:06:07.109 INFO:tasks.workunit.client.0.smithi115.stdout:8/103: rename d3 to d3/d5/dc/d16/d1f/d21 22 2024-09-13T23:06:07.109 INFO:tasks.workunit.client.0.smithi115.stdout:8/104: truncate d3/d5/dc/f12 172428 0 2024-09-13T23:06:07.110 INFO:tasks.workunit.client.0.smithi115.stdout:8/105: fdatasync d3/d5/f1e 0 2024-09-13T23:06:07.112 INFO:tasks.workunit.client.0.smithi115.stdout:4/211: getdents db/d19/d1d/d2a 0 2024-09-13T23:06:07.113 INFO:tasks.workunit.client.0.smithi115.stdout:2/146: dwrite da/f15 [0,4194304] 0 2024-09-13T23:06:07.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/106: creat d3/d5/dc/d16/d1f/f22 x:0 0 0 2024-09-13T23:06:07.118 INFO:tasks.workunit.client.0.smithi115.stdout:4/212: write fa [5654470,106175] 0 2024-09-13T23:06:07.118 INFO:tasks.workunit.client.0.smithi115.stdout:5/137: dwrite d8/dd/d20/f1a [0,4194304] 0 2024-09-13T23:06:07.118 INFO:tasks.workunit.client.0.smithi115.stdout:2/147: symlink da/de/d1a/l30 0 2024-09-13T23:06:07.119 INFO:tasks.workunit.client.0.smithi115.stdout:8/107: mkdir d3/d5/dc/d23 0 2024-09-13T23:06:07.121 INFO:tasks.workunit.client.0.smithi115.stdout:5/138: link d8/f1f d8/dd/f2c 0 2024-09-13T23:06:07.126 INFO:tasks.workunit.client.0.smithi115.stdout:8/108: symlink d3/d5/d1d/l24 0 2024-09-13T23:06:07.126 INFO:tasks.workunit.client.0.smithi115.stdout:8/109: write d3/d11/f15 [1166455,68135] 0 2024-09-13T23:06:07.129 INFO:tasks.workunit.client.0.smithi115.stdout:4/213: write db/f10 [579651,1802] 0 2024-09-13T23:06:07.132 INFO:tasks.workunit.client.0.smithi115.stdout:6/212: dwrite d4/df/d14/d38/d2a/d31/f34 [0,4194304] 0 2024-09-13T23:06:07.132 INFO:tasks.workunit.client.0.smithi115.stdout:2/148: write da/de/d1a/f1f [2971925,96710] 0 2024-09-13T23:06:07.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/213: creat d4/f3c x:0 0 0 2024-09-13T23:06:07.137 INFO:tasks.workunit.client.0.smithi115.stdout:6/214: symlink d4/df/l3d 0 2024-09-13T23:06:07.137 INFO:tasks.workunit.client.0.smithi115.stdout:6/215: dread - d4/df/d14/d35/f39 zero size 2024-09-13T23:06:07.137 INFO:tasks.workunit.client.0.smithi115.stdout:6/216: dread - d4/f3c zero size 2024-09-13T23:06:07.139 INFO:tasks.workunit.client.0.smithi115.stdout:6/217: unlink d4/df/f3b 0 2024-09-13T23:06:07.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/170: dwrite d0/d14/d23/f2c [0,4194304] 0 2024-09-13T23:06:07.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/171: creat d0/de/d1a/d29/f39 x:0 0 0 2024-09-13T23:06:07.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/172: write d0/dd/f20 [931090,54406] 0 2024-09-13T23:06:07.140 INFO:tasks.workunit.client.0.smithi115.stdout:7/106: dwrite da/dd/d1c/f1f [4194304,4194304] 0 2024-09-13T23:06:07.140 INFO:tasks.workunit.client.0.smithi115.stdout:2/149: dread da/de/f12 [0,4194304] 0 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:6/218: mkdir d4/df/d14/d38/d2a/d3e 0 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:6/219: write d4/f1d [1692578,46143] 0 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:6/220: dread - d4/f3c zero size 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:0/195: dwrite d6/fd [0,4194304] 0 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:6/221: fdatasync d4/df/f28 0 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:6/222: chown d4/df/c2c 0 1 2024-09-13T23:06:07.141 INFO:tasks.workunit.client.0.smithi115.stdout:4/214: dread db/d19/f27 [0,4194304] 0 2024-09-13T23:06:07.142 INFO:tasks.workunit.client.0.smithi115.stdout:1/173: mknod d0/d14/c3a 0 2024-09-13T23:06:07.145 INFO:tasks.workunit.client.0.smithi115.stdout:7/107: rename da/df/f14 to da/dd/d1c/f22 0 2024-09-13T23:06:07.146 INFO:tasks.workunit.client.0.smithi115.stdout:7/108: write f2 [4893928,24568] 0 2024-09-13T23:06:07.146 INFO:tasks.workunit.client.0.smithi115.stdout:7/109: write da/dd/d1c/f1f [463998,18908] 0 2024-09-13T23:06:07.146 INFO:tasks.workunit.client.0.smithi115.stdout:4/215: write db/dd/d17/f24 [806759,48029] 0 2024-09-13T23:06:07.146 INFO:tasks.workunit.client.0.smithi115.stdout:2/150: symlink da/d21/l31 0 2024-09-13T23:06:07.149 INFO:tasks.workunit.client.0.smithi115.stdout:0/196: link d6/f19 d6/d24/d25/d2b/d32/d44/f4b 0 2024-09-13T23:06:07.149 INFO:tasks.workunit.client.0.smithi115.stdout:0/197: fdatasync d6/d24/f49 0 2024-09-13T23:06:07.152 INFO:tasks.workunit.client.0.smithi115.stdout:7/110: creat da/dd/d13/f23 x:0 0 0 2024-09-13T23:06:07.152 INFO:tasks.workunit.client.0.smithi115.stdout:7/111: write da/f21 [165755,63350] 0 2024-09-13T23:06:07.153 INFO:tasks.workunit.client.0.smithi115.stdout:6/223: rename d4/df/c29 to d4/c3f 0 2024-09-13T23:06:07.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/216: creat db/d19/d1d/d2a/f3a x:0 0 0 2024-09-13T23:06:07.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/151: mkdir da/d23/d32 0 2024-09-13T23:06:07.160 INFO:tasks.workunit.client.0.smithi115.stdout:5/139: rmdir d8 39 2024-09-13T23:06:07.161 INFO:tasks.workunit.client.0.smithi115.stdout:0/198: link d6/c1a d6/d24/d25/d2b/d32/c4c 0 2024-09-13T23:06:07.162 INFO:tasks.workunit.client.0.smithi115.stdout:6/224: mknod d4/df/c40 0 2024-09-13T23:06:07.163 INFO:tasks.workunit.client.0.smithi115.stdout:4/217: creat db/d11/d2e/d33/d36/f3b x:0 0 0 2024-09-13T23:06:07.164 INFO:tasks.workunit.client.0.smithi115.stdout:4/218: creat db/d11/d2e/d33/d36/f3c x:0 0 0 2024-09-13T23:06:07.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/140: mkdir d8/dd/d14/d2d 0 2024-09-13T23:06:07.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/141: write d8/dd/ff [3558197,58561] 0 2024-09-13T23:06:07.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/142: write d8/f26 [273362,35665] 0 2024-09-13T23:06:07.166 INFO:tasks.workunit.client.0.smithi115.stdout:0/199: truncate d6/f1c 2447191 0 2024-09-13T23:06:07.167 INFO:tasks.workunit.client.0.smithi115.stdout:8/110: truncate d3/d11/f14 227273 0 2024-09-13T23:06:07.169 INFO:tasks.workunit.client.0.smithi115.stdout:2/152: getdents da/d23/d2c 0 2024-09-13T23:06:07.171 INFO:tasks.workunit.client.0.smithi115.stdout:5/143: rmdir d8/dd/d20/d24 0 2024-09-13T23:06:07.172 INFO:tasks.workunit.client.0.smithi115.stdout:0/200: creat d6/f4d x:0 0 0 2024-09-13T23:06:07.172 INFO:tasks.workunit.client.0.smithi115.stdout:4/219: write db/d11/d2e/f2c [1256421,13251] 0 2024-09-13T23:06:07.172 INFO:tasks.workunit.client.0.smithi115.stdout:4/220: truncate db/d11/d2e/d33/d36/f3b 825958 0 2024-09-13T23:06:07.172 INFO:tasks.workunit.client.0.smithi115.stdout:4/221: stat db/d11/d2e/d35 0 2024-09-13T23:06:07.173 INFO:tasks.workunit.client.0.smithi115.stdout:2/153: creat da/d21/f33 x:0 0 0 2024-09-13T23:06:07.173 INFO:tasks.workunit.client.0.smithi115.stdout:0/201: symlink d6/d24/d25/d2b/d32/l4e 0 2024-09-13T23:06:07.178 INFO:tasks.workunit.client.0.smithi115.stdout:2/154: dread da/f11 [0,4194304] 0 2024-09-13T23:06:07.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/112: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:07.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/113: truncate da/dd/d1c/f20 1021439 0 2024-09-13T23:06:07.180 INFO:tasks.workunit.client.0.smithi115.stdout:7/114: mkdir da/dd/d13/d24 0 2024-09-13T23:06:07.183 INFO:tasks.workunit.client.0.smithi115.stdout:5/144: dread d8/f16 [0,4194304] 0 2024-09-13T23:06:07.185 INFO:tasks.workunit.client.0.smithi115.stdout:5/145: mknod d8/dd/d20/d27/c2e 0 2024-09-13T23:06:07.185 INFO:tasks.workunit.client.0.smithi115.stdout:5/146: write d8/dd/ff [4932482,88941] 0 2024-09-13T23:06:07.191 INFO:tasks.workunit.client.0.smithi115.stdout:0/202: dread d6/d24/d25/f29 [0,4194304] 0 2024-09-13T23:06:07.192 INFO:tasks.workunit.client.0.smithi115.stdout:7/115: dread da/fc [0,4194304] 0 2024-09-13T23:06:07.193 INFO:tasks.workunit.client.0.smithi115.stdout:9/102: sync 2024-09-13T23:06:07.193 INFO:tasks.workunit.client.0.smithi115.stdout:0/203: truncate d6/fa 1283910 0 2024-09-13T23:06:07.193 INFO:tasks.workunit.client.0.smithi115.stdout:8/111: dwrite d3/d5/f1e [0,4194304] 0 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/116: mknod da/dd/c25 0 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/117: stat da/df 0 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/118: chown da/f10 1 1 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:9/103: mknod d0/d13/d17/c27 0 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:3/195: sync 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:0/204: mknod d6/d24/d25/c4f 0 2024-09-13T23:06:07.195 INFO:tasks.workunit.client.0.smithi115.stdout:0/205: creat d6/d24/d25/d2b/d32/f50 x:0 0 0 2024-09-13T23:06:07.196 INFO:tasks.workunit.client.0.smithi115.stdout:0/206: dread d6/d24/f49 [0,4194304] 0 2024-09-13T23:06:07.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/112: symlink d3/d5/dc/d23/l25 0 2024-09-13T23:06:07.197 INFO:tasks.workunit.client.0.smithi115.stdout:4/222: dwrite db/dd/d17/f24 [0,4194304] 0 2024-09-13T23:06:07.197 INFO:tasks.workunit.client.0.smithi115.stdout:9/104: mkdir d0/d13/d17/d1f/d28 0 2024-09-13T23:06:07.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/147: dread d8/f16 [0,4194304] 0 2024-09-13T23:06:07.200 INFO:tasks.workunit.client.0.smithi115.stdout:3/196: link d3/d5/db/f17 d3/d16/d1c/d31/f44 0 2024-09-13T23:06:07.203 INFO:tasks.workunit.client.0.smithi115.stdout:8/113: link d3/d5/d1d/f20 d3/d5/d1d/f26 0 2024-09-13T23:06:07.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/223: symlink db/l3d 0 2024-09-13T23:06:07.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/224: read db/d19/f27 [1260127,89311] 0 2024-09-13T23:06:07.205 INFO:tasks.workunit.client.0.smithi115.stdout:9/105: mknod d0/d13/d17/d1f/d28/c29 0 2024-09-13T23:06:07.210 INFO:tasks.workunit.client.0.smithi115.stdout:4/225: dread db/d11/d2e/f2c [0,4194304] 0 2024-09-13T23:06:07.210 INFO:tasks.workunit.client.0.smithi115.stdout:4/226: write db/d11/d2e/d33/d36/f3c [1032886,79840] 0 2024-09-13T23:06:07.210 INFO:tasks.workunit.client.0.smithi115.stdout:4/227: chown fa 2621943 1 2024-09-13T23:06:07.212 INFO:tasks.workunit.client.0.smithi115.stdout:4/228: creat db/d11/d2e/d35/f3e x:0 0 0 2024-09-13T23:06:07.212 INFO:tasks.workunit.client.0.smithi115.stdout:4/229: fdatasync db/d19/d1d/d2a/f3a 0 2024-09-13T23:06:07.222 INFO:tasks.workunit.client.0.smithi115.stdout:2/155: dwrite da/de/f24 [0,4194304] 0 2024-09-13T23:06:07.225 INFO:tasks.workunit.client.0.smithi115.stdout:7/119: dwrite da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:07.227 INFO:tasks.workunit.client.0.smithi115.stdout:7/120: creat da/df/f26 x:0 0 0 2024-09-13T23:06:07.227 INFO:tasks.workunit.client.0.smithi115.stdout:7/121: creat da/dd/d1c/f27 x:0 0 0 2024-09-13T23:06:07.228 INFO:tasks.workunit.client.0.smithi115.stdout:7/122: write da/f21 [542404,128635] 0 2024-09-13T23:06:07.228 INFO:tasks.workunit.client.0.smithi115.stdout:9/106: rmdir d0/d13/d17/d1f 39 2024-09-13T23:06:07.232 INFO:tasks.workunit.client.0.smithi115.stdout:7/123: dread da/dd/d1c/f20 [0,4194304] 0 2024-09-13T23:06:07.232 INFO:tasks.workunit.client.0.smithi115.stdout:7/124: creat da/df/f28 x:0 0 0 2024-09-13T23:06:07.241 INFO:tasks.workunit.client.0.smithi115.stdout:5/148: dwrite d8/f2a [0,4194304] 0 2024-09-13T23:06:07.244 INFO:tasks.workunit.client.0.smithi115.stdout:9/107: write d0/fd [1862268,105265] 0 2024-09-13T23:06:07.244 INFO:tasks.workunit.client.0.smithi115.stdout:7/125: dread f2 [4194304,4194304] 0 2024-09-13T23:06:07.244 INFO:tasks.workunit.client.0.smithi115.stdout:7/126: truncate da/dd/d13/f23 862928 0 2024-09-13T23:06:07.244 INFO:tasks.workunit.client.0.smithi115.stdout:9/108: write d0/d13/d17/f1e [9109061,33334] 0 2024-09-13T23:06:07.245 INFO:tasks.workunit.client.0.smithi115.stdout:7/127: mkdir da/dd/d16/d29 0 2024-09-13T23:06:07.245 INFO:tasks.workunit.client.0.smithi115.stdout:7/128: creat da/dd/d13/f2a x:0 0 0 2024-09-13T23:06:07.246 INFO:tasks.workunit.client.0.smithi115.stdout:9/109: rmdir d0/d13/d17 39 2024-09-13T23:06:07.260 INFO:tasks.workunit.client.0.smithi115.stdout:5/149: read d8/fb [3330563,16894] 0 2024-09-13T23:06:07.263 INFO:tasks.workunit.client.0.smithi115.stdout:5/150: rename d8/dd/f2c to d8/dd/d20/d23/f2f 0 2024-09-13T23:06:07.264 INFO:tasks.workunit.client.0.smithi115.stdout:7/129: write da/dd/d1c/f22 [3610387,66225] 0 2024-09-13T23:06:07.264 INFO:tasks.workunit.client.0.smithi115.stdout:8/114: dwrite d3/fd [0,4194304] 0 2024-09-13T23:06:07.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/207: dwrite d6/d24/d25/f29 [0,4194304] 0 2024-09-13T23:06:07.264 INFO:tasks.workunit.client.0.smithi115.stdout:8/115: readlink d3/d5/d1d/l24 0 2024-09-13T23:06:07.270 INFO:tasks.workunit.client.0.smithi115.stdout:3/197: dwrite d3/f1b [0,4194304] 0 2024-09-13T23:06:07.270 INFO:tasks.workunit.client.0.smithi115.stdout:9/110: dwrite d0/d13/d17/d1f/f23 [0,4194304] 0 2024-09-13T23:06:07.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/156: dwrite da/de/d1a/f1d [0,4194304] 0 2024-09-13T23:06:07.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/230: dwrite db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:07.270 INFO:tasks.workunit.client.0.smithi115.stdout:9/111: fdatasync d0/f4 0 2024-09-13T23:06:07.271 INFO:tasks.workunit.client.0.smithi115.stdout:0/208: unlink d6/d24/d25/d2b/d32/c33 0 2024-09-13T23:06:07.271 INFO:tasks.workunit.client.0.smithi115.stdout:0/209: chown d6/d24/d25/d2b/c40 519274 1 2024-09-13T23:06:07.271 INFO:tasks.workunit.client.0.smithi115.stdout:8/116: mkdir d3/d5/dc/d16/d1f/d27 0 2024-09-13T23:06:07.273 INFO:tasks.workunit.client.0.smithi115.stdout:3/198: mkdir d3/d16/d1c/d31/d45 0 2024-09-13T23:06:07.273 INFO:tasks.workunit.client.0.smithi115.stdout:3/199: dread - d3/d5/d20/f39 zero size 2024-09-13T23:06:07.274 INFO:tasks.workunit.client.0.smithi115.stdout:2/157: symlink da/de/l34 0 2024-09-13T23:06:07.274 INFO:tasks.workunit.client.0.smithi115.stdout:2/158: write da/de/d1a/f1f [429596,30488] 0 2024-09-13T23:06:07.276 INFO:tasks.workunit.client.0.smithi115.stdout:4/231: mkdir db/d16/d3f 0 2024-09-13T23:06:07.276 INFO:tasks.workunit.client.0.smithi115.stdout:4/232: creat db/d19/d1d/d2a/f40 x:0 0 0 2024-09-13T23:06:07.276 INFO:tasks.workunit.client.0.smithi115.stdout:4/233: dread - db/d19/d1d/d2a/f3a zero size 2024-09-13T23:06:07.276 INFO:tasks.workunit.client.0.smithi115.stdout:4/234: write db/d19/d1d/f22 [4774212,41385] 0 2024-09-13T23:06:07.277 INFO:tasks.workunit.client.0.smithi115.stdout:9/112: dread d0/d13/d17/d1f/f23 [0,4194304] 0 2024-09-13T23:06:07.277 INFO:tasks.workunit.client.0.smithi115.stdout:9/113: readlink d0/d13/l21 0 2024-09-13T23:06:07.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/210: rename d6/f1c to d6/d24/f51 0 2024-09-13T23:06:07.283 INFO:tasks.workunit.client.0.smithi115.stdout:0/211: write d6/d24/f49 [314789,31875] 0 2024-09-13T23:06:07.283 INFO:tasks.workunit.client.0.smithi115.stdout:3/200: mknod d3/d16/d1a/d29/c46 0 2024-09-13T23:06:07.283 INFO:tasks.workunit.client.0.smithi115.stdout:3/201: fdatasync d3/d16/f37 0 2024-09-13T23:06:07.284 INFO:tasks.workunit.client.0.smithi115.stdout:3/202: chown d3/d5/db/f17 53866 1 2024-09-13T23:06:07.284 INFO:tasks.workunit.client.0.smithi115.stdout:3/203: chown d3/d16/d1a/c22 5 1 2024-09-13T23:06:07.284 INFO:tasks.workunit.client.0.smithi115.stdout:3/204: fdatasync d3/d5/db/f23 0 2024-09-13T23:06:07.286 INFO:tasks.workunit.client.0.smithi115.stdout:2/159: unlink da/de/c18 0 2024-09-13T23:06:07.286 INFO:tasks.workunit.client.0.smithi115.stdout:2/160: readlink da/de/l34 0 2024-09-13T23:06:07.290 INFO:tasks.workunit.client.0.smithi115.stdout:2/161: mknod da/d23/d2c/c35 0 2024-09-13T23:06:07.320 INFO:tasks.workunit.client.0.smithi115.stdout:5/151: dwrite d8/dd/d20/f1a [0,4194304] 0 2024-09-13T23:06:07.320 INFO:tasks.workunit.client.0.smithi115.stdout:7/130: dwrite da/df/f26 [0,4194304] 0 2024-09-13T23:06:07.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/131: dread da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:07.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/132: truncate da/df/f28 235778 0 2024-09-13T23:06:07.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/133: write da/dd/d1c/f27 [823671,125524] 0 2024-09-13T23:06:07.326 INFO:tasks.workunit.client.0.smithi115.stdout:3/205: dwrite d3/d16/d1c/f2b [0,4194304] 0 2024-09-13T23:06:07.327 INFO:tasks.workunit.client.0.smithi115.stdout:8/117: dwrite d3/d5/fa [0,4194304] 0 2024-09-13T23:06:07.328 INFO:tasks.workunit.client.0.smithi115.stdout:4/235: dwrite db/d19/d1d/d2a/f40 [0,4194304] 0 2024-09-13T23:06:07.328 INFO:tasks.workunit.client.0.smithi115.stdout:0/212: dwrite d6/fd [4194304,4194304] 0 2024-09-13T23:06:07.328 INFO:tasks.workunit.client.0.smithi115.stdout:0/213: truncate d6/d24/d25/d2b/d32/f48 818653 0 2024-09-13T23:06:07.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/162: dwrite da/f11 [0,4194304] 0 2024-09-13T23:06:07.331 INFO:tasks.workunit.client.0.smithi115.stdout:5/152: write d8/f9 [1935481,129822] 0 2024-09-13T23:06:07.333 INFO:tasks.workunit.client.0.smithi115.stdout:1/174: sync 2024-09-13T23:06:07.336 INFO:tasks.workunit.client.0.smithi115.stdout:4/236: symlink db/d16/l41 0 2024-09-13T23:06:07.336 INFO:tasks.workunit.client.0.smithi115.stdout:4/237: chown db/d19/d1d/d2a/f40 0 1 2024-09-13T23:06:07.336 INFO:tasks.workunit.client.0.smithi115.stdout:4/238: chown db/dd/d17/f24 4 1 2024-09-13T23:06:07.336 INFO:tasks.workunit.client.0.smithi115.stdout:4/239: creat db/d11/d2e/d33/d36/f42 x:0 0 0 2024-09-13T23:06:07.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/225: sync 2024-09-13T23:06:07.340 INFO:tasks.workunit.client.0.smithi115.stdout:5/153: mknod d8/dd/d14/c30 0 2024-09-13T23:06:07.342 INFO:tasks.workunit.client.0.smithi115.stdout:1/175: creat d0/d14/d31/d37/f3b x:0 0 0 2024-09-13T23:06:07.343 INFO:tasks.workunit.client.0.smithi115.stdout:1/176: readlink d0/l15 0 2024-09-13T23:06:07.345 INFO:tasks.workunit.client.0.smithi115.stdout:4/240: creat db/f43 x:0 0 0 2024-09-13T23:06:07.345 INFO:tasks.workunit.client.0.smithi115.stdout:4/241: read db/f10 [1677123,24757] 0 2024-09-13T23:06:07.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/206: rename d3/d5/d20 to d3/d16/d1c/d31/d3b/d47 0 2024-09-13T23:06:07.347 INFO:tasks.workunit.client.0.smithi115.stdout:6/226: rename d4/df/d14 to d4/df/d14/d41 22 2024-09-13T23:06:07.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/207: stat d3/d5 0 2024-09-13T23:06:07.348 INFO:tasks.workunit.client.0.smithi115.stdout:6/227: read d4/df/f28 [57067,84707] 0 2024-09-13T23:06:07.348 INFO:tasks.workunit.client.0.smithi115.stdout:6/228: chown c1 32062014 1 2024-09-13T23:06:07.348 INFO:tasks.workunit.client.0.smithi115.stdout:6/229: dread - d4/df/d14/d35/f39 zero size 2024-09-13T23:06:07.350 INFO:tasks.workunit.client.0.smithi115.stdout:5/154: rmdir d8/dd/d14/d2d 0 2024-09-13T23:06:07.350 INFO:tasks.workunit.client.0.smithi115.stdout:1/177: mknod d0/de/d1b/c3c 0 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/178: creat d0/de/d1b/d25/f3d x:0 0 0 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/179: fdatasync d0/de/f19 0 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/180: chown d0/dd/c18 1390274 1 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/181: chown d0/f22 106921366 1 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/182: dread - d0/de/d1a/d29/f2a zero size 2024-09-13T23:06:07.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/230: dread d4/f1d [0,4194304] 0 2024-09-13T23:06:07.356 INFO:tasks.workunit.client.0.smithi115.stdout:4/242: getdents db/dd/d17 0 2024-09-13T23:06:07.356 INFO:tasks.workunit.client.0.smithi115.stdout:4/243: getdents db/d16/d3f 0 2024-09-13T23:06:07.357 INFO:tasks.workunit.client.0.smithi115.stdout:1/183: creat d0/dd/f3e x:0 0 0 2024-09-13T23:06:07.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/231: creat d4/df/d14/d38/d2a/d31/f42 x:0 0 0 2024-09-13T23:06:07.360 INFO:tasks.workunit.client.0.smithi115.stdout:6/232: mknod d4/df/d3a/c43 0 2024-09-13T23:06:07.360 INFO:tasks.workunit.client.0.smithi115.stdout:3/208: write d3/d16/f33 [286130,105870] 0 2024-09-13T23:06:07.361 INFO:tasks.workunit.client.0.smithi115.stdout:6/233: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:07.361 INFO:tasks.workunit.client.0.smithi115.stdout:8/118: dwrite d3/d5/d1d/f20 [0,4194304] 0 2024-09-13T23:06:07.362 INFO:tasks.workunit.client.0.smithi115.stdout:6/234: mkdir d4/df/d14/d38/d44 0 2024-09-13T23:06:07.365 INFO:tasks.workunit.client.0.smithi115.stdout:8/119: mkdir d3/d5/dc/d16/d1f/d28 0 2024-09-13T23:06:07.365 INFO:tasks.workunit.client.0.smithi115.stdout:8/120: dread - d3/d5/dc/d16/d1f/f22 zero size 2024-09-13T23:06:07.365 INFO:tasks.workunit.client.0.smithi115.stdout:8/121: chown d3/c18 535213 1 2024-09-13T23:06:07.366 INFO:tasks.workunit.client.0.smithi115.stdout:8/122: creat d3/d5/dc/d16/d1f/d28/f29 x:0 0 0 2024-09-13T23:06:07.368 INFO:tasks.workunit.client.0.smithi115.stdout:4/244: dread db/dd/d17/f24 [4194304,4194304] 0 2024-09-13T23:06:07.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/245: truncate db/d11/d2e/d35/f3e 35516 0 2024-09-13T23:06:07.369 INFO:tasks.workunit.client.0.smithi115.stdout:1/184: dread d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:07.369 INFO:tasks.workunit.client.0.smithi115.stdout:1/185: creat d0/d14/d31/d37/f3f x:0 0 0 2024-09-13T23:06:07.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/134: dwrite da/dd/d1c/f27 [0,4194304] 0 2024-09-13T23:06:07.372 INFO:tasks.workunit.client.0.smithi115.stdout:7/135: unlink f2 0 2024-09-13T23:06:07.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/136: dread da/f21 [0,4194304] 0 2024-09-13T23:06:07.378 INFO:tasks.workunit.client.0.smithi115.stdout:7/137: rename da/dd/d16/c1b to da/dd/d1c/c2b 0 2024-09-13T23:06:07.378 INFO:tasks.workunit.client.0.smithi115.stdout:7/138: creat da/df/f2c x:0 0 0 2024-09-13T23:06:07.380 INFO:tasks.workunit.client.0.smithi115.stdout:7/139: mkdir da/dd/d1c/d2d 0 2024-09-13T23:06:07.380 INFO:tasks.workunit.client.0.smithi115.stdout:7/140: write da/f21 [1256573,29878] 0 2024-09-13T23:06:07.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/214: dwrite d6/f9 [8388608,4194304] 0 2024-09-13T23:06:07.381 INFO:tasks.workunit.client.0.smithi115.stdout:7/141: creat da/dd/f2e x:0 0 0 2024-09-13T23:06:07.383 INFO:tasks.workunit.client.0.smithi115.stdout:2/163: dwrite da/de/f28 [0,4194304] 0 2024-09-13T23:06:07.388 INFO:tasks.workunit.client.0.smithi115.stdout:3/209: dwrite d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:07.389 INFO:tasks.workunit.client.0.smithi115.stdout:5/155: dwrite d8/dd/d20/f25 [0,4194304] 0 2024-09-13T23:06:07.390 INFO:tasks.workunit.client.0.smithi115.stdout:1/186: dwrite d0/f7 [0,4194304] 0 2024-09-13T23:06:07.397 INFO:tasks.workunit.client.0.smithi115.stdout:3/210: dread d3/d16/d1c/f2b [0,4194304] 0 2024-09-13T23:06:07.398 INFO:tasks.workunit.client.0.smithi115.stdout:2/164: read f4 [196649,95477] 0 2024-09-13T23:06:07.399 INFO:tasks.workunit.client.0.smithi115.stdout:6/235: rmdir d4/df/d14 39 2024-09-13T23:06:07.403 INFO:tasks.workunit.client.0.smithi115.stdout:5/156: rmdir d8/dd/d20/d23 39 2024-09-13T23:06:07.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/187: mknod d0/de/d1b/c40 0 2024-09-13T23:06:07.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/188: fdatasync d0/de/f32 0 2024-09-13T23:06:07.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/189: fsync d0/fc 0 2024-09-13T23:06:07.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/190: chown d0/l8 43434 1 2024-09-13T23:06:07.405 INFO:tasks.workunit.client.0.smithi115.stdout:2/165: mknod da/c36 0 2024-09-13T23:06:07.407 INFO:tasks.workunit.client.0.smithi115.stdout:0/215: dwrite d6/f12 [0,4194304] 0 2024-09-13T23:06:07.410 INFO:tasks.workunit.client.0.smithi115.stdout:0/216: rmdir d6/d24/d25/d2b/d32/d44 39 2024-09-13T23:06:07.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/217: mknod d6/c52 0 2024-09-13T23:06:07.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/218: write d6/f12 [4436983,96755] 0 2024-09-13T23:06:07.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/219: truncate d6/d24/d25/d2b/d32/f50 158531 0 2024-09-13T23:06:07.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/220: truncate d6/d24/d25/d2b/f42 678760 0 2024-09-13T23:06:07.414 INFO:tasks.workunit.client.0.smithi115.stdout:9/114: sync 2024-09-13T23:06:07.416 INFO:tasks.workunit.client.0.smithi115.stdout:9/115: unlink d0/lc 0 2024-09-13T23:06:07.418 INFO:tasks.workunit.client.0.smithi115.stdout:0/221: dread d6/f9 [0,4194304] 0 2024-09-13T23:06:07.418 INFO:tasks.workunit.client.0.smithi115.stdout:7/142: dwrite da/dd/d1c/f20 [0,4194304] 0 2024-09-13T23:06:07.419 INFO:tasks.workunit.client.0.smithi115.stdout:0/222: chown d6/d24/f49 1612 1 2024-09-13T23:06:07.419 INFO:tasks.workunit.client.0.smithi115.stdout:0/223: truncate d6/d24/d25/d2b/f42 1276323 0 2024-09-13T23:06:07.420 INFO:tasks.workunit.client.0.smithi115.stdout:0/224: truncate d6/d24/d25/d2b/d32/f48 15489 0 2024-09-13T23:06:07.421 INFO:tasks.workunit.client.0.smithi115.stdout:0/225: rmdir d6/d24/d25 39 2024-09-13T23:06:07.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/226: write d6/f10 [3327187,103367] 0 2024-09-13T23:06:07.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/227: rmdir d6/d24/d25/d2b/d32/d44 39 2024-09-13T23:06:07.424 INFO:tasks.workunit.client.0.smithi115.stdout:0/228: readlink d6/d24/d25/d2b/d32/d44/l47 0 2024-09-13T23:06:07.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/229: dread - d6/d24/f3d zero size 2024-09-13T23:06:07.425 INFO:tasks.workunit.client.0.smithi115.stdout:0/230: symlink d6/d24/d25/d2b/d32/d44/l53 0 2024-09-13T23:06:07.426 INFO:tasks.workunit.client.0.smithi115.stdout:7/143: read da/f21 [310462,22212] 0 2024-09-13T23:06:07.427 INFO:tasks.workunit.client.0.smithi115.stdout:7/144: symlink da/dd/d13/d24/l2f 0 2024-09-13T23:06:07.427 INFO:tasks.workunit.client.0.smithi115.stdout:9/116: dread d0/d13/f1c [0,4194304] 0 2024-09-13T23:06:07.427 INFO:tasks.workunit.client.0.smithi115.stdout:9/117: chown d0/f2 3757244 1 2024-09-13T23:06:07.427 INFO:tasks.workunit.client.0.smithi115.stdout:9/118: chown d0/f4 0 1 2024-09-13T23:06:07.428 INFO:tasks.workunit.client.0.smithi115.stdout:9/119: mknod d0/d13/d17/d1f/c2a 0 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/120: write d0/d13/f1c [1054561,76759] 0 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/121: chown d0/d13/d17/d19/f1d 6771315 1 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/122: fdatasync d0/fd 0 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/123: readlink d0/l16 0 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/124: write d0/d13/d17/d19/f1d [849015,52496] 0 2024-09-13T23:06:07.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/211: dwrite d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:07.430 INFO:tasks.workunit.client.0.smithi115.stdout:3/212: mknod d3/d5/d2c/c48 0 2024-09-13T23:06:07.430 INFO:tasks.workunit.client.0.smithi115.stdout:5/157: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T23:06:07.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/236: dwrite d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:07.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/213: fsync d3/d16/f19 0 2024-09-13T23:06:07.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/158: dread - d8/dd/d20/d23/f2f zero size 2024-09-13T23:06:07.431 INFO:tasks.workunit.client.0.smithi115.stdout:5/159: chown d8/dd/d14/c29 1760681 1 2024-09-13T23:06:07.432 INFO:tasks.workunit.client.0.smithi115.stdout:9/125: dread d0/d13/d17/d1f/f23 [0,4194304] 0 2024-09-13T23:06:07.433 INFO:tasks.workunit.client.0.smithi115.stdout:5/160: dread d8/f26 [0,4194304] 0 2024-09-13T23:06:07.435 INFO:tasks.workunit.client.0.smithi115.stdout:6/237: symlink d4/l45 0 2024-09-13T23:06:07.437 INFO:tasks.workunit.client.0.smithi115.stdout:3/214: mkdir d3/d16/d1a/d29/d49 0 2024-09-13T23:06:07.440 INFO:tasks.workunit.client.0.smithi115.stdout:5/161: creat d8/dd/d20/f31 x:0 0 0 2024-09-13T23:06:07.440 INFO:tasks.workunit.client.0.smithi115.stdout:5/162: write d8/fb [5053630,11374] 0 2024-09-13T23:06:07.442 INFO:tasks.workunit.client.0.smithi115.stdout:3/215: creat d3/d16/d1c/d31/d3b/f4a x:0 0 0 2024-09-13T23:06:07.447 INFO:tasks.workunit.client.0.smithi115.stdout:6/238: write d4/df/d14/d38/d2a/d31/f42 [4323780,121390] 0 2024-09-13T23:06:07.447 INFO:tasks.workunit.client.0.smithi115.stdout:6/239: truncate d4/df/d14/d38/d2a/f33 4549291 0 2024-09-13T23:06:07.447 INFO:tasks.workunit.client.0.smithi115.stdout:6/240: write d4/df/f28 [139703,51011] 0 2024-09-13T23:06:07.447 INFO:tasks.workunit.client.0.smithi115.stdout:5/163: getdents d8 0 2024-09-13T23:06:07.448 INFO:tasks.workunit.client.0.smithi115.stdout:3/216: creat d3/d16/d1c/d31/f4b x:0 0 0 2024-09-13T23:06:07.449 INFO:tasks.workunit.client.0.smithi115.stdout:3/217: readlink d3/d16/d1a/d29/l2d 0 2024-09-13T23:06:07.449 INFO:tasks.workunit.client.0.smithi115.stdout:6/241: rmdir d4/df/d14/d38/d2a/d31 39 2024-09-13T23:06:07.449 INFO:tasks.workunit.client.0.smithi115.stdout:5/164: symlink d8/dd/d20/l32 0 2024-09-13T23:06:07.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/218: unlink d3/d5/db/f23 0 2024-09-13T23:06:07.452 INFO:tasks.workunit.client.0.smithi115.stdout:3/219: rename d3/d16/d1c/d31/d41 to d3/d5/d35/d4c 0 2024-09-13T23:06:07.453 INFO:tasks.workunit.client.0.smithi115.stdout:3/220: rmdir d3/d5/d2c 39 2024-09-13T23:06:07.454 INFO:tasks.workunit.client.0.smithi115.stdout:7/145: dwrite da/dd/f2e [0,4194304] 0 2024-09-13T23:06:07.454 INFO:tasks.workunit.client.0.smithi115.stdout:3/221: write d3/d16/d1a/f1f [4406826,63720] 0 2024-09-13T23:06:07.454 INFO:tasks.workunit.client.0.smithi115.stdout:5/165: dread d8/dd/ff [4194304,4194304] 0 2024-09-13T23:06:07.454 INFO:tasks.workunit.client.0.smithi115.stdout:5/166: write d8/dd/f2b [979855,63845] 0 2024-09-13T23:06:07.456 INFO:tasks.workunit.client.0.smithi115.stdout:0/231: dwrite d6/d24/d25/d2b/f2d [4194304,4194304] 0 2024-09-13T23:06:07.457 INFO:tasks.workunit.client.0.smithi115.stdout:7/146: rename da/cb to da/dd/c30 0 2024-09-13T23:06:07.457 INFO:tasks.workunit.client.0.smithi115.stdout:7/147: write da/dd/d13/f2a [629570,55686] 0 2024-09-13T23:06:07.459 INFO:tasks.workunit.client.0.smithi115.stdout:5/167: dread d8/f16 [0,4194304] 0 2024-09-13T23:06:07.459 INFO:tasks.workunit.client.0.smithi115.stdout:9/126: dwrite d0/fd [0,4194304] 0 2024-09-13T23:06:07.466 INFO:tasks.workunit.client.0.smithi115.stdout:5/168: dread d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:07.466 INFO:tasks.workunit.client.0.smithi115.stdout:5/169: stat d8/dd/d14/c30 0 2024-09-13T23:06:07.467 INFO:tasks.workunit.client.0.smithi115.stdout:3/222: write d3/f1b [3006502,76456] 0 2024-09-13T23:06:07.467 INFO:tasks.workunit.client.0.smithi115.stdout:3/223: chown d3/d5/db/f40 4 1 2024-09-13T23:06:07.467 INFO:tasks.workunit.client.0.smithi115.stdout:6/242: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:07.468 INFO:tasks.workunit.client.0.smithi115.stdout:5/170: read d8/dd/f2b [956040,99986] 0 2024-09-13T23:06:07.470 INFO:tasks.workunit.client.0.smithi115.stdout:0/232: symlink d6/l54 0 2024-09-13T23:06:07.470 INFO:tasks.workunit.client.0.smithi115.stdout:0/233: chown d6/d24/d25/d2b/f31 202657 1 2024-09-13T23:06:07.471 INFO:tasks.workunit.client.0.smithi115.stdout:7/148: link da/df/c12 da/dd/d16/c31 0 2024-09-13T23:06:07.478 INFO:tasks.workunit.client.0.smithi115.stdout:3/224: rename d3/d5/d2c/d2f to d3/d16/d1c/d31/d3b/d4d 0 2024-09-13T23:06:07.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/171: mknod d8/c33 0 2024-09-13T23:06:07.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/172: readlink d8/dd/d20/l1d 0 2024-09-13T23:06:07.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/173: read d8/fb [4221636,110273] 0 2024-09-13T23:06:07.481 INFO:tasks.workunit.client.0.smithi115.stdout:0/234: unlink d6/f12 0 2024-09-13T23:06:07.483 INFO:tasks.workunit.client.0.smithi115.stdout:7/149: mknod da/dd/d1c/c32 0 2024-09-13T23:06:07.484 INFO:tasks.workunit.client.0.smithi115.stdout:5/174: mknod d8/dd/c34 0 2024-09-13T23:06:07.484 INFO:tasks.workunit.client.0.smithi115.stdout:5/175: readlink d8/dd/l22 0 2024-09-13T23:06:07.484 INFO:tasks.workunit.client.0.smithi115.stdout:5/176: fdatasync d8/fa 0 2024-09-13T23:06:07.487 INFO:tasks.workunit.client.0.smithi115.stdout:0/235: rename d6/fa to d6/d24/d25/d2b/d32/d44/f55 0 2024-09-13T23:06:07.488 INFO:tasks.workunit.client.0.smithi115.stdout:7/150: mknod da/dd/d13/c33 0 2024-09-13T23:06:07.489 INFO:tasks.workunit.client.0.smithi115.stdout:5/177: mkdir d8/dd/d20/d35 0 2024-09-13T23:06:07.491 INFO:tasks.workunit.client.0.smithi115.stdout:5/178: unlink d8/dd/d20/l32 0 2024-09-13T23:06:07.494 INFO:tasks.workunit.client.0.smithi115.stdout:6/243: dwrite d4/f12 [0,4194304] 0 2024-09-13T23:06:07.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/244: link d4/l2b d4/df/d14/d38/d44/l46 0 2024-09-13T23:06:07.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/245: write d4/df/f2e [4921926,116791] 0 2024-09-13T23:06:07.496 INFO:tasks.workunit.client.0.smithi115.stdout:9/127: dwrite d0/f22 [0,4194304] 0 2024-09-13T23:06:07.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/128: mknod d0/c2b 0 2024-09-13T23:06:07.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/129: chown d0/d13/c1b 96175557 1 2024-09-13T23:06:07.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/130: chown d0/d13/d17/d19/f1d 27450063 1 2024-09-13T23:06:07.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/131: write d0/d13/d17/d1f/f23 [4588356,62023] 0 2024-09-13T23:06:07.503 INFO:tasks.workunit.client.0.smithi115.stdout:9/132: write d0/f4 [1139045,58103] 0 2024-09-13T23:06:07.503 INFO:tasks.workunit.client.0.smithi115.stdout:5/179: write d8/fa [2567578,19558] 0 2024-09-13T23:06:07.505 INFO:tasks.workunit.client.0.smithi115.stdout:9/133: rmdir d0/d13/d17/d19 39 2024-09-13T23:06:07.506 INFO:tasks.workunit.client.0.smithi115.stdout:9/134: symlink d0/l2c 0 2024-09-13T23:06:07.507 INFO:tasks.workunit.client.0.smithi115.stdout:9/135: write d0/f4 [568700,36557] 0 2024-09-13T23:06:07.507 INFO:tasks.workunit.client.0.smithi115.stdout:6/246: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:07.509 INFO:tasks.workunit.client.0.smithi115.stdout:5/180: write d8/f16 [1416844,16752] 0 2024-09-13T23:06:07.511 INFO:tasks.workunit.client.0.smithi115.stdout:5/181: mkdir d8/d36 0 2024-09-13T23:06:07.511 INFO:tasks.workunit.client.0.smithi115.stdout:7/151: read da/df/f26 [1980622,39158] 0 2024-09-13T23:06:07.513 INFO:tasks.workunit.client.0.smithi115.stdout:5/182: dread d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:07.514 INFO:tasks.workunit.client.0.smithi115.stdout:5/183: creat d8/dd/d14/f37 x:0 0 0 2024-09-13T23:06:07.515 INFO:tasks.workunit.client.0.smithi115.stdout:3/225: dwrite d3/d16/f33 [0,4194304] 0 2024-09-13T23:06:07.515 INFO:tasks.workunit.client.0.smithi115.stdout:3/226: chown d3/d5/d2c/c48 648005299 1 2024-09-13T23:06:07.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/227: readlink d3/d5/l8 0 2024-09-13T23:06:07.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/228: dread - d3/d16/d1c/d31/d3b/f4a zero size 2024-09-13T23:06:07.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/229: creat d3/d16/d1c/d31/f4e x:0 0 0 2024-09-13T23:06:07.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/230: write d3/d16/f37 [61322,75839] 0 2024-09-13T23:06:07.519 INFO:tasks.workunit.client.0.smithi115.stdout:0/236: dwrite d6/f9 [4194304,4194304] 0 2024-09-13T23:06:07.519 INFO:tasks.workunit.client.0.smithi115.stdout:3/231: write d3/d16/d1c/f2b [1283069,1590] 0 2024-09-13T23:06:07.520 INFO:tasks.workunit.client.0.smithi115.stdout:6/247: write d4/f12 [2198815,12531] 0 2024-09-13T23:06:07.522 INFO:tasks.workunit.client.0.smithi115.stdout:3/232: symlink d3/d16/d1c/d31/d3b/d47/d28/l4f 0 2024-09-13T23:06:07.523 INFO:tasks.workunit.client.0.smithi115.stdout:6/248: mkdir d4/df/d14/d47 0 2024-09-13T23:06:07.524 INFO:tasks.workunit.client.0.smithi115.stdout:6/249: chown d4/l45 45 1 2024-09-13T23:06:07.525 INFO:tasks.workunit.client.0.smithi115.stdout:3/233: creat d3/d5/d35/f50 x:0 0 0 2024-09-13T23:06:07.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/234: rename d3/d16/d1c/d31/d3b/d4d/l3d to d3/d16/d1a/d1e/l51 0 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/250: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/251: stat d4/df/d14/d38/d2a/d31/f34 0 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/252: chown c1 5344679 1 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/253: dread - d4/f3c zero size 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/254: write d4/df/d14/d35/f39 [516051,95211] 0 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/255: write d4/df/d14/d38/d2a/f33 [4984813,71948] 0 2024-09-13T23:06:07.531 INFO:tasks.workunit.client.0.smithi115.stdout:6/256: write d4/df/f1f [1317316,11105] 0 2024-09-13T23:06:07.532 INFO:tasks.workunit.client.0.smithi115.stdout:3/235: creat d3/d16/d1a/d29/f52 x:0 0 0 2024-09-13T23:06:07.535 INFO:tasks.workunit.client.0.smithi115.stdout:8/123: sync 2024-09-13T23:06:07.535 INFO:tasks.workunit.client.0.smithi115.stdout:4/246: sync 2024-09-13T23:06:07.535 INFO:tasks.workunit.client.0.smithi115.stdout:1/191: sync 2024-09-13T23:06:07.535 INFO:tasks.workunit.client.0.smithi115.stdout:2/166: sync 2024-09-13T23:06:07.536 INFO:tasks.workunit.client.0.smithi115.stdout:8/124: write d3/d11/f14 [110224,64506] 0 2024-09-13T23:06:07.536 INFO:tasks.workunit.client.0.smithi115.stdout:8/125: readlink d3/d5/d1d/l24 0 2024-09-13T23:06:07.538 INFO:tasks.workunit.client.0.smithi115.stdout:2/167: mknod da/d21/c37 0 2024-09-13T23:06:07.538 INFO:tasks.workunit.client.0.smithi115.stdout:2/168: write da/d21/f33 [527118,35949] 0 2024-09-13T23:06:07.540 INFO:tasks.workunit.client.0.smithi115.stdout:8/126: rename d3/c10 to d3/d11/c2a 0 2024-09-13T23:06:07.540 INFO:tasks.workunit.client.0.smithi115.stdout:8/127: fsync d3/d5/f1e 0 2024-09-13T23:06:07.541 INFO:tasks.workunit.client.0.smithi115.stdout:2/169: creat da/d23/f38 x:0 0 0 2024-09-13T23:06:07.542 INFO:tasks.workunit.client.0.smithi115.stdout:2/170: mknod da/c39 0 2024-09-13T23:06:07.544 INFO:tasks.workunit.client.0.smithi115.stdout:2/171: creat da/d23/d32/f3a x:0 0 0 2024-09-13T23:06:07.544 INFO:tasks.workunit.client.0.smithi115.stdout:2/172: dread - da/de/d1a/f2f zero size 2024-09-13T23:06:07.545 INFO:tasks.workunit.client.0.smithi115.stdout:7/152: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:07.547 INFO:tasks.workunit.client.0.smithi115.stdout:4/247: dread db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:07.547 INFO:tasks.workunit.client.0.smithi115.stdout:4/248: creat db/dd/f44 x:0 0 0 2024-09-13T23:06:07.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/249: dread db/d11/d2e/d33/d36/f3c [0,4194304] 0 2024-09-13T23:06:07.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/250: stat db/d11/d2e/f2c 0 2024-09-13T23:06:07.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/251: write db/f43 [691614,92192] 0 2024-09-13T23:06:07.556 INFO:tasks.workunit.client.0.smithi115.stdout:4/252: write db/d11/d2e/f2c [1020352,17158] 0 2024-09-13T23:06:07.557 INFO:tasks.workunit.client.0.smithi115.stdout:5/184: dwrite d8/f26 [0,4194304] 0 2024-09-13T23:06:07.560 INFO:tasks.workunit.client.0.smithi115.stdout:5/185: symlink d8/dd/d14/l38 0 2024-09-13T23:06:07.560 INFO:tasks.workunit.client.0.smithi115.stdout:5/186: chown d8/c33 10656683 1 2024-09-13T23:06:07.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/153: dread da/dd/d1c/f1f [4194304,4194304] 0 2024-09-13T23:06:07.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/154: mknod da/dd/c34 0 2024-09-13T23:06:07.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/155: readlink da/dd/d13/d24/l2f 0 2024-09-13T23:06:07.565 INFO:tasks.workunit.client.0.smithi115.stdout:7/156: rmdir da/dd/d1c 39 2024-09-13T23:06:07.565 INFO:tasks.workunit.client.0.smithi115.stdout:7/157: readlink da/dd/le 0 2024-09-13T23:06:07.565 INFO:tasks.workunit.client.0.smithi115.stdout:7/158: fsync da/f21 0 2024-09-13T23:06:07.567 INFO:tasks.workunit.client.0.smithi115.stdout:9/136: truncate d0/f4 473032 0 2024-09-13T23:06:07.568 INFO:tasks.workunit.client.0.smithi115.stdout:8/128: dwrite d3/d5/dc/f12 [0,4194304] 0 2024-09-13T23:06:07.568 INFO:tasks.workunit.client.0.smithi115.stdout:7/159: rename c6 to da/c35 0 2024-09-13T23:06:07.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/237: dwrite d6/f9 [0,4194304] 0 2024-09-13T23:06:07.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/238: write d6/f4d [826109,112880] 0 2024-09-13T23:06:07.568 INFO:tasks.workunit.client.0.smithi115.stdout:1/192: dwrite d0/fc [0,4194304] 0 2024-09-13T23:06:07.569 INFO:tasks.workunit.client.0.smithi115.stdout:1/193: truncate d0/de/d1b/d25/f3d 517615 0 2024-09-13T23:06:07.569 INFO:tasks.workunit.client.0.smithi115.stdout:1/194: write d0/de/d1b/f35 [92484,41259] 0 2024-09-13T23:06:07.570 INFO:tasks.workunit.client.0.smithi115.stdout:5/187: dread d8/dd/d20/f1a [0,4194304] 0 2024-09-13T23:06:07.573 INFO:tasks.workunit.client.0.smithi115.stdout:9/137: creat d0/d13/f2d x:0 0 0 2024-09-13T23:06:07.573 INFO:tasks.workunit.client.0.smithi115.stdout:9/138: creat d0/d13/f2e x:0 0 0 2024-09-13T23:06:07.573 INFO:tasks.workunit.client.0.smithi115.stdout:5/188: dread d8/f2a [0,4194304] 0 2024-09-13T23:06:07.573 INFO:tasks.workunit.client.0.smithi115.stdout:5/189: dread - d8/dd/d20/f31 zero size 2024-09-13T23:06:07.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/257: rmdir d4/df 39 2024-09-13T23:06:07.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/258: fdatasync d4/f3c 0 2024-09-13T23:06:07.574 INFO:tasks.workunit.client.0.smithi115.stdout:6/259: rename d4/df/d14/d38/d2a/d3e to d4/df/d14/d38/d2a/d3e/d48 22 2024-09-13T23:06:07.577 INFO:tasks.workunit.client.0.smithi115.stdout:2/173: dwrite da/de/f24 [0,4194304] 0 2024-09-13T23:06:07.577 INFO:tasks.workunit.client.0.smithi115.stdout:8/129: creat d3/d5/dc/f2b x:0 0 0 2024-09-13T23:06:07.577 INFO:tasks.workunit.client.0.smithi115.stdout:8/130: stat d3/d5/dc/d16/c19 0 2024-09-13T23:06:07.577 INFO:tasks.workunit.client.0.smithi115.stdout:8/131: chown d3/d5/dc/d16/d1f 4155586 1 2024-09-13T23:06:07.579 INFO:tasks.workunit.client.0.smithi115.stdout:0/239: rmdir d6/d24 39 2024-09-13T23:06:07.579 INFO:tasks.workunit.client.0.smithi115.stdout:6/260: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:07.580 INFO:tasks.workunit.client.0.smithi115.stdout:7/160: write da/dd/d1c/f27 [1240312,68731] 0 2024-09-13T23:06:07.591 INFO:tasks.workunit.client.0.smithi115.stdout:2/174: symlink da/d23/d2c/l3b 0 2024-09-13T23:06:07.591 INFO:tasks.workunit.client.0.smithi115.stdout:2/175: fsync da/de/f12 0 2024-09-13T23:06:07.591 INFO:tasks.workunit.client.0.smithi115.stdout:8/132: mknod d3/d5/dc/d16/c2c 0 2024-09-13T23:06:07.593 INFO:tasks.workunit.client.0.smithi115.stdout:6/261: symlink d4/df/d14/l49 0 2024-09-13T23:06:07.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/195: getdents d0/d14/d31/d37 0 2024-09-13T23:06:07.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/196: stat d0/dd/c28 0 2024-09-13T23:06:07.595 INFO:tasks.workunit.client.0.smithi115.stdout:7/161: mkdir da/dd/d13/d36 0 2024-09-13T23:06:07.596 INFO:tasks.workunit.client.0.smithi115.stdout:2/176: truncate da/de/f28 13189 0 2024-09-13T23:06:07.596 INFO:tasks.workunit.client.0.smithi115.stdout:2/177: dread - da/d23/d32/f3a zero size 2024-09-13T23:06:07.597 INFO:tasks.workunit.client.0.smithi115.stdout:8/133: creat d3/d5/dc/d23/f2d x:0 0 0 2024-09-13T23:06:07.597 INFO:tasks.workunit.client.0.smithi115.stdout:8/134: truncate d3/d11/f17 4865161 0 2024-09-13T23:06:07.598 INFO:tasks.workunit.client.0.smithi115.stdout:8/135: readlink d3/d5/l1b 0 2024-09-13T23:06:07.598 INFO:tasks.workunit.client.0.smithi115.stdout:8/136: write d3/d5/dc/d23/f2d [298375,85645] 0 2024-09-13T23:06:07.598 INFO:tasks.workunit.client.0.smithi115.stdout:8/137: chown d3/d11/f15 13903 1 2024-09-13T23:06:07.598 INFO:tasks.workunit.client.0.smithi115.stdout:0/240: getdents d6/d24/d25/d2b/d32 0 2024-09-13T23:06:07.599 INFO:tasks.workunit.client.0.smithi115.stdout:6/262: getdents d4/df/d14/d38 0 2024-09-13T23:06:07.599 INFO:tasks.workunit.client.0.smithi115.stdout:6/263: fsync d4/df/f2e 0 2024-09-13T23:06:07.600 INFO:tasks.workunit.client.0.smithi115.stdout:1/197: rename d0/d14/d23/f27 to d0/d14/f41 0 2024-09-13T23:06:07.600 INFO:tasks.workunit.client.0.smithi115.stdout:1/198: chown d0/de/d1b/f35 1 1 2024-09-13T23:06:07.601 INFO:tasks.workunit.client.0.smithi115.stdout:7/162: link da/dd/d1c/c2b da/dd/d1c/d2d/c37 0 2024-09-13T23:06:07.602 INFO:tasks.workunit.client.0.smithi115.stdout:2/178: mknod da/de/c3c 0 2024-09-13T23:06:07.604 INFO:tasks.workunit.client.0.smithi115.stdout:1/199: link d0/de/d1a/d29/f2a d0/de/d1a/d29/f42 0 2024-09-13T23:06:07.604 INFO:tasks.workunit.client.0.smithi115.stdout:7/163: write da/fc [3688953,16637] 0 2024-09-13T23:06:07.606 INFO:tasks.workunit.client.0.smithi115.stdout:9/139: dwrite d0/d13/f1c [0,4194304] 0 2024-09-13T23:06:07.606 INFO:tasks.workunit.client.0.smithi115.stdout:9/140: dread - d0/d13/f2e zero size 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:9/141: fsync d0/f22 0 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:2/179: creat da/d23/d2c/f3d x:0 0 0 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:7/164: mknod da/dd/d13/d36/c38 0 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:7/165: write da/dd/d1c/f22 [2949985,18614] 0 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:6/264: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:07.607 INFO:tasks.workunit.client.0.smithi115.stdout:6/265: read d4/df/d14/f18 [1551858,34012] 0 2024-09-13T23:06:07.612 INFO:tasks.workunit.client.0.smithi115.stdout:8/138: write d3/d5/dc/f12 [2578621,57383] 0 2024-09-13T23:06:07.612 INFO:tasks.workunit.client.0.smithi115.stdout:8/139: write d3/d11/f17 [1343797,32610] 0 2024-09-13T23:06:07.612 INFO:tasks.workunit.client.0.smithi115.stdout:8/140: read - d3/d5/dc/f2b zero size 2024-09-13T23:06:07.612 INFO:tasks.workunit.client.0.smithi115.stdout:1/200: write d0/f6 [3892440,74459] 0 2024-09-13T23:06:07.614 INFO:tasks.workunit.client.0.smithi115.stdout:0/241: dread d6/f9 [4194304,4194304] 0 2024-09-13T23:06:07.614 INFO:tasks.workunit.client.0.smithi115.stdout:5/190: dwrite d8/f26 [0,4194304] 0 2024-09-13T23:06:07.616 INFO:tasks.workunit.client.0.smithi115.stdout:9/142: symlink d0/l2f 0 2024-09-13T23:06:07.618 INFO:tasks.workunit.client.0.smithi115.stdout:0/242: dread d6/f20 [0,4194304] 0 2024-09-13T23:06:07.618 INFO:tasks.workunit.client.0.smithi115.stdout:0/243: fsync d6/d24/d25/f29 0 2024-09-13T23:06:07.620 INFO:tasks.workunit.client.0.smithi115.stdout:8/141: link d3/d11/f14 d3/d5/d1c/f2e 0 2024-09-13T23:06:07.620 INFO:tasks.workunit.client.0.smithi115.stdout:0/244: write d6/d24/d25/d2b/d32/d44/f55 [509863,81271] 0 2024-09-13T23:06:07.620 INFO:tasks.workunit.client.0.smithi115.stdout:0/245: write d6/d24/d25/f2c [1061313,7200] 0 2024-09-13T23:06:07.621 INFO:tasks.workunit.client.0.smithi115.stdout:0/246: write d6/d24/d25/d2b/d32/f50 [163703,95870] 0 2024-09-13T23:06:07.623 INFO:tasks.workunit.client.0.smithi115.stdout:5/191: dread d8/dd/f10 [0,4194304] 0 2024-09-13T23:06:07.624 INFO:tasks.workunit.client.0.smithi115.stdout:1/201: rename d0/de/d1b/c40 to d0/de/d1a/d29/c43 0 2024-09-13T23:06:07.633 INFO:tasks.workunit.client.0.smithi115.stdout:8/142: rename d3/ff to d3/f2f 0 2024-09-13T23:06:07.634 INFO:tasks.workunit.client.0.smithi115.stdout:5/192: symlink d8/dd/d14/l39 0 2024-09-13T23:06:07.634 INFO:tasks.workunit.client.0.smithi115.stdout:6/266: write d4/df/d14/d38/d2a/f33 [2469227,23738] 0 2024-09-13T23:06:07.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/267: chown d4/f3c 812435 1 2024-09-13T23:06:07.636 INFO:tasks.workunit.client.0.smithi115.stdout:1/202: link d0/l8 d0/d14/d31/l44 0 2024-09-13T23:06:07.636 INFO:tasks.workunit.client.0.smithi115.stdout:1/203: write d0/f1 [396404,94553] 0 2024-09-13T23:06:07.638 INFO:tasks.workunit.client.0.smithi115.stdout:9/143: symlink d0/l30 0 2024-09-13T23:06:07.638 INFO:tasks.workunit.client.0.smithi115.stdout:8/143: stat d3/d11/c2a 0 2024-09-13T23:06:07.638 INFO:tasks.workunit.client.0.smithi115.stdout:8/144: write d3/f2f [1317074,7600] 0 2024-09-13T23:06:07.639 INFO:tasks.workunit.client.0.smithi115.stdout:5/193: link d8/l21 d8/dd/d20/d35/l3a 0 2024-09-13T23:06:07.640 INFO:tasks.workunit.client.0.smithi115.stdout:5/194: truncate d8/dd/d14/f37 987950 0 2024-09-13T23:06:07.640 INFO:tasks.workunit.client.0.smithi115.stdout:1/204: getdents d0/de/d1a 0 2024-09-13T23:06:07.640 INFO:tasks.workunit.client.0.smithi115.stdout:1/205: fdatasync d0/de/d1a/d29/f39 0 2024-09-13T23:06:07.641 INFO:tasks.workunit.client.0.smithi115.stdout:9/144: mkdir d0/d13/d31 0 2024-09-13T23:06:07.643 INFO:tasks.workunit.client.0.smithi115.stdout:8/145: rename d3/d5/dc/d23/l25 to d3/d5/dc/d16/d1f/d27/l30 0 2024-09-13T23:06:07.643 INFO:tasks.workunit.client.0.smithi115.stdout:8/146: chown d3/d11/f15 2244 1 2024-09-13T23:06:07.643 INFO:tasks.workunit.client.0.smithi115.stdout:8/147: creat d3/d5/dc/f31 x:0 0 0 2024-09-13T23:06:07.643 INFO:tasks.workunit.client.0.smithi115.stdout:8/148: creat d3/d5/dc/f32 x:0 0 0 2024-09-13T23:06:07.643 INFO:tasks.workunit.client.0.smithi115.stdout:5/195: creat d8/dd/d20/d35/f3b x:0 0 0 2024-09-13T23:06:07.644 INFO:tasks.workunit.client.0.smithi115.stdout:5/196: dread - d8/dd/d20/f31 zero size 2024-09-13T23:06:07.645 INFO:tasks.workunit.client.0.smithi115.stdout:2/180: dwrite f4 [0,4194304] 0 2024-09-13T23:06:07.645 INFO:tasks.workunit.client.0.smithi115.stdout:1/206: rename d0/l8 to d0/d14/l45 0 2024-09-13T23:06:07.645 INFO:tasks.workunit.client.0.smithi115.stdout:1/207: chown d0/de/f32 0 1 2024-09-13T23:06:07.649 INFO:tasks.workunit.client.0.smithi115.stdout:8/149: unlink d3/d5/l1b 0 2024-09-13T23:06:07.649 INFO:tasks.workunit.client.0.smithi115.stdout:8/150: creat d3/d5/dc/d16/d1f/f33 x:0 0 0 2024-09-13T23:06:07.650 INFO:tasks.workunit.client.0.smithi115.stdout:0/247: dwrite d6/d24/d25/d2b/d32/f36 [0,4194304] 0 2024-09-13T23:06:07.651 INFO:tasks.workunit.client.0.smithi115.stdout:7/166: dwrite da/dd/d13/f2a [0,4194304] 0 2024-09-13T23:06:07.652 INFO:tasks.workunit.client.0.smithi115.stdout:7/167: fdatasync da/dd/d13/f2a 0 2024-09-13T23:06:07.652 INFO:tasks.workunit.client.0.smithi115.stdout:7/168: creat da/df/f39 x:0 0 0 2024-09-13T23:06:07.652 INFO:tasks.workunit.client.0.smithi115.stdout:5/197: link d8/f2a d8/f3c 0 2024-09-13T23:06:07.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/151: mknod d3/d5/dc/d23/c34 0 2024-09-13T23:06:07.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/152: fdatasync d3/d5/dc/d16/d1f/d28/f29 0 2024-09-13T23:06:07.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/153: creat d3/d5/dc/f35 x:0 0 0 2024-09-13T23:06:07.657 INFO:tasks.workunit.client.0.smithi115.stdout:0/248: creat d6/d24/d25/d2b/d32/d44/f56 x:0 0 0 2024-09-13T23:06:07.657 INFO:tasks.workunit.client.0.smithi115.stdout:0/249: creat d6/d24/d25/d2b/d32/d44/f57 x:0 0 0 2024-09-13T23:06:07.665 INFO:tasks.workunit.client.0.smithi115.stdout:2/181: rename da/de/d1a/l22 to da/l3e 0 2024-09-13T23:06:07.668 INFO:tasks.workunit.client.0.smithi115.stdout:9/145: dwrite d0/d13/d17/d1f/f23 [0,4194304] 0 2024-09-13T23:06:07.668 INFO:tasks.workunit.client.0.smithi115.stdout:1/208: dwrite d0/de/d1b/f36 [0,4194304] 0 2024-09-13T23:06:07.668 INFO:tasks.workunit.client.0.smithi115.stdout:1/209: fsync d0/d14/f41 0 2024-09-13T23:06:07.668 INFO:tasks.workunit.client.0.smithi115.stdout:0/250: truncate d6/d24/f26 578250 0 2024-09-13T23:06:07.672 INFO:tasks.workunit.client.0.smithi115.stdout:3/236: sync 2024-09-13T23:06:07.672 INFO:tasks.workunit.client.0.smithi115.stdout:7/169: rename da/df/f39 to da/dd/d13/d36/f3a 0 2024-09-13T23:06:07.672 INFO:tasks.workunit.client.0.smithi115.stdout:3/237: creat d3/d5/d35/f53 x:0 0 0 2024-09-13T23:06:07.672 INFO:tasks.workunit.client.0.smithi115.stdout:2/182: write da/de/d1a/f1f [1137635,125354] 0 2024-09-13T23:06:07.672 INFO:tasks.workunit.client.0.smithi115.stdout:2/183: write da/d23/f38 [511676,51309] 0 2024-09-13T23:06:07.676 INFO:tasks.workunit.client.0.smithi115.stdout:1/210: stat d0/dd/c18 0 2024-09-13T23:06:07.677 INFO:tasks.workunit.client.0.smithi115.stdout:1/211: truncate d0/dd/f3e 825420 0 2024-09-13T23:06:07.677 INFO:tasks.workunit.client.0.smithi115.stdout:8/154: fsync d3/d11/f15 0 2024-09-13T23:06:07.677 INFO:tasks.workunit.client.0.smithi115.stdout:8/155: creat d3/d5/dc/d23/f36 x:0 0 0 2024-09-13T23:06:07.684 INFO:tasks.workunit.client.0.smithi115.stdout:8/156: symlink d3/d11/l37 0 2024-09-13T23:06:07.685 INFO:tasks.workunit.client.0.smithi115.stdout:2/184: rename da/c27 to da/de/d1a/d1c/c3f 0 2024-09-13T23:06:07.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/157: creat d3/d5/dc/d16/f38 x:0 0 0 2024-09-13T23:06:07.692 INFO:tasks.workunit.client.0.smithi115.stdout:2/185: dread f7 [0,4194304] 0 2024-09-13T23:06:07.699 INFO:tasks.workunit.client.0.smithi115.stdout:7/170: write da/dd/d13/f2a [4885212,19971] 0 2024-09-13T23:06:07.699 INFO:tasks.workunit.client.0.smithi115.stdout:4/253: sync 2024-09-13T23:06:07.699 INFO:tasks.workunit.client.0.smithi115.stdout:4/254: chown db/dd/f44 31 1 2024-09-13T23:06:07.700 INFO:tasks.workunit.client.0.smithi115.stdout:7/171: mkdir da/df/d3b 0 2024-09-13T23:06:07.701 INFO:tasks.workunit.client.0.smithi115.stdout:4/255: creat db/d16/d3f/f45 x:0 0 0 2024-09-13T23:06:07.703 INFO:tasks.workunit.client.0.smithi115.stdout:4/256: write db/d11/d2e/d33/d36/f3c [624516,84940] 0 2024-09-13T23:06:07.703 INFO:tasks.workunit.client.0.smithi115.stdout:4/257: readlink db/d11/d2e/l39 0 2024-09-13T23:06:07.703 INFO:tasks.workunit.client.0.smithi115.stdout:4/258: chown db/d19/d1d/d2a/f3a 149 1 2024-09-13T23:06:07.703 INFO:tasks.workunit.client.0.smithi115.stdout:4/259: truncate db/d11/d2e/d33/d36/f3b 1667728 0 2024-09-13T23:06:07.707 INFO:tasks.workunit.client.0.smithi115.stdout:9/146: dwrite d0/d13/f2e [0,4194304] 0 2024-09-13T23:06:07.707 INFO:tasks.workunit.client.0.smithi115.stdout:0/251: dwrite d6/d24/d25/d2b/d32/d44/f55 [0,4194304] 0 2024-09-13T23:06:07.707 INFO:tasks.workunit.client.0.smithi115.stdout:1/212: dwrite d0/f5 [0,4194304] 0 2024-09-13T23:06:07.708 INFO:tasks.workunit.client.0.smithi115.stdout:1/213: stat d0/dd/c18 0 2024-09-13T23:06:07.708 INFO:tasks.workunit.client.0.smithi115.stdout:3/238: dwrite d3/d16/d1c/d31/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:07.710 INFO:tasks.workunit.client.0.smithi115.stdout:9/147: creat d0/d13/d31/f32 x:0 0 0 2024-09-13T23:06:07.714 INFO:tasks.workunit.client.0.smithi115.stdout:3/239: link d3/d16/d1a/d1e/l51 d3/d5/d35/l54 0 2024-09-13T23:06:07.716 INFO:tasks.workunit.client.0.smithi115.stdout:4/260: write db/d19/d1d/d2a/f40 [2980753,22218] 0 2024-09-13T23:06:07.720 INFO:tasks.workunit.client.0.smithi115.stdout:9/148: dread d0/d13/d17/f1e [4194304,4194304] 0 2024-09-13T23:06:07.722 INFO:tasks.workunit.client.0.smithi115.stdout:8/158: rename d3/d11 to d3/d5/d39 0 2024-09-13T23:06:07.722 INFO:tasks.workunit.client.0.smithi115.stdout:4/261: rmdir db/dd 39 2024-09-13T23:06:07.722 INFO:tasks.workunit.client.0.smithi115.stdout:4/262: fdatasync db/d11/d2e/d35/f3e 0 2024-09-13T23:06:07.723 INFO:tasks.workunit.client.0.smithi115.stdout:9/149: mknod d0/d13/c33 0 2024-09-13T23:06:07.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/159: symlink d3/d5/dc/d23/l3a 0 2024-09-13T23:06:07.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/160: write d3/d5/dc/d16/d1f/d28/f29 [431577,121755] 0 2024-09-13T23:06:07.727 INFO:tasks.workunit.client.0.smithi115.stdout:9/150: creat d0/f34 x:0 0 0 2024-09-13T23:06:07.727 INFO:tasks.workunit.client.0.smithi115.stdout:9/151: chown d0/d13/d17/d19 580699 1 2024-09-13T23:06:07.727 INFO:tasks.workunit.client.0.smithi115.stdout:9/152: stat d0/d13/d17/d19/l1a 0 2024-09-13T23:06:07.728 INFO:tasks.workunit.client.0.smithi115.stdout:2/186: rename da/de/d1a/c20 to da/d21/d2d/c40 0 2024-09-13T23:06:07.730 INFO:tasks.workunit.client.0.smithi115.stdout:9/153: mkdir d0/d13/d17/d1f/d35 0 2024-09-13T23:06:07.732 INFO:tasks.workunit.client.0.smithi115.stdout:7/172: rename da/dd/d13/d36/c38 to da/dd/d13/c3c 0 2024-09-13T23:06:07.732 INFO:tasks.workunit.client.0.smithi115.stdout:0/252: dwrite d6/d24/d25/d2b/d32/f36 [0,4194304] 0 2024-09-13T23:06:07.732 INFO:tasks.workunit.client.0.smithi115.stdout:0/253: stat d6/l54 0 2024-09-13T23:06:07.733 INFO:tasks.workunit.client.0.smithi115.stdout:2/187: mkdir da/de/d1a/d1c/d41 0 2024-09-13T23:06:07.733 INFO:tasks.workunit.client.0.smithi115.stdout:2/188: chown da/d23/d2c/c35 0 1 2024-09-13T23:06:07.733 INFO:tasks.workunit.client.0.smithi115.stdout:2/189: creat da/d23/d32/f42 x:0 0 0 2024-09-13T23:06:07.733 INFO:tasks.workunit.client.0.smithi115.stdout:9/154: mkdir d0/d13/d17/d36 0 2024-09-13T23:06:07.733 INFO:tasks.workunit.client.0.smithi115.stdout:9/155: truncate d0/d13/d31/f32 589717 0 2024-09-13T23:06:07.734 INFO:tasks.workunit.client.0.smithi115.stdout:0/254: write d6/f20 [225100,16053] 0 2024-09-13T23:06:07.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/240: rename d3/d16/d1c/c1d to d3/d16/d1c/d31/d45/c55 0 2024-09-13T23:06:07.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/263: dread db/d19/d1d/f22 [0,4194304] 0 2024-09-13T23:06:07.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/264: truncate db/d16/d3f/f45 493677 0 2024-09-13T23:06:07.739 INFO:tasks.workunit.client.0.smithi115.stdout:7/173: mknod da/dd/d16/d29/c3d 0 2024-09-13T23:06:07.742 INFO:tasks.workunit.client.0.smithi115.stdout:2/190: creat da/de/f43 x:0 0 0 2024-09-13T23:06:07.743 INFO:tasks.workunit.client.0.smithi115.stdout:8/161: dwrite d3/d5/fa [0,4194304] 0 2024-09-13T23:06:07.747 INFO:tasks.workunit.client.0.smithi115.stdout:3/241: mknod d3/d16/d1c/d31/d42/c56 0 2024-09-13T23:06:07.747 INFO:tasks.workunit.client.0.smithi115.stdout:3/242: creat d3/d16/d1a/f57 x:0 0 0 2024-09-13T23:06:07.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/174: mkdir da/d3e 0 2024-09-13T23:06:07.748 INFO:tasks.workunit.client.0.smithi115.stdout:7/175: fdatasync da/dd/d1c/f1f 0 2024-09-13T23:06:07.749 INFO:tasks.workunit.client.0.smithi115.stdout:2/191: getdents da 0 2024-09-13T23:06:07.750 INFO:tasks.workunit.client.0.smithi115.stdout:9/156: link d0/c2b d0/c37 0 2024-09-13T23:06:07.750 INFO:tasks.workunit.client.0.smithi115.stdout:4/265: getdents db/d16/d3f 0 2024-09-13T23:06:07.751 INFO:tasks.workunit.client.0.smithi115.stdout:4/266: write db/d16/d3f/f45 [347829,13035] 0 2024-09-13T23:06:07.751 INFO:tasks.workunit.client.0.smithi115.stdout:4/267: dread - db/dd/f44 zero size 2024-09-13T23:06:07.753 INFO:tasks.workunit.client.0.smithi115.stdout:3/243: creat d3/d16/d1c/d31/d45/f58 x:0 0 0 2024-09-13T23:06:07.755 INFO:tasks.workunit.client.0.smithi115.stdout:2/192: dread da/de/f28 [0,4194304] 0 2024-09-13T23:06:07.757 INFO:tasks.workunit.client.0.smithi115.stdout:0/255: dwrite d6/d24/f49 [0,4194304] 0 2024-09-13T23:06:07.758 INFO:tasks.workunit.client.0.smithi115.stdout:0/256: dread - d6/d24/d25/d2b/d32/d44/f56 zero size 2024-09-13T23:06:07.759 INFO:tasks.workunit.client.0.smithi115.stdout:4/268: rmdir db/d11/d2e/d33/d36 39 2024-09-13T23:06:07.762 INFO:tasks.workunit.client.0.smithi115.stdout:4/269: creat db/d11/f46 x:0 0 0 2024-09-13T23:06:07.772 INFO:tasks.workunit.client.0.smithi115.stdout:9/157: getdents d0/d13 0 2024-09-13T23:06:07.772 INFO:tasks.workunit.client.0.smithi115.stdout:2/193: dread f4 [0,4194304] 0 2024-09-13T23:06:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:9/158: write d0/d13/d17/f1e [5435752,80688] 0 2024-09-13T23:06:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:9/159: write d0/f34 [713342,42812] 0 2024-09-13T23:06:07.776 INFO:tasks.workunit.client.0.smithi115.stdout:0/257: dread d6/f9 [8388608,4194304] 0 2024-09-13T23:06:07.777 INFO:tasks.workunit.client.0.smithi115.stdout:7/176: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:07.778 INFO:tasks.workunit.client.0.smithi115.stdout:4/270: dread db/d19/d1d/d2a/f40 [0,4194304] 0 2024-09-13T23:06:07.780 INFO:tasks.workunit.client.0.smithi115.stdout:3/244: dwrite d3/d16/d1a/f57 [0,4194304] 0 2024-09-13T23:06:07.780 INFO:tasks.workunit.client.0.smithi115.stdout:0/258: mkdir d6/d24/d25/d58 0 2024-09-13T23:06:07.784 INFO:tasks.workunit.client.0.smithi115.stdout:7/177: rename da/dd/le to da/df/l3f 0 2024-09-13T23:06:07.787 INFO:tasks.workunit.client.0.smithi115.stdout:4/271: unlink db/d16/f30 0 2024-09-13T23:06:07.787 INFO:tasks.workunit.client.0.smithi115.stdout:4/272: write db/f43 [904591,24761] 0 2024-09-13T23:06:07.787 INFO:tasks.workunit.client.0.smithi115.stdout:4/273: creat db/d16/f47 x:0 0 0 2024-09-13T23:06:07.787 INFO:tasks.workunit.client.0.smithi115.stdout:4/274: read f5 [3915616,13883] 0 2024-09-13T23:06:07.791 INFO:tasks.workunit.client.0.smithi115.stdout:0/259: rmdir d6/d24/d25/d2b/d32 39 2024-09-13T23:06:07.792 INFO:tasks.workunit.client.0.smithi115.stdout:0/260: getdents d6/d24/d25/d2b/d32 0 2024-09-13T23:06:07.793 INFO:tasks.workunit.client.0.smithi115.stdout:7/178: symlink da/dd/d13/l40 0 2024-09-13T23:06:07.795 INFO:tasks.workunit.client.0.smithi115.stdout:0/261: getdents d6/d24 0 2024-09-13T23:06:07.795 INFO:tasks.workunit.client.0.smithi115.stdout:0/262: creat d6/d24/d25/d2b/d32/d44/f59 x:0 0 0 2024-09-13T23:06:07.796 INFO:tasks.workunit.client.0.smithi115.stdout:7/179: mkdir da/dd/d1c/d2d/d41 0 2024-09-13T23:06:07.799 INFO:tasks.workunit.client.0.smithi115.stdout:0/263: link d6/d24/d25/l4a d6/d24/d25/d58/l5a 0 2024-09-13T23:06:07.801 INFO:tasks.workunit.client.0.smithi115.stdout:6/268: sync 2024-09-13T23:06:07.801 INFO:tasks.workunit.client.0.smithi115.stdout:7/180: creat da/dd/d13/d36/f42 x:0 0 0 2024-09-13T23:06:07.801 INFO:tasks.workunit.client.0.smithi115.stdout:7/181: getdents da/d3e 0 2024-09-13T23:06:07.801 INFO:tasks.workunit.client.0.smithi115.stdout:7/182: dread - da/dd/d13/d36/f3a zero size 2024-09-13T23:06:07.801 INFO:tasks.workunit.client.0.smithi115.stdout:9/160: dwrite d0/fd [4194304,4194304] 0 2024-09-13T23:06:07.802 INFO:tasks.workunit.client.0.smithi115.stdout:6/269: unlink c2 0 2024-09-13T23:06:07.804 INFO:tasks.workunit.client.0.smithi115.stdout:4/275: dwrite db/d11/d2e/f2c [4194304,4194304] 0 2024-09-13T23:06:07.805 INFO:tasks.workunit.client.0.smithi115.stdout:6/270: getdents d4/df/d14/d38/d2a 0 2024-09-13T23:06:07.808 INFO:tasks.workunit.client.0.smithi115.stdout:0/264: dread d6/d24/d25/d2b/d32/d44/f55 [0,4194304] 0 2024-09-13T23:06:07.811 INFO:tasks.workunit.client.0.smithi115.stdout:0/265: mkdir d6/d24/d25/d58/d5b 0 2024-09-13T23:06:07.812 INFO:tasks.workunit.client.0.smithi115.stdout:5/198: sync 2024-09-13T23:06:07.812 INFO:tasks.workunit.client.0.smithi115.stdout:1/214: sync 2024-09-13T23:06:07.812 INFO:tasks.workunit.client.0.smithi115.stdout:1/215: readlink d0/d14/l33 0 2024-09-13T23:06:07.813 INFO:tasks.workunit.client.0.smithi115.stdout:1/216: read - d0/d14/d31/d37/f3f zero size 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/266: mkdir d6/d24/d25/d2b/d32/d44/d5c 0 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/267: creat d6/d24/d25/d2b/d32/d44/f5d x:0 0 0 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/268: read - d6/d24/f3d zero size 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/269: chown d6/d24/d25/c4f 3970202 1 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/270: readlink d6/d24/d25/l4a 0 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/271: truncate d6/d24/d25/d2b/d32/f50 910589 0 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/272: chown d6/d24/d25/f29 7087659 1 2024-09-13T23:06:07.814 INFO:tasks.workunit.client.0.smithi115.stdout:0/273: creat d6/d24/d25/d2b/f5e x:0 0 0 2024-09-13T23:06:07.815 INFO:tasks.workunit.client.0.smithi115.stdout:5/199: truncate d8/dd/d20/f17 571362 0 2024-09-13T23:06:07.815 INFO:tasks.workunit.client.0.smithi115.stdout:5/200: stat d8/dd/d20 0 2024-09-13T23:06:07.822 INFO:tasks.workunit.client.0.smithi115.stdout:0/274: unlink d6/d24/f26 0 2024-09-13T23:06:07.825 INFO:tasks.workunit.client.0.smithi115.stdout:5/201: link l2 d8/dd/l3d 0 2024-09-13T23:06:07.828 INFO:tasks.workunit.client.0.smithi115.stdout:7/183: rmdir da 39 2024-09-13T23:06:07.829 INFO:tasks.workunit.client.0.smithi115.stdout:0/275: write d6/d24/d25/d2b/d32/d44/f55 [381902,61793] 0 2024-09-13T23:06:07.846 INFO:tasks.workunit.client.0.smithi115.stdout:6/271: dwrite d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:07.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/276: dwrite db/d11/d2e/d35/f3e [0,4194304] 0 2024-09-13T23:06:07.846 INFO:tasks.workunit.client.0.smithi115.stdout:4/277: truncate db/d16/d3f/f45 640423 0 2024-09-13T23:06:07.846 INFO:tasks.workunit.client.0.smithi115.stdout:1/217: dwrite d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:07.848 INFO:tasks.workunit.client.0.smithi115.stdout:6/272: unlink d4/df/d14/c30 0 2024-09-13T23:06:07.860 INFO:tasks.workunit.client.0.smithi115.stdout:5/202: dwrite d8/dd/d20/d23/f2f [0,4194304] 0 2024-09-13T23:06:07.860 INFO:tasks.workunit.client.0.smithi115.stdout:9/161: dwrite d0/f2 [0,4194304] 0 2024-09-13T23:06:07.862 INFO:tasks.workunit.client.0.smithi115.stdout:9/162: dread d0/f34 [0,4194304] 0 2024-09-13T23:06:07.897 INFO:tasks.workunit.client.0.smithi115.stdout:4/278: symlink db/d16/l48 0 2024-09-13T23:06:07.898 INFO:tasks.workunit.client.0.smithi115.stdout:1/218: link d0/d14/d23/f2c d0/de/f46 0 2024-09-13T23:06:07.898 INFO:tasks.workunit.client.0.smithi115.stdout:1/219: chown d0/c1c 14004 1 2024-09-13T23:06:07.898 INFO:tasks.workunit.client.0.smithi115.stdout:1/220: readlink d0/d14/l45 0 2024-09-13T23:06:07.898 INFO:tasks.workunit.client.0.smithi115.stdout:1/221: chown d0/d14/c2e 82 1 2024-09-13T23:06:07.899 INFO:tasks.workunit.client.0.smithi115.stdout:6/273: mknod d4/df/d14/d35/c4a 0 2024-09-13T23:06:07.899 INFO:tasks.workunit.client.0.smithi115.stdout:6/274: write d4/df/d14/d38/f23 [535604,64392] 0 2024-09-13T23:06:07.899 INFO:tasks.workunit.client.0.smithi115.stdout:6/275: chown d4/l45 408457 1 2024-09-13T23:06:07.900 INFO:tasks.workunit.client.0.smithi115.stdout:6/276: fsync d4/df/d14/f18 0 2024-09-13T23:06:07.900 INFO:tasks.workunit.client.0.smithi115.stdout:6/277: chown d4/df/d14/d38/l26 0 1 2024-09-13T23:06:07.902 INFO:tasks.workunit.client.0.smithi115.stdout:5/203: creat d8/dd/d20/d23/f3e x:0 0 0 2024-09-13T23:06:07.902 INFO:tasks.workunit.client.0.smithi115.stdout:5/204: creat d8/dd/d20/d23/f3f x:0 0 0 2024-09-13T23:06:07.903 INFO:tasks.workunit.client.0.smithi115.stdout:9/163: creat d0/d13/d17/d1f/d28/f38 x:0 0 0 2024-09-13T23:06:07.903 INFO:tasks.workunit.client.0.smithi115.stdout:9/164: readlink d0/l30 0 2024-09-13T23:06:07.904 INFO:tasks.workunit.client.0.smithi115.stdout:9/165: dread - d0/d13/f2d zero size 2024-09-13T23:06:07.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/278: dread d4/f1d [0,4194304] 0 2024-09-13T23:06:07.909 INFO:tasks.workunit.client.0.smithi115.stdout:1/222: mkdir d0/de/d1a/d29/d47 0 2024-09-13T23:06:07.909 INFO:tasks.workunit.client.0.smithi115.stdout:1/223: stat d0/de/d1b/f2f 0 2024-09-13T23:06:07.911 INFO:tasks.workunit.client.0.smithi115.stdout:5/205: mknod d8/dd/d20/d35/c40 0 2024-09-13T23:06:07.911 INFO:tasks.workunit.client.0.smithi115.stdout:6/279: symlink d4/df/d3a/l4b 0 2024-09-13T23:06:07.913 INFO:tasks.workunit.client.0.smithi115.stdout:9/166: write d0/d13/d17/f1e [309404,36465] 0 2024-09-13T23:06:07.913 INFO:tasks.workunit.client.0.smithi115.stdout:5/206: creat d8/d36/f41 x:0 0 0 2024-09-13T23:06:07.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/207: write d8/d36/f41 [419443,30509] 0 2024-09-13T23:06:07.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/279: dwrite db/f43 [0,4194304] 0 2024-09-13T23:06:07.923 INFO:tasks.workunit.client.0.smithi115.stdout:4/280: symlink db/d19/l49 0 2024-09-13T23:06:07.923 INFO:tasks.workunit.client.0.smithi115.stdout:8/162: sync 2024-09-13T23:06:07.930 INFO:tasks.workunit.client.0.smithi115.stdout:9/167: dread d0/d13/d17/f1e [4194304,4194304] 0 2024-09-13T23:06:07.933 INFO:tasks.workunit.client.0.smithi115.stdout:9/168: unlink d0/le 0 2024-09-13T23:06:07.939 INFO:tasks.workunit.client.0.smithi115.stdout:8/163: write d3/fd [201674,44623] 0 2024-09-13T23:06:07.939 INFO:tasks.workunit.client.0.smithi115.stdout:8/164: fsync d3/d5/dc/d23/f2d 0 2024-09-13T23:06:07.940 INFO:tasks.workunit.client.0.smithi115.stdout:8/165: mknod d3/d5/dc/d16/d1f/d27/c3b 0 2024-09-13T23:06:07.943 INFO:tasks.workunit.client.0.smithi115.stdout:6/280: dwrite d4/df/f2e [4194304,4194304] 0 2024-09-13T23:06:07.943 INFO:tasks.workunit.client.0.smithi115.stdout:1/224: dwrite d0/de/f32 [0,4194304] 0 2024-09-13T23:06:07.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/208: dwrite d8/dd/d20/d23/f3f [0,4194304] 0 2024-09-13T23:06:07.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/209: fdatasync d8/dd/d20/f25 0 2024-09-13T23:06:07.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/210: fdatasync d8/dd/d20/f1a 0 2024-09-13T23:06:07.947 INFO:tasks.workunit.client.0.smithi115.stdout:4/281: dwrite fa [0,4194304] 0 2024-09-13T23:06:07.950 INFO:tasks.workunit.client.0.smithi115.stdout:9/169: write d0/f2 [100713,124551] 0 2024-09-13T23:06:07.950 INFO:tasks.workunit.client.0.smithi115.stdout:4/282: mknod db/d19/d1d/c4a 0 2024-09-13T23:06:07.952 INFO:tasks.workunit.client.0.smithi115.stdout:1/225: getdents d0/dd 0 2024-09-13T23:06:07.952 INFO:tasks.workunit.client.0.smithi115.stdout:1/226: creat d0/de/d1a/d29/f48 x:0 0 0 2024-09-13T23:06:07.952 INFO:tasks.workunit.client.0.smithi115.stdout:1/227: write d0/f2 [595265,78783] 0 2024-09-13T23:06:07.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/211: getdents d8/dd/d20 0 2024-09-13T23:06:07.953 INFO:tasks.workunit.client.0.smithi115.stdout:5/212: chown d8/l11 3405 1 2024-09-13T23:06:07.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/281: write d4/df/f2e [5545853,41468] 0 2024-09-13T23:06:07.956 INFO:tasks.workunit.client.0.smithi115.stdout:9/170: creat d0/d13/d17/f39 x:0 0 0 2024-09-13T23:06:07.956 INFO:tasks.workunit.client.0.smithi115.stdout:4/283: symlink db/d19/d1d/l4b 0 2024-09-13T23:06:07.957 INFO:tasks.workunit.client.0.smithi115.stdout:2/194: sync 2024-09-13T23:06:07.958 INFO:tasks.workunit.client.0.smithi115.stdout:6/282: creat d4/df/d14/d38/d2a/d3e/f4c x:0 0 0 2024-09-13T23:06:07.958 INFO:tasks.workunit.client.0.smithi115.stdout:6/283: chown d4/df/d14/d38/d2a/d3e 3266 1 2024-09-13T23:06:07.958 INFO:tasks.workunit.client.0.smithi115.stdout:6/284: write d4/f3c [877171,12568] 0 2024-09-13T23:06:07.958 INFO:tasks.workunit.client.0.smithi115.stdout:5/213: dread d8/fb [0,4194304] 0 2024-09-13T23:06:07.959 INFO:tasks.workunit.client.0.smithi115.stdout:4/284: creat db/d11/d2e/d33/f4c x:0 0 0 2024-09-13T23:06:07.959 INFO:tasks.workunit.client.0.smithi115.stdout:1/228: dread d0/f6 [0,4194304] 0 2024-09-13T23:06:07.960 INFO:tasks.workunit.client.0.smithi115.stdout:2/195: creat da/de/d1a/f44 x:0 0 0 2024-09-13T23:06:07.960 INFO:tasks.workunit.client.0.smithi115.stdout:2/196: creat da/de/f45 x:0 0 0 2024-09-13T23:06:07.960 INFO:tasks.workunit.client.0.smithi115.stdout:2/197: rename da/de/d1a/d1c/d41 to da/de/d1a/d1c/d41/d46 22 2024-09-13T23:06:07.960 INFO:tasks.workunit.client.0.smithi115.stdout:2/198: creat da/d23/d2c/f47 x:0 0 0 2024-09-13T23:06:07.961 INFO:tasks.workunit.client.0.smithi115.stdout:6/285: mknod d4/df/c4d 0 2024-09-13T23:06:07.961 INFO:tasks.workunit.client.0.smithi115.stdout:5/214: mknod d8/dd/c42 0 2024-09-13T23:06:07.962 INFO:tasks.workunit.client.0.smithi115.stdout:4/285: mknod db/d11/c4d 0 2024-09-13T23:06:07.963 INFO:tasks.workunit.client.0.smithi115.stdout:8/166: dwrite d3/d5/dc/f32 [0,4194304] 0 2024-09-13T23:06:07.966 INFO:tasks.workunit.client.0.smithi115.stdout:2/199: mkdir da/d23/d32/d48 0 2024-09-13T23:06:07.966 INFO:tasks.workunit.client.0.smithi115.stdout:2/200: dread - da/de/f43 zero size 2024-09-13T23:06:07.967 INFO:tasks.workunit.client.0.smithi115.stdout:6/286: symlink d4/df/d14/d38/d2a/l4e 0 2024-09-13T23:06:07.967 INFO:tasks.workunit.client.0.smithi115.stdout:9/171: read d0/d13/d17/d1f/f23 [1070604,21455] 0 2024-09-13T23:06:07.967 INFO:tasks.workunit.client.0.smithi115.stdout:4/286: mkdir db/d19/d4e 0 2024-09-13T23:06:07.967 INFO:tasks.workunit.client.0.smithi115.stdout:4/287: fdatasync db/d19/d1d/d2a/f3a 0 2024-09-13T23:06:07.969 INFO:tasks.workunit.client.0.smithi115.stdout:8/167: link d3/c18 d3/d5/dc/d16/d1f/c3c 0 2024-09-13T23:06:07.969 INFO:tasks.workunit.client.0.smithi115.stdout:8/168: chown d3/d5/d1d/l24 1000041360 1 2024-09-13T23:06:07.970 INFO:tasks.workunit.client.0.smithi115.stdout:8/169: creat d3/d5/f3d x:0 0 0 2024-09-13T23:06:07.970 INFO:tasks.workunit.client.0.smithi115.stdout:1/229: dread d0/fc [0,4194304] 0 2024-09-13T23:06:07.971 INFO:tasks.workunit.client.0.smithi115.stdout:6/287: mknod d4/df/d14/d38/d2a/d31/c4f 0 2024-09-13T23:06:07.976 INFO:tasks.workunit.client.0.smithi115.stdout:4/288: mknod db/d16/c4f 0 2024-09-13T23:06:07.977 INFO:tasks.workunit.client.0.smithi115.stdout:8/170: mkdir d3/d5/dc/d16/d1f/d28/d3e 0 2024-09-13T23:06:07.977 INFO:tasks.workunit.client.0.smithi115.stdout:8/171: dread - d3/d5/f3d zero size 2024-09-13T23:06:07.979 INFO:tasks.workunit.client.0.smithi115.stdout:1/230: link d0/c11 d0/d14/d23/c49 0 2024-09-13T23:06:07.979 INFO:tasks.workunit.client.0.smithi115.stdout:6/288: mknod d4/df/d14/d35/c50 0 2024-09-13T23:06:07.981 INFO:tasks.workunit.client.0.smithi115.stdout:9/172: rename d0/l16 to d0/d13/d17/l3a 0 2024-09-13T23:06:07.981 INFO:tasks.workunit.client.0.smithi115.stdout:8/172: rename d3/d5/dc/d16/d1f/d28 to d3/d5/dc/d16/d1f/d28/d3e/d3f 22 2024-09-13T23:06:07.982 INFO:tasks.workunit.client.0.smithi115.stdout:4/289: unlink db/l23 0 2024-09-13T23:06:07.983 INFO:tasks.workunit.client.0.smithi115.stdout:8/173: dread d3/d5/fb [0,4194304] 0 2024-09-13T23:06:07.983 INFO:tasks.workunit.client.0.smithi115.stdout:1/231: rename d0/de/f32 to d0/de/d1b/f4a 0 2024-09-13T23:06:07.984 INFO:tasks.workunit.client.0.smithi115.stdout:1/232: dread - d0/d14/d31/d37/f3f zero size 2024-09-13T23:06:07.986 INFO:tasks.workunit.client.0.smithi115.stdout:4/290: rename db/d19/d1d/d2a/f3a to db/d19/d34/f50 0 2024-09-13T23:06:07.987 INFO:tasks.workunit.client.0.smithi115.stdout:1/233: mknod d0/de/c4b 0 2024-09-13T23:06:07.987 INFO:tasks.workunit.client.0.smithi115.stdout:1/234: write d0/de/f19 [1256437,24392] 0 2024-09-13T23:06:07.994 INFO:tasks.workunit.client.0.smithi115.stdout:2/201: dwrite da/d21/f33 [0,4194304] 0 2024-09-13T23:06:07.999 INFO:tasks.workunit.client.0.smithi115.stdout:2/202: unlink da/de/f43 0 2024-09-13T23:06:07.999 INFO:tasks.workunit.client.0.smithi115.stdout:9/173: dread d0/fd [0,4194304] 0 2024-09-13T23:06:08.013 INFO:tasks.workunit.client.0.smithi115.stdout:2/203: dread da/de/f24 [0,4194304] 0 2024-09-13T23:06:08.013 INFO:tasks.workunit.client.0.smithi115.stdout:2/204: stat da/de 0 2024-09-13T23:06:08.014 INFO:tasks.workunit.client.0.smithi115.stdout:9/174: write d0/d13/f1c [4135955,50322] 0 2024-09-13T23:06:08.015 INFO:tasks.workunit.client.0.smithi115.stdout:9/175: fsync d0/fd 0 2024-09-13T23:06:08.015 INFO:tasks.workunit.client.0.smithi115.stdout:9/176: write d0/d13/d17/f1e [7853045,105741] 0 2024-09-13T23:06:08.015 INFO:tasks.workunit.client.0.smithi115.stdout:2/205: unlink l9 0 2024-09-13T23:06:08.018 INFO:tasks.workunit.client.0.smithi115.stdout:2/206: rmdir da/d23 39 2024-09-13T23:06:08.019 INFO:tasks.workunit.client.0.smithi115.stdout:4/291: dwrite db/f43 [0,4194304] 0 2024-09-13T23:06:08.019 INFO:tasks.workunit.client.0.smithi115.stdout:8/174: dwrite d3/d5/dc/f31 [0,4194304] 0 2024-09-13T23:06:08.019 INFO:tasks.workunit.client.0.smithi115.stdout:1/235: dwrite d0/de/d1a/d29/f42 [0,4194304] 0 2024-09-13T23:06:08.021 INFO:tasks.workunit.client.0.smithi115.stdout:4/292: unlink db/d11/c1b 0 2024-09-13T23:06:08.021 INFO:tasks.workunit.client.0.smithi115.stdout:4/293: read db/f10 [2081009,62861] 0 2024-09-13T23:06:08.021 INFO:tasks.workunit.client.0.smithi115.stdout:4/294: chown db/lc 4 1 2024-09-13T23:06:08.022 INFO:tasks.workunit.client.0.smithi115.stdout:6/289: dwrite d4/df/d14/d38/d2a/d3e/f4c [0,4194304] 0 2024-09-13T23:06:08.022 INFO:tasks.workunit.client.0.smithi115.stdout:8/175: mknod d3/d5/d39/c40 0 2024-09-13T23:06:08.022 INFO:tasks.workunit.client.0.smithi115.stdout:8/176: write d3/d5/dc/d16/d1f/d28/f29 [1423771,58463] 0 2024-09-13T23:06:08.026 INFO:tasks.workunit.client.0.smithi115.stdout:1/236: unlink d0/de/d1b/f36 0 2024-09-13T23:06:08.027 INFO:tasks.workunit.client.0.smithi115.stdout:1/237: write d0/de/d1b/f35 [4875,103855] 0 2024-09-13T23:06:08.027 INFO:tasks.workunit.client.0.smithi115.stdout:4/295: mkdir db/d11/d2e/d33/d36/d51 0 2024-09-13T23:06:08.027 INFO:tasks.workunit.client.0.smithi115.stdout:4/296: readlink l4 0 2024-09-13T23:06:08.031 INFO:tasks.workunit.client.0.smithi115.stdout:2/207: write da/d21/f33 [3344557,109166] 0 2024-09-13T23:06:08.031 INFO:tasks.workunit.client.0.smithi115.stdout:9/177: dwrite d0/d13/f2e [0,4194304] 0 2024-09-13T23:06:08.034 INFO:tasks.workunit.client.0.smithi115.stdout:6/290: getdents d4/df/d14/d38/d44 0 2024-09-13T23:06:08.034 INFO:tasks.workunit.client.0.smithi115.stdout:6/291: stat d4/df/c16 0 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:8/177: write d3/d5/d1d/f26 [3704252,31116] 0 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:0/276: sync 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:7/184: sync 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:3/245: sync 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:7/185: write da/dd/d1c/f27 [1133327,80779] 0 2024-09-13T23:06:08.035 INFO:tasks.workunit.client.0.smithi115.stdout:2/208: truncate da/de/f12 3558048 0 2024-09-13T23:06:08.036 INFO:tasks.workunit.client.0.smithi115.stdout:9/178: read d0/d13/d31/f32 [584766,7724] 0 2024-09-13T23:06:08.036 INFO:tasks.workunit.client.0.smithi115.stdout:9/179: fsync d0/d13/f2d 0 2024-09-13T23:06:08.043 INFO:tasks.workunit.client.0.smithi115.stdout:8/178: mkdir d3/d5/d1c/d41 0 2024-09-13T23:06:08.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/180: write d0/fd [715427,547] 0 2024-09-13T23:06:08.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/181: readlink d0/l30 0 2024-09-13T23:06:08.045 INFO:tasks.workunit.client.0.smithi115.stdout:9/182: read d0/d13/f1c [502745,107954] 0 2024-09-13T23:06:08.045 INFO:tasks.workunit.client.0.smithi115.stdout:0/277: symlink d6/d24/d25/d58/l5f 0 2024-09-13T23:06:08.047 INFO:tasks.workunit.client.0.smithi115.stdout:7/186: creat da/dd/d13/f43 x:0 0 0 2024-09-13T23:06:08.047 INFO:tasks.workunit.client.0.smithi115.stdout:7/187: rename da/dd to da/dd/d1c/d2d/d44 22 2024-09-13T23:06:08.048 INFO:tasks.workunit.client.0.smithi115.stdout:2/209: mkdir da/d23/d49 0 2024-09-13T23:06:08.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:07 smithi115 ceph-mon[27601]: pgmap v242: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 23 MiB/s wr, 816 op/s 2024-09-13T23:06:08.050 INFO:tasks.workunit.client.0.smithi115.stdout:3/246: getdents d3/d16/d1c 0 2024-09-13T23:06:08.052 INFO:tasks.workunit.client.0.smithi115.stdout:0/278: mknod d6/d24/d25/c60 0 2024-09-13T23:06:08.056 INFO:tasks.workunit.client.0.smithi115.stdout:3/247: unlink d3/d16/d1a/f1f 0 2024-09-13T23:06:08.058 INFO:tasks.workunit.client.0.smithi115.stdout:0/279: unlink d6/d24/f51 0 2024-09-13T23:06:08.058 INFO:tasks.workunit.client.0.smithi115.stdout:0/280: fdatasync d6/fd 0 2024-09-13T23:06:08.058 INFO:tasks.workunit.client.0.smithi115.stdout:5/215: sync 2024-09-13T23:06:08.059 INFO:tasks.workunit.client.0.smithi115.stdout:8/179: read d3/d5/dc/f31 [3535756,10884] 0 2024-09-13T23:06:08.059 INFO:tasks.workunit.client.0.smithi115.stdout:8/180: readlink d3/d5/dc/d23/l3a 0 2024-09-13T23:06:08.059 INFO:tasks.workunit.client.0.smithi115.stdout:3/248: mkdir d3/d16/d1c/d31/d45/d59 0 2024-09-13T23:06:08.059 INFO:tasks.workunit.client.0.smithi115.stdout:0/281: mkdir d6/d24/d25/d2b/d61 0 2024-09-13T23:06:08.059 INFO:tasks.workunit.client.0.smithi115.stdout:0/282: chown d6/d24/f38 18650 1 2024-09-13T23:06:08.060 INFO:tasks.workunit.client.0.smithi115.stdout:0/283: chown d6/d24/d25/d2b/c2e 106306 1 2024-09-13T23:06:08.060 INFO:tasks.workunit.client.0.smithi115.stdout:7/188: rmdir da/d3e 0 2024-09-13T23:06:08.062 INFO:tasks.workunit.client.0.smithi115.stdout:8/181: rename d3/d5/d39 to d3/d5/d1c/d41/d42 0 2024-09-13T23:06:08.067 INFO:tasks.workunit.client.0.smithi115.stdout:0/284: read f2 [5727797,51502] 0 2024-09-13T23:06:08.072 INFO:tasks.workunit.client.0.smithi115.stdout:3/249: dread d3/d16/f33 [0,4194304] 0 2024-09-13T23:06:08.072 INFO:tasks.workunit.client.0.smithi115.stdout:3/250: write d3/d16/d1c/d31/f4e [920449,15879] 0 2024-09-13T23:06:08.078 INFO:tasks.workunit.client.0.smithi115.stdout:1/238: dwrite d0/f6 [4194304,4194304] 0 2024-09-13T23:06:08.078 INFO:tasks.workunit.client.0.smithi115.stdout:6/292: dwrite d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:08.081 INFO:tasks.workunit.client.0.smithi115.stdout:1/239: unlink d0/de/c4b 0 2024-09-13T23:06:08.081 INFO:tasks.workunit.client.0.smithi115.stdout:1/240: creat d0/de/d1a/d29/f4c x:0 0 0 2024-09-13T23:06:08.084 INFO:tasks.workunit.client.0.smithi115.stdout:1/241: truncate d0/de/d1b/f26 3635386 0 2024-09-13T23:06:08.084 INFO:tasks.workunit.client.0.smithi115.stdout:4/297: dwrite f5 [0,4194304] 0 2024-09-13T23:06:08.084 INFO:tasks.workunit.client.0.smithi115.stdout:4/298: write db/d11/d2e/d33/f4c [245536,129215] 0 2024-09-13T23:06:08.084 INFO:tasks.workunit.client.0.smithi115.stdout:4/299: fdatasync db/d11/d2e/d33/d36/f3c 0 2024-09-13T23:06:08.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/183: dwrite d0/d13/d17/d19/f1d [0,4194304] 0 2024-09-13T23:06:08.089 INFO:tasks.workunit.client.0.smithi115.stdout:9/184: mkdir d0/d13/d3b 0 2024-09-13T23:06:08.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/210: dwrite da/d23/d2c/f2e [0,4194304] 0 2024-09-13T23:06:08.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/211: dread - da/d23/d2c/f3d zero size 2024-09-13T23:06:08.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/212: dread - da/d23/d32/f42 zero size 2024-09-13T23:06:08.092 INFO:tasks.workunit.client.0.smithi115.stdout:9/185: symlink d0/l3c 0 2024-09-13T23:06:08.097 INFO:tasks.workunit.client.0.smithi115.stdout:5/216: dwrite d8/f3c [4194304,4194304] 0 2024-09-13T23:06:08.100 INFO:tasks.workunit.client.0.smithi115.stdout:5/217: symlink d8/dd/l43 0 2024-09-13T23:06:08.112 INFO:tasks.workunit.client.0.smithi115.stdout:5/218: write d8/f1f [2364939,89241] 0 2024-09-13T23:06:08.112 INFO:tasks.workunit.client.0.smithi115.stdout:5/219: chown d8/dd/d20/d27 6110238 1 2024-09-13T23:06:08.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/182: dwrite d3/d5/f3d [0,4194304] 0 2024-09-13T23:06:08.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/183: dread - d3/d5/dc/f2b zero size 2024-09-13T23:06:08.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/184: chown d3/d5/dc/d23/f36 135177 1 2024-09-13T23:06:08.121 INFO:tasks.workunit.client.0.smithi115.stdout:1/242: dread d0/de/d1b/f35 [0,4194304] 0 2024-09-13T23:06:08.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/285: dwrite d6/d24/d25/d2b/d32/d44/f57 [0,4194304] 0 2024-09-13T23:06:08.132 INFO:tasks.workunit.client.0.smithi115.stdout:0/286: write d6/d24/d25/d2b/d32/d44/f59 [143916,62399] 0 2024-09-13T23:06:08.132 INFO:tasks.workunit.client.0.smithi115.stdout:4/300: fsync db/d11/d2e/d33/f4c 0 2024-09-13T23:06:08.132 INFO:tasks.workunit.client.0.smithi115.stdout:7/189: dwrite da/df/f26 [0,4194304] 0 2024-09-13T23:06:08.134 INFO:tasks.workunit.client.0.smithi115.stdout:4/301: getdents db/d19/d1d 0 2024-09-13T23:06:08.135 INFO:tasks.workunit.client.0.smithi115.stdout:7/190: mkdir da/dd/d1c/d2d/d45 0 2024-09-13T23:06:08.140 INFO:tasks.workunit.client.0.smithi115.stdout:4/302: dread fa [4194304,4194304] 0 2024-09-13T23:06:08.140 INFO:tasks.workunit.client.0.smithi115.stdout:3/251: dwrite d3/d16/d1c/d31/d3b/d47/d28/f32 [0,4194304] 0 2024-09-13T23:06:08.141 INFO:tasks.workunit.client.0.smithi115.stdout:4/303: fdatasync db/dd/f38 0 2024-09-13T23:06:08.141 INFO:tasks.workunit.client.0.smithi115.stdout:4/304: truncate db/d19/d34/f50 260753 0 2024-09-13T23:06:08.141 INFO:tasks.workunit.client.0.smithi115.stdout:4/305: write db/f10 [3395622,28984] 0 2024-09-13T23:06:08.141 INFO:tasks.workunit.client.0.smithi115.stdout:4/306: write fa [6118951,584] 0 2024-09-13T23:06:08.145 INFO:tasks.workunit.client.0.smithi115.stdout:3/252: link d3/d16/d1c/f2b d3/d16/d1c/d31/d45/d59/f5a 0 2024-09-13T23:06:08.150 INFO:tasks.workunit.client.0.smithi115.stdout:3/253: mkdir d3/d5/d5b 0 2024-09-13T23:06:08.151 INFO:tasks.workunit.client.0.smithi115.stdout:3/254: symlink d3/d16/d1c/d31/d45/d59/l5c 0 2024-09-13T23:06:08.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/255: dread d3/d16/d1c/f38 [0,4194304] 0 2024-09-13T23:06:08.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/256: rename d3/d16/d1c/d31 to d3/d16/d1c/d31/d3b/d47/d28/d5d 22 2024-09-13T23:06:08.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/257: readlink d3/d5/d35/l54 0 2024-09-13T23:06:08.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/258: symlink d3/d5/d35/l5e 0 2024-09-13T23:06:08.156 INFO:tasks.workunit.client.0.smithi115.stdout:3/259: getdents d3/d16/d1c/d31/d45 0 2024-09-13T23:06:08.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/260: truncate d3/d16/f33 3632913 0 2024-09-13T23:06:08.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/261: chown d3/d16/d1c/d31/d3b/d47/d28/f32 4514540 1 2024-09-13T23:06:08.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/262: dread - d3/d16/d1c/d31/f4b zero size 2024-09-13T23:06:08.157 INFO:tasks.workunit.client.0.smithi115.stdout:3/263: chown d3/d5/d35 30288497 1 2024-09-13T23:06:08.159 INFO:tasks.workunit.client.0.smithi115.stdout:6/293: dwrite d4/df/d14/f18 [0,4194304] 0 2024-09-13T23:06:08.159 INFO:tasks.workunit.client.0.smithi115.stdout:9/186: dwrite d0/d13/d31/f32 [0,4194304] 0 2024-09-13T23:06:08.159 INFO:tasks.workunit.client.0.smithi115.stdout:2/213: dwrite da/f11 [0,4194304] 0 2024-09-13T23:06:08.159 INFO:tasks.workunit.client.0.smithi115.stdout:2/214: readlink da/d23/l2b 0 2024-09-13T23:06:08.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/220: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T23:06:08.160 INFO:tasks.workunit.client.0.smithi115.stdout:6/294: mkdir d4/df/d51 0 2024-09-13T23:06:08.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/215: symlink da/de/d1a/d1c/d41/l4a 0 2024-09-13T23:06:08.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/216: write da/de/d1a/f1f [3438085,98737] 0 2024-09-13T23:06:08.164 INFO:tasks.workunit.client.0.smithi115.stdout:2/217: read da/de/f28 [4945,53523] 0 2024-09-13T23:06:08.165 INFO:tasks.workunit.client.0.smithi115.stdout:2/218: mkdir da/de/d4b 0 2024-09-13T23:06:08.166 INFO:tasks.workunit.client.0.smithi115.stdout:2/219: truncate da/de/d1a/f1d 5926756 0 2024-09-13T23:06:08.167 INFO:tasks.workunit.client.0.smithi115.stdout:8/185: dwrite d3/d5/d1d/f26 [4194304,4194304] 0 2024-09-13T23:06:08.167 INFO:tasks.workunit.client.0.smithi115.stdout:0/287: dwrite d6/fd [8388608,4194304] 0 2024-09-13T23:06:08.168 INFO:tasks.workunit.client.0.smithi115.stdout:1/243: dwrite d0/de/d1a/d29/f39 [0,4194304] 0 2024-09-13T23:06:08.169 INFO:tasks.workunit.client.0.smithi115.stdout:8/186: rmdir d3/d5/d1c 39 2024-09-13T23:06:08.169 INFO:tasks.workunit.client.0.smithi115.stdout:4/307: dwrite db/d11/d2e/d33/d36/f42 [0,4194304] 0 2024-09-13T23:06:08.170 INFO:tasks.workunit.client.0.smithi115.stdout:1/244: read d0/dd/f3e [737189,114315] 0 2024-09-13T23:06:08.171 INFO:tasks.workunit.client.0.smithi115.stdout:7/191: dwrite da/dd/f2e [4194304,4194304] 0 2024-09-13T23:06:08.173 INFO:tasks.workunit.client.0.smithi115.stdout:8/187: rmdir d3/d5/d1c/d41 39 2024-09-13T23:06:08.174 INFO:tasks.workunit.client.0.smithi115.stdout:5/221: write d8/f2a [8007301,61365] 0 2024-09-13T23:06:08.175 INFO:tasks.workunit.client.0.smithi115.stdout:0/288: dread d6/d24/d25/d2b/d32/d44/f59 [0,4194304] 0 2024-09-13T23:06:08.175 INFO:tasks.workunit.client.0.smithi115.stdout:5/222: creat d8/dd/d20/d35/f44 x:0 0 0 2024-09-13T23:06:08.175 INFO:tasks.workunit.client.0.smithi115.stdout:5/223: chown d8/dd/d14/f1e 2218 1 2024-09-13T23:06:08.175 INFO:tasks.workunit.client.0.smithi115.stdout:5/224: dread - d8/dd/d20/f31 zero size 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/308: link db/d16/f47 db/d11/f52 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/309: readlink db/d19/l20 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/310: truncate db/d16/f47 354386 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/311: write db/d19/d34/f50 [1215777,93181] 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/312: readlink db/d19/d1d/l4b 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/313: write db/f10 [830957,89615] 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/314: write fa [7859338,128897] 0 2024-09-13T23:06:08.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/315: creat db/d11/d2e/d35/f53 x:0 0 0 2024-09-13T23:06:08.179 INFO:tasks.workunit.client.0.smithi115.stdout:1/245: mkdir d0/de/d1b/d25/d4d 0 2024-09-13T23:06:08.181 INFO:tasks.workunit.client.0.smithi115.stdout:7/192: unlink da/l19 0 2024-09-13T23:06:08.188 INFO:tasks.workunit.client.0.smithi115.stdout:9/187: dwrite d0/d13/d17/f1e [8388608,4194304] 0 2024-09-13T23:06:08.188 INFO:tasks.workunit.client.0.smithi115.stdout:9/188: fdatasync d0/d13/d17/d19/f1d 0 2024-09-13T23:06:08.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/246: write d0/f5 [1074332,130641] 0 2024-09-13T23:06:08.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/247: dread - d0/d14/d31/d37/f3f zero size 2024-09-13T23:06:08.193 INFO:tasks.workunit.client.0.smithi115.stdout:7/193: dread da/f10 [0,4194304] 0 2024-09-13T23:06:08.198 INFO:tasks.workunit.client.0.smithi115.stdout:1/248: dread d0/f7 [0,4194304] 0 2024-09-13T23:06:08.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:07 smithi152 ceph-mon[34465]: pgmap v242: 65 pgs: 65 active+clean; 331 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 23 MiB/s wr, 816 op/s 2024-09-13T23:06:08.254 INFO:tasks.workunit.client.0.smithi115.stdout:7/194: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:08.254 INFO:tasks.workunit.client.0.smithi115.stdout:8/188: creat d3/d5/dc/d16/d1f/d28/d3e/f43 x:0 0 0 2024-09-13T23:06:08.256 INFO:tasks.workunit.client.0.smithi115.stdout:0/289: mkdir d6/d62 0 2024-09-13T23:06:08.256 INFO:tasks.workunit.client.0.smithi115.stdout:0/290: chown d6/d24/d25/d2b/d32/d44/f56 18 1 2024-09-13T23:06:08.257 INFO:tasks.workunit.client.0.smithi115.stdout:5/225: rmdir d8/dd/d20/d27 39 2024-09-13T23:06:08.257 INFO:tasks.workunit.client.0.smithi115.stdout:5/226: creat d8/dd/d20/d35/f45 x:0 0 0 2024-09-13T23:06:08.260 INFO:tasks.workunit.client.0.smithi115.stdout:3/264: rename d3/d16/f33 to d3/d5/db/f5f 0 2024-09-13T23:06:08.260 INFO:tasks.workunit.client.0.smithi115.stdout:9/189: mknod d0/d13/d17/d19/c3d 0 2024-09-13T23:06:08.261 INFO:tasks.workunit.client.0.smithi115.stdout:9/190: creat d0/d13/d17/d1f/d28/f3e x:0 0 0 2024-09-13T23:06:08.261 INFO:tasks.workunit.client.0.smithi115.stdout:1/249: truncate d0/de/d1b/f4a 1893831 0 2024-09-13T23:06:08.264 INFO:tasks.workunit.client.0.smithi115.stdout:1/250: dread d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:08.265 INFO:tasks.workunit.client.0.smithi115.stdout:1/251: creat d0/de/d1a/d29/f4e x:0 0 0 2024-09-13T23:06:08.265 INFO:tasks.workunit.client.0.smithi115.stdout:1/252: fdatasync d0/de/d1b/f26 0 2024-09-13T23:06:08.266 INFO:tasks.workunit.client.0.smithi115.stdout:7/195: rmdir da/dd/d13/d24 39 2024-09-13T23:06:08.268 INFO:tasks.workunit.client.0.smithi115.stdout:7/196: dread da/dd/d13/f23 [0,4194304] 0 2024-09-13T23:06:08.268 INFO:tasks.workunit.client.0.smithi115.stdout:7/197: fsync da/df/f28 0 2024-09-13T23:06:08.268 INFO:tasks.workunit.client.0.smithi115.stdout:7/198: readlink da/dd/d13/l40 0 2024-09-13T23:06:08.268 INFO:tasks.workunit.client.0.smithi115.stdout:8/189: rename d3/d5/fa to d3/d5/f44 0 2024-09-13T23:06:08.269 INFO:tasks.workunit.client.0.smithi115.stdout:0/291: unlink d6/d24/d25/d2b/d32/c4c 0 2024-09-13T23:06:08.272 INFO:tasks.workunit.client.0.smithi115.stdout:5/227: rename d8/dd/f10 to d8/dd/f46 0 2024-09-13T23:06:08.272 INFO:tasks.workunit.client.0.smithi115.stdout:5/228: chown d8/dd/d20/d35 2 1 2024-09-13T23:06:08.272 INFO:tasks.workunit.client.0.smithi115.stdout:5/229: stat d8/dd/d20/d35 0 2024-09-13T23:06:08.275 INFO:tasks.workunit.client.0.smithi115.stdout:4/316: rename db/dd to db/d11/d54 0 2024-09-13T23:06:08.275 INFO:tasks.workunit.client.0.smithi115.stdout:4/317: truncate db/d11/d2e/f1f 4730516 0 2024-09-13T23:06:08.276 INFO:tasks.workunit.client.0.smithi115.stdout:3/265: symlink d3/d16/d1a/d29/l60 0 2024-09-13T23:06:08.276 INFO:tasks.workunit.client.0.smithi115.stdout:3/266: chown d3/d5/d2c/c48 103 1 2024-09-13T23:06:08.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/199: write da/dd/f2e [6356780,111178] 0 2024-09-13T23:06:08.279 INFO:tasks.workunit.client.0.smithi115.stdout:1/253: mknod d0/d14/d23/c4f 0 2024-09-13T23:06:08.280 INFO:tasks.workunit.client.0.smithi115.stdout:1/254: readlink d0/l16 0 2024-09-13T23:06:08.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/230: dread d8/f9 [0,4194304] 0 2024-09-13T23:06:08.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/231: dread - d8/dd/d20/d23/f3e zero size 2024-09-13T23:06:08.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/232: read d8/fa [3392243,56313] 0 2024-09-13T23:06:08.281 INFO:tasks.workunit.client.0.smithi115.stdout:5/233: creat d8/dd/d14/f47 x:0 0 0 2024-09-13T23:06:08.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/190: creat d3/d5/dc/d16/d1f/d27/f45 x:0 0 0 2024-09-13T23:06:08.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/191: fsync d3/d5/dc/f12 0 2024-09-13T23:06:08.281 INFO:tasks.workunit.client.0.smithi115.stdout:8/192: chown d3/d5/dc 2042843 1 2024-09-13T23:06:08.282 INFO:tasks.workunit.client.0.smithi115.stdout:3/267: creat d3/d5/d35/d4c/f61 x:0 0 0 2024-09-13T23:06:08.284 INFO:tasks.workunit.client.0.smithi115.stdout:9/191: rename d0/f4 to d0/f3f 0 2024-09-13T23:06:08.285 INFO:tasks.workunit.client.0.smithi115.stdout:7/200: rename da/dd/d13/d24/l2f to da/dd/d1c/l46 0 2024-09-13T23:06:08.286 INFO:tasks.workunit.client.0.smithi115.stdout:1/255: stat d0/d14/d23/c49 0 2024-09-13T23:06:08.286 INFO:tasks.workunit.client.0.smithi115.stdout:1/256: readlink d0/d14/l33 0 2024-09-13T23:06:08.288 INFO:tasks.workunit.client.0.smithi115.stdout:5/234: rmdir d8 39 2024-09-13T23:06:08.288 INFO:tasks.workunit.client.0.smithi115.stdout:2/220: sync 2024-09-13T23:06:08.288 INFO:tasks.workunit.client.0.smithi115.stdout:6/295: sync 2024-09-13T23:06:08.291 INFO:tasks.workunit.client.0.smithi115.stdout:7/201: mknod da/dd/d16/c47 0 2024-09-13T23:06:08.293 INFO:tasks.workunit.client.0.smithi115.stdout:1/257: mknod d0/de/d1b/d25/c50 0 2024-09-13T23:06:08.293 INFO:tasks.workunit.client.0.smithi115.stdout:1/258: chown d0/f9 1 1 2024-09-13T23:06:08.294 INFO:tasks.workunit.client.0.smithi115.stdout:2/221: unlink da/de/f28 0 2024-09-13T23:06:08.294 INFO:tasks.workunit.client.0.smithi115.stdout:6/296: rmdir d4/df/d3a 39 2024-09-13T23:06:08.296 INFO:tasks.workunit.client.0.smithi115.stdout:7/202: link da/dd/d1c/f20 da/dd/d13/d36/f48 0 2024-09-13T23:06:08.297 INFO:tasks.workunit.client.0.smithi115.stdout:9/192: dread d0/fd [4194304,4194304] 0 2024-09-13T23:06:08.298 INFO:tasks.workunit.client.0.smithi115.stdout:1/259: unlink d0/f22 0 2024-09-13T23:06:08.299 INFO:tasks.workunit.client.0.smithi115.stdout:2/222: creat da/d23/d32/f4c x:0 0 0 2024-09-13T23:06:08.299 INFO:tasks.workunit.client.0.smithi115.stdout:2/223: write da/de/d1a/f44 [286128,4476] 0 2024-09-13T23:06:08.300 INFO:tasks.workunit.client.0.smithi115.stdout:6/297: symlink d4/df/d14/d38/d2a/l52 0 2024-09-13T23:06:08.301 INFO:tasks.workunit.client.0.smithi115.stdout:9/193: mkdir d0/d13/d17/d1f/d35/d40 0 2024-09-13T23:06:08.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/260: dread d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:08.302 INFO:tasks.workunit.client.0.smithi115.stdout:2/224: rename da/f15 to da/de/d1a/d1c/f4d 0 2024-09-13T23:06:08.305 INFO:tasks.workunit.client.0.smithi115.stdout:2/225: mkdir da/d23/d4e 0 2024-09-13T23:06:08.307 INFO:tasks.workunit.client.0.smithi115.stdout:4/318: dwrite db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:08.307 INFO:tasks.workunit.client.0.smithi115.stdout:9/194: symlink d0/l41 0 2024-09-13T23:06:08.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/235: dwrite d8/dd/d20/d35/f3b [0,4194304] 0 2024-09-13T23:06:08.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/236: stat d8/dd/d14/l38 0 2024-09-13T23:06:08.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/237: chown d8/lc 1 1 2024-09-13T23:06:08.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/238: readlink d8/dd/l3d 0 2024-09-13T23:06:08.308 INFO:tasks.workunit.client.0.smithi115.stdout:5/239: fsync d8/f16 0 2024-09-13T23:06:08.309 INFO:tasks.workunit.client.0.smithi115.stdout:2/226: symlink da/d23/d32/l4f 0 2024-09-13T23:06:08.309 INFO:tasks.workunit.client.0.smithi115.stdout:7/203: dread da/dd/d13/d36/f48 [0,4194304] 0 2024-09-13T23:06:08.309 INFO:tasks.workunit.client.0.smithi115.stdout:7/204: fsync da/dd/f2e 0 2024-09-13T23:06:08.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/319: creat db/d19/d34/f55 x:0 0 0 2024-09-13T23:06:08.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/320: creat db/f56 x:0 0 0 2024-09-13T23:06:08.315 INFO:tasks.workunit.client.0.smithi115.stdout:6/298: dwrite d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:08.316 INFO:tasks.workunit.client.0.smithi115.stdout:5/240: unlink d8/dd/d20/d35/f3b 0 2024-09-13T23:06:08.317 INFO:tasks.workunit.client.0.smithi115.stdout:2/227: dread da/de/d1a/f44 [0,4194304] 0 2024-09-13T23:06:08.317 INFO:tasks.workunit.client.0.smithi115.stdout:7/205: mknod da/dd/d1c/d2d/d41/c49 0 2024-09-13T23:06:08.317 INFO:tasks.workunit.client.0.smithi115.stdout:7/206: chown da/dd/d1c/l46 1789 1 2024-09-13T23:06:08.317 INFO:tasks.workunit.client.0.smithi115.stdout:7/207: fdatasync da/dd/d13/f2a 0 2024-09-13T23:06:08.317 INFO:tasks.workunit.client.0.smithi115.stdout:2/228: write da/d23/f38 [1272114,30537] 0 2024-09-13T23:06:08.318 INFO:tasks.workunit.client.0.smithi115.stdout:1/261: rename d0/d14 to d0/de/d1b/d25/d4d/d51 0 2024-09-13T23:06:08.319 INFO:tasks.workunit.client.0.smithi115.stdout:4/321: mkdir db/d11/d2e/d33/d36/d51/d57 0 2024-09-13T23:06:08.319 INFO:tasks.workunit.client.0.smithi115.stdout:4/322: stat db/d11/d2e/d35/f53 0 2024-09-13T23:06:08.320 INFO:tasks.workunit.client.0.smithi115.stdout:8/193: rmdir d3/d5/dc/d16/d1f/d27 39 2024-09-13T23:06:08.320 INFO:tasks.workunit.client.0.smithi115.stdout:8/194: chown d3/d5/d1c/f2e 187 1 2024-09-13T23:06:08.320 INFO:tasks.workunit.client.0.smithi115.stdout:8/195: creat d3/d5/dc/d23/f46 x:0 0 0 2024-09-13T23:06:08.320 INFO:tasks.workunit.client.0.smithi115.stdout:8/196: fsync d3/d5/d1c/f2e 0 2024-09-13T23:06:08.321 INFO:tasks.workunit.client.0.smithi115.stdout:7/208: stat da/dd/d1c/l46 0 2024-09-13T23:06:08.321 INFO:tasks.workunit.client.0.smithi115.stdout:2/229: creat da/d23/d49/f50 x:0 0 0 2024-09-13T23:06:08.322 INFO:tasks.workunit.client.0.smithi115.stdout:6/299: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:08.323 INFO:tasks.workunit.client.0.smithi115.stdout:4/323: unlink fa 0 2024-09-13T23:06:08.325 INFO:tasks.workunit.client.0.smithi115.stdout:7/209: truncate da/dd/d1c/f27 1929402 0 2024-09-13T23:06:08.326 INFO:tasks.workunit.client.0.smithi115.stdout:7/210: fdatasync da/df/f28 0 2024-09-13T23:06:08.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/230: creat da/d23/d32/d48/f51 x:0 0 0 2024-09-13T23:06:08.328 INFO:tasks.workunit.client.0.smithi115.stdout:1/262: read d0/dd/f10 [325199,4664] 0 2024-09-13T23:06:08.328 INFO:tasks.workunit.client.0.smithi115.stdout:1/263: fdatasync d0/dd/f10 0 2024-09-13T23:06:08.330 INFO:tasks.workunit.client.0.smithi115.stdout:6/300: creat d4/df/d3a/f53 x:0 0 0 2024-09-13T23:06:08.331 INFO:tasks.workunit.client.0.smithi115.stdout:4/324: symlink db/d19/d34/l58 0 2024-09-13T23:06:08.332 INFO:tasks.workunit.client.0.smithi115.stdout:5/241: dwrite d8/dd/d14/f47 [0,4194304] 0 2024-09-13T23:06:08.332 INFO:tasks.workunit.client.0.smithi115.stdout:5/242: chown d8/l11 3868 1 2024-09-13T23:06:08.333 INFO:tasks.workunit.client.0.smithi115.stdout:5/243: fsync d8/dd/d20/d35/f45 0 2024-09-13T23:06:08.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/264: truncate d0/f1 2561385 0 2024-09-13T23:06:08.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/265: read d0/dd/f10 [505470,28462] 0 2024-09-13T23:06:08.335 INFO:tasks.workunit.client.0.smithi115.stdout:1/266: creat d0/de/d1a/d29/f52 x:0 0 0 2024-09-13T23:06:08.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/301: mknod d4/df/d14/d47/c54 0 2024-09-13T23:06:08.339 INFO:tasks.workunit.client.0.smithi115.stdout:4/325: creat db/d19/d1d/f59 x:0 0 0 2024-09-13T23:06:08.339 INFO:tasks.workunit.client.0.smithi115.stdout:4/326: chown db/d11/d2e/d35/f53 347 1 2024-09-13T23:06:08.340 INFO:tasks.workunit.client.0.smithi115.stdout:9/195: getdents d0/d13/d17/d1f/d35 0 2024-09-13T23:06:08.340 INFO:tasks.workunit.client.0.smithi115.stdout:9/196: write d0/d13/f1c [4074477,61605] 0 2024-09-13T23:06:08.346 INFO:tasks.workunit.client.0.smithi115.stdout:5/244: mknod d8/dd/d20/d35/c48 0 2024-09-13T23:06:08.346 INFO:tasks.workunit.client.0.smithi115.stdout:2/231: rmdir da/d21 39 2024-09-13T23:06:08.350 INFO:tasks.workunit.client.0.smithi115.stdout:9/197: readlink d0/l7 0 2024-09-13T23:06:08.352 INFO:tasks.workunit.client.0.smithi115.stdout:6/302: read d4/df/d14/d38/d2a/d3e/f4c [3736269,8200] 0 2024-09-13T23:06:08.352 INFO:tasks.workunit.client.0.smithi115.stdout:8/197: dwrite d3/d5/dc/f31 [0,4194304] 0 2024-09-13T23:06:08.352 INFO:tasks.workunit.client.0.smithi115.stdout:8/198: chown d3/d5/d1c/d41/d42/c40 8606425 1 2024-09-13T23:06:08.352 INFO:tasks.workunit.client.0.smithi115.stdout:2/232: symlink da/d21/l52 0 2024-09-13T23:06:08.354 INFO:tasks.workunit.client.0.smithi115.stdout:9/198: unlink d0/f22 0 2024-09-13T23:06:08.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/233: mkdir da/d23/d32/d53 0 2024-09-13T23:06:08.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/234: chown da/f11 414339 1 2024-09-13T23:06:08.357 INFO:tasks.workunit.client.0.smithi115.stdout:2/235: read da/d21/f33 [1991081,118489] 0 2024-09-13T23:06:08.357 INFO:tasks.workunit.client.0.smithi115.stdout:6/303: dread d4/df/d14/d38/d2a/d3e/f4c [0,4194304] 0 2024-09-13T23:06:08.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/199: mkdir d0/d13/d3b/d42 0 2024-09-13T23:06:08.359 INFO:tasks.workunit.client.0.smithi115.stdout:2/236: getdents da 0 2024-09-13T23:06:08.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/237: truncate da/d23/d2c/f2e 349751 0 2024-09-13T23:06:08.361 INFO:tasks.workunit.client.0.smithi115.stdout:2/238: fdatasync da/de/f24 0 2024-09-13T23:06:08.365 INFO:tasks.workunit.client.0.smithi115.stdout:6/304: write d4/df/f1c [2388061,32304] 0 2024-09-13T23:06:08.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/200: rename d0/d13/d31 to d0/d43 0 2024-09-13T23:06:08.366 INFO:tasks.workunit.client.0.smithi115.stdout:8/199: write d3/d5/d1d/f26 [4300513,101504] 0 2024-09-13T23:06:08.366 INFO:tasks.workunit.client.0.smithi115.stdout:8/200: chown d3/d5/dc/d16/c2c 24498 1 2024-09-13T23:06:08.366 INFO:tasks.workunit.client.0.smithi115.stdout:6/305: link d4/f1d d4/df/d14/d38/d44/f55 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:1/267: dwrite d0/dd/f20 [0,4194304] 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/327: dwrite db/f43 [0,4194304] 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/328: readlink db/d11/d2e/l39 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:4/329: write db/d11/d54/f44 [924065,113723] 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:9/201: mknod d0/d13/d17/d1f/d35/c44 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:8/201: mknod d3/c47 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:7/211: dwrite da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/239: dread f7 [0,4194304] 0 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/240: read - da/d23/d32/f42 zero size 2024-09-13T23:06:08.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/241: stat da 0 2024-09-13T23:06:08.370 INFO:tasks.workunit.client.0.smithi115.stdout:6/306: mkdir d4/df/d14/d38/d2a/d3e/d56 0 2024-09-13T23:06:08.375 INFO:tasks.workunit.client.0.smithi115.stdout:1/268: write d0/de/d1b/f4a [239833,85966] 0 2024-09-13T23:06:08.376 INFO:tasks.workunit.client.0.smithi115.stdout:5/245: getdents d8/dd/d20/d35 0 2024-09-13T23:06:08.376 INFO:tasks.workunit.client.0.smithi115.stdout:5/246: chown d8/f9 0 1 2024-09-13T23:06:08.376 INFO:tasks.workunit.client.0.smithi115.stdout:2/242: write da/f11 [2712509,36473] 0 2024-09-13T23:06:08.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/243: fdatasync f4 0 2024-09-13T23:06:08.380 INFO:tasks.workunit.client.0.smithi115.stdout:4/330: unlink l4 0 2024-09-13T23:06:08.380 INFO:tasks.workunit.client.0.smithi115.stdout:4/331: readlink db/d19/l49 0 2024-09-13T23:06:08.380 INFO:tasks.workunit.client.0.smithi115.stdout:2/244: dread da/de/d1a/f44 [0,4194304] 0 2024-09-13T23:06:08.381 INFO:tasks.workunit.client.0.smithi115.stdout:9/202: rmdir d0/d13/d17/d1f/d35 39 2024-09-13T23:06:08.384 INFO:tasks.workunit.client.0.smithi115.stdout:8/202: creat d3/d5/dc/d16/d1f/d27/f48 x:0 0 0 2024-09-13T23:06:08.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/307: rename d4/df/d14/d47 to d4/d57 0 2024-09-13T23:06:08.388 INFO:tasks.workunit.client.0.smithi115.stdout:1/269: getdents d0/de/d1b/d25/d4d/d51/d23 0 2024-09-13T23:06:08.390 INFO:tasks.workunit.client.0.smithi115.stdout:4/332: creat db/d16/d3f/f5a x:0 0 0 2024-09-13T23:06:08.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/203: mknod d3/d5/dc/d23/c49 0 2024-09-13T23:06:08.392 INFO:tasks.workunit.client.0.smithi115.stdout:2/245: rename da/de/f12 to da/d23/d32/f54 0 2024-09-13T23:06:08.392 INFO:tasks.workunit.client.0.smithi115.stdout:2/246: write da/d23/d32/d48/f51 [733721,39617] 0 2024-09-13T23:06:08.392 INFO:tasks.workunit.client.0.smithi115.stdout:7/212: dwrite da/df/f28 [0,4194304] 0 2024-09-13T23:06:08.394 INFO:tasks.workunit.client.0.smithi115.stdout:6/308: creat d4/df/d14/d38/d44/f58 x:0 0 0 2024-09-13T23:06:08.394 INFO:tasks.workunit.client.0.smithi115.stdout:6/309: stat d4/f12 0 2024-09-13T23:06:08.394 INFO:tasks.workunit.client.0.smithi115.stdout:6/310: chown d4/l25 22337 1 2024-09-13T23:06:08.396 INFO:tasks.workunit.client.0.smithi115.stdout:1/270: link d0/dd/f3e d0/de/d1b/d25/d4d/d51/d31/f53 0 2024-09-13T23:06:08.397 INFO:tasks.workunit.client.0.smithi115.stdout:8/204: truncate d3/d5/f1e 1029389 0 2024-09-13T23:06:08.397 INFO:tasks.workunit.client.0.smithi115.stdout:8/205: fsync d3/d5/dc/f2b 0 2024-09-13T23:06:08.397 INFO:tasks.workunit.client.0.smithi115.stdout:8/206: write d3/d5/dc/d16/d1f/d28/d3e/f43 [133756,50282] 0 2024-09-13T23:06:08.399 INFO:tasks.workunit.client.0.smithi115.stdout:9/203: rename d0/f34 to d0/d13/d17/d1f/f45 0 2024-09-13T23:06:08.399 INFO:tasks.workunit.client.0.smithi115.stdout:9/204: chown d0/d13/d17/f39 86754297 1 2024-09-13T23:06:08.401 INFO:tasks.workunit.client.0.smithi115.stdout:5/247: dwrite d8/dd/d14/f1e [0,4194304] 0 2024-09-13T23:06:08.403 INFO:tasks.workunit.client.0.smithi115.stdout:6/311: link d4/df/d14/d38/c27 d4/df/d14/d38/d44/c59 0 2024-09-13T23:06:08.404 INFO:tasks.workunit.client.0.smithi115.stdout:2/247: read da/de/d1a/f1d [415148,36704] 0 2024-09-13T23:06:08.404 INFO:tasks.workunit.client.0.smithi115.stdout:2/248: write da/de/f45 [844582,126519] 0 2024-09-13T23:06:08.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/271: link d0/f9 d0/de/d1b/d25/f54 0 2024-09-13T23:06:08.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/272: truncate d0/de/d1b/d25/d4d/d51/f41 5204869 0 2024-09-13T23:06:08.405 INFO:tasks.workunit.client.0.smithi115.stdout:1/273: chown d0/dd 256316201 1 2024-09-13T23:06:08.407 INFO:tasks.workunit.client.0.smithi115.stdout:8/207: link d3/d5/d1c/d41/d42/c2a d3/d5/dc/d16/d1f/d28/c4a 0 2024-09-13T23:06:08.408 INFO:tasks.workunit.client.0.smithi115.stdout:4/333: rename db/d19/d1d/f22 to db/d19/d4e/f5b 0 2024-09-13T23:06:08.410 INFO:tasks.workunit.client.0.smithi115.stdout:9/205: creat d0/d13/d17/d36/f46 x:0 0 0 2024-09-13T23:06:08.412 INFO:tasks.workunit.client.0.smithi115.stdout:1/274: dread d0/de/d1b/d25/f54 [0,4194304] 0 2024-09-13T23:06:08.418 INFO:tasks.workunit.client.0.smithi115.stdout:2/249: mknod da/c55 0 2024-09-13T23:06:08.418 INFO:tasks.workunit.client.0.smithi115.stdout:2/250: read - da/d23/d32/f4c zero size 2024-09-13T23:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:8/208: mknod d3/d5/dc/c4b 0 2024-09-13T23:06:08.420 INFO:tasks.workunit.client.0.smithi115.stdout:8/209: creat d3/d5/dc/f4c x:0 0 0 2024-09-13T23:06:08.421 INFO:tasks.workunit.client.0.smithi115.stdout:6/312: dwrite d4/df/d14/f18 [0,4194304] 0 2024-09-13T23:06:08.422 INFO:tasks.workunit.client.0.smithi115.stdout:4/334: creat db/d11/d2e/d33/d36/f5c x:0 0 0 2024-09-13T23:06:08.422 INFO:tasks.workunit.client.0.smithi115.stdout:4/335: chown db/d16/l41 94 1 2024-09-13T23:06:08.424 INFO:tasks.workunit.client.0.smithi115.stdout:9/206: unlink d0/d13/d17/d1f/f23 0 2024-09-13T23:06:08.427 INFO:tasks.workunit.client.0.smithi115.stdout:8/210: truncate d3/d5/d1c/d41/d42/f17 4182039 0 2024-09-13T23:06:08.427 INFO:tasks.workunit.client.0.smithi115.stdout:8/211: write d3/d5/dc/d16/d1f/d27/f45 [1017860,106795] 0 2024-09-13T23:06:08.430 INFO:tasks.workunit.client.0.smithi115.stdout:6/313: unlink d4/l24 0 2024-09-13T23:06:08.432 INFO:tasks.workunit.client.0.smithi115.stdout:4/336: creat db/d11/d2e/f5d x:0 0 0 2024-09-13T23:06:08.433 INFO:tasks.workunit.client.0.smithi115.stdout:9/207: link d0/d13/d17/d1f/d35/c44 d0/d43/c47 0 2024-09-13T23:06:08.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/212: getdents d3/d5/d1c 0 2024-09-13T23:06:08.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/213: stat d3/d5/d1c/f2e 0 2024-09-13T23:06:08.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/214: write d3/d5/dc/d16/d1f/f22 [183607,37092] 0 2024-09-13T23:06:08.438 INFO:tasks.workunit.client.0.smithi115.stdout:6/314: mkdir d4/d57/d5a 0 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/208: unlink d0/d43/f32 0 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/209: dread - d0/d13/d17/d1f/d28/f38 zero size 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/210: dread - d0/d13/d17/d1f/d28/f38 zero size 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/211: write d0/d13/d17/d1f/d28/f3e [836135,102592] 0 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/212: read - d0/d13/d17/d36/f46 zero size 2024-09-13T23:06:08.440 INFO:tasks.workunit.client.0.smithi115.stdout:9/213: chown d0/l2c 451409 1 2024-09-13T23:06:08.441 INFO:tasks.workunit.client.0.smithi115.stdout:2/251: rename da/de to da/d23/d32/d56 0 2024-09-13T23:06:08.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/215: mkdir d3/d5/d1c/d41/d42/d4d 0 2024-09-13T23:06:08.442 INFO:tasks.workunit.client.0.smithi115.stdout:6/315: mkdir d4/df/d14/d38/d2a/d31/d5b 0 2024-09-13T23:06:08.443 INFO:tasks.workunit.client.0.smithi115.stdout:9/214: mknod d0/d13/d17/d36/c48 0 2024-09-13T23:06:08.445 INFO:tasks.workunit.client.0.smithi115.stdout:2/252: rename da/c39 to da/d23/d2c/c57 0 2024-09-13T23:06:08.445 INFO:tasks.workunit.client.0.smithi115.stdout:2/253: dread - da/d23/d32/f42 zero size 2024-09-13T23:06:08.445 INFO:tasks.workunit.client.0.smithi115.stdout:0/292: sync 2024-09-13T23:06:08.445 INFO:tasks.workunit.client.0.smithi115.stdout:0/293: truncate d6/d24/d25/d2b/d32/d44/f46 7085 0 2024-09-13T23:06:08.446 INFO:tasks.workunit.client.0.smithi115.stdout:8/216: mkdir d3/d5/dc/d23/d4e 0 2024-09-13T23:06:08.448 INFO:tasks.workunit.client.0.smithi115.stdout:9/215: mknod d0/d13/d17/d1f/d35/d40/c49 0 2024-09-13T23:06:08.448 INFO:tasks.workunit.client.0.smithi115.stdout:0/294: creat d6/d24/f63 x:0 0 0 2024-09-13T23:06:08.449 INFO:tasks.workunit.client.0.smithi115.stdout:4/337: dwrite db/d16/f47 [0,4194304] 0 2024-09-13T23:06:08.450 INFO:tasks.workunit.client.0.smithi115.stdout:8/217: mkdir d3/d5/dc/d16/d1f/d4f 0 2024-09-13T23:06:08.450 INFO:tasks.workunit.client.0.smithi115.stdout:0/295: dread d6/d24/f38 [0,4194304] 0 2024-09-13T23:06:08.453 INFO:tasks.workunit.client.0.smithi115.stdout:8/218: mknod d3/d5/dc/c50 0 2024-09-13T23:06:08.454 INFO:tasks.workunit.client.0.smithi115.stdout:4/338: rmdir db/d19/d34 39 2024-09-13T23:06:08.455 INFO:tasks.workunit.client.0.smithi115.stdout:9/216: dread d0/d13/d17/d1f/d28/f3e [0,4194304] 0 2024-09-13T23:06:08.457 INFO:tasks.workunit.client.0.smithi115.stdout:6/316: dread d4/df/d14/d38/d2a/d31/f34 [0,4194304] 0 2024-09-13T23:06:08.457 INFO:tasks.workunit.client.0.smithi115.stdout:6/317: fsync d4/df/f1f 0 2024-09-13T23:06:08.458 INFO:tasks.workunit.client.0.smithi115.stdout:9/217: rename d0/ca to d0/d13/c4a 0 2024-09-13T23:06:08.465 INFO:tasks.workunit.client.0.smithi115.stdout:4/339: write db/d11/f52 [1014166,44288] 0 2024-09-13T23:06:08.465 INFO:tasks.workunit.client.0.smithi115.stdout:4/340: fsync db/d11/f46 0 2024-09-13T23:06:08.477 INFO:tasks.workunit.client.0.smithi115.stdout:2/254: dwrite da/d21/f33 [0,4194304] 0 2024-09-13T23:06:08.478 INFO:tasks.workunit.client.0.smithi115.stdout:2/255: truncate da/d23/d32/d56/d1a/f1d 5814614 0 2024-09-13T23:06:08.480 INFO:tasks.workunit.client.0.smithi115.stdout:4/341: dread db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:08.480 INFO:tasks.workunit.client.0.smithi115.stdout:2/256: unlink c6 0 2024-09-13T23:06:08.481 INFO:tasks.workunit.client.0.smithi115.stdout:4/342: dread db/d11/d2e/d33/d36/f3b [0,4194304] 0 2024-09-13T23:06:08.481 INFO:tasks.workunit.client.0.smithi115.stdout:4/343: chown db/l3d 0 1 2024-09-13T23:06:08.481 INFO:tasks.workunit.client.0.smithi115.stdout:2/257: symlink da/d23/d2c/l58 0 2024-09-13T23:06:08.482 INFO:tasks.workunit.client.0.smithi115.stdout:4/344: rename db/d11/d2e/f2c to db/d11/d2e/d35/f5e 0 2024-09-13T23:06:08.482 INFO:tasks.workunit.client.0.smithi115.stdout:4/345: write db/d19/d1d/d2a/f40 [3734833,8115] 0 2024-09-13T23:06:08.482 INFO:tasks.workunit.client.0.smithi115.stdout:2/258: rmdir da 39 2024-09-13T23:06:08.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/259: creat da/d23/d4e/f59 x:0 0 0 2024-09-13T23:06:08.484 INFO:tasks.workunit.client.0.smithi115.stdout:6/318: dwrite d4/df/d3a/f53 [0,4194304] 0 2024-09-13T23:06:08.485 INFO:tasks.workunit.client.0.smithi115.stdout:8/219: dwrite d3/d5/f3d [0,4194304] 0 2024-09-13T23:06:08.487 INFO:tasks.workunit.client.0.smithi115.stdout:4/346: dread db/d11/d2e/d33/f4c [0,4194304] 0 2024-09-13T23:06:08.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/218: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:08.488 INFO:tasks.workunit.client.0.smithi115.stdout:6/319: creat d4/df/d14/d38/d2a/d3e/d56/f5c x:0 0 0 2024-09-13T23:06:08.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/219: stat d0/d13/d17/d1f/d28/c29 0 2024-09-13T23:06:08.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/220: truncate d0/d13/d17/f39 598258 0 2024-09-13T23:06:08.489 INFO:tasks.workunit.client.0.smithi115.stdout:2/260: dread da/d23/d32/d56/f24 [0,4194304] 0 2024-09-13T23:06:08.491 INFO:tasks.workunit.client.0.smithi115.stdout:6/320: symlink d4/df/l5d 0 2024-09-13T23:06:08.492 INFO:tasks.workunit.client.0.smithi115.stdout:9/221: symlink d0/d13/d17/l4b 0 2024-09-13T23:06:08.493 INFO:tasks.workunit.client.0.smithi115.stdout:2/261: rename da/d23/d32/d56/l34 to da/d23/l5a 0 2024-09-13T23:06:08.493 INFO:tasks.workunit.client.0.smithi115.stdout:2/262: chown da/d23/d4e/f59 3222794 1 2024-09-13T23:06:08.496 INFO:tasks.workunit.client.0.smithi115.stdout:6/321: dread d4/df/d14/d38/d2a/d31/f34 [0,4194304] 0 2024-09-13T23:06:08.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/222: rmdir d0/d13/d17/d36 39 2024-09-13T23:06:08.499 INFO:tasks.workunit.client.0.smithi115.stdout:6/322: creat d4/df/d14/d38/f5e x:0 0 0 2024-09-13T23:06:08.500 INFO:tasks.workunit.client.0.smithi115.stdout:8/220: dread d3/d5/dc/f31 [0,4194304] 0 2024-09-13T23:06:08.500 INFO:tasks.workunit.client.0.smithi115.stdout:8/221: creat d3/d5/dc/d16/d1f/d28/d3e/f51 x:0 0 0 2024-09-13T23:06:08.500 INFO:tasks.workunit.client.0.smithi115.stdout:8/222: fsync d3/d5/f1e 0 2024-09-13T23:06:08.501 INFO:tasks.workunit.client.0.smithi115.stdout:9/223: mkdir d0/d13/d17/d19/d4c 0 2024-09-13T23:06:08.501 INFO:tasks.workunit.client.0.smithi115.stdout:6/323: mknod d4/df/d14/d38/d2a/d31/c5f 0 2024-09-13T23:06:08.502 INFO:tasks.workunit.client.0.smithi115.stdout:9/224: mknod d0/d13/d17/d1f/c4d 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/324: mknod d4/df/d14/d38/d2a/d3e/c60 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/325: chown d4/df/d14/d38/c37 90304 1 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/326: fsync d4/df/f1c 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/327: chown d4/df/d14/d38/d2a/d3e/f4c 1637 1 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/328: write d4/df/d14/d38/f5e [900451,108860] 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:6/329: read d4/df/d14/d38/d2a/f33 [444823,25778] 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:4/347: dread db/f10 [0,4194304] 0 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:4/348: chown db/f43 134 1 2024-09-13T23:06:08.504 INFO:tasks.workunit.client.0.smithi115.stdout:9/225: mkdir d0/d13/d17/d1f/d4e 0 2024-09-13T23:06:08.505 INFO:tasks.workunit.client.0.smithi115.stdout:6/330: mknod d4/df/d14/d38/d2a/d3e/c61 0 2024-09-13T23:06:08.505 INFO:tasks.workunit.client.0.smithi115.stdout:4/349: symlink db/d11/d2e/d35/l5f 0 2024-09-13T23:06:08.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/268: sync 2024-09-13T23:06:08.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/269: creat d3/d16/d1a/d29/f62 x:0 0 0 2024-09-13T23:06:08.507 INFO:tasks.workunit.client.0.smithi115.stdout:3/270: stat d3/d16/d1a/f26 0 2024-09-13T23:06:08.511 INFO:tasks.workunit.client.0.smithi115.stdout:3/271: symlink d3/d16/d1c/d31/d45/l63 0 2024-09-13T23:06:08.512 INFO:tasks.workunit.client.0.smithi115.stdout:3/272: truncate d3/d16/d1a/f57 5040910 0 2024-09-13T23:06:08.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/331: dread d4/df/d14/d38/d2a/d3e/f4c [0,4194304] 0 2024-09-13T23:06:08.514 INFO:tasks.workunit.client.0.smithi115.stdout:3/273: symlink d3/d5/d35/l64 0 2024-09-13T23:06:08.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/274: mkdir d3/d5/d65 0 2024-09-13T23:06:08.516 INFO:tasks.workunit.client.0.smithi115.stdout:3/275: stat d3/d5/d5b 0 2024-09-13T23:06:08.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/276: truncate d3/d5/d35/f53 689642 0 2024-09-13T23:06:08.517 INFO:tasks.workunit.client.0.smithi115.stdout:3/277: creat d3/d16/d1c/d31/d45/f66 x:0 0 0 2024-09-13T23:06:08.523 INFO:tasks.workunit.client.0.smithi115.stdout:3/278: dread d3/d16/d1c/d31/f4e [0,4194304] 0 2024-09-13T23:06:08.523 INFO:tasks.workunit.client.0.smithi115.stdout:3/279: dread - d3/d16/d1a/d29/f52 zero size 2024-09-13T23:06:08.524 INFO:tasks.workunit.client.0.smithi115.stdout:3/280: creat d3/d16/d1a/d29/d49/f67 x:0 0 0 2024-09-13T23:06:08.526 INFO:tasks.workunit.client.0.smithi115.stdout:3/281: unlink d3/d16/f37 0 2024-09-13T23:06:08.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/282: write d3/f1b [952661,83817] 0 2024-09-13T23:06:08.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/283: readlink d3/d5/d35/l64 0 2024-09-13T23:06:08.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/284: chown d3/d5/l15 0 1 2024-09-13T23:06:08.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/285: creat d3/d5/d5b/f68 x:0 0 0 2024-09-13T23:06:08.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/286: fdatasync d3/d5/d5b/f68 0 2024-09-13T23:06:08.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/287: chown d3/d16/d1a/d29/l60 177380 1 2024-09-13T23:06:08.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/288: symlink d3/d5/d5b/l69 0 2024-09-13T23:06:08.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/289: dread - d3/d16/d1c/d31/d45/f58 zero size 2024-09-13T23:06:08.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/290: mknod d3/d16/d1c/d31/d3b/d47/d28/c6a 0 2024-09-13T23:06:08.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/291: write d3/d16/d1c/d31/d3b/f4a [1011220,46101] 0 2024-09-13T23:06:08.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/292: readlink d3/d5/d5b/l69 0 2024-09-13T23:06:08.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/293: rmdir d3/d16/d1a/d1e 39 2024-09-13T23:06:08.534 INFO:tasks.workunit.client.0.smithi115.stdout:4/350: dwrite db/f43 [0,4194304] 0 2024-09-13T23:06:08.535 INFO:tasks.workunit.client.0.smithi115.stdout:8/223: dwrite d3/d5/dc/f4c [0,4194304] 0 2024-09-13T23:06:08.535 INFO:tasks.workunit.client.0.smithi115.stdout:9/226: dwrite d0/d13/d17/d19/f1d [4194304,4194304] 0 2024-09-13T23:06:08.535 INFO:tasks.workunit.client.0.smithi115.stdout:8/224: creat d3/d5/dc/d16/d1f/f52 x:0 0 0 2024-09-13T23:06:08.535 INFO:tasks.workunit.client.0.smithi115.stdout:6/332: dwrite d4/df/f1c [0,4194304] 0 2024-09-13T23:06:08.537 INFO:tasks.workunit.client.0.smithi115.stdout:4/351: dread db/d11/d54/f38 [0,4194304] 0 2024-09-13T23:06:08.537 INFO:tasks.workunit.client.0.smithi115.stdout:4/352: creat db/d11/d2e/d33/d36/f60 x:0 0 0 2024-09-13T23:06:08.539 INFO:tasks.workunit.client.0.smithi115.stdout:9/227: mknod d0/d13/d17/d1f/d28/c4f 0 2024-09-13T23:06:08.541 INFO:tasks.workunit.client.0.smithi115.stdout:8/225: rmdir d3/d5/dc/d16/d1f/d4f 0 2024-09-13T23:06:08.543 INFO:tasks.workunit.client.0.smithi115.stdout:4/353: rename db/d19/l49 to db/d16/d3f/l61 0 2024-09-13T23:06:08.544 INFO:tasks.workunit.client.0.smithi115.stdout:4/354: fsync db/d11/d54/d17/f24 0 2024-09-13T23:06:08.545 INFO:tasks.workunit.client.0.smithi115.stdout:8/226: mknod d3/d5/dc/d23/c53 0 2024-09-13T23:06:08.546 INFO:tasks.workunit.client.0.smithi115.stdout:6/333: dread d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:08.546 INFO:tasks.workunit.client.0.smithi115.stdout:6/334: getdents d4/df/d51 0 2024-09-13T23:06:08.546 INFO:tasks.workunit.client.0.smithi115.stdout:4/355: mknod db/d11/d2e/d33/d36/d51/d57/c62 0 2024-09-13T23:06:08.549 INFO:tasks.workunit.client.0.smithi115.stdout:9/228: dread d0/d13/d17/d19/f1d [0,4194304] 0 2024-09-13T23:06:08.550 INFO:tasks.workunit.client.0.smithi115.stdout:9/229: chown d0/d13/d17/d1f/d35/d40/c49 0 1 2024-09-13T23:06:08.550 INFO:tasks.workunit.client.0.smithi115.stdout:3/294: getdents d3/d5 0 2024-09-13T23:06:08.550 INFO:tasks.workunit.client.0.smithi115.stdout:3/295: chown d3/d16/f19 1 1 2024-09-13T23:06:08.551 INFO:tasks.workunit.client.0.smithi115.stdout:4/356: dread db/d16/f47 [0,4194304] 0 2024-09-13T23:06:08.551 INFO:tasks.workunit.client.0.smithi115.stdout:6/335: rename d4/df/d14/d38/d2a/d3e/c60 to d4/df/d14/d38/d2a/d31/d5b/c62 0 2024-09-13T23:06:08.552 INFO:tasks.workunit.client.0.smithi115.stdout:9/230: link d0/d13/d17/d1f/d28/f3e d0/d13/d17/d19/f50 0 2024-09-13T23:06:08.554 INFO:tasks.workunit.client.0.smithi115.stdout:3/296: rename d3/d16/d1a/c22 to d3/d16/d1a/c6b 0 2024-09-13T23:06:08.554 INFO:tasks.workunit.client.0.smithi115.stdout:3/297: creat d3/d16/d1c/d31/d45/f6c x:0 0 0 2024-09-13T23:06:08.555 INFO:tasks.workunit.client.0.smithi115.stdout:6/336: truncate d4/df/f2e 3300179 0 2024-09-13T23:06:08.557 INFO:tasks.workunit.client.0.smithi115.stdout:9/231: symlink d0/d13/d17/d1f/d35/d40/l51 0 2024-09-13T23:06:08.560 INFO:tasks.workunit.client.0.smithi115.stdout:3/298: symlink d3/d16/d1c/d31/d42/l6d 0 2024-09-13T23:06:08.560 INFO:tasks.workunit.client.0.smithi115.stdout:3/299: stat d3/c3a 0 2024-09-13T23:06:08.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/337: creat d4/df/d51/f63 x:0 0 0 2024-09-13T23:06:08.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/338: readlink d4/df/d14/l49 0 2024-09-13T23:06:08.563 INFO:tasks.workunit.client.0.smithi115.stdout:9/232: creat d0/d13/d17/d1f/d35/d40/f52 x:0 0 0 2024-09-13T23:06:08.563 INFO:tasks.workunit.client.0.smithi115.stdout:6/339: rmdir d4/df/d14/d35 39 2024-09-13T23:06:08.565 INFO:tasks.workunit.client.0.smithi115.stdout:8/227: dwrite d3/d5/dc/d16/d1f/d28/d3e/f51 [0,4194304] 0 2024-09-13T23:06:08.565 INFO:tasks.workunit.client.0.smithi115.stdout:8/228: dread - d3/d5/dc/d23/f46 zero size 2024-09-13T23:06:08.565 INFO:tasks.workunit.client.0.smithi115.stdout:6/340: unlink d4/df/d14/d38/f23 0 2024-09-13T23:06:08.570 INFO:tasks.workunit.client.0.smithi115.stdout:8/229: mkdir d3/d5/dc/d23/d4e/d54 0 2024-09-13T23:06:08.570 INFO:tasks.workunit.client.0.smithi115.stdout:8/230: read - d3/d5/dc/f35 zero size 2024-09-13T23:06:08.572 INFO:tasks.workunit.client.0.smithi115.stdout:6/341: symlink d4/d57/d5a/l64 0 2024-09-13T23:06:08.572 INFO:tasks.workunit.client.0.smithi115.stdout:4/357: dwrite db/d11/d2e/d35/f53 [0,4194304] 0 2024-09-13T23:06:08.574 INFO:tasks.workunit.client.0.smithi115.stdout:8/231: rename d3/d5/d1c/d41/d42/f17 to d3/d5/dc/d16/d1f/d28/f55 0 2024-09-13T23:06:08.577 INFO:tasks.workunit.client.0.smithi115.stdout:3/300: write d3/d16/d1a/f57 [2533184,117987] 0 2024-09-13T23:06:08.578 INFO:tasks.workunit.client.0.smithi115.stdout:4/358: creat db/d11/d2e/d33/d36/d51/d57/f63 x:0 0 0 2024-09-13T23:06:08.578 INFO:tasks.workunit.client.0.smithi115.stdout:3/301: write d3/d16/d1c/d31/d3b/f4a [658077,3092] 0 2024-09-13T23:06:08.579 INFO:tasks.workunit.client.0.smithi115.stdout:9/233: dwrite d0/d13/d17/d36/f46 [0,4194304] 0 2024-09-13T23:06:08.579 INFO:tasks.workunit.client.0.smithi115.stdout:9/234: write d0/d13/d17/d19/f50 [870498,113440] 0 2024-09-13T23:06:08.581 INFO:tasks.workunit.client.0.smithi115.stdout:6/342: rename d4/df/d14/d38/d44/l46 to d4/df/d51/l65 0 2024-09-13T23:06:08.581 INFO:tasks.workunit.client.0.smithi115.stdout:6/343: truncate d4/df/f28 1027506 0 2024-09-13T23:06:08.581 INFO:tasks.workunit.client.0.smithi115.stdout:8/232: link d3/d5/dc/d16/c19 d3/d5/d1d/c56 0 2024-09-13T23:06:08.582 INFO:tasks.workunit.client.0.smithi115.stdout:3/302: unlink d3/d5/d35/l64 0 2024-09-13T23:06:08.585 INFO:tasks.workunit.client.0.smithi115.stdout:7/213: sync 2024-09-13T23:06:08.588 INFO:tasks.workunit.client.0.smithi115.stdout:6/344: read d4/df/d14/d35/f39 [366987,79490] 0 2024-09-13T23:06:08.590 INFO:tasks.workunit.client.0.smithi115.stdout:6/345: write d4/df/f28 [257446,68773] 0 2024-09-13T23:06:08.591 INFO:tasks.workunit.client.0.smithi115.stdout:3/303: symlink d3/d16/l6e 0 2024-09-13T23:06:08.592 INFO:tasks.workunit.client.0.smithi115.stdout:7/214: creat da/df/d3b/f4a x:0 0 0 2024-09-13T23:06:08.594 INFO:tasks.workunit.client.0.smithi115.stdout:7/215: truncate da/f10 690530 0 2024-09-13T23:06:08.595 INFO:tasks.workunit.client.0.smithi115.stdout:7/216: rename c3 to da/dd/d16/d29/c4b 0 2024-09-13T23:06:08.597 INFO:tasks.workunit.client.0.smithi115.stdout:7/217: symlink da/dd/d13/l4c 0 2024-09-13T23:06:08.598 INFO:tasks.workunit.client.0.smithi115.stdout:7/218: mkdir da/dd/d1c/d2d/d45/d4d 0 2024-09-13T23:06:08.598 INFO:tasks.workunit.client.0.smithi115.stdout:7/219: chown da/dd/d1c/f20 184178527 1 2024-09-13T23:06:08.598 INFO:tasks.workunit.client.0.smithi115.stdout:7/220: stat l0 0 2024-09-13T23:06:08.599 INFO:tasks.workunit.client.0.smithi115.stdout:7/221: link l0 da/dd/d13/d36/l4e 0 2024-09-13T23:06:08.600 INFO:tasks.workunit.client.0.smithi115.stdout:7/222: rename da/df/d3b/f4a to da/dd/d13/d24/f4f 0 2024-09-13T23:06:08.601 INFO:tasks.workunit.client.0.smithi115.stdout:6/346: write d4/df/d3a/f53 [3404959,91293] 0 2024-09-13T23:06:08.603 INFO:tasks.workunit.client.0.smithi115.stdout:6/347: mkdir d4/df/d14/d38/d44/d66 0 2024-09-13T23:06:08.603 INFO:tasks.workunit.client.0.smithi115.stdout:6/348: fdatasync d4/df/f2e 0 2024-09-13T23:06:08.606 INFO:tasks.workunit.client.0.smithi115.stdout:3/304: dread d3/d16/d1c/d31/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:08.606 INFO:tasks.workunit.client.0.smithi115.stdout:3/305: fsync d3/d5/d35/f50 0 2024-09-13T23:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:3/306: creat d3/d16/d1c/d31/d45/d59/f6f x:0 0 0 2024-09-13T23:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:3/307: creat d3/d5/d5b/f70 x:0 0 0 2024-09-13T23:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:4/359: dwrite db/d11/d2e/d33/d36/d51/d57/f63 [0,4194304] 0 2024-09-13T23:06:08.608 INFO:tasks.workunit.client.0.smithi115.stdout:4/360: fsync db/d16/d3f/f5a 0 2024-09-13T23:06:08.610 INFO:tasks.workunit.client.0.smithi115.stdout:9/235: dwrite d0/d13/f2e [0,4194304] 0 2024-09-13T23:06:08.610 INFO:tasks.workunit.client.0.smithi115.stdout:9/236: chown d0/d13/l21 250 1 2024-09-13T23:06:08.613 INFO:tasks.workunit.client.0.smithi115.stdout:8/233: dwrite d3/d5/d1c/f2e [0,4194304] 0 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:9/237: rmdir d0/d13/d17/d19/d4c 0 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:0/296: sync 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:5/248: sync 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:1/275: sync 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:5/249: write d8/f2a [5200464,14869] 0 2024-09-13T23:06:08.618 INFO:tasks.workunit.client.0.smithi115.stdout:2/263: sync 2024-09-13T23:06:08.620 INFO:tasks.workunit.client.0.smithi115.stdout:4/361: dread db/f10 [0,4194304] 0 2024-09-13T23:06:08.620 INFO:tasks.workunit.client.0.smithi115.stdout:0/297: mkdir d6/d24/d25/d2b/d32/d44/d64 0 2024-09-13T23:06:08.622 INFO:tasks.workunit.client.0.smithi115.stdout:5/250: unlink d8/dd/d20/f31 0 2024-09-13T23:06:08.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/349: write d4/f12 [1112770,101026] 0 2024-09-13T23:06:08.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/264: creat da/d21/f5b x:0 0 0 2024-09-13T23:06:08.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/265: chown da/d23/d32/f4c 1500 1 2024-09-13T23:06:08.625 INFO:tasks.workunit.client.0.smithi115.stdout:4/362: unlink db/d11/d2e/d33/d36/f5c 0 2024-09-13T23:06:08.629 INFO:tasks.workunit.client.0.smithi115.stdout:2/266: dread f4 [0,4194304] 0 2024-09-13T23:06:08.629 INFO:tasks.workunit.client.0.smithi115.stdout:7/223: getdents da/dd/d16/d29 0 2024-09-13T23:06:08.629 INFO:tasks.workunit.client.0.smithi115.stdout:0/298: unlink d6/c1a 0 2024-09-13T23:06:08.629 INFO:tasks.workunit.client.0.smithi115.stdout:0/299: stat d6/d24/d25/d2b 0 2024-09-13T23:06:08.630 INFO:tasks.workunit.client.0.smithi115.stdout:5/251: symlink d8/l49 0 2024-09-13T23:06:08.631 INFO:tasks.workunit.client.0.smithi115.stdout:6/350: mkdir d4/df/d14/d67 0 2024-09-13T23:06:08.635 INFO:tasks.workunit.client.0.smithi115.stdout:4/363: creat db/d19/d4e/f64 x:0 0 0 2024-09-13T23:06:08.635 INFO:tasks.workunit.client.0.smithi115.stdout:4/364: read db/f10 [728032,29449] 0 2024-09-13T23:06:08.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/224: link l0 da/dd/d1c/d2d/d45/l50 0 2024-09-13T23:06:08.637 INFO:tasks.workunit.client.0.smithi115.stdout:7/225: readlink da/dd/d13/l40 0 2024-09-13T23:06:08.639 INFO:tasks.workunit.client.0.smithi115.stdout:6/351: link d4/f12 d4/df/d14/d38/f68 0 2024-09-13T23:06:08.641 INFO:tasks.workunit.client.0.smithi115.stdout:7/226: mkdir da/dd/d13/d36/d51 0 2024-09-13T23:06:08.643 INFO:tasks.workunit.client.0.smithi115.stdout:6/352: unlink d4/f12 0 2024-09-13T23:06:08.644 INFO:tasks.workunit.client.0.smithi115.stdout:6/353: chown d4/df/d14/d38/d2a/d3e/d56 15 1 2024-09-13T23:06:08.644 INFO:tasks.workunit.client.0.smithi115.stdout:7/227: mkdir da/dd/d13/d24/d52 0 2024-09-13T23:06:08.644 INFO:tasks.workunit.client.0.smithi115.stdout:7/228: getdents da/dd/d13/d36/d51 0 2024-09-13T23:06:08.645 INFO:tasks.workunit.client.0.smithi115.stdout:4/365: write db/d11/d2e/d33/d36/d51/d57/f63 [5041310,130378] 0 2024-09-13T23:06:08.646 INFO:tasks.workunit.client.0.smithi115.stdout:3/308: rename d3/d16/d1c/d31 to d3/d5/d35/d71 0 2024-09-13T23:06:08.646 INFO:tasks.workunit.client.0.smithi115.stdout:3/309: creat d3/d5/d5b/f72 x:0 0 0 2024-09-13T23:06:08.646 INFO:tasks.workunit.client.0.smithi115.stdout:3/310: truncate d3/d5/d5b/f72 170125 0 2024-09-13T23:06:08.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/354: link d4/df/d14/d38/d2a/f33 d4/df/d3a/f69 0 2024-09-13T23:06:08.650 INFO:tasks.workunit.client.0.smithi115.stdout:4/366: dread db/f10 [0,4194304] 0 2024-09-13T23:06:08.650 INFO:tasks.workunit.client.0.smithi115.stdout:6/355: rmdir d4/df/d14 39 2024-09-13T23:06:08.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/311: read d3/d16/d1c/f38 [368402,126325] 0 2024-09-13T23:06:08.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/312: truncate d3/d5/d5b/f72 886412 0 2024-09-13T23:06:08.651 INFO:tasks.workunit.client.0.smithi115.stdout:4/367: stat db/d19/d1d/c26 0 2024-09-13T23:06:08.652 INFO:tasks.workunit.client.0.smithi115.stdout:6/356: creat d4/df/d14/d38/d2a/d31/f6a x:0 0 0 2024-09-13T23:06:08.653 INFO:tasks.workunit.client.0.smithi115.stdout:3/313: symlink d3/d5/d2c/l73 0 2024-09-13T23:06:08.654 INFO:tasks.workunit.client.0.smithi115.stdout:3/314: creat d3/d5/d35/d71/d3b/d4d/f74 x:0 0 0 2024-09-13T23:06:08.666 INFO:tasks.workunit.client.0.smithi115.stdout:3/315: write d3/d16/f19 [1162070,11838] 0 2024-09-13T23:06:08.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/316: getdents d3/d5/d35/d4c 0 2024-09-13T23:06:08.667 INFO:tasks.workunit.client.0.smithi115.stdout:3/317: write d3/d5/d35/d4c/f61 [788007,16005] 0 2024-09-13T23:06:08.668 INFO:tasks.workunit.client.0.smithi115.stdout:6/357: dread d4/df/f1c [0,4194304] 0 2024-09-13T23:06:08.668 INFO:tasks.workunit.client.0.smithi115.stdout:3/318: symlink d3/d5/d35/d4c/l75 0 2024-09-13T23:06:08.669 INFO:tasks.workunit.client.0.smithi115.stdout:8/234: dwrite d3/d5/dc/d16/f38 [0,4194304] 0 2024-09-13T23:06:08.669 INFO:tasks.workunit.client.0.smithi115.stdout:8/235: chown d3/d5/dc/d23/f2d 668203 1 2024-09-13T23:06:08.669 INFO:tasks.workunit.client.0.smithi115.stdout:8/236: fdatasync d3/d5/dc/f2b 0 2024-09-13T23:06:08.669 INFO:tasks.workunit.client.0.smithi115.stdout:1/276: dwrite d0/de/d1b/d25/d4d/d51/d31/d37/f3f [0,4194304] 0 2024-09-13T23:06:08.670 INFO:tasks.workunit.client.0.smithi115.stdout:2/267: dwrite da/d23/d2c/f2e [0,4194304] 0 2024-09-13T23:06:08.670 INFO:tasks.workunit.client.0.smithi115.stdout:2/268: chown da/d23/d32/f54 29 1 2024-09-13T23:06:08.670 INFO:tasks.workunit.client.0.smithi115.stdout:9/238: dwrite d0/d13/d17/f39 [0,4194304] 0 2024-09-13T23:06:08.670 INFO:tasks.workunit.client.0.smithi115.stdout:2/269: write da/d23/d32/d56/d1a/f1f [881840,8988] 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:6/358: mkdir d4/d57/d5a/d6b 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:6/359: readlink d4/l25 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:6/360: creat d4/f6c x:0 0 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:7/229: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:7/230: read - da/dd/d13/d36/f42 zero size 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:0/300: dwrite f2 [8388608,4194304] 0 2024-09-13T23:06:08.671 INFO:tasks.workunit.client.0.smithi115.stdout:0/301: creat d6/d24/d25/d2b/d32/d44/f65 x:0 0 0 2024-09-13T23:06:08.676 INFO:tasks.workunit.client.0.smithi115.stdout:6/361: write d4/df/d14/d38/d2a/d31/f34 [234090,6269] 0 2024-09-13T23:06:08.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/319: dread d3/d5/d35/d71/d45/d59/f5a [0,4194304] 0 2024-09-13T23:06:08.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/368: rmdir db/d11/d2e 39 2024-09-13T23:06:08.678 INFO:tasks.workunit.client.0.smithi115.stdout:4/369: chown f5 1638 1 2024-09-13T23:06:08.685 INFO:tasks.workunit.client.0.smithi115.stdout:9/239: mkdir d0/d43/d53 0 2024-09-13T23:06:08.685 INFO:tasks.workunit.client.0.smithi115.stdout:9/240: readlink d0/d13/d17/l4b 0 2024-09-13T23:06:08.685 INFO:tasks.workunit.client.0.smithi115.stdout:9/241: chown d0/d13/d17/d1f/d35/d40 16546784 1 2024-09-13T23:06:08.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/370: fsync db/d11/d2e/d33/d36/d51/d57/f63 0 2024-09-13T23:06:08.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/371: fsync db/d11/d2e/d33/d36/f3b 0 2024-09-13T23:06:08.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/372: creat db/d19/d4e/f65 x:0 0 0 2024-09-13T23:06:08.686 INFO:tasks.workunit.client.0.smithi115.stdout:8/237: dwrite d3/d5/dc/d23/f36 [0,4194304] 0 2024-09-13T23:06:08.686 INFO:tasks.workunit.client.0.smithi115.stdout:8/238: fsync d3/d5/f1e 0 2024-09-13T23:06:08.687 INFO:tasks.workunit.client.0.smithi115.stdout:9/242: dread d0/d13/d17/d1f/d28/f3e [0,4194304] 0 2024-09-13T23:06:08.687 INFO:tasks.workunit.client.0.smithi115.stdout:9/243: getdents d0/d13/d17/d1f/d4e 0 2024-09-13T23:06:08.689 INFO:tasks.workunit.client.0.smithi115.stdout:9/244: read d0/d13/d17/d1f/f45 [207480,44018] 0 2024-09-13T23:06:08.693 INFO:tasks.workunit.client.0.smithi115.stdout:7/231: mkdir da/d53 0 2024-09-13T23:06:08.699 INFO:tasks.workunit.client.0.smithi115.stdout:0/302: unlink d6/d24/d25/d2b/c40 0 2024-09-13T23:06:08.702 INFO:tasks.workunit.client.0.smithi115.stdout:1/277: mknod d0/c55 0 2024-09-13T23:06:08.702 INFO:tasks.workunit.client.0.smithi115.stdout:3/320: truncate d3/d16/d1a/f26 3616031 0 2024-09-13T23:06:08.702 INFO:tasks.workunit.client.0.smithi115.stdout:1/278: dread d0/f9 [4194304,4194304] 0 2024-09-13T23:06:08.703 INFO:tasks.workunit.client.0.smithi115.stdout:2/270: getdents da/d23/d4e 0 2024-09-13T23:06:08.703 INFO:tasks.workunit.client.0.smithi115.stdout:2/271: chown da/d23/d32/d56/d1a/d1c/c3f 64120438 1 2024-09-13T23:06:08.705 INFO:tasks.workunit.client.0.smithi115.stdout:4/373: mkdir db/d16/d3f/d66 0 2024-09-13T23:06:08.709 INFO:tasks.workunit.client.0.smithi115.stdout:8/239: creat d3/d5/d1c/d41/f57 x:0 0 0 2024-09-13T23:06:08.712 INFO:tasks.workunit.client.0.smithi115.stdout:6/362: symlink d4/df/d14/d38/l6d 0 2024-09-13T23:06:08.714 INFO:tasks.workunit.client.0.smithi115.stdout:9/245: mknod d0/d13/d17/d36/c54 0 2024-09-13T23:06:08.716 INFO:tasks.workunit.client.0.smithi115.stdout:7/232: creat da/dd/d1c/d2d/f54 x:0 0 0 2024-09-13T23:06:08.717 INFO:tasks.workunit.client.0.smithi115.stdout:4/374: dread db/d11/d2e/d35/f53 [0,4194304] 0 2024-09-13T23:06:08.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/303: link d6/d24/d25/d2b/d32/d44/f46 d6/d24/d25/d2b/d32/d44/f66 0 2024-09-13T23:06:08.719 INFO:tasks.workunit.client.0.smithi115.stdout:3/321: mkdir d3/d16/d1a/d1e/d76 0 2024-09-13T23:06:08.721 INFO:tasks.workunit.client.0.smithi115.stdout:2/272: mknod da/d23/d32/d48/c5c 0 2024-09-13T23:06:08.722 INFO:tasks.workunit.client.0.smithi115.stdout:2/273: write da/f11 [3936305,112862] 0 2024-09-13T23:06:08.724 INFO:tasks.workunit.client.0.smithi115.stdout:6/363: mknod d4/c6e 0 2024-09-13T23:06:08.724 INFO:tasks.workunit.client.0.smithi115.stdout:8/240: dwrite d3/d5/d1c/d41/d42/f15 [0,4194304] 0 2024-09-13T23:06:08.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/241: chown d3/d5/d1c/d41 31 1 2024-09-13T23:06:08.726 INFO:tasks.workunit.client.0.smithi115.stdout:3/322: link d3/d5/d35/d71/f44 d3/d16/f77 0 2024-09-13T23:06:08.727 INFO:tasks.workunit.client.0.smithi115.stdout:1/279: link d0/de/d1a/l2b d0/l56 0 2024-09-13T23:06:08.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/274: mknod da/d23/d32/d48/c5d 0 2024-09-13T23:06:08.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/275: creat da/d21/f5e x:0 0 0 2024-09-13T23:06:08.729 INFO:tasks.workunit.client.0.smithi115.stdout:2/276: creat da/d21/f5f x:0 0 0 2024-09-13T23:06:08.730 INFO:tasks.workunit.client.0.smithi115.stdout:2/277: dread da/d23/d32/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:08.731 INFO:tasks.workunit.client.0.smithi115.stdout:2/278: write da/d21/f5b [975721,67618] 0 2024-09-13T23:06:08.733 INFO:tasks.workunit.client.0.smithi115.stdout:6/364: creat d4/d57/d5a/d6b/f6f x:0 0 0 2024-09-13T23:06:08.735 INFO:tasks.workunit.client.0.smithi115.stdout:8/242: mkdir d3/d5/dc/d16/d1f/d27/d58 0 2024-09-13T23:06:08.735 INFO:tasks.workunit.client.0.smithi115.stdout:8/243: stat d3/d5/dc/f12 0 2024-09-13T23:06:08.736 INFO:tasks.workunit.client.0.smithi115.stdout:3/323: mknod d3/d5/d35/d71/d45/c78 0 2024-09-13T23:06:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:2/279: rename da/d23/d32/d48/c5c to da/d23/d49/c60 0 2024-09-13T23:06:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:2/280: truncate da/d21/f5e 308057 0 2024-09-13T23:06:08.745 INFO:tasks.workunit.client.0.smithi115.stdout:6/365: link d4/df/d14/c21 d4/df/d51/c70 0 2024-09-13T23:06:08.746 INFO:tasks.workunit.client.0.smithi115.stdout:8/244: creat d3/d5/dc/d16/d1f/d27/d58/f59 x:0 0 0 2024-09-13T23:06:08.748 INFO:tasks.workunit.client.0.smithi115.stdout:2/281: creat da/d23/d32/d56/d1a/d1c/d41/f61 x:0 0 0 2024-09-13T23:06:08.749 INFO:tasks.workunit.client.0.smithi115.stdout:8/245: symlink d3/d5/d1c/d41/d42/l5a 0 2024-09-13T23:06:08.749 INFO:tasks.workunit.client.0.smithi115.stdout:8/246: truncate d3/d5/dc/f32 4922978 0 2024-09-13T23:06:08.750 INFO:tasks.workunit.client.0.smithi115.stdout:2/282: rename da/d23/d4e to da/d23/d32/d56/d1a/d1c/d41/d62 0 2024-09-13T23:06:08.751 INFO:tasks.workunit.client.0.smithi115.stdout:6/366: symlink d4/df/d14/d38/d2a/l71 0 2024-09-13T23:06:08.752 INFO:tasks.workunit.client.0.smithi115.stdout:2/283: truncate f4 828400 0 2024-09-13T23:06:08.752 INFO:tasks.workunit.client.0.smithi115.stdout:6/367: write d4/df/d14/d38/d44/f58 [854060,62107] 0 2024-09-13T23:06:08.753 INFO:tasks.workunit.client.0.smithi115.stdout:2/284: creat da/d23/d32/d56/d1a/d1c/f63 x:0 0 0 2024-09-13T23:06:08.754 INFO:tasks.workunit.client.0.smithi115.stdout:6/368: truncate d4/df/d14/d38/d44/f55 2861062 0 2024-09-13T23:06:08.761 INFO:tasks.workunit.client.0.smithi115.stdout:8/247: dread d3/d5/d1d/f26 [0,4194304] 0 2024-09-13T23:06:08.761 INFO:tasks.workunit.client.0.smithi115.stdout:8/248: write d3/d5/dc/d16/d1f/d27/f45 [250203,114372] 0 2024-09-13T23:06:08.763 INFO:tasks.workunit.client.0.smithi115.stdout:8/249: rmdir d3/d5/dc/d23/d4e 39 2024-09-13T23:06:08.763 INFO:tasks.workunit.client.0.smithi115.stdout:3/324: dread d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:08.763 INFO:tasks.workunit.client.0.smithi115.stdout:3/325: chown d3/d5/db/f5f 471495 1 2024-09-13T23:06:08.764 INFO:tasks.workunit.client.0.smithi115.stdout:8/250: unlink d3/d5/c1a 0 2024-09-13T23:06:08.764 INFO:tasks.workunit.client.0.smithi115.stdout:8/251: write d3/d5/d1c/d41/d42/f14 [4675232,129597] 0 2024-09-13T23:06:08.765 INFO:tasks.workunit.client.0.smithi115.stdout:3/326: unlink d3/d5/db/f5f 0 2024-09-13T23:06:08.765 INFO:tasks.workunit.client.0.smithi115.stdout:3/327: fdatasync d3/d5/d35/d71/d45/d59/f5a 0 2024-09-13T23:06:08.767 INFO:tasks.workunit.client.0.smithi115.stdout:8/252: mknod d3/c5b 0 2024-09-13T23:06:08.767 INFO:tasks.workunit.client.0.smithi115.stdout:8/253: write d3/d5/f3d [4825603,1674] 0 2024-09-13T23:06:08.768 INFO:tasks.workunit.client.0.smithi115.stdout:3/328: link d3/d16/d1a/d29/f62 d3/d5/d35/d71/d3b/d47/d28/f79 0 2024-09-13T23:06:08.768 INFO:tasks.workunit.client.0.smithi115.stdout:3/329: truncate d3/d5/d35/d71/d3b/d4d/f74 199350 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:9/246: dwrite d0/d13/d17/f39 [0,4194304] 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:9/247: fsync d0/d13/d17/d1f/d35/d40/f52 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:9/248: stat d0/d13/d17/d19/f1d 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:1/280: dwrite d0/f7 [0,4194304] 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:0/304: dwrite d6/d24/d25/d2b/d32/d44/f57 [0,4194304] 0 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:1/281: chown d0/de/f46 856 1 2024-09-13T23:06:08.771 INFO:tasks.workunit.client.0.smithi115.stdout:7/233: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:08.774 INFO:tasks.workunit.client.0.smithi115.stdout:4/375: dwrite db/d19/d1d/d2a/f40 [4194304,4194304] 0 2024-09-13T23:06:08.775 INFO:tasks.workunit.client.0.smithi115.stdout:9/249: mkdir d0/d43/d55 0 2024-09-13T23:06:08.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/285: dwrite da/d21/f33 [0,4194304] 0 2024-09-13T23:06:08.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/286: chown da/d23/d32/d56/d1a/d1c/d41/d62 8 1 2024-09-13T23:06:08.776 INFO:tasks.workunit.client.0.smithi115.stdout:2/287: read da/d23/d32/f54 [3135332,106546] 0 2024-09-13T23:06:08.779 INFO:tasks.workunit.client.0.smithi115.stdout:4/376: truncate db/d11/d54/d17/f24 2093921 0 2024-09-13T23:06:08.779 INFO:tasks.workunit.client.0.smithi115.stdout:4/377: creat db/d16/d3f/f67 x:0 0 0 2024-09-13T23:06:08.779 INFO:tasks.workunit.client.0.smithi115.stdout:4/378: read - db/d19/d34/f55 zero size 2024-09-13T23:06:08.781 INFO:tasks.workunit.client.0.smithi115.stdout:9/250: rename d0/d13/d17/d1f/c2a to d0/d13/d3b/c56 0 2024-09-13T23:06:08.781 INFO:tasks.workunit.client.0.smithi115.stdout:3/330: fsync d3/d5/db/f17 0 2024-09-13T23:06:08.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/288: mknod da/d23/d32/d56/c64 0 2024-09-13T23:06:08.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/289: write da/d23/d32/d48/f51 [1220072,128675] 0 2024-09-13T23:06:08.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/290: readlink da/l3e 0 2024-09-13T23:06:08.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/291: chown da/d23/d32/d53 228 1 2024-09-13T23:06:08.783 INFO:tasks.workunit.client.0.smithi115.stdout:5/252: sync 2024-09-13T23:06:08.785 INFO:tasks.workunit.client.0.smithi115.stdout:4/379: mkdir db/d16/d3f/d66/d68 0 2024-09-13T23:06:08.786 INFO:tasks.workunit.client.0.smithi115.stdout:3/331: creat d3/d5/d35/d71/d45/d59/f7a x:0 0 0 2024-09-13T23:06:08.786 INFO:tasks.workunit.client.0.smithi115.stdout:3/332: chown d3/d16/d1a/d29 244 1 2024-09-13T23:06:08.789 INFO:tasks.workunit.client.0.smithi115.stdout:2/292: creat da/d21/d2d/f65 x:0 0 0 2024-09-13T23:06:08.793 INFO:tasks.workunit.client.0.smithi115.stdout:7/234: rmdir da/dd/d13/d36/d51 0 2024-09-13T23:06:08.793 INFO:tasks.workunit.client.0.smithi115.stdout:4/380: rename db/c2f to db/d11/d54/c69 0 2024-09-13T23:06:08.793 INFO:tasks.workunit.client.0.smithi115.stdout:4/381: chown db/d16/d3f/f67 222 1 2024-09-13T23:06:08.794 INFO:tasks.workunit.client.0.smithi115.stdout:4/382: dread - db/f56 zero size 2024-09-13T23:06:08.794 INFO:tasks.workunit.client.0.smithi115.stdout:4/383: write db/d11/d54/f44 [1011733,11175] 0 2024-09-13T23:06:08.794 INFO:tasks.workunit.client.0.smithi115.stdout:5/253: write d8/dd/f46 [784841,2920] 0 2024-09-13T23:06:08.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/235: creat da/dd/d16/d29/f55 x:0 0 0 2024-09-13T23:06:08.795 INFO:tasks.workunit.client.0.smithi115.stdout:8/254: dwrite d3/d5/dc/d16/d1f/d28/f55 [4194304,4194304] 0 2024-09-13T23:06:08.795 INFO:tasks.workunit.client.0.smithi115.stdout:1/282: dwrite d0/fc [0,4194304] 0 2024-09-13T23:06:08.795 INFO:tasks.workunit.client.0.smithi115.stdout:1/283: write d0/de/d1a/d29/f2a [5086437,53196] 0 2024-09-13T23:06:08.796 INFO:tasks.workunit.client.0.smithi115.stdout:3/333: rename d3/d16/c27 to d3/d16/d1a/d1e/d76/c7b 0 2024-09-13T23:06:08.798 INFO:tasks.workunit.client.0.smithi115.stdout:4/384: unlink db/d19/d34/f50 0 2024-09-13T23:06:08.798 INFO:tasks.workunit.client.0.smithi115.stdout:5/254: mkdir d8/dd/d20/d4a 0 2024-09-13T23:06:08.798 INFO:tasks.workunit.client.0.smithi115.stdout:8/255: dread d3/d5/dc/d23/f2d [0,4194304] 0 2024-09-13T23:06:08.805 INFO:tasks.workunit.client.0.smithi115.stdout:1/284: symlink d0/de/d1a/l57 0 2024-09-13T23:06:08.807 INFO:tasks.workunit.client.0.smithi115.stdout:7/236: write da/df/f26 [741915,61032] 0 2024-09-13T23:06:08.807 INFO:tasks.workunit.client.0.smithi115.stdout:7/237: chown da/dd/d13/l4c 150 1 2024-09-13T23:06:08.810 INFO:tasks.workunit.client.0.smithi115.stdout:9/251: dwrite d0/fd [4194304,4194304] 0 2024-09-13T23:06:08.810 INFO:tasks.workunit.client.0.smithi115.stdout:3/334: unlink d3/d16/f77 0 2024-09-13T23:06:08.810 INFO:tasks.workunit.client.0.smithi115.stdout:3/335: chown d3/c12 1591511 1 2024-09-13T23:06:08.812 INFO:tasks.workunit.client.0.smithi115.stdout:2/293: dwrite da/d21/f5e [0,4194304] 0 2024-09-13T23:06:08.820 INFO:tasks.workunit.client.0.smithi115.stdout:9/252: write d0/d13/f2d [3147778,90777] 0 2024-09-13T23:06:08.825 INFO:tasks.workunit.client.0.smithi115.stdout:6/369: dwrite d4/df/d14/d38/d44/f55 [0,4194304] 0 2024-09-13T23:06:08.825 INFO:tasks.workunit.client.0.smithi115.stdout:6/370: truncate d4/df/d14/d38/d2a/d31/f6a 611204 0 2024-09-13T23:06:08.826 INFO:tasks.workunit.client.0.smithi115.stdout:4/385: truncate db/f43 1936905 0 2024-09-13T23:06:08.826 INFO:tasks.workunit.client.0.smithi115.stdout:4/386: dread - db/d11/f46 zero size 2024-09-13T23:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:8/256: symlink d3/d5/dc/d16/d1f/d27/l5c 0 2024-09-13T23:06:08.828 INFO:tasks.workunit.client.0.smithi115.stdout:8/257: write d3/d5/d1c/d41/f57 [308919,8849] 0 2024-09-13T23:06:08.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/285: symlink d0/de/d1b/d25/d4d/d51/l58 0 2024-09-13T23:06:08.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/286: readlink d0/de/d1a/l21 0 2024-09-13T23:06:08.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/287: creat d0/de/d1b/f59 x:0 0 0 2024-09-13T23:06:08.829 INFO:tasks.workunit.client.0.smithi115.stdout:7/238: truncate da/dd/d13/f2a 2174108 0 2024-09-13T23:06:08.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/336: unlink d3/d5/d35/d71/d45/f66 0 2024-09-13T23:06:08.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/337: dread - d3/d5/d5b/f68 zero size 2024-09-13T23:06:08.836 INFO:tasks.workunit.client.0.smithi115.stdout:1/288: write d0/de/d1b/d25/d4d/d51/d31/d37/f3f [2841271,74340] 0 2024-09-13T23:06:08.845 INFO:tasks.workunit.client.0.smithi115.stdout:8/258: link d3/d5/dc/d23/c34 d3/d5/d1d/c5d 0 2024-09-13T23:06:08.845 INFO:tasks.workunit.client.0.smithi115.stdout:9/253: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:08.845 INFO:tasks.workunit.client.0.smithi115.stdout:9/254: write d0/d13/d17/f39 [4601342,3232] 0 2024-09-13T23:06:08.847 INFO:tasks.workunit.client.0.smithi115.stdout:9/255: dread d0/d13/d17/d19/f50 [0,4194304] 0 2024-09-13T23:06:08.850 INFO:tasks.workunit.client.0.smithi115.stdout:7/239: link da/df/l3f da/dd/d16/l56 0 2024-09-13T23:06:08.852 INFO:tasks.workunit.client.0.smithi115.stdout:3/338: creat d3/f7c x:0 0 0 2024-09-13T23:06:08.852 INFO:tasks.workunit.client.0.smithi115.stdout:3/339: creat d3/d16/d1a/d29/d49/f7d x:0 0 0 2024-09-13T23:06:08.852 INFO:tasks.workunit.client.0.smithi115.stdout:3/340: stat d3/d5/d2c/c48 0 2024-09-13T23:06:08.855 INFO:tasks.workunit.client.0.smithi115.stdout:1/289: dwrite d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:08.855 INFO:tasks.workunit.client.0.smithi115.stdout:8/259: unlink d3/c5b 0 2024-09-13T23:06:08.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/256: mknod d0/d13/d3b/d42/c57 0 2024-09-13T23:06:08.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/257: write d0/d13/d17/d19/f50 [1876973,69602] 0 2024-09-13T23:06:08.858 INFO:tasks.workunit.client.0.smithi115.stdout:7/240: symlink da/dd/d13/d36/l57 0 2024-09-13T23:06:08.860 INFO:tasks.workunit.client.0.smithi115.stdout:3/341: creat d3/d5/d35/d71/d3b/f7e x:0 0 0 2024-09-13T23:06:08.860 INFO:tasks.workunit.client.0.smithi115.stdout:3/342: truncate d3/d5/d35/d71/d45/d59/f5a 4507014 0 2024-09-13T23:06:08.862 INFO:tasks.workunit.client.0.smithi115.stdout:2/294: rename da/d23/d32/d56/d1a/d1c to da/d21/d2d/d66 0 2024-09-13T23:06:08.862 INFO:tasks.workunit.client.0.smithi115.stdout:2/295: write f4 [1036333,50431] 0 2024-09-13T23:06:08.862 INFO:tasks.workunit.client.0.smithi115.stdout:2/296: fdatasync da/d23/d32/d56/d1a/f1f 0 2024-09-13T23:06:08.863 INFO:tasks.workunit.client.0.smithi115.stdout:8/260: read d3/d5/dc/d16/d1f/d28/d3e/f51 [4128046,69410] 0 2024-09-13T23:06:08.863 INFO:tasks.workunit.client.0.smithi115.stdout:9/258: fsync d0/d13/d17/d1f/d28/f3e 0 2024-09-13T23:06:08.863 INFO:tasks.workunit.client.0.smithi115.stdout:9/259: fdatasync d0/d13/d17/d19/f1d 0 2024-09-13T23:06:08.864 INFO:tasks.workunit.client.0.smithi115.stdout:1/290: unlink d0/de/d1b/d25/f54 0 2024-09-13T23:06:08.864 INFO:tasks.workunit.client.0.smithi115.stdout:1/291: dread - d0/de/d1a/d29/f4e zero size 2024-09-13T23:06:08.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/241: symlink da/l58 0 2024-09-13T23:06:08.866 INFO:tasks.workunit.client.0.smithi115.stdout:3/343: unlink d3/d16/d1a/d29/l60 0 2024-09-13T23:06:08.869 INFO:tasks.workunit.client.0.smithi115.stdout:6/371: rename d4/df/d14/d35/c4a to d4/df/d14/c72 0 2024-09-13T23:06:08.869 INFO:tasks.workunit.client.0.smithi115.stdout:6/372: write d4/df/d14/d38/d2a/f33 [2372189,81205] 0 2024-09-13T23:06:08.876 INFO:tasks.workunit.client.0.smithi115.stdout:1/292: symlink d0/de/d1b/d25/d4d/d51/l5a 0 2024-09-13T23:06:08.876 INFO:tasks.workunit.client.0.smithi115.stdout:1/293: write d0/de/d1b/f35 [164600,14784] 0 2024-09-13T23:06:08.877 INFO:tasks.workunit.client.0.smithi115.stdout:7/242: creat da/dd/f59 x:0 0 0 2024-09-13T23:06:08.878 INFO:tasks.workunit.client.0.smithi115.stdout:3/344: creat d3/d5/f7f x:0 0 0 2024-09-13T23:06:08.880 INFO:tasks.workunit.client.0.smithi115.stdout:8/261: getdents d3/d5/dc/d16/d1f/d27 0 2024-09-13T23:06:08.883 INFO:tasks.workunit.client.0.smithi115.stdout:1/294: rename d0/de/d1a/l57 to d0/de/d1b/d25/l5b 0 2024-09-13T23:06:08.883 INFO:tasks.workunit.client.0.smithi115.stdout:1/295: readlink d0/de/d1a/l21 0 2024-09-13T23:06:08.884 INFO:tasks.workunit.client.0.smithi115.stdout:1/296: dread - d0/de/d1a/d29/f52 zero size 2024-09-13T23:06:08.885 INFO:tasks.workunit.client.0.smithi115.stdout:7/243: getdents da/dd/d1c 0 2024-09-13T23:06:08.887 INFO:tasks.workunit.client.0.smithi115.stdout:3/345: dread d3/d16/d1a/f57 [0,4194304] 0 2024-09-13T23:06:08.887 INFO:tasks.workunit.client.0.smithi115.stdout:3/346: stat d3/d5/db 0 2024-09-13T23:06:08.887 INFO:tasks.workunit.client.0.smithi115.stdout:8/262: dread d3/d5/f1e [0,4194304] 0 2024-09-13T23:06:08.890 INFO:tasks.workunit.client.0.smithi115.stdout:3/347: creat d3/d16/d1a/d1e/f80 x:0 0 0 2024-09-13T23:06:08.890 INFO:tasks.workunit.client.0.smithi115.stdout:3/348: stat d3/d16/d1a/d29/d49/f67 0 2024-09-13T23:06:08.892 INFO:tasks.workunit.client.0.smithi115.stdout:8/263: symlink d3/d5/dc/d23/d4e/d54/l5e 0 2024-09-13T23:06:08.892 INFO:tasks.workunit.client.0.smithi115.stdout:2/297: dwrite da/d23/d32/f3a [0,4194304] 0 2024-09-13T23:06:08.896 INFO:tasks.workunit.client.0.smithi115.stdout:7/244: dread da/df/f2c [0,4194304] 0 2024-09-13T23:06:08.896 INFO:tasks.workunit.client.0.smithi115.stdout:7/245: read da/dd/f2e [7297857,95618] 0 2024-09-13T23:06:08.896 INFO:tasks.workunit.client.0.smithi115.stdout:8/264: unlink d3/d5/dc/d16/d1f/d27/d58/f59 0 2024-09-13T23:06:08.897 INFO:tasks.workunit.client.0.smithi115.stdout:9/260: truncate d0/d13/f2d 3110582 0 2024-09-13T23:06:08.897 INFO:tasks.workunit.client.0.smithi115.stdout:9/261: fsync d0/d13/d17/d1f/d28/f38 0 2024-09-13T23:06:08.900 INFO:tasks.workunit.client.0.smithi115.stdout:8/265: creat d3/d5/d1c/d41/d42/d4d/f5f x:0 0 0 2024-09-13T23:06:08.901 INFO:tasks.workunit.client.0.smithi115.stdout:8/266: chown d3/d5/dc/d23/c53 22437781 1 2024-09-13T23:06:08.901 INFO:tasks.workunit.client.0.smithi115.stdout:8/267: write d3/d5/d1d/f20 [5290977,28511] 0 2024-09-13T23:06:08.901 INFO:tasks.workunit.client.0.smithi115.stdout:8/268: chown d3/le 16 1 2024-09-13T23:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/269: creat d3/d5/dc/d16/d1f/d27/f60 x:0 0 0 2024-09-13T23:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/270: read - d3/d5/dc/f35 zero size 2024-09-13T23:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/271: fsync d3/d5/dc/f35 0 2024-09-13T23:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:8/272: write d3/d5/dc/d23/f46 [655668,12056] 0 2024-09-13T23:06:08.905 INFO:tasks.workunit.client.0.smithi115.stdout:7/246: dread da/dd/d1c/f27 [0,4194304] 0 2024-09-13T23:06:08.906 INFO:tasks.workunit.client.0.smithi115.stdout:8/273: creat d3/d5/d1c/d41/d42/f61 x:0 0 0 2024-09-13T23:06:08.906 INFO:tasks.workunit.client.0.smithi115.stdout:8/274: write d3/d5/d1c/d41/d42/f61 [410584,107048] 0 2024-09-13T23:06:08.908 INFO:tasks.workunit.client.0.smithi115.stdout:2/298: write da/d21/f33 [528877,111214] 0 2024-09-13T23:06:08.908 INFO:tasks.workunit.client.0.smithi115.stdout:2/299: truncate da/d23/d32/f3a 5239735 0 2024-09-13T23:06:08.908 INFO:tasks.workunit.client.0.smithi115.stdout:7/247: mkdir da/dd/d13/d36/d5a 0 2024-09-13T23:06:08.908 INFO:tasks.workunit.client.0.smithi115.stdout:1/297: dwrite d0/de/d1b/d25/f3d [0,4194304] 0 2024-09-13T23:06:08.908 INFO:tasks.workunit.client.0.smithi115.stdout:6/373: dwrite d4/df/d14/d38/d2a/d3e/f4c [0,4194304] 0 2024-09-13T23:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:2/300: rename da/d23/d2c/l58 to da/d21/d2d/d66/d41/d62/l67 0 2024-09-13T23:06:08.912 INFO:tasks.workunit.client.0.smithi115.stdout:2/301: dread - da/d23/d49/f50 zero size 2024-09-13T23:06:08.921 INFO:tasks.workunit.client.0.smithi115.stdout:1/298: creat d0/dd/f5c x:0 0 0 2024-09-13T23:06:08.928 INFO:tasks.workunit.client.0.smithi115.stdout:6/374: write d4/df/d14/d38/f5e [771314,2561] 0 2024-09-13T23:06:08.928 INFO:tasks.workunit.client.0.smithi115.stdout:6/375: stat d4/df/f28 0 2024-09-13T23:06:08.929 INFO:tasks.workunit.client.0.smithi115.stdout:1/299: unlink d0/f1 0 2024-09-13T23:06:08.930 INFO:tasks.workunit.client.0.smithi115.stdout:6/376: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:08.936 INFO:tasks.workunit.client.0.smithi115.stdout:1/300: dread d0/de/d1b/f35 [0,4194304] 0 2024-09-13T23:06:08.936 INFO:tasks.workunit.client.0.smithi115.stdout:6/377: mknod d4/d57/d5a/c73 0 2024-09-13T23:06:08.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/301: symlink d0/de/d1b/d25/d4d/d51/d31/l5d 0 2024-09-13T23:06:08.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/302: fsync d0/de/d1a/d29/f2d 0 2024-09-13T23:06:08.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/303: mknod d0/de/d1a/c5e 0 2024-09-13T23:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/304: mknod d0/de/d1b/d25/d4d/d51/d23/c5f 0 2024-09-13T23:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/305: write d0/de/d1b/f59 [274070,57659] 0 2024-09-13T23:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:6/378: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:08.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/306: creat d0/de/f60 x:0 0 0 2024-09-13T23:06:08.940 INFO:tasks.workunit.client.0.smithi115.stdout:1/307: write d0/de/f19 [665749,2359] 0 2024-09-13T23:06:08.941 INFO:tasks.workunit.client.0.smithi115.stdout:6/379: creat d4/df/f74 x:0 0 0 2024-09-13T23:06:08.941 INFO:tasks.workunit.client.0.smithi115.stdout:6/380: truncate d4/f3c 577051 0 2024-09-13T23:06:08.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/381: write d4/d57/d5a/d6b/f6f [1002658,110839] 0 2024-09-13T23:06:08.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/382: stat d4/df/d14/d38/d2a 0 2024-09-13T23:06:08.944 INFO:tasks.workunit.client.0.smithi115.stdout:8/275: dwrite d3/d5/d1c/d41/d42/f14 [4194304,4194304] 0 2024-09-13T23:06:08.945 INFO:tasks.workunit.client.0.smithi115.stdout:6/383: rename d4/d57/d5a/d6b to d4/d57/d75 0 2024-09-13T23:06:08.947 INFO:tasks.workunit.client.0.smithi115.stdout:2/302: dwrite f7 [0,4194304] 0 2024-09-13T23:06:08.949 INFO:tasks.workunit.client.0.smithi115.stdout:7/248: dwrite da/df/f26 [0,4194304] 0 2024-09-13T23:06:08.950 INFO:tasks.workunit.client.0.smithi115.stdout:7/249: chown da/dd/d16/c47 25663 1 2024-09-13T23:06:09.004 INFO:tasks.workunit.client.0.smithi115.stdout:8/276: mkdir d3/d5/dc/d16/d1f/d28/d62 0 2024-09-13T23:06:09.005 INFO:tasks.workunit.client.0.smithi115.stdout:6/384: mkdir d4/df/d14/d76 0 2024-09-13T23:06:09.012 INFO:tasks.workunit.client.0.smithi115.stdout:7/250: mkdir da/dd/d1c/d2d/d45/d4d/d5b 0 2024-09-13T23:06:09.015 INFO:tasks.workunit.client.0.smithi115.stdout:8/277: mkdir d3/d5/d1d/d63 0 2024-09-13T23:06:09.015 INFO:tasks.workunit.client.0.smithi115.stdout:8/278: creat d3/d5/dc/f64 x:0 0 0 2024-09-13T23:06:09.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/303: getdents da/d21 0 2024-09-13T23:06:09.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/304: write da/d23/d32/f42 [8959,30342] 0 2024-09-13T23:06:09.018 INFO:tasks.workunit.client.0.smithi115.stdout:7/251: mknod da/dd/d13/d36/d5a/c5c 0 2024-09-13T23:06:09.018 INFO:tasks.workunit.client.0.smithi115.stdout:2/305: dread da/d23/d32/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:09.018 INFO:tasks.workunit.client.0.smithi115.stdout:2/306: write da/d23/d32/f42 [95151,18693] 0 2024-09-13T23:06:09.018 INFO:tasks.workunit.client.0.smithi115.stdout:1/308: rmdir d0/de/d1b 39 2024-09-13T23:06:09.023 INFO:tasks.workunit.client.0.smithi115.stdout:8/279: creat d3/d5/dc/d16/d1f/d28/d62/f65 x:0 0 0 2024-09-13T23:06:09.024 INFO:tasks.workunit.client.0.smithi115.stdout:6/385: getdents d4/d57 0 2024-09-13T23:06:09.024 INFO:tasks.workunit.client.0.smithi115.stdout:6/386: write d4/df/d14/d35/f39 [2734229,101519] 0 2024-09-13T23:06:09.026 INFO:tasks.workunit.client.0.smithi115.stdout:2/307: unlink da/d21/f5e 0 2024-09-13T23:06:09.027 INFO:tasks.workunit.client.0.smithi115.stdout:7/252: write da/dd/d1c/f22 [3265150,27548] 0 2024-09-13T23:06:09.027 INFO:tasks.workunit.client.0.smithi115.stdout:7/253: dread - da/dd/d16/d29/f55 zero size 2024-09-13T23:06:09.030 INFO:tasks.workunit.client.0.smithi115.stdout:7/254: symlink da/l5d 0 2024-09-13T23:06:09.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/308: rename da/d23/d32/d56/l1e to da/d23/d32/d56/d1a/l68 0 2024-09-13T23:06:09.033 INFO:tasks.workunit.client.0.smithi115.stdout:6/387: write d4/df/d14/d38/d2a/d3e/f4c [797756,59307] 0 2024-09-13T23:06:09.034 INFO:tasks.workunit.client.0.smithi115.stdout:7/255: rmdir da/dd/d13/d36 39 2024-09-13T23:06:09.035 INFO:tasks.workunit.client.0.smithi115.stdout:2/309: rmdir da/d23 39 2024-09-13T23:06:09.036 INFO:tasks.workunit.client.0.smithi115.stdout:6/388: mkdir d4/df/d14/d67/d77 0 2024-09-13T23:06:09.037 INFO:tasks.workunit.client.0.smithi115.stdout:0/305: sync 2024-09-13T23:06:09.037 INFO:tasks.workunit.client.0.smithi115.stdout:7/256: mknod da/d53/c5e 0 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:9/262: sync 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:5/255: sync 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:4/387: sync 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/349: sync 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/350: truncate d3/f7c 611775 0 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:4/388: chown db/d16/c2d 53259 1 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/351: fdatasync d3/d16/d1a/d29/d49/f7d 0 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/352: write d3/d5/d35/d71/f4b [630119,122095] 0 2024-09-13T23:06:09.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/353: read - d3/d5/db/f40 zero size 2024-09-13T23:06:09.040 INFO:tasks.workunit.client.0.smithi115.stdout:8/280: rmdir d3/d5/dc/d16/d1f/d27/d58 0 2024-09-13T23:06:09.040 INFO:tasks.workunit.client.0.smithi115.stdout:6/389: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:09.040 INFO:tasks.workunit.client.0.smithi115.stdout:1/309: dwrite d0/de/f60 [0,4194304] 0 2024-09-13T23:06:09.042 INFO:tasks.workunit.client.0.smithi115.stdout:0/306: creat d6/d24/d25/d58/d5b/f67 x:0 0 0 2024-09-13T23:06:09.044 INFO:tasks.workunit.client.0.smithi115.stdout:5/256: getdents d8 0 2024-09-13T23:06:09.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/263: mknod d0/d13/d3b/d42/c58 0 2024-09-13T23:06:09.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/264: truncate d0/d13/d17/d1f/d28/f38 325631 0 2024-09-13T23:06:09.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/265: getdents d0/d43/d53 0 2024-09-13T23:06:09.048 INFO:tasks.workunit.client.0.smithi115.stdout:4/389: mkdir db/d16/d3f/d66/d68/d6a 0 2024-09-13T23:06:09.048 INFO:tasks.workunit.client.0.smithi115.stdout:4/390: chown db/d16/d3f/l61 34026985 1 2024-09-13T23:06:09.048 INFO:tasks.workunit.client.0.smithi115.stdout:4/391: write db/f56 [578581,45238] 0 2024-09-13T23:06:09.048 INFO:tasks.workunit.client.0.smithi115.stdout:4/392: fdatasync db/f10 0 2024-09-13T23:06:09.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:08 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:09.049 INFO:tasks.workunit.client.0.smithi115.stdout:3/354: mkdir d3/d5/d35/d71/d3b/d47/d28/d81 0 2024-09-13T23:06:09.049 INFO:tasks.workunit.client.0.smithi115.stdout:4/393: dread db/d11/d54/f38 [0,4194304] 0 2024-09-13T23:06:09.050 INFO:tasks.workunit.client.0.smithi115.stdout:3/355: chown d3/d5/d35/f50 219459780 1 2024-09-13T23:06:09.051 INFO:tasks.workunit.client.0.smithi115.stdout:8/281: truncate d3/d5/dc/f4c 2344680 0 2024-09-13T23:06:09.051 INFO:tasks.workunit.client.0.smithi115.stdout:8/282: chown d3/d5/dc/d16/d1f/d27/f60 3541300 1 2024-09-13T23:06:09.054 INFO:tasks.workunit.client.0.smithi115.stdout:6/390: link d4/d57/d5a/l64 d4/d57/d5a/l78 0 2024-09-13T23:06:09.055 INFO:tasks.workunit.client.0.smithi115.stdout:7/257: dwrite da/fc [4194304,4194304] 0 2024-09-13T23:06:09.055 INFO:tasks.workunit.client.0.smithi115.stdout:7/258: write da/dd/d1c/f27 [1387028,122196] 0 2024-09-13T23:06:09.058 INFO:tasks.workunit.client.0.smithi115.stdout:9/266: rmdir d0/d13/d17/d1f/d35 39 2024-09-13T23:06:09.058 INFO:tasks.workunit.client.0.smithi115.stdout:3/356: dread d3/d5/d35/d71/d45/d59/f5a [0,4194304] 0 2024-09-13T23:06:09.060 INFO:tasks.workunit.client.0.smithi115.stdout:4/394: mknod db/d16/d3f/d66/d68/c6b 0 2024-09-13T23:06:09.060 INFO:tasks.workunit.client.0.smithi115.stdout:6/391: mkdir d4/d57/d5a/d79 0 2024-09-13T23:06:09.061 INFO:tasks.workunit.client.0.smithi115.stdout:2/310: rename da/d23/d49 to da/d21/d2d/d66/d41/d69 0 2024-09-13T23:06:09.064 INFO:tasks.workunit.client.0.smithi115.stdout:1/310: rename d0/de/d1a/d29/f52 to d0/de/d1a/f61 0 2024-09-13T23:06:09.064 INFO:tasks.workunit.client.0.smithi115.stdout:1/311: fsync d0/de/d1b/f35 0 2024-09-13T23:06:09.064 INFO:tasks.workunit.client.0.smithi115.stdout:1/312: fsync d0/de/f34 0 2024-09-13T23:06:09.066 INFO:tasks.workunit.client.0.smithi115.stdout:2/311: dread da/d21/f33 [0,4194304] 0 2024-09-13T23:06:09.067 INFO:tasks.workunit.client.0.smithi115.stdout:0/307: dwrite d6/d24/f3b [0,4194304] 0 2024-09-13T23:06:09.069 INFO:tasks.workunit.client.0.smithi115.stdout:6/392: getdents d4/df/d14/d38/d2a/d3e 0 2024-09-13T23:06:09.071 INFO:tasks.workunit.client.0.smithi115.stdout:8/283: rename d3/d5/dc/d16/c19 to d3/d5/dc/d16/d1f/d28/d3e/c66 0 2024-09-13T23:06:09.072 INFO:tasks.workunit.client.0.smithi115.stdout:2/312: dread da/d23/f38 [0,4194304] 0 2024-09-13T23:06:09.072 INFO:tasks.workunit.client.0.smithi115.stdout:2/313: readlink da/d23/l5a 0 2024-09-13T23:06:09.074 INFO:tasks.workunit.client.0.smithi115.stdout:5/257: dwrite d8/dd/d20/d35/f45 [0,4194304] 0 2024-09-13T23:06:09.077 INFO:tasks.workunit.client.0.smithi115.stdout:9/267: rename d0/f3f to d0/d43/d53/f59 0 2024-09-13T23:06:09.077 INFO:tasks.workunit.client.0.smithi115.stdout:9/268: fdatasync d0/d13/d17/d19/f1d 0 2024-09-13T23:06:09.078 INFO:tasks.workunit.client.0.smithi115.stdout:9/269: fdatasync d0/d13/d17/d36/f46 0 2024-09-13T23:06:09.078 INFO:tasks.workunit.client.0.smithi115.stdout:9/270: creat d0/d13/d17/d1f/d28/f5a x:0 0 0 2024-09-13T23:06:09.078 INFO:tasks.workunit.client.0.smithi115.stdout:9/271: fdatasync d0/d13/d17/f39 0 2024-09-13T23:06:09.079 INFO:tasks.workunit.client.0.smithi115.stdout:9/272: write d0/d13/d17/d1f/d28/f5a [1023738,129982] 0 2024-09-13T23:06:09.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/259: dread da/df/f28 [0,4194304] 0 2024-09-13T23:06:09.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/260: chown da/dd/d1c/d2d/d45/d4d/d5b 227504 1 2024-09-13T23:06:09.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/261: write da/f10 [441043,75476] 0 2024-09-13T23:06:09.081 INFO:tasks.workunit.client.0.smithi115.stdout:4/395: rmdir db 39 2024-09-13T23:06:09.081 INFO:tasks.workunit.client.0.smithi115.stdout:4/396: fdatasync db/d11/d2e/d35/f3e 0 2024-09-13T23:06:09.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/258: stat d8/dd/l3d 0 2024-09-13T23:06:09.086 INFO:tasks.workunit.client.0.smithi115.stdout:6/393: rmdir d4 39 2024-09-13T23:06:09.087 INFO:tasks.workunit.client.0.smithi115.stdout:9/273: dread d0/d13/d17/f1e [4194304,4194304] 0 2024-09-13T23:06:09.087 INFO:tasks.workunit.client.0.smithi115.stdout:3/357: rename d3/d5/l15 to d3/d5/d35/d71/d45/d59/l82 0 2024-09-13T23:06:09.089 INFO:tasks.workunit.client.0.smithi115.stdout:7/262: unlink da/l58 0 2024-09-13T23:06:09.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/314: rmdir da/d21/d2d 39 2024-09-13T23:06:09.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/315: read - da/d23/d32/d56/d1a/f2f zero size 2024-09-13T23:06:09.091 INFO:tasks.workunit.client.0.smithi115.stdout:2/316: fdatasync da/d21/f5f 0 2024-09-13T23:06:09.093 INFO:tasks.workunit.client.0.smithi115.stdout:4/397: creat db/d16/d3f/f6c x:0 0 0 2024-09-13T23:06:09.093 INFO:tasks.workunit.client.0.smithi115.stdout:4/398: read db/d11/d54/f38 [223261,34555] 0 2024-09-13T23:06:09.093 INFO:tasks.workunit.client.0.smithi115.stdout:9/274: creat d0/f5b x:0 0 0 2024-09-13T23:06:09.096 INFO:tasks.workunit.client.0.smithi115.stdout:5/259: rename d8/dd/ce to d8/dd/d20/d4a/c4b 0 2024-09-13T23:06:09.096 INFO:tasks.workunit.client.0.smithi115.stdout:2/317: rename da/d23/d32 to da/d23/d32/d48/d6a 22 2024-09-13T23:06:09.096 INFO:tasks.workunit.client.0.smithi115.stdout:3/358: creat d3/d16/d1a/d1e/d76/f83 x:0 0 0 2024-09-13T23:06:09.097 INFO:tasks.workunit.client.0.smithi115.stdout:9/275: symlink d0/d13/d3b/l5c 0 2024-09-13T23:06:09.098 INFO:tasks.workunit.client.0.smithi115.stdout:5/260: mkdir d8/dd/d4c 0 2024-09-13T23:06:09.099 INFO:tasks.workunit.client.0.smithi115.stdout:3/359: rmdir d3/d5/d35/d71 39 2024-09-13T23:06:09.099 INFO:tasks.workunit.client.0.smithi115.stdout:3/360: read - d3/d5/d35/d71/d3b/d47/d28/f79 zero size 2024-09-13T23:06:09.099 INFO:tasks.workunit.client.0.smithi115.stdout:3/361: chown d3/f1b 5658 1 2024-09-13T23:06:09.100 INFO:tasks.workunit.client.0.smithi115.stdout:5/261: dread d8/dd/d14/f37 [0,4194304] 0 2024-09-13T23:06:09.100 INFO:tasks.workunit.client.0.smithi115.stdout:9/276: rename d0/d13/f1c to d0/d13/d17/d1f/d4e/f5d 0 2024-09-13T23:06:09.101 INFO:tasks.workunit.client.0.smithi115.stdout:3/362: mkdir d3/d16/d84 0 2024-09-13T23:06:09.101 INFO:tasks.workunit.client.0.smithi115.stdout:5/262: symlink d8/dd/d4c/l4d 0 2024-09-13T23:06:09.101 INFO:tasks.workunit.client.0.smithi115.stdout:3/363: mknod d3/d16/d1a/c85 0 2024-09-13T23:06:09.103 INFO:tasks.workunit.client.0.smithi115.stdout:3/364: creat d3/d5/d35/d71/d3b/d47/f86 x:0 0 0 2024-09-13T23:06:09.104 INFO:tasks.workunit.client.0.smithi115.stdout:5/263: getdents d8/dd/d20/d23 0 2024-09-13T23:06:09.106 INFO:tasks.workunit.client.0.smithi115.stdout:8/284: dwrite d3/d5/dc/d16/d1f/d28/f55 [4194304,4194304] 0 2024-09-13T23:06:09.106 INFO:tasks.workunit.client.0.smithi115.stdout:8/285: write d3/d5/dc/d16/d1f/f52 [1025834,125726] 0 2024-09-13T23:06:09.106 INFO:tasks.workunit.client.0.smithi115.stdout:3/365: unlink d3/d5/d35/d71/d3b/f4a 0 2024-09-13T23:06:09.106 INFO:tasks.workunit.client.0.smithi115.stdout:3/366: chown d3/d5/d35/l54 85540674 1 2024-09-13T23:06:09.108 INFO:tasks.workunit.client.0.smithi115.stdout:5/264: unlink d8/dd/d14/f1e 0 2024-09-13T23:06:09.108 INFO:tasks.workunit.client.0.smithi115.stdout:5/265: creat d8/dd/d14/f4e x:0 0 0 2024-09-13T23:06:09.111 INFO:tasks.workunit.client.0.smithi115.stdout:8/286: creat d3/d5/dc/d23/d4e/f67 x:0 0 0 2024-09-13T23:06:09.111 INFO:tasks.workunit.client.0.smithi115.stdout:8/287: truncate d3/d5/dc/f35 354036 0 2024-09-13T23:06:09.111 INFO:tasks.workunit.client.0.smithi115.stdout:8/288: chown d3/d5/dc/f32 14 1 2024-09-13T23:06:09.112 INFO:tasks.workunit.client.0.smithi115.stdout:3/367: truncate d3/d16/d1c/f38 120034 0 2024-09-13T23:06:09.115 INFO:tasks.workunit.client.0.smithi115.stdout:0/308: dwrite d6/d24/d25/d2b/d32/d44/f5d [0,4194304] 0 2024-09-13T23:06:09.115 INFO:tasks.workunit.client.0.smithi115.stdout:1/313: dwrite d0/de/d1a/d29/f4e [0,4194304] 0 2024-09-13T23:06:09.117 INFO:tasks.workunit.client.0.smithi115.stdout:6/394: dwrite d4/df/f74 [0,4194304] 0 2024-09-13T23:06:09.117 INFO:tasks.workunit.client.0.smithi115.stdout:5/266: rename d8/f1f to d8/dd/d20/d4a/f4f 0 2024-09-13T23:06:09.117 INFO:tasks.workunit.client.0.smithi115.stdout:2/318: dwrite da/d23/f38 [0,4194304] 0 2024-09-13T23:06:09.117 INFO:tasks.workunit.client.0.smithi115.stdout:2/319: readlink da/d23/d32/d56/d1a/l68 0 2024-09-13T23:06:09.117 INFO:tasks.workunit.client.0.smithi115.stdout:2/320: fsync da/f11 0 2024-09-13T23:06:09.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/309: dread d6/d24/d25/d2b/d32/d44/f55 [0,4194304] 0 2024-09-13T23:06:09.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/310: getdents d6/d24/d25/d2b/d32/d44/d5c 0 2024-09-13T23:06:09.124 INFO:tasks.workunit.client.0.smithi115.stdout:6/395: creat d4/df/d14/d67/f7a x:0 0 0 2024-09-13T23:06:09.127 INFO:tasks.workunit.client.0.smithi115.stdout:3/368: dread d3/d5/d35/d71/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:09.133 INFO:tasks.workunit.client.0.smithi115.stdout:0/311: truncate d6/f4d 611461 0 2024-09-13T23:06:09.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/396: rename d4/df/d3a to d4/df/d14/d38/d2a/d3e/d56/d7b 0 2024-09-13T23:06:09.136 INFO:tasks.workunit.client.0.smithi115.stdout:1/314: dread d0/de/d1a/d29/f4e [0,4194304] 0 2024-09-13T23:06:09.136 INFO:tasks.workunit.client.0.smithi115.stdout:9/277: dwrite d0/fd [0,4194304] 0 2024-09-13T23:06:09.136 INFO:tasks.workunit.client.0.smithi115.stdout:3/369: mknod d3/d5/d35/d71/d42/c87 0 2024-09-13T23:06:09.137 INFO:tasks.workunit.client.0.smithi115.stdout:2/321: symlink da/d23/d32/d56/d1a/l6b 0 2024-09-13T23:06:09.139 INFO:tasks.workunit.client.0.smithi115.stdout:0/312: symlink d6/d24/d25/d2b/d32/l68 0 2024-09-13T23:06:09.140 INFO:tasks.workunit.client.0.smithi115.stdout:6/397: mknod d4/df/d14/d38/d44/d66/c7c 0 2024-09-13T23:06:09.140 INFO:tasks.workunit.client.0.smithi115.stdout:6/398: fdatasync d4/df/d14/d35/f39 0 2024-09-13T23:06:09.141 INFO:tasks.workunit.client.0.smithi115.stdout:9/278: unlink d0/d13/d3b/l5c 0 2024-09-13T23:06:09.143 INFO:tasks.workunit.client.0.smithi115.stdout:3/370: unlink d3/d5/d35/d71/c3c 0 2024-09-13T23:06:09.145 INFO:tasks.workunit.client.0.smithi115.stdout:2/322: symlink da/d21/d2d/d66/d41/d62/l6c 0 2024-09-13T23:06:09.145 INFO:tasks.workunit.client.0.smithi115.stdout:2/323: chown da/d23/d32/d53 20871 1 2024-09-13T23:06:09.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/315: write d0/de/f46 [2939243,21039] 0 2024-09-13T23:06:09.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/289: dwrite d3/d5/f3d [0,4194304] 0 2024-09-13T23:06:09.147 INFO:tasks.workunit.client.0.smithi115.stdout:9/279: unlink d0/d13/c24 0 2024-09-13T23:06:09.147 INFO:tasks.workunit.client.0.smithi115.stdout:9/280: chown d0/d13/d17/d19/l1a 53441 1 2024-09-13T23:06:09.148 INFO:tasks.workunit.client.0.smithi115.stdout:3/371: rename d3/c3a to d3/d5/d35/d71/d45/d59/c88 0 2024-09-13T23:06:09.149 INFO:tasks.workunit.client.0.smithi115.stdout:3/372: write d3/d5/d35/d71/d45/d59/f5a [2259872,106009] 0 2024-09-13T23:06:09.149 INFO:tasks.workunit.client.0.smithi115.stdout:7/263: dwrite da/dd/d1c/f27 [0,4194304] 0 2024-09-13T23:06:09.149 INFO:tasks.workunit.client.0.smithi115.stdout:6/399: dread d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [0,4194304] 0 2024-09-13T23:06:09.150 INFO:tasks.workunit.client.0.smithi115.stdout:2/324: link da/d21/d2d/d66/l1b da/l6d 0 2024-09-13T23:06:09.150 INFO:tasks.workunit.client.0.smithi115.stdout:0/313: write d6/d24/f49 [1421951,42879] 0 2024-09-13T23:06:09.151 INFO:tasks.workunit.client.0.smithi115.stdout:1/316: mkdir d0/de/d62 0 2024-09-13T23:06:09.151 INFO:tasks.workunit.client.0.smithi115.stdout:0/314: dread d6/d24/d25/d2b/d32/d44/f66 [0,4194304] 0 2024-09-13T23:06:09.153 INFO:tasks.workunit.client.0.smithi115.stdout:8/290: mkdir d3/d5/dc/d16/d1f/d27/d68 0 2024-09-13T23:06:09.154 INFO:tasks.workunit.client.0.smithi115.stdout:8/291: truncate d3/d5/dc/d16/d1f/d27/f48 30025 0 2024-09-13T23:06:09.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/373: mknod d3/d5/d35/d71/c89 0 2024-09-13T23:06:09.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/374: write d3/d5/d35/d71/d3b/d47/f39 [359278,75415] 0 2024-09-13T23:06:09.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/375: truncate d3/d16/d1a/d29/d49/f67 764074 0 2024-09-13T23:06:09.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/376: fsync d3/d5/d35/d71/d3b/d4d/f74 0 2024-09-13T23:06:09.157 INFO:tasks.workunit.client.0.smithi115.stdout:9/281: dread d0/fd [0,4194304] 0 2024-09-13T23:06:09.157 INFO:tasks.workunit.client.0.smithi115.stdout:6/400: mknod d4/df/d14/d76/c7d 0 2024-09-13T23:06:09.157 INFO:tasks.workunit.client.0.smithi115.stdout:6/401: chown d4/df/l5d 84282004 1 2024-09-13T23:06:09.159 INFO:tasks.workunit.client.0.smithi115.stdout:6/402: dread d4/df/d14/d38/f5e [0,4194304] 0 2024-09-13T23:06:09.160 INFO:tasks.workunit.client.0.smithi115.stdout:2/325: creat da/d21/d2d/f6e x:0 0 0 2024-09-13T23:06:09.163 INFO:tasks.workunit.client.0.smithi115.stdout:0/315: rename d6/d24/d25/d2b/d32/f50 to d6/d24/d25/d2b/d61/f69 0 2024-09-13T23:06:09.165 INFO:tasks.workunit.client.0.smithi115.stdout:8/292: link d3/d5/dc/d16/d1f/d27/l5c d3/d5/dc/d23/l69 0 2024-09-13T23:06:09.166 INFO:tasks.workunit.client.0.smithi115.stdout:3/377: getdents d3/d5/d35/d71/d3b/d4d 0 2024-09-13T23:06:09.167 INFO:tasks.workunit.client.0.smithi115.stdout:6/403: symlink d4/df/d14/l7e 0 2024-09-13T23:06:09.168 INFO:tasks.workunit.client.0.smithi115.stdout:2/326: rmdir da/d21/d2d/d66/d41 39 2024-09-13T23:06:09.169 INFO:tasks.workunit.client.0.smithi115.stdout:6/404: write d4/df/f1f [854939,85484] 0 2024-09-13T23:06:09.171 INFO:tasks.workunit.client.0.smithi115.stdout:9/282: rename d0/d13/d17/d1f/d28/c29 to d0/d13/d3b/c5e 0 2024-09-13T23:06:09.171 INFO:tasks.workunit.client.0.smithi115.stdout:9/283: fsync d0/d13/d17/d1f/d28/f5a 0 2024-09-13T23:06:09.172 INFO:tasks.workunit.client.0.smithi115.stdout:9/284: dread d0/d13/d17/d1f/d28/f38 [0,4194304] 0 2024-09-13T23:06:09.172 INFO:tasks.workunit.client.0.smithi115.stdout:9/285: dread - d0/f5b zero size 2024-09-13T23:06:09.173 INFO:tasks.workunit.client.0.smithi115.stdout:9/286: dread - d0/f5b zero size 2024-09-13T23:06:09.173 INFO:tasks.workunit.client.0.smithi115.stdout:0/316: symlink d6/d24/d25/d2b/d32/l6a 0 2024-09-13T23:06:09.177 INFO:tasks.workunit.client.0.smithi115.stdout:3/378: link d3/d5/d35/d71/d45/d59/l82 d3/d16/d1c/l8a 0 2024-09-13T23:06:09.177 INFO:tasks.workunit.client.0.smithi115.stdout:3/379: readlink d3/d16/d1a/d1e/l51 0 2024-09-13T23:06:09.177 INFO:tasks.workunit.client.0.smithi115.stdout:3/380: chown d3/d5/d35/d71/d45/d59/f5a 56 1 2024-09-13T23:06:09.178 INFO:tasks.workunit.client.0.smithi115.stdout:6/405: truncate d4/df/d14/d38/d2a/d31/f6a 397563 0 2024-09-13T23:06:09.178 INFO:tasks.workunit.client.0.smithi115.stdout:7/264: dwrite da/df/f28 [0,4194304] 0 2024-09-13T23:06:09.182 INFO:tasks.workunit.client.0.smithi115.stdout:9/287: symlink d0/d13/d17/d1f/d28/l5f 0 2024-09-13T23:06:09.182 INFO:tasks.workunit.client.0.smithi115.stdout:0/317: mkdir d6/d24/d25/d2b/d32/d6b 0 2024-09-13T23:06:09.182 INFO:tasks.workunit.client.0.smithi115.stdout:0/318: fsync d6/d24/d25/f2c 0 2024-09-13T23:06:09.182 INFO:tasks.workunit.client.0.smithi115.stdout:1/317: dwrite d0/de/d1b/f4a [0,4194304] 0 2024-09-13T23:06:09.183 INFO:tasks.workunit.client.0.smithi115.stdout:3/381: symlink d3/d5/d35/d71/d3b/d4d/l8b 0 2024-09-13T23:06:09.183 INFO:tasks.workunit.client.0.smithi115.stdout:3/382: creat d3/d16/d1a/d29/f8c x:0 0 0 2024-09-13T23:06:09.188 INFO:tasks.workunit.client.0.smithi115.stdout:3/383: dread d3/d5/d35/d71/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:09.188 INFO:tasks.workunit.client.0.smithi115.stdout:3/384: fsync d3/d16/d1a/d29/d49/f67 0 2024-09-13T23:06:09.189 INFO:tasks.workunit.client.0.smithi115.stdout:9/288: dread d0/d13/d17/d1f/d28/f3e [0,4194304] 0 2024-09-13T23:06:09.190 INFO:tasks.workunit.client.0.smithi115.stdout:3/385: mkdir d3/d5/d35/d71/d3b/d4d/d8d 0 2024-09-13T23:06:09.191 INFO:tasks.workunit.client.0.smithi115.stdout:7/265: dread da/fc [0,4194304] 0 2024-09-13T23:06:09.194 INFO:tasks.workunit.client.0.smithi115.stdout:7/266: creat da/dd/d1c/d2d/d45/f5f x:0 0 0 2024-09-13T23:06:09.199 INFO:tasks.workunit.client.0.smithi115.stdout:2/327: dwrite da/d23/d2c/f3d [0,4194304] 0 2024-09-13T23:06:09.205 INFO:tasks.workunit.client.0.smithi115.stdout:8/293: dwrite d3/d5/dc/f2b [0,4194304] 0 2024-09-13T23:06:09.205 INFO:tasks.workunit.client.0.smithi115.stdout:8/294: chown d3/c18 44949102 1 2024-09-13T23:06:09.205 INFO:tasks.workunit.client.0.smithi115.stdout:9/289: dread d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:09.205 INFO:tasks.workunit.client.0.smithi115.stdout:9/290: chown d0/d13/d17/d19 8 1 2024-09-13T23:06:09.210 INFO:tasks.workunit.client.0.smithi115.stdout:0/319: dwrite d6/d24/d25/d2b/d32/d44/f46 [0,4194304] 0 2024-09-13T23:06:09.212 INFO:tasks.workunit.client.0.smithi115.stdout:9/291: getdents d0/d13/d17/d19 0 2024-09-13T23:06:09.213 INFO:tasks.workunit.client.0.smithi115.stdout:2/328: dread da/d23/d2c/f2e [0,4194304] 0 2024-09-13T23:06:09.215 INFO:tasks.workunit.client.0.smithi115.stdout:0/320: unlink d6/d24/d25/c4f 0 2024-09-13T23:06:09.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:08 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:09.220 INFO:tasks.workunit.client.0.smithi115.stdout:9/292: truncate d0/d13/d17/d19/f1d 6013996 0 2024-09-13T23:06:09.222 INFO:tasks.workunit.client.0.smithi115.stdout:2/329: creat da/d23/d32/d53/f6f x:0 0 0 2024-09-13T23:06:09.222 INFO:tasks.workunit.client.0.smithi115.stdout:2/330: chown c5 60 1 2024-09-13T23:06:09.222 INFO:tasks.workunit.client.0.smithi115.stdout:2/331: dread - da/d21/d2d/f65 zero size 2024-09-13T23:06:09.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/293: creat d0/d13/d17/d1f/d35/f60 x:0 0 0 2024-09-13T23:06:09.225 INFO:tasks.workunit.client.0.smithi115.stdout:0/321: dread d6/d24/d25/d2b/d32/d44/f4b [0,4194304] 0 2024-09-13T23:06:09.226 INFO:tasks.workunit.client.0.smithi115.stdout:8/295: rmdir d3/d5/dc/d16 39 2024-09-13T23:06:09.228 INFO:tasks.workunit.client.0.smithi115.stdout:9/294: dread d0/d43/d53/f59 [0,4194304] 0 2024-09-13T23:06:09.228 INFO:tasks.workunit.client.0.smithi115.stdout:0/322: creat d6/d24/d25/d2b/d32/d44/d5c/f6c x:0 0 0 2024-09-13T23:06:09.230 INFO:tasks.workunit.client.0.smithi115.stdout:1/318: dwrite d0/de/f60 [0,4194304] 0 2024-09-13T23:06:09.230 INFO:tasks.workunit.client.0.smithi115.stdout:1/319: readlink d0/de/d1b/d25/d4d/d51/l58 0 2024-09-13T23:06:09.230 INFO:tasks.workunit.client.0.smithi115.stdout:3/386: dwrite d3/d5/d35/d71/f44 [0,4194304] 0 2024-09-13T23:06:09.230 INFO:tasks.workunit.client.0.smithi115.stdout:8/296: mkdir d3/d5/d6a 0 2024-09-13T23:06:09.231 INFO:tasks.workunit.client.0.smithi115.stdout:7/267: dwrite da/dd/f59 [0,4194304] 0 2024-09-13T23:06:09.231 INFO:tasks.workunit.client.0.smithi115.stdout:7/268: write da/dd/d13/d36/f42 [238369,35654] 0 2024-09-13T23:06:09.233 INFO:tasks.workunit.client.0.smithi115.stdout:0/323: rename d6/d24/d25/d2b/f5e to d6/d24/d25/f6d 0 2024-09-13T23:06:09.233 INFO:tasks.workunit.client.0.smithi115.stdout:0/324: chown d6/d62 873207092 1 2024-09-13T23:06:09.233 INFO:tasks.workunit.client.0.smithi115.stdout:0/325: write d6/d24/f63 [695482,64116] 0 2024-09-13T23:06:09.235 INFO:tasks.workunit.client.0.smithi115.stdout:3/387: mkdir d3/d16/d1a/d1e/d8e 0 2024-09-13T23:06:09.238 INFO:tasks.workunit.client.0.smithi115.stdout:7/269: mkdir da/dd/d1c/d2d/d60 0 2024-09-13T23:06:09.239 INFO:tasks.workunit.client.0.smithi115.stdout:0/326: rename d6/d24/d25/d2b/d32/c39 to d6/d24/d25/d2b/d32/d44/d64/c6e 0 2024-09-13T23:06:09.241 INFO:tasks.workunit.client.0.smithi115.stdout:3/388: creat d3/d16/d1a/d1e/d8e/f8f x:0 0 0 2024-09-13T23:06:09.243 INFO:tasks.workunit.client.0.smithi115.stdout:0/327: symlink d6/d24/d25/d2b/d32/d44/l6f 0 2024-09-13T23:06:09.243 INFO:tasks.workunit.client.0.smithi115.stdout:0/328: creat d6/d24/d25/d2b/f70 x:0 0 0 2024-09-13T23:06:09.243 INFO:tasks.workunit.client.0.smithi115.stdout:1/320: getdents d0 0 2024-09-13T23:06:09.245 INFO:tasks.workunit.client.0.smithi115.stdout:3/389: creat d3/d5/d2c/f90 x:0 0 0 2024-09-13T23:06:09.247 INFO:tasks.workunit.client.0.smithi115.stdout:0/329: symlink d6/d24/d25/d2b/d32/d44/l71 0 2024-09-13T23:06:09.247 INFO:tasks.workunit.client.0.smithi115.stdout:0/330: fsync d6/f19 0 2024-09-13T23:06:09.247 INFO:tasks.workunit.client.0.smithi115.stdout:0/331: readlink d6/d24/d25/d2b/d32/d44/l47 0 2024-09-13T23:06:09.248 INFO:tasks.workunit.client.0.smithi115.stdout:1/321: mkdir d0/de/d1a/d29/d47/d63 0 2024-09-13T23:06:09.249 INFO:tasks.workunit.client.0.smithi115.stdout:1/322: link d0/de/d1a/c5e d0/de/d1a/d29/d47/c64 0 2024-09-13T23:06:09.249 INFO:tasks.workunit.client.0.smithi115.stdout:1/323: fsync d0/de/d1a/d29/f2a 0 2024-09-13T23:06:09.251 INFO:tasks.workunit.client.0.smithi115.stdout:1/324: mkdir d0/de/d1b/d25/d4d/d51/d23/d65 0 2024-09-13T23:06:09.253 INFO:tasks.workunit.client.0.smithi115.stdout:4/399: sync 2024-09-13T23:06:09.253 INFO:tasks.workunit.client.0.smithi115.stdout:5/267: sync 2024-09-13T23:06:09.254 INFO:tasks.workunit.client.0.smithi115.stdout:5/268: fsync d8/f9 0 2024-09-13T23:06:09.254 INFO:tasks.workunit.client.0.smithi115.stdout:5/269: creat d8/dd/d14/f50 x:0 0 0 2024-09-13T23:06:09.257 INFO:tasks.workunit.client.0.smithi115.stdout:8/297: dwrite d3/d5/dc/d16/d1f/d27/f60 [0,4194304] 0 2024-09-13T23:06:09.257 INFO:tasks.workunit.client.0.smithi115.stdout:7/270: dwrite da/f10 [0,4194304] 0 2024-09-13T23:06:09.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/270: write d8/f2a [3395178,15331] 0 2024-09-13T23:06:09.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/271: write d8/dd/d20/f1a [3815281,123386] 0 2024-09-13T23:06:09.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/272: write d8/dd/d14/f37 [1195107,19790] 0 2024-09-13T23:06:09.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/273: read d8/f2a [1202401,35365] 0 2024-09-13T23:06:09.259 INFO:tasks.workunit.client.0.smithi115.stdout:2/332: dwrite da/d23/d32/d56/f45 [0,4194304] 0 2024-09-13T23:06:09.259 INFO:tasks.workunit.client.0.smithi115.stdout:4/400: dread db/f10 [0,4194304] 0 2024-09-13T23:06:09.259 INFO:tasks.workunit.client.0.smithi115.stdout:4/401: write db/d11/d2e/d33/f4c [916802,68615] 0 2024-09-13T23:06:09.261 INFO:tasks.workunit.client.0.smithi115.stdout:8/298: mknod d3/d5/dc/d16/d1f/d28/d62/c6b 0 2024-09-13T23:06:09.261 INFO:tasks.workunit.client.0.smithi115.stdout:0/332: dread d6/fd [0,4194304] 0 2024-09-13T23:06:09.263 INFO:tasks.workunit.client.0.smithi115.stdout:7/271: rename da/dd/d13/f2a to da/df/d3b/f61 0 2024-09-13T23:06:09.263 INFO:tasks.workunit.client.0.smithi115.stdout:7/272: creat da/df/d3b/f62 x:0 0 0 2024-09-13T23:06:09.264 INFO:tasks.workunit.client.0.smithi115.stdout:5/274: creat d8/f51 x:0 0 0 2024-09-13T23:06:09.264 INFO:tasks.workunit.client.0.smithi115.stdout:5/275: chown d8/f3c 0 1 2024-09-13T23:06:09.265 INFO:tasks.workunit.client.0.smithi115.stdout:9/295: read d0/d13/d17/d19/f1d [3532050,65027] 0 2024-09-13T23:06:09.266 INFO:tasks.workunit.client.0.smithi115.stdout:1/325: dread d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:09.266 INFO:tasks.workunit.client.0.smithi115.stdout:1/326: stat d0/f6 0 2024-09-13T23:06:09.266 INFO:tasks.workunit.client.0.smithi115.stdout:8/299: read d3/d5/dc/d16/d1f/f22 [74412,22776] 0 2024-09-13T23:06:09.266 INFO:tasks.workunit.client.0.smithi115.stdout:8/300: fsync f2 0 2024-09-13T23:06:09.266 INFO:tasks.workunit.client.0.smithi115.stdout:8/301: write d3/d5/d1d/f26 [141875,77693] 0 2024-09-13T23:06:09.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/402: link db/d11/f52 db/d11/d2e/d33/f6d 0 2024-09-13T23:06:09.271 INFO:tasks.workunit.client.0.smithi115.stdout:0/333: rename d6/f19 to d6/f72 0 2024-09-13T23:06:09.271 INFO:tasks.workunit.client.0.smithi115.stdout:2/333: read da/d23/d2c/f3d [1892012,125088] 0 2024-09-13T23:06:09.271 INFO:tasks.workunit.client.0.smithi115.stdout:3/390: dwrite d3/d5/d35/d71/d3b/d47/f39 [0,4194304] 0 2024-09-13T23:06:09.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/273: symlink da/d53/l63 0 2024-09-13T23:06:09.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/274: truncate da/dd/d16/d29/f55 558579 0 2024-09-13T23:06:09.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/275: fsync da/dd/d1c/f27 0 2024-09-13T23:06:09.273 INFO:tasks.workunit.client.0.smithi115.stdout:5/276: creat d8/dd/d20/f52 x:0 0 0 2024-09-13T23:06:09.275 INFO:tasks.workunit.client.0.smithi115.stdout:9/296: rmdir d0/d13/d17/d36 39 2024-09-13T23:06:09.277 INFO:tasks.workunit.client.0.smithi115.stdout:8/302: symlink d3/d5/d1c/d41/d42/l6c 0 2024-09-13T23:06:09.278 INFO:tasks.workunit.client.0.smithi115.stdout:8/303: dread d3/d5/dc/d16/d1f/d27/f48 [0,4194304] 0 2024-09-13T23:06:09.278 INFO:tasks.workunit.client.0.smithi115.stdout:8/304: fdatasync d3/d5/dc/d16/d1f/f33 0 2024-09-13T23:06:09.279 INFO:tasks.workunit.client.0.smithi115.stdout:8/305: readlink d3/d5/d1d/l24 0 2024-09-13T23:06:09.279 INFO:tasks.workunit.client.0.smithi115.stdout:4/403: symlink db/d11/d54/l6e 0 2024-09-13T23:06:09.281 INFO:tasks.workunit.client.0.smithi115.stdout:9/297: dread d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:09.282 INFO:tasks.workunit.client.0.smithi115.stdout:0/334: write d6/d24/d25/d2b/f2d [4382335,2390] 0 2024-09-13T23:06:09.292 INFO:tasks.workunit.client.0.smithi115.stdout:7/276: rmdir da/dd/d1c/d2d/d45/d4d/d5b 0 2024-09-13T23:06:09.292 INFO:tasks.workunit.client.0.smithi115.stdout:7/277: write da/dd/f59 [4385086,33846] 0 2024-09-13T23:06:09.292 INFO:tasks.workunit.client.0.smithi115.stdout:7/278: fsync da/dd/d1c/d2d/f54 0 2024-09-13T23:06:09.293 INFO:tasks.workunit.client.0.smithi115.stdout:7/279: dread da/dd/d13/f23 [0,4194304] 0 2024-09-13T23:06:09.293 INFO:tasks.workunit.client.0.smithi115.stdout:7/280: dread - da/dd/d1c/d2d/f54 zero size 2024-09-13T23:06:09.293 INFO:tasks.workunit.client.0.smithi115.stdout:7/281: write da/df/d3b/f61 [3145750,23528] 0 2024-09-13T23:06:09.293 INFO:tasks.workunit.client.0.smithi115.stdout:7/282: stat da/f21 0 2024-09-13T23:06:09.293 INFO:tasks.workunit.client.0.smithi115.stdout:5/277: unlink d8/dd/d14/l38 0 2024-09-13T23:06:09.294 INFO:tasks.workunit.client.0.smithi115.stdout:9/298: write d0/fd [3167390,23298] 0 2024-09-13T23:06:09.295 INFO:tasks.workunit.client.0.smithi115.stdout:8/306: symlink d3/d5/d1c/d41/l6d 0 2024-09-13T23:06:09.298 INFO:tasks.workunit.client.0.smithi115.stdout:3/391: rmdir d3/d16/d1a/d1e 39 2024-09-13T23:06:09.298 INFO:tasks.workunit.client.0.smithi115.stdout:1/327: dwrite d0/de/d1b/d25/d4d/d51/f41 [0,4194304] 0 2024-09-13T23:06:09.298 INFO:tasks.workunit.client.0.smithi115.stdout:3/392: creat d3/d5/d35/f91 x:0 0 0 2024-09-13T23:06:09.299 INFO:tasks.workunit.client.0.smithi115.stdout:5/278: mknod d8/dd/d14/c53 0 2024-09-13T23:06:09.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/307: mknod d3/d5/dc/d16/c6e 0 2024-09-13T23:06:09.300 INFO:tasks.workunit.client.0.smithi115.stdout:8/308: creat d3/d5/dc/d23/f6f x:0 0 0 2024-09-13T23:06:09.301 INFO:tasks.workunit.client.0.smithi115.stdout:3/393: unlink d3/d5/d35/d71/d45/d59/f7a 0 2024-09-13T23:06:09.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/328: mkdir d0/de/d66 0 2024-09-13T23:06:09.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/329: chown d0/de/d1b/d25/d4d/d51/d31/d37 1669527 1 2024-09-13T23:06:09.302 INFO:tasks.workunit.client.0.smithi115.stdout:1/330: chown d0/f6 14989613 1 2024-09-13T23:06:09.303 INFO:tasks.workunit.client.0.smithi115.stdout:5/279: mkdir d8/dd/d20/d23/d54 0 2024-09-13T23:06:09.303 INFO:tasks.workunit.client.0.smithi115.stdout:9/299: getdents d0/d13/d17/d1f/d35 0 2024-09-13T23:06:09.303 INFO:tasks.workunit.client.0.smithi115.stdout:9/300: dread - d0/d13/d17/d1f/d35/f60 zero size 2024-09-13T23:06:09.303 INFO:tasks.workunit.client.0.smithi115.stdout:9/301: chown d0/d13/d17/d36/f46 27956987 1 2024-09-13T23:06:09.305 INFO:tasks.workunit.client.0.smithi115.stdout:3/394: symlink d3/d16/d1a/d29/d49/l92 0 2024-09-13T23:06:09.306 INFO:tasks.workunit.client.0.smithi115.stdout:9/302: rmdir d0/d43/d55 0 2024-09-13T23:06:09.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/331: dread d0/de/d1b/d25/d4d/d51/f41 [0,4194304] 0 2024-09-13T23:06:09.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/334: dwrite f4 [0,4194304] 0 2024-09-13T23:06:09.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/335: write da/d23/d32/f4c [283389,105575] 0 2024-09-13T23:06:09.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/336: write da/d21/d2d/d66/f63 [353696,45578] 0 2024-09-13T23:06:09.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/332: mkdir d0/de/d1b/d25/d67 0 2024-09-13T23:06:09.317 INFO:tasks.workunit.client.0.smithi115.stdout:5/280: dread d8/dd/d14/f47 [0,4194304] 0 2024-09-13T23:06:09.319 INFO:tasks.workunit.client.0.smithi115.stdout:2/337: unlink da/d23/d2c/f2e 0 2024-09-13T23:06:09.321 INFO:tasks.workunit.client.0.smithi115.stdout:5/281: rename d8/dd/d14/f4e to d8/dd/d20/d23/f55 0 2024-09-13T23:06:09.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/338: truncate da/d21/f33 3666556 0 2024-09-13T23:06:09.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/339: chown da/d21/d2d 46 1 2024-09-13T23:06:09.322 INFO:tasks.workunit.client.0.smithi115.stdout:2/340: write da/d21/d2d/f6e [885692,81148] 0 2024-09-13T23:06:09.324 INFO:tasks.workunit.client.0.smithi115.stdout:5/282: mknod d8/c56 0 2024-09-13T23:06:09.324 INFO:tasks.workunit.client.0.smithi115.stdout:5/283: chown d8/lc 0 1 2024-09-13T23:06:09.326 INFO:tasks.workunit.client.0.smithi115.stdout:6/406: sync 2024-09-13T23:06:09.326 INFO:tasks.workunit.client.0.smithi115.stdout:2/341: rename da/d21/l31 to da/d21/d2d/d66/d41/l70 0 2024-09-13T23:06:09.326 INFO:tasks.workunit.client.0.smithi115.stdout:2/342: fsync da/d23/d32/d53/f6f 0 2024-09-13T23:06:09.327 INFO:tasks.workunit.client.0.smithi115.stdout:6/407: unlink d4/df/d51/f63 0 2024-09-13T23:06:09.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/343: creat da/d21/d2d/d66/d41/d62/f71 x:0 0 0 2024-09-13T23:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:2/344: creat da/d21/f72 x:0 0 0 2024-09-13T23:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:2/345: chown da/d23/d32/d56/d1a/l6b 786235 1 2024-09-13T23:06:09.329 INFO:tasks.workunit.client.0.smithi115.stdout:7/283: dwrite da/dd/d16/d29/f55 [0,4194304] 0 2024-09-13T23:06:09.330 INFO:tasks.workunit.client.0.smithi115.stdout:6/408: rename d4/df/d14/d38/c20 to d4/df/d14/d38/d44/c7f 0 2024-09-13T23:06:09.331 INFO:tasks.workunit.client.0.smithi115.stdout:7/284: mkdir da/dd/d16/d64 0 2024-09-13T23:06:09.335 INFO:tasks.workunit.client.0.smithi115.stdout:5/284: dread d8/fb [0,4194304] 0 2024-09-13T23:06:09.335 INFO:tasks.workunit.client.0.smithi115.stdout:5/285: chown d8/d36 873 1 2024-09-13T23:06:09.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/285: dread da/df/f2c [0,4194304] 0 2024-09-13T23:06:09.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/286: truncate da/dd/d13/d36/f3a 1041544 0 2024-09-13T23:06:09.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/287: rename da/dd/d13/l4c to da/df/l65 0 2024-09-13T23:06:09.339 INFO:tasks.workunit.client.0.smithi115.stdout:7/288: truncate da/dd/f2e 7062049 0 2024-09-13T23:06:09.339 INFO:tasks.workunit.client.0.smithi115.stdout:7/289: creat da/dd/d13/f66 x:0 0 0 2024-09-13T23:06:09.341 INFO:tasks.workunit.client.0.smithi115.stdout:0/335: dwrite d6/d24/d25/d2b/f70 [0,4194304] 0 2024-09-13T23:06:09.342 INFO:tasks.workunit.client.0.smithi115.stdout:4/404: dwrite db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:09.343 INFO:tasks.workunit.client.0.smithi115.stdout:2/346: read da/d23/f38 [4077884,38552] 0 2024-09-13T23:06:09.343 INFO:tasks.workunit.client.0.smithi115.stdout:2/347: readlink da/d21/l2a 0 2024-09-13T23:06:09.343 INFO:tasks.workunit.client.0.smithi115.stdout:2/348: fdatasync f7 0 2024-09-13T23:06:09.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/395: dwrite d3/d5/d35/f91 [0,4194304] 0 2024-09-13T23:06:09.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/396: read d3/d16/d1a/f57 [2358512,83903] 0 2024-09-13T23:06:09.344 INFO:tasks.workunit.client.0.smithi115.stdout:9/303: dwrite d0/d13/d17/d1f/d35/d40/f52 [0,4194304] 0 2024-09-13T23:06:09.344 INFO:tasks.workunit.client.0.smithi115.stdout:7/290: rename da/dd/d16/d64 to da/dd/d13/d24/d67 0 2024-09-13T23:06:09.348 INFO:tasks.workunit.client.0.smithi115.stdout:1/333: dwrite d0/de/d1b/f35 [0,4194304] 0 2024-09-13T23:06:09.349 INFO:tasks.workunit.client.0.smithi115.stdout:8/309: getdents d3/d5/dc/d16 0 2024-09-13T23:06:09.349 INFO:tasks.workunit.client.0.smithi115.stdout:8/310: readlink d3/d5/dc/d16/d1f/d27/l30 0 2024-09-13T23:06:09.350 INFO:tasks.workunit.client.0.smithi115.stdout:4/405: creat db/d19/d1d/d2a/f6f x:0 0 0 2024-09-13T23:06:09.350 INFO:tasks.workunit.client.0.smithi115.stdout:4/406: fdatasync db/d19/d1d/d2a/f40 0 2024-09-13T23:06:09.356 INFO:tasks.workunit.client.0.smithi115.stdout:2/349: creat da/f73 x:0 0 0 2024-09-13T23:06:09.358 INFO:tasks.workunit.client.0.smithi115.stdout:3/397: rmdir d3/d5/d35/d71/d3b/d47/d28/d81 0 2024-09-13T23:06:09.362 INFO:tasks.workunit.client.0.smithi115.stdout:1/334: dread d0/de/d1a/d29/f39 [0,4194304] 0 2024-09-13T23:06:09.363 INFO:tasks.workunit.client.0.smithi115.stdout:1/335: readlink d0/l56 0 2024-09-13T23:06:09.364 INFO:tasks.workunit.client.0.smithi115.stdout:8/311: mknod d3/d5/d1d/c70 0 2024-09-13T23:06:09.366 INFO:tasks.workunit.client.0.smithi115.stdout:4/407: creat db/d11/f70 x:0 0 0 2024-09-13T23:06:09.366 INFO:tasks.workunit.client.0.smithi115.stdout:4/408: dread - db/d19/d4e/f64 zero size 2024-09-13T23:06:09.367 INFO:tasks.workunit.client.0.smithi115.stdout:2/350: mkdir da/d23/d32/d56/d74 0 2024-09-13T23:06:09.367 INFO:tasks.workunit.client.0.smithi115.stdout:2/351: chown da/d23/d2c/f47 113927349 1 2024-09-13T23:06:09.369 INFO:tasks.workunit.client.0.smithi115.stdout:3/398: rmdir d3/d5/d35/d71/d3b/d47/d28 39 2024-09-13T23:06:09.369 INFO:tasks.workunit.client.0.smithi115.stdout:3/399: chown d3/d16/f19 803 1 2024-09-13T23:06:09.371 INFO:tasks.workunit.client.0.smithi115.stdout:1/336: dread d0/de/d1b/d25/d4d/d51/d23/f2c [0,4194304] 0 2024-09-13T23:06:09.371 INFO:tasks.workunit.client.0.smithi115.stdout:8/312: rename d3/d5/dc/d16/d1f/d27/l5c to d3/d5/dc/d23/d4e/l71 0 2024-09-13T23:06:09.372 INFO:tasks.workunit.client.0.smithi115.stdout:4/409: mkdir db/d16/d3f/d66/d68/d71 0 2024-09-13T23:06:09.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/400: unlink d3/d5/d35/d71/d45/l63 0 2024-09-13T23:06:09.376 INFO:tasks.workunit.client.0.smithi115.stdout:1/337: symlink d0/de/d66/l68 0 2024-09-13T23:06:09.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/336: dwrite d6/f10 [4194304,4194304] 0 2024-09-13T23:06:09.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/337: write d6/d24/f49 [4736025,11849] 0 2024-09-13T23:06:09.379 INFO:tasks.workunit.client.0.smithi115.stdout:8/313: mkdir d3/d5/d1d/d72 0 2024-09-13T23:06:09.379 INFO:tasks.workunit.client.0.smithi115.stdout:5/286: dwrite d8/dd/d20/d4a/f4f [4194304,4194304] 0 2024-09-13T23:06:09.379 INFO:tasks.workunit.client.0.smithi115.stdout:5/287: chown d8/dd/d20/d23/f3f 26636168 1 2024-09-13T23:06:09.380 INFO:tasks.workunit.client.0.smithi115.stdout:7/291: dwrite da/dd/d1c/f20 [4194304,4194304] 0 2024-09-13T23:06:09.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/409: dwrite d4/df/d14/d38/f68 [0,4194304] 0 2024-09-13T23:06:09.381 INFO:tasks.workunit.client.0.smithi115.stdout:6/410: fsync d4/df/d14/d38/d2a/d31/f34 0 2024-09-13T23:06:09.382 INFO:tasks.workunit.client.0.smithi115.stdout:4/410: unlink db/d16/l48 0 2024-09-13T23:06:09.382 INFO:tasks.workunit.client.0.smithi115.stdout:4/411: read - db/d11/d2e/f5d zero size 2024-09-13T23:06:09.382 INFO:tasks.workunit.client.0.smithi115.stdout:6/411: write d4/df/f28 [11007,43221] 0 2024-09-13T23:06:09.382 INFO:tasks.workunit.client.0.smithi115.stdout:4/412: write db/d16/d3f/f67 [585365,102255] 0 2024-09-13T23:06:09.382 INFO:tasks.workunit.client.0.smithi115.stdout:1/338: mkdir d0/dd/d69 0 2024-09-13T23:06:09.384 INFO:tasks.workunit.client.0.smithi115.stdout:0/338: unlink d6/d24/d25/d2b/f2d 0 2024-09-13T23:06:09.389 INFO:tasks.workunit.client.0.smithi115.stdout:8/314: mknod d3/d5/dc/d23/c73 0 2024-09-13T23:06:09.389 INFO:tasks.workunit.client.0.smithi115.stdout:8/315: chown d3/d5/dc 3 1 2024-09-13T23:06:09.392 INFO:tasks.workunit.client.0.smithi115.stdout:7/292: symlink da/dd/d1c/d2d/d45/d4d/l68 0 2024-09-13T23:06:09.393 INFO:tasks.workunit.client.0.smithi115.stdout:6/412: symlink d4/df/d14/d38/d2a/d3e/d56/d7b/l80 0 2024-09-13T23:06:09.399 INFO:tasks.workunit.client.0.smithi115.stdout:1/339: mkdir d0/de/d1a/d29/d47/d6a 0 2024-09-13T23:06:09.406 INFO:tasks.workunit.client.0.smithi115.stdout:0/339: write d6/d24/f3b [1100561,126156] 0 2024-09-13T23:06:09.406 INFO:tasks.workunit.client.0.smithi115.stdout:8/316: rename d3/d5/dc/d16/d1f/d27/f45 to d3/d5/d1c/d41/d42/d4d/f74 0 2024-09-13T23:06:09.406 INFO:tasks.workunit.client.0.smithi115.stdout:8/317: chown d3/d5/d1c/d41/d42/f14 62698406 1 2024-09-13T23:06:09.407 INFO:tasks.workunit.client.0.smithi115.stdout:1/340: creat d0/de/d1a/d29/d47/d63/f6b x:0 0 0 2024-09-13T23:06:09.407 INFO:tasks.workunit.client.0.smithi115.stdout:7/293: dread da/df/f28 [0,4194304] 0 2024-09-13T23:06:09.409 INFO:tasks.workunit.client.0.smithi115.stdout:0/340: unlink d6/d24/d25/f2c 0 2024-09-13T23:06:09.410 INFO:tasks.workunit.client.0.smithi115.stdout:2/352: dwrite f4 [0,4194304] 0 2024-09-13T23:06:09.413 INFO:tasks.workunit.client.0.smithi115.stdout:0/341: truncate d6/d24/d25/d2b/d32/d44/f66 2527051 0 2024-09-13T23:06:09.414 INFO:tasks.workunit.client.0.smithi115.stdout:2/353: symlink da/d23/d32/d48/l75 0 2024-09-13T23:06:09.418 INFO:tasks.workunit.client.0.smithi115.stdout:0/342: mknod d6/d24/d25/d58/d5b/c73 0 2024-09-13T23:06:09.418 INFO:tasks.workunit.client.0.smithi115.stdout:3/401: dwrite d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:09.419 INFO:tasks.workunit.client.0.smithi115.stdout:0/343: symlink d6/d24/d25/d2b/d61/l74 0 2024-09-13T23:06:09.419 INFO:tasks.workunit.client.0.smithi115.stdout:0/344: truncate f2 12868859 0 2024-09-13T23:06:09.419 INFO:tasks.workunit.client.0.smithi115.stdout:0/345: creat d6/f75 x:0 0 0 2024-09-13T23:06:09.421 INFO:tasks.workunit.client.0.smithi115.stdout:3/402: mknod d3/d16/d1a/d1e/d76/c93 0 2024-09-13T23:06:09.423 INFO:tasks.workunit.client.0.smithi115.stdout:0/346: mknod d6/d24/d25/d58/d5b/c76 0 2024-09-13T23:06:09.424 INFO:tasks.workunit.client.0.smithi115.stdout:4/413: dwrite db/d11/d2e/d35/f5e [8388608,4194304] 0 2024-09-13T23:06:09.426 INFO:tasks.workunit.client.0.smithi115.stdout:6/413: dwrite d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [4194304,4194304] 0 2024-09-13T23:06:09.426 INFO:tasks.workunit.client.0.smithi115.stdout:6/414: chown d4/df/d14/d38/d2a/d3e/d56 183 1 2024-09-13T23:06:09.426 INFO:tasks.workunit.client.0.smithi115.stdout:5/288: dwrite d8/dd/d20/d35/f45 [4194304,4194304] 0 2024-09-13T23:06:09.429 INFO:tasks.workunit.client.0.smithi115.stdout:8/318: dwrite d3/fd [4194304,4194304] 0 2024-09-13T23:06:09.431 INFO:tasks.workunit.client.0.smithi115.stdout:2/354: write da/d23/d32/f3a [2721364,69010] 0 2024-09-13T23:06:09.431 INFO:tasks.workunit.client.0.smithi115.stdout:4/414: write db/f43 [663568,31929] 0 2024-09-13T23:06:09.431 INFO:tasks.workunit.client.0.smithi115.stdout:4/415: creat db/d16/d3f/f72 x:0 0 0 2024-09-13T23:06:09.431 INFO:tasks.workunit.client.0.smithi115.stdout:4/416: fsync db/d11/d54/f38 0 2024-09-13T23:06:09.432 INFO:tasks.workunit.client.0.smithi115.stdout:4/417: dread - db/d16/d3f/f72 zero size 2024-09-13T23:06:09.432 INFO:tasks.workunit.client.0.smithi115.stdout:5/289: unlink d8/dd/d14/f47 0 2024-09-13T23:06:09.432 INFO:tasks.workunit.client.0.smithi115.stdout:5/290: write d8/dd/d20/d4a/f4f [1052233,27012] 0 2024-09-13T23:06:09.432 INFO:tasks.workunit.client.0.smithi115.stdout:5/291: truncate d8/dd/d14/f37 1969380 0 2024-09-13T23:06:09.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/319: creat d3/d5/d6a/f75 x:0 0 0 2024-09-13T23:06:09.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/320: creat d3/d5/f76 x:0 0 0 2024-09-13T23:06:09.441 INFO:tasks.workunit.client.0.smithi115.stdout:5/292: dread d8/fa [0,4194304] 0 2024-09-13T23:06:09.441 INFO:tasks.workunit.client.0.smithi115.stdout:5/293: dread - d8/f51 zero size 2024-09-13T23:06:09.445 INFO:tasks.workunit.client.0.smithi115.stdout:7/294: dwrite da/dd/d1c/d2d/f54 [0,4194304] 0 2024-09-13T23:06:09.445 INFO:tasks.workunit.client.0.smithi115.stdout:3/403: dwrite d3/d5/d35/d71/d3b/d47/f86 [0,4194304] 0 2024-09-13T23:06:09.446 INFO:tasks.workunit.client.0.smithi115.stdout:3/404: dread - d3/d16/d1a/d29/f62 zero size 2024-09-13T23:06:09.446 INFO:tasks.workunit.client.0.smithi115.stdout:3/405: chown d3/d5/d35/d71/d3b/d47/d28/c6a 29985 1 2024-09-13T23:06:09.457 INFO:tasks.workunit.client.0.smithi115.stdout:3/406: mkdir d3/d16/d1a/d1e/d94 0 2024-09-13T23:06:09.457 INFO:tasks.workunit.client.0.smithi115.stdout:3/407: stat d3/d5/d35/d71/d45 0 2024-09-13T23:06:09.457 INFO:tasks.workunit.client.0.smithi115.stdout:3/408: dread - d3/d5/d5b/f68 zero size 2024-09-13T23:06:09.458 INFO:tasks.workunit.client.0.smithi115.stdout:2/355: getdents da/d23/d32 0 2024-09-13T23:06:09.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/409: stat d3/d16/d1c/l8a 0 2024-09-13T23:06:09.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/410: write d3/d16/d1a/d29/d49/f7d [609439,52154] 0 2024-09-13T23:06:09.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/411: chown d3/d16/d1a/d29/f62 33 1 2024-09-13T23:06:09.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/412: chown d3/d16/d84 8165 1 2024-09-13T23:06:09.459 INFO:tasks.workunit.client.0.smithi115.stdout:3/413: write d3/d5/d35/d71/d45/f58 [200379,21375] 0 2024-09-13T23:06:09.460 INFO:tasks.workunit.client.0.smithi115.stdout:0/347: rmdir d6 39 2024-09-13T23:06:09.461 INFO:tasks.workunit.client.0.smithi115.stdout:0/348: chown d6/d24/d25/d2b/d32/d44/f59 25290774 1 2024-09-13T23:06:09.461 INFO:tasks.workunit.client.0.smithi115.stdout:0/349: symlink d6/d62/l77 0 2024-09-13T23:06:09.462 INFO:tasks.workunit.client.0.smithi115.stdout:0/350: rmdir d6/d24/d25 39 2024-09-13T23:06:09.463 INFO:tasks.workunit.client.0.smithi115.stdout:0/351: symlink d6/d24/d25/d2b/d32/d44/d64/l78 0 2024-09-13T23:06:09.475 INFO:tasks.workunit.client.0.smithi115.stdout:2/356: write f4 [198916,118192] 0 2024-09-13T23:06:09.487 INFO:tasks.workunit.client.0.smithi115.stdout:6/415: dwrite d4/df/f2e [0,4194304] 0 2024-09-13T23:06:09.487 INFO:tasks.workunit.client.0.smithi115.stdout:4/418: dwrite db/d16/d3f/f72 [0,4194304] 0 2024-09-13T23:06:09.487 INFO:tasks.workunit.client.0.smithi115.stdout:4/419: stat db/d19/d34/f55 0 2024-09-13T23:06:09.487 INFO:tasks.workunit.client.0.smithi115.stdout:7/295: dwrite da/df/f28 [0,4194304] 0 2024-09-13T23:06:09.488 INFO:tasks.workunit.client.0.smithi115.stdout:8/321: dwrite d3/d5/dc/d16/d1f/d28/f29 [0,4194304] 0 2024-09-13T23:06:09.489 INFO:tasks.workunit.client.0.smithi115.stdout:6/416: dread d4/df/f28 [0,4194304] 0 2024-09-13T23:06:09.490 INFO:tasks.workunit.client.0.smithi115.stdout:7/296: stat da/dd/d16/c31 0 2024-09-13T23:06:09.491 INFO:tasks.workunit.client.0.smithi115.stdout:3/414: dwrite d3/d5/d35/d71/d3b/d47/f86 [0,4194304] 0 2024-09-13T23:06:09.494 INFO:tasks.workunit.client.0.smithi115.stdout:0/352: dwrite d6/d24/f38 [0,4194304] 0 2024-09-13T23:06:09.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/357: dwrite da/d23/f38 [0,4194304] 0 2024-09-13T23:06:09.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/358: dread - da/d21/d2d/d66/d41/f61 zero size 2024-09-13T23:06:09.494 INFO:tasks.workunit.client.0.smithi115.stdout:2/359: write f7 [4906627,6293] 0 2024-09-13T23:06:09.494 INFO:tasks.workunit.client.0.smithi115.stdout:8/322: rename d3/d5/dc/d23/f46 to d3/d5/dc/d23/d4e/f77 0 2024-09-13T23:06:09.495 INFO:tasks.workunit.client.0.smithi115.stdout:6/417: unlink d4/d57/d5a/c73 0 2024-09-13T23:06:09.495 INFO:tasks.workunit.client.0.smithi115.stdout:8/323: read d3/d5/dc/d16/d1f/f52 [268769,75534] 0 2024-09-13T23:06:09.495 INFO:tasks.workunit.client.0.smithi115.stdout:8/324: write d3/d5/dc/d16/d1f/d28/d3e/f51 [2073512,74738] 0 2024-09-13T23:06:09.495 INFO:tasks.workunit.client.0.smithi115.stdout:4/420: rmdir db/d16/d3f 39 2024-09-13T23:06:09.496 INFO:tasks.workunit.client.0.smithi115.stdout:7/297: mknod da/dd/d13/d36/d5a/c69 0 2024-09-13T23:06:09.498 INFO:tasks.workunit.client.0.smithi115.stdout:3/415: mknod d3/d5/d5b/c95 0 2024-09-13T23:06:09.502 INFO:tasks.workunit.client.0.smithi115.stdout:0/353: unlink d6/d24/d25/d2b/d32/l4e 0 2024-09-13T23:06:09.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/360: rename da/d23/d32 to da/d23/d32/d56/d1a/d76 22 2024-09-13T23:06:09.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/361: write da/d23/d32/d56/d1a/f1d [1082641,77898] 0 2024-09-13T23:06:09.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/362: write da/d21/f33 [3082579,40278] 0 2024-09-13T23:06:09.505 INFO:tasks.workunit.client.0.smithi115.stdout:6/418: getdents d4/df/d14/d38/d2a/d3e/d56 0 2024-09-13T23:06:09.507 INFO:tasks.workunit.client.0.smithi115.stdout:6/419: write d4/f3c [140061,14696] 0 2024-09-13T23:06:09.507 INFO:tasks.workunit.client.0.smithi115.stdout:8/325: unlink d3/le 0 2024-09-13T23:06:09.507 INFO:tasks.workunit.client.0.smithi115.stdout:8/326: chown d3/d5/d1d/d72 29488 1 2024-09-13T23:06:09.508 INFO:tasks.workunit.client.0.smithi115.stdout:4/421: link db/d16/d3f/l61 db/d16/d3f/d66/d68/l73 0 2024-09-13T23:06:09.508 INFO:tasks.workunit.client.0.smithi115.stdout:4/422: fsync db/d11/f52 0 2024-09-13T23:06:09.509 INFO:tasks.workunit.client.0.smithi115.stdout:3/416: mknod d3/d5/d5b/c96 0 2024-09-13T23:06:09.509 INFO:tasks.workunit.client.0.smithi115.stdout:3/417: chown d3/d5/d35/d71/d3b/f7e 72375200 1 2024-09-13T23:06:09.509 INFO:tasks.workunit.client.0.smithi115.stdout:3/418: write d3/d5/d35/d71/d3b/d47/d28/f79 [15245,13970] 0 2024-09-13T23:06:09.509 INFO:tasks.workunit.client.0.smithi115.stdout:3/419: fsync d3/d16/d1a/d29/d49/f67 0 2024-09-13T23:06:09.510 INFO:tasks.workunit.client.0.smithi115.stdout:3/420: creat d3/d16/f97 x:0 0 0 2024-09-13T23:06:09.510 INFO:tasks.workunit.client.0.smithi115.stdout:0/354: symlink d6/d24/d25/d2b/d32/d44/d5c/l79 0 2024-09-13T23:06:09.510 INFO:tasks.workunit.client.0.smithi115.stdout:0/355: fdatasync d6/d24/d25/d58/d5b/f67 0 2024-09-13T23:06:09.511 INFO:tasks.workunit.client.0.smithi115.stdout:9/304: sync 2024-09-13T23:06:09.511 INFO:tasks.workunit.client.0.smithi115.stdout:2/363: mkdir da/d77 0 2024-09-13T23:06:09.511 INFO:tasks.workunit.client.0.smithi115.stdout:2/364: dread - da/d21/d2d/f65 zero size 2024-09-13T23:06:09.511 INFO:tasks.workunit.client.0.smithi115.stdout:2/365: fsync da/d23/d32/d56/f45 0 2024-09-13T23:06:09.512 INFO:tasks.workunit.client.0.smithi115.stdout:8/327: unlink d3/d5/d1c/d41/d42/c40 0 2024-09-13T23:06:09.512 INFO:tasks.workunit.client.0.smithi115.stdout:8/328: stat d3/d5/dc/d16/d1f/d28/d62 0 2024-09-13T23:06:09.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/420: mknod d4/df/d14/d38/d2a/d3e/d56/c81 0 2024-09-13T23:06:09.513 INFO:tasks.workunit.client.0.smithi115.stdout:6/421: write d4/df/d14/d38/d2a/f33 [3453889,80784] 0 2024-09-13T23:06:09.514 INFO:tasks.workunit.client.0.smithi115.stdout:4/423: creat db/d19/d34/f74 x:0 0 0 2024-09-13T23:06:09.515 INFO:tasks.workunit.client.0.smithi115.stdout:3/421: mkdir d3/d5/d35/d71/d45/d98 0 2024-09-13T23:06:09.515 INFO:tasks.workunit.client.0.smithi115.stdout:0/356: stat d6/d24/d25/d58/l5a 0 2024-09-13T23:06:09.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/305: mkdir d0/d13/d17/d1f/d4e/d61 0 2024-09-13T23:06:09.517 INFO:tasks.workunit.client.0.smithi115.stdout:1/341: sync 2024-09-13T23:06:09.518 INFO:tasks.workunit.client.0.smithi115.stdout:6/422: symlink d4/df/d14/d38/d2a/d3e/l82 0 2024-09-13T23:06:09.519 INFO:tasks.workunit.client.0.smithi115.stdout:4/424: mkdir db/d16/d3f/d66/d68/d71/d75 0 2024-09-13T23:06:09.520 INFO:tasks.workunit.client.0.smithi115.stdout:3/422: symlink d3/d16/d1a/d1e/l99 0 2024-09-13T23:06:09.520 INFO:tasks.workunit.client.0.smithi115.stdout:3/423: truncate d3/d16/d1a/d1e/d8e/f8f 754870 0 2024-09-13T23:06:09.520 INFO:tasks.workunit.client.0.smithi115.stdout:3/424: creat d3/d5/f9a x:0 0 0 2024-09-13T23:06:09.520 INFO:tasks.workunit.client.0.smithi115.stdout:3/425: write d3/d5/d35/d71/d3b/d47/d28/f79 [80901,48027] 0 2024-09-13T23:06:09.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/342: creat d0/de/d62/f6c x:0 0 0 2024-09-13T23:06:09.522 INFO:tasks.workunit.client.0.smithi115.stdout:7/298: dwrite da/dd/f2e [4194304,4194304] 0 2024-09-13T23:06:09.523 INFO:tasks.workunit.client.0.smithi115.stdout:7/299: dread - da/df/d3b/f62 zero size 2024-09-13T23:06:09.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/366: rename da/d23/d32 to da/d21/d2d/d78 0 2024-09-13T23:06:09.527 INFO:tasks.workunit.client.0.smithi115.stdout:6/423: creat d4/df/d51/f83 x:0 0 0 2024-09-13T23:06:09.527 INFO:tasks.workunit.client.0.smithi115.stdout:6/424: dread - d4/df/d14/d67/f7a zero size 2024-09-13T23:06:09.527 INFO:tasks.workunit.client.0.smithi115.stdout:6/425: fdatasync d4/df/d14/d38/d2a/d31/f6a 0 2024-09-13T23:06:09.527 INFO:tasks.workunit.client.0.smithi115.stdout:8/329: write d3/d5/dc/d23/f36 [2805731,35085] 0 2024-09-13T23:06:09.527 INFO:tasks.workunit.client.0.smithi115.stdout:8/330: creat d3/d5/d1c/d41/d42/d4d/f78 x:0 0 0 2024-09-13T23:06:09.528 INFO:tasks.workunit.client.0.smithi115.stdout:4/425: symlink db/d16/d3f/d66/d68/l76 0 2024-09-13T23:06:09.531 INFO:tasks.workunit.client.0.smithi115.stdout:3/426: rmdir d3/d16/d1c 39 2024-09-13T23:06:09.532 INFO:tasks.workunit.client.0.smithi115.stdout:9/306: getdents d0/d13/d17/d1f/d28 0 2024-09-13T23:06:09.532 INFO:tasks.workunit.client.0.smithi115.stdout:9/307: chown d0/d13/d17/f1e 18306561 1 2024-09-13T23:06:09.533 INFO:tasks.workunit.client.0.smithi115.stdout:6/426: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:09.543 INFO:tasks.workunit.client.0.smithi115.stdout:0/357: rename d6/d24/d25/f6d to d6/d24/d25/d58/f7a 0 2024-09-13T23:06:09.545 INFO:tasks.workunit.client.0.smithi115.stdout:2/367: unlink da/d21/d2d/d78/d48/f51 0 2024-09-13T23:06:09.545 INFO:tasks.workunit.client.0.smithi115.stdout:2/368: dread - da/d21/d2d/f65 zero size 2024-09-13T23:06:09.545 INFO:tasks.workunit.client.0.smithi115.stdout:2/369: dread - da/d21/d2d/d78/d56/d1a/f2f zero size 2024-09-13T23:06:09.545 INFO:tasks.workunit.client.0.smithi115.stdout:8/331: mkdir d3/d5/dc/d16/d1f/d27/d79 0 2024-09-13T23:06:09.548 INFO:tasks.workunit.client.0.smithi115.stdout:4/426: link db/f10 db/d11/d54/d17/f77 0 2024-09-13T23:06:09.549 INFO:tasks.workunit.client.0.smithi115.stdout:9/308: mkdir d0/d13/d17/d1f/d35/d62 0 2024-09-13T23:06:09.550 INFO:tasks.workunit.client.0.smithi115.stdout:0/358: creat d6/d24/d25/d2b/d32/d6b/f7b x:0 0 0 2024-09-13T23:06:09.552 INFO:tasks.workunit.client.0.smithi115.stdout:4/427: symlink db/d16/d3f/d66/l78 0 2024-09-13T23:06:09.553 INFO:tasks.workunit.client.0.smithi115.stdout:9/309: mknod d0/d43/c63 0 2024-09-13T23:06:09.553 INFO:tasks.workunit.client.0.smithi115.stdout:9/310: readlink d0/d13/d17/d19/l1a 0 2024-09-13T23:06:09.553 INFO:tasks.workunit.client.0.smithi115.stdout:0/359: mknod d6/d24/d25/d58/c7c 0 2024-09-13T23:06:09.554 INFO:tasks.workunit.client.0.smithi115.stdout:4/428: dread db/d11/d2e/d33/d36/f3b [0,4194304] 0 2024-09-13T23:06:09.554 INFO:tasks.workunit.client.0.smithi115.stdout:9/311: symlink d0/d13/d17/l64 0 2024-09-13T23:06:09.555 INFO:tasks.workunit.client.0.smithi115.stdout:0/360: mknod d6/d24/d25/d2b/d32/d44/d5c/c7d 0 2024-09-13T23:06:09.556 INFO:tasks.workunit.client.0.smithi115.stdout:9/312: symlink d0/d13/d3b/d42/l65 0 2024-09-13T23:06:09.559 INFO:tasks.workunit.client.0.smithi115.stdout:9/313: truncate d0/d13/d17/f1e 5688907 0 2024-09-13T23:06:09.560 INFO:tasks.workunit.client.0.smithi115.stdout:9/314: creat d0/d13/d17/d1f/f66 x:0 0 0 2024-09-13T23:06:09.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/315: mkdir d0/d13/d17/d1f/d67 0 2024-09-13T23:06:09.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/316: write d0/d13/d17/d1f/d28/f3e [2786292,54076] 0 2024-09-13T23:06:09.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/317: fsync d0/fd 0 2024-09-13T23:06:09.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/318: write d0/d13/d17/d1f/d35/f60 [315854,61999] 0 2024-09-13T23:06:09.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/319: truncate d0/d13/d17/d1f/d35/d40/f52 4698539 0 2024-09-13T23:06:09.564 INFO:tasks.workunit.client.0.smithi115.stdout:9/320: creat d0/d13/d3b/f68 x:0 0 0 2024-09-13T23:06:09.568 INFO:tasks.workunit.client.0.smithi115.stdout:7/300: dwrite da/dd/d13/d36/f48 [4194304,4194304] 0 2024-09-13T23:06:09.569 INFO:tasks.workunit.client.0.smithi115.stdout:7/301: symlink da/dd/d1c/d2d/d60/l6a 0 2024-09-13T23:06:09.570 INFO:tasks.workunit.client.0.smithi115.stdout:0/361: write f2 [10137243,123853] 0 2024-09-13T23:06:09.571 INFO:tasks.workunit.client.0.smithi115.stdout:7/302: rename da/dd/d13/f23 to da/dd/d13/f6b 0 2024-09-13T23:06:09.572 INFO:tasks.workunit.client.0.smithi115.stdout:0/362: link d6/d24/d25/d58/d5b/f67 d6/d24/d25/d58/f7e 0 2024-09-13T23:06:09.578 INFO:tasks.workunit.client.0.smithi115.stdout:3/427: dwrite d3/d5/d35/d71/f4b [0,4194304] 0 2024-09-13T23:06:09.578 INFO:tasks.workunit.client.0.smithi115.stdout:3/428: truncate d3/d16/d1a/d1e/f80 215655 0 2024-09-13T23:06:09.578 INFO:tasks.workunit.client.0.smithi115.stdout:1/343: dwrite d0/de/d1b/f35 [0,4194304] 0 2024-09-13T23:06:09.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/303: dread da/dd/d1c/f20 [4194304,4194304] 0 2024-09-13T23:06:09.585 INFO:tasks.workunit.client.0.smithi115.stdout:7/304: creat da/dd/d13/d24/f6c x:0 0 0 2024-09-13T23:06:09.586 INFO:tasks.workunit.client.0.smithi115.stdout:7/305: mkdir da/dd/d13/d36/d5a/d6d 0 2024-09-13T23:06:09.587 INFO:tasks.workunit.client.0.smithi115.stdout:7/306: rename da to da/d6e 22 2024-09-13T23:06:09.587 INFO:tasks.workunit.client.0.smithi115.stdout:2/370: dwrite da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:09.587 INFO:tasks.workunit.client.0.smithi115.stdout:2/371: write da/d21/d2d/d66/f4d [4598203,34078] 0 2024-09-13T23:06:09.587 INFO:tasks.workunit.client.0.smithi115.stdout:2/372: write da/d21/d2d/d78/d56/d1a/f44 [974192,71825] 0 2024-09-13T23:06:09.588 INFO:tasks.workunit.client.0.smithi115.stdout:4/429: dwrite db/d19/f27 [0,4194304] 0 2024-09-13T23:06:09.588 INFO:tasks.workunit.client.0.smithi115.stdout:7/307: link da/dd/d1c/d2d/d45/f5f da/dd/d1c/d2d/d45/d4d/f6f 0 2024-09-13T23:06:09.590 INFO:tasks.workunit.client.0.smithi115.stdout:6/427: fsync d4/df/d51/f83 0 2024-09-13T23:06:09.592 INFO:tasks.workunit.client.0.smithi115.stdout:2/373: symlink da/d21/l79 0 2024-09-13T23:06:09.592 INFO:tasks.workunit.client.0.smithi115.stdout:2/374: chown da/d21/d2d/f6e 725 1 2024-09-13T23:06:09.592 INFO:tasks.workunit.client.0.smithi115.stdout:2/375: chown da/d21/d2d/d78/d56/c3c 18283 1 2024-09-13T23:06:09.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/344: write d0/f7 [3537528,51867] 0 2024-09-13T23:06:09.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/345: dread - d0/de/d1a/f61 zero size 2024-09-13T23:06:09.594 INFO:tasks.workunit.client.0.smithi115.stdout:1/346: readlink d0/de/d1b/d25/d4d/d51/l45 0 2024-09-13T23:06:09.594 INFO:tasks.workunit.client.0.smithi115.stdout:9/321: dwrite d0/d13/d17/d1f/f45 [0,4194304] 0 2024-09-13T23:06:09.594 INFO:tasks.workunit.client.0.smithi115.stdout:9/322: chown d0/d43/c63 13290 1 2024-09-13T23:06:09.598 INFO:tasks.workunit.client.0.smithi115.stdout:4/430: creat db/d11/d54/f79 x:0 0 0 2024-09-13T23:06:09.599 INFO:tasks.workunit.client.0.smithi115.stdout:7/308: link da/dd/d1c/d2d/d45/d4d/f6f da/dd/d1c/d2d/f70 0 2024-09-13T23:06:09.599 INFO:tasks.workunit.client.0.smithi115.stdout:7/309: fdatasync da/dd/d1c/d2d/f54 0 2024-09-13T23:06:09.600 INFO:tasks.workunit.client.0.smithi115.stdout:6/428: symlink d4/d57/d5a/d79/l84 0 2024-09-13T23:06:09.600 INFO:tasks.workunit.client.0.smithi115.stdout:5/294: sync 2024-09-13T23:06:09.601 INFO:tasks.workunit.client.0.smithi115.stdout:2/376: creat da/d21/d2d/d66/d41/f7a x:0 0 0 2024-09-13T23:06:09.602 INFO:tasks.workunit.client.0.smithi115.stdout:3/429: dwrite d3/d5/d35/d71/d3b/d4d/f74 [0,4194304] 0 2024-09-13T23:06:09.607 INFO:tasks.workunit.client.0.smithi115.stdout:9/323: unlink d0/d13/d17/l64 0 2024-09-13T23:06:09.608 INFO:tasks.workunit.client.0.smithi115.stdout:9/324: chown d0/d13/d17/d19 898223 1 2024-09-13T23:06:09.609 INFO:tasks.workunit.client.0.smithi115.stdout:7/310: creat da/dd/d13/d36/f71 x:0 0 0 2024-09-13T23:06:09.609 INFO:tasks.workunit.client.0.smithi115.stdout:7/311: chown c4 2161 1 2024-09-13T23:06:09.610 INFO:tasks.workunit.client.0.smithi115.stdout:6/429: mkdir d4/d57/d5a/d79/d85 0 2024-09-13T23:06:09.610 INFO:tasks.workunit.client.0.smithi115.stdout:1/347: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:09.611 INFO:tasks.workunit.client.0.smithi115.stdout:5/295: creat d8/dd/d20/d4a/f57 x:0 0 0 2024-09-13T23:06:09.612 INFO:tasks.workunit.client.0.smithi115.stdout:4/431: dread db/d11/d2e/d35/f3e [0,4194304] 0 2024-09-13T23:06:09.612 INFO:tasks.workunit.client.0.smithi115.stdout:2/377: link da/d21/d2d/d78/d56/d1a/f1f da/d23/f7b 0 2024-09-13T23:06:09.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/430: mknod d3/d5/d5b/c9b 0 2024-09-13T23:06:09.617 INFO:tasks.workunit.client.0.smithi115.stdout:3/431: read d3/d5/d35/d71/d3b/d47/d28/f79 [107867,112283] 0 2024-09-13T23:06:09.617 INFO:tasks.workunit.client.0.smithi115.stdout:9/325: rename d0/d13/d17/f39 to d0/d43/d53/f69 0 2024-09-13T23:06:09.617 INFO:tasks.workunit.client.0.smithi115.stdout:9/326: chown d0/d13/d17/d1f/d35/d40/f52 298960642 1 2024-09-13T23:06:09.618 INFO:tasks.workunit.client.0.smithi115.stdout:7/312: rmdir da/d53 39 2024-09-13T23:06:09.619 INFO:tasks.workunit.client.0.smithi115.stdout:6/430: mknod d4/df/d14/d38/d2a/c86 0 2024-09-13T23:06:09.619 INFO:tasks.workunit.client.0.smithi115.stdout:6/431: readlink d4/df/l3d 0 2024-09-13T23:06:09.621 INFO:tasks.workunit.client.0.smithi115.stdout:5/296: creat d8/dd/d20/d23/d54/f58 x:0 0 0 2024-09-13T23:06:09.622 INFO:tasks.workunit.client.0.smithi115.stdout:4/432: truncate f5 8200891 0 2024-09-13T23:06:09.622 INFO:tasks.workunit.client.0.smithi115.stdout:4/433: chown db/d11/c4d 3 1 2024-09-13T23:06:09.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/378: symlink da/d21/d2d/d78/d48/l7c 0 2024-09-13T23:06:09.624 INFO:tasks.workunit.client.0.smithi115.stdout:3/432: getdents d3/d5/d35/d71/d3b/d47/d28 0 2024-09-13T23:06:09.624 INFO:tasks.workunit.client.0.smithi115.stdout:3/433: dread - d3/d5/d35/f50 zero size 2024-09-13T23:06:09.626 INFO:tasks.workunit.client.0.smithi115.stdout:9/327: symlink d0/d13/d3b/l6a 0 2024-09-13T23:06:09.626 INFO:tasks.workunit.client.0.smithi115.stdout:9/328: readlink d0/d13/d17/d19/l25 0 2024-09-13T23:06:09.626 INFO:tasks.workunit.client.0.smithi115.stdout:9/329: fdatasync d0/d13/d17/d1f/f66 0 2024-09-13T23:06:09.627 INFO:tasks.workunit.client.0.smithi115.stdout:7/313: link da/dd/d16/d29/c3d da/d53/c72 0 2024-09-13T23:06:09.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/297: truncate d8/dd/d20/d35/f45 3036591 0 2024-09-13T23:06:09.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/434: creat db/d16/d3f/d66/d68/d6a/f7a x:0 0 0 2024-09-13T23:06:09.630 INFO:tasks.workunit.client.0.smithi115.stdout:2/379: rmdir da/d21/d2d/d78/d56 39 2024-09-13T23:06:09.630 INFO:tasks.workunit.client.0.smithi115.stdout:5/298: dread d8/d36/f41 [0,4194304] 0 2024-09-13T23:06:09.630 INFO:tasks.workunit.client.0.smithi115.stdout:6/432: write d4/df/d14/d38/d44/f55 [1419311,22829] 0 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:3/434: symlink d3/d16/d1a/d1e/d76/l9c 0 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:3/435: creat d3/d16/f9d x:0 0 0 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:7/314: rmdir da/dd/d1c 39 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/433: dread d4/df/d14/d38/d2a/d31/f6a [0,4194304] 0 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/434: truncate d4/d57/d75/f6f 1552150 0 2024-09-13T23:06:09.632 INFO:tasks.workunit.client.0.smithi115.stdout:6/435: fsync d4/f3c 0 2024-09-13T23:06:09.633 INFO:tasks.workunit.client.0.smithi115.stdout:4/435: symlink db/d16/d3f/d66/d68/d71/l7b 0 2024-09-13T23:06:09.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/380: rename da/d21/d2d/d78/d56/c13 to da/d21/d2d/c7d 0 2024-09-13T23:06:09.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/381: truncate da/f73 274485 0 2024-09-13T23:06:09.636 INFO:tasks.workunit.client.0.smithi115.stdout:6/436: dread d4/df/f1f [0,4194304] 0 2024-09-13T23:06:09.636 INFO:tasks.workunit.client.0.smithi115.stdout:9/330: read d0/d43/d53/f69 [2577307,128793] 0 2024-09-13T23:06:09.636 INFO:tasks.workunit.client.0.smithi115.stdout:5/299: creat d8/dd/d20/d23/f59 x:0 0 0 2024-09-13T23:06:09.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/315: creat da/dd/d1c/d2d/d45/d4d/f73 x:0 0 0 2024-09-13T23:06:09.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/316: write da/dd/d1c/f22 [1735132,9517] 0 2024-09-13T23:06:09.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/317: chown da/dd/d16/d29/f55 35377084 1 2024-09-13T23:06:09.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/318: stat da/df/d3b/f61 0 2024-09-13T23:06:09.640 INFO:tasks.workunit.client.0.smithi115.stdout:7/319: stat da/l5d 0 2024-09-13T23:06:09.641 INFO:tasks.workunit.client.0.smithi115.stdout:2/382: creat da/d23/f7e x:0 0 0 2024-09-13T23:06:09.642 INFO:tasks.workunit.client.0.smithi115.stdout:6/437: symlink d4/df/l87 0 2024-09-13T23:06:09.647 INFO:tasks.workunit.client.0.smithi115.stdout:7/320: mkdir da/dd/d1c/d2d/d45/d4d/d74 0 2024-09-13T23:06:09.650 INFO:tasks.workunit.client.0.smithi115.stdout:6/438: mkdir d4/df/d14/d38/d2a/d31/d5b/d88 0 2024-09-13T23:06:09.651 INFO:tasks.workunit.client.0.smithi115.stdout:7/321: symlink da/df/d3b/l75 0 2024-09-13T23:06:09.651 INFO:tasks.workunit.client.0.smithi115.stdout:7/322: truncate da/df/f2c 4227163 0 2024-09-13T23:06:09.652 INFO:tasks.workunit.client.0.smithi115.stdout:7/323: readlink da/dd/d13/d36/l4e 0 2024-09-13T23:06:09.652 INFO:tasks.workunit.client.0.smithi115.stdout:1/348: truncate d0/de/d1b/f26 2988151 0 2024-09-13T23:06:09.653 INFO:tasks.workunit.client.0.smithi115.stdout:2/383: mkdir da/d21/d2d/d78/d56/d1a/d7f 0 2024-09-13T23:06:09.654 INFO:tasks.workunit.client.0.smithi115.stdout:6/439: getdents d4/df/d14 0 2024-09-13T23:06:09.656 INFO:tasks.workunit.client.0.smithi115.stdout:7/324: mknod da/dd/c76 0 2024-09-13T23:06:09.658 INFO:tasks.workunit.client.0.smithi115.stdout:1/349: creat d0/de/d1a/f6d x:0 0 0 2024-09-13T23:06:09.663 INFO:tasks.workunit.client.0.smithi115.stdout:1/350: rename d0/dd/f5c to d0/de/d1b/d25/d67/f6e 0 2024-09-13T23:06:09.665 INFO:tasks.workunit.client.0.smithi115.stdout:1/351: mknod d0/de/d1b/d25/d4d/d51/c6f 0 2024-09-13T23:06:09.665 INFO:tasks.workunit.client.0.smithi115.stdout:1/352: write d0/f3 [752144,121443] 0 2024-09-13T23:06:09.666 INFO:tasks.workunit.client.0.smithi115.stdout:1/353: rmdir d0/de/d1b/d25 39 2024-09-13T23:06:09.696 INFO:tasks.workunit.client.0.smithi115.stdout:4/436: dwrite db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:09.696 INFO:tasks.workunit.client.0.smithi115.stdout:4/437: getdents db/d11/d2e/d33/d36 0 2024-09-13T23:06:09.700 INFO:tasks.workunit.client.0.smithi115.stdout:7/325: dwrite da/dd/d13/f66 [0,4194304] 0 2024-09-13T23:06:09.702 INFO:tasks.workunit.client.0.smithi115.stdout:9/331: dwrite d0/d13/d17/d36/f46 [0,4194304] 0 2024-09-13T23:06:09.705 INFO:tasks.workunit.client.0.smithi115.stdout:6/440: dwrite d4/df/d51/f83 [0,4194304] 0 2024-09-13T23:06:09.705 INFO:tasks.workunit.client.0.smithi115.stdout:6/441: chown d4/df/d14/d38/d2a/f33 1852928294 1 2024-09-13T23:06:09.705 INFO:tasks.workunit.client.0.smithi115.stdout:7/326: mknod da/dd/d13/d36/c77 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:2/384: dwrite f4 [0,4194304] 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:2/385: truncate da/d21/f33 4278841 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:2/386: creat da/d21/d2d/f80 x:0 0 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:5/300: dwrite d8/dd/d20/d35/f44 [0,4194304] 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:2/387: write da/d23/d2c/f3d [3165186,62806] 0 2024-09-13T23:06:09.708 INFO:tasks.workunit.client.0.smithi115.stdout:5/301: write d8/dd/d14/f50 [533868,72525] 0 2024-09-13T23:06:09.709 INFO:tasks.workunit.client.0.smithi115.stdout:5/302: chown d8/lc 13360611 1 2024-09-13T23:06:09.709 INFO:tasks.workunit.client.0.smithi115.stdout:1/354: dwrite d0/de/d1b/f4a [0,4194304] 0 2024-09-13T23:06:09.713 INFO:tasks.workunit.client.0.smithi115.stdout:2/388: symlink da/d21/l81 0 2024-09-13T23:06:09.715 INFO:tasks.workunit.client.0.smithi115.stdout:1/355: write d0/f5 [1392490,94982] 0 2024-09-13T23:06:09.720 INFO:tasks.workunit.client.0.smithi115.stdout:5/303: dread d8/dd/d20/d23/f3f [0,4194304] 0 2024-09-13T23:06:09.721 INFO:tasks.workunit.client.0.smithi115.stdout:1/356: rename d0/f2 to d0/de/d1b/d25/d4d/d51/d23/d65/f70 0 2024-09-13T23:06:09.721 INFO:tasks.workunit.client.0.smithi115.stdout:4/438: dwrite db/d11/d2e/f5d [0,4194304] 0 2024-09-13T23:06:09.721 INFO:tasks.workunit.client.0.smithi115.stdout:4/439: truncate db/d11/d2e/d33/d36/f42 4785370 0 2024-09-13T23:06:09.723 INFO:tasks.workunit.client.0.smithi115.stdout:5/304: mkdir d8/dd/d20/d35/d5a 0 2024-09-13T23:06:09.724 INFO:tasks.workunit.client.0.smithi115.stdout:5/305: write d8/dd/d20/d23/f59 [828336,20141] 0 2024-09-13T23:06:09.726 INFO:tasks.workunit.client.0.smithi115.stdout:1/357: mkdir d0/de/d71 0 2024-09-13T23:06:09.726 INFO:tasks.workunit.client.0.smithi115.stdout:1/358: write d0/de/d1b/d25/d4d/d51/d23/f2c [180362,105877] 0 2024-09-13T23:06:09.728 INFO:tasks.workunit.client.0.smithi115.stdout:5/306: mknod d8/dd/d20/d4a/c5b 0 2024-09-13T23:06:09.728 INFO:tasks.workunit.client.0.smithi115.stdout:5/307: fsync d8/fa 0 2024-09-13T23:06:09.728 INFO:tasks.workunit.client.0.smithi115.stdout:5/308: chown d8/l11 883739669 1 2024-09-13T23:06:09.729 INFO:tasks.workunit.client.0.smithi115.stdout:1/359: mkdir d0/de/d1b/d25/d4d/d51/d31/d37/d72 0 2024-09-13T23:06:09.731 INFO:tasks.workunit.client.0.smithi115.stdout:5/309: unlink d8/dd/c34 0 2024-09-13T23:06:09.731 INFO:tasks.workunit.client.0.smithi115.stdout:5/310: readlink d8/dd/d14/l39 0 2024-09-13T23:06:09.733 INFO:tasks.workunit.client.0.smithi115.stdout:5/311: creat d8/dd/f5c x:0 0 0 2024-09-13T23:06:09.738 INFO:tasks.workunit.client.0.smithi115.stdout:0/363: sync 2024-09-13T23:06:09.738 INFO:tasks.workunit.client.0.smithi115.stdout:8/332: sync 2024-09-13T23:06:09.739 INFO:tasks.workunit.client.0.smithi115.stdout:0/364: mkdir d6/d24/d25/d7f 0 2024-09-13T23:06:09.740 INFO:tasks.workunit.client.0.smithi115.stdout:8/333: creat d3/d5/dc/d16/d1f/d27/f7a x:0 0 0 2024-09-13T23:06:09.740 INFO:tasks.workunit.client.0.smithi115.stdout:0/365: creat d6/d24/d25/d58/d5b/f80 x:0 0 0 2024-09-13T23:06:09.741 INFO:tasks.workunit.client.0.smithi115.stdout:0/366: creat d6/f81 x:0 0 0 2024-09-13T23:06:09.742 INFO:tasks.workunit.client.0.smithi115.stdout:0/367: readlink d6/d24/d25/d2b/d32/l3e 0 2024-09-13T23:06:09.747 INFO:tasks.workunit.client.0.smithi115.stdout:1/360: dread d0/de/d1b/f35 [0,4194304] 0 2024-09-13T23:06:09.748 INFO:tasks.workunit.client.0.smithi115.stdout:6/442: dwrite d4/f6c [0,4194304] 0 2024-09-13T23:06:09.749 INFO:tasks.workunit.client.0.smithi115.stdout:7/327: dwrite da/df/d3b/f61 [0,4194304] 0 2024-09-13T23:06:09.750 INFO:tasks.workunit.client.0.smithi115.stdout:8/334: read d3/d5/f44 [2084761,89267] 0 2024-09-13T23:06:09.751 INFO:tasks.workunit.client.0.smithi115.stdout:5/312: write d8/dd/d20/d4a/f4f [7434101,129704] 0 2024-09-13T23:06:09.751 INFO:tasks.workunit.client.0.smithi115.stdout:2/389: dwrite da/d21/d2d/d78/d56/d1a/f1f [0,4194304] 0 2024-09-13T23:06:09.751 INFO:tasks.workunit.client.0.smithi115.stdout:2/390: dread - da/d21/d2d/d66/d41/f7a zero size 2024-09-13T23:06:09.751 INFO:tasks.workunit.client.0.smithi115.stdout:2/391: stat da/d21/d2d/d78/f3a 0 2024-09-13T23:06:09.752 INFO:tasks.workunit.client.0.smithi115.stdout:2/392: write da/d23/d2c/f3d [4137710,15767] 0 2024-09-13T23:06:09.752 INFO:tasks.workunit.client.0.smithi115.stdout:0/368: write d6/d24/f38 [636554,1533] 0 2024-09-13T23:06:09.754 INFO:tasks.workunit.client.0.smithi115.stdout:9/332: dwrite d0/d13/d3b/f68 [0,4194304] 0 2024-09-13T23:06:09.754 INFO:tasks.workunit.client.0.smithi115.stdout:1/361: dread d0/de/d1a/d29/f4e [0,4194304] 0 2024-09-13T23:06:09.757 INFO:tasks.workunit.client.0.smithi115.stdout:7/328: symlink da/dd/d1c/d2d/l78 0 2024-09-13T23:06:09.757 INFO:tasks.workunit.client.0.smithi115.stdout:8/335: link d3/d5/dc/d23/f6f d3/d5/dc/d16/d1f/d28/d62/f7b 0 2024-09-13T23:06:09.757 INFO:tasks.workunit.client.0.smithi115.stdout:8/336: chown d3/d5/dc/d16/d1f/d27/f7a 58 1 2024-09-13T23:06:09.762 INFO:tasks.workunit.client.0.smithi115.stdout:5/313: mkdir d8/dd/d5d 0 2024-09-13T23:06:09.762 INFO:tasks.workunit.client.0.smithi115.stdout:7/329: dread da/dd/d13/d36/f42 [0,4194304] 0 2024-09-13T23:06:09.774 INFO:tasks.workunit.client.0.smithi115.stdout:5/314: write d8/dd/d20/d35/f44 [2888116,43869] 0 2024-09-13T23:06:09.774 INFO:tasks.workunit.client.0.smithi115.stdout:5/315: stat d8/f26 0 2024-09-13T23:06:09.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/337: creat d3/d5/dc/d16/d1f/d27/d79/f7c x:0 0 0 2024-09-13T23:06:09.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/338: dread - d3/d5/d1c/d41/d42/d4d/f5f zero size 2024-09-13T23:06:09.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/339: readlink d3/d5/dc/d23/d4e/l71 0 2024-09-13T23:06:09.775 INFO:tasks.workunit.client.0.smithi115.stdout:2/393: symlink da/d21/d2d/d78/d56/d1a/l82 0 2024-09-13T23:06:09.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/443: dwrite d4/df/d14/d38/d2a/d3e/f4c [4194304,4194304] 0 2024-09-13T23:06:09.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/444: chown d4/l2b 827 1 2024-09-13T23:06:09.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/445: fsync d4/df/d14/d38/f68 0 2024-09-13T23:06:09.787 INFO:tasks.workunit.client.0.smithi115.stdout:6/446: link d4/df/c2c d4/df/d14/c89 0 2024-09-13T23:06:09.792 INFO:tasks.workunit.client.0.smithi115.stdout:8/340: dread d3/d5/dc/f12 [0,4194304] 0 2024-09-13T23:06:09.792 INFO:tasks.workunit.client.0.smithi115.stdout:9/333: dwrite d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:09.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/362: dwrite d0/de/d1a/f61 [0,4194304] 0 2024-09-13T23:06:09.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/363: write d0/de/d1a/d29/f39 [4922356,122495] 0 2024-09-13T23:06:09.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/364: read - d0/de/d1a/d29/d47/d63/f6b zero size 2024-09-13T23:06:09.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/365: chown d0/de/f34 39089 1 2024-09-13T23:06:09.794 INFO:tasks.workunit.client.0.smithi115.stdout:1/366: truncate d0/f5 2866280 0 2024-09-13T23:06:09.795 INFO:tasks.workunit.client.0.smithi115.stdout:8/341: creat d3/d5/d1d/d63/f7d x:0 0 0 2024-09-13T23:06:09.795 INFO:tasks.workunit.client.0.smithi115.stdout:0/369: dwrite d6/d24/d25/d2b/f31 [0,4194304] 0 2024-09-13T23:06:09.795 INFO:tasks.workunit.client.0.smithi115.stdout:2/394: dwrite da/d23/f38 [0,4194304] 0 2024-09-13T23:06:09.795 INFO:tasks.workunit.client.0.smithi115.stdout:2/395: fsync da/d21/d2d/d66/d41/d62/f71 0 2024-09-13T23:06:09.798 INFO:tasks.workunit.client.0.smithi115.stdout:1/367: mknod d0/dd/c73 0 2024-09-13T23:06:09.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/330: truncate da/dd/d1c/f22 3628758 0 2024-09-13T23:06:09.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/331: chown da/dd/d1c/d2d/d45/l50 7986 1 2024-09-13T23:06:09.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/332: truncate da/dd/d13/d24/f4f 140015 0 2024-09-13T23:06:09.809 INFO:tasks.workunit.client.0.smithi115.stdout:2/396: mkdir da/d77/d83 0 2024-09-13T23:06:09.809 INFO:tasks.workunit.client.0.smithi115.stdout:2/397: chown da/d21/d2d/f6e 19715501 1 2024-09-13T23:06:09.810 INFO:tasks.workunit.client.0.smithi115.stdout:9/334: rmdir d0 39 2024-09-13T23:06:09.811 INFO:tasks.workunit.client.0.smithi115.stdout:1/368: mkdir d0/de/d1a/d29/d47/d74 0 2024-09-13T23:06:09.812 INFO:tasks.workunit.client.0.smithi115.stdout:1/369: dread d0/dd/f3e [0,4194304] 0 2024-09-13T23:06:09.813 INFO:tasks.workunit.client.0.smithi115.stdout:1/370: dread d0/dd/f3e [0,4194304] 0 2024-09-13T23:06:09.814 INFO:tasks.workunit.client.0.smithi115.stdout:2/398: truncate da/d21/d2d/d78/d56/f24 2926622 0 2024-09-13T23:06:09.814 INFO:tasks.workunit.client.0.smithi115.stdout:2/399: truncate da/d21/d2d/d78/d56/d1a/f2f 565999 0 2024-09-13T23:06:09.814 INFO:tasks.workunit.client.0.smithi115.stdout:3/436: sync 2024-09-13T23:06:09.814 INFO:tasks.workunit.client.0.smithi115.stdout:3/437: write d3/f1b [4005190,64199] 0 2024-09-13T23:06:09.815 INFO:tasks.workunit.client.0.smithi115.stdout:1/371: dread d0/de/d1b/f59 [0,4194304] 0 2024-09-13T23:06:09.815 INFO:tasks.workunit.client.0.smithi115.stdout:0/370: rename d6/d24/d25/d2b/d32 to d6/d24/d25/d2b/d82 0 2024-09-13T23:06:09.816 INFO:tasks.workunit.client.0.smithi115.stdout:2/400: link da/l10 da/d23/l84 0 2024-09-13T23:06:09.816 INFO:tasks.workunit.client.0.smithi115.stdout:2/401: creat da/d21/d2d/d66/d41/f85 x:0 0 0 2024-09-13T23:06:09.817 INFO:tasks.workunit.client.0.smithi115.stdout:9/335: mknod d0/c6b 0 2024-09-13T23:06:09.820 INFO:tasks.workunit.client.0.smithi115.stdout:3/438: creat d3/d5/d35/d71/d3b/d47/d28/f9e x:0 0 0 2024-09-13T23:06:09.821 INFO:tasks.workunit.client.0.smithi115.stdout:1/372: creat d0/f75 x:0 0 0 2024-09-13T23:06:09.821 INFO:tasks.workunit.client.0.smithi115.stdout:0/371: rename d6/d24/d25/d2b/f70 to d6/d62/f83 0 2024-09-13T23:06:09.821 INFO:tasks.workunit.client.0.smithi115.stdout:0/372: chown d6/l3c 2690691 1 2024-09-13T23:06:09.822 INFO:tasks.workunit.client.0.smithi115.stdout:2/402: mknod da/d77/d83/c86 0 2024-09-13T23:06:09.822 INFO:tasks.workunit.client.0.smithi115.stdout:2/403: fdatasync da/d21/f72 0 2024-09-13T23:06:09.822 INFO:tasks.workunit.client.0.smithi115.stdout:3/439: truncate d3/d5/d35/d71/d45/d59/f5a 436959 0 2024-09-13T23:06:09.822 INFO:tasks.workunit.client.0.smithi115.stdout:1/373: getdents d0/de/d1b/d25/d4d 0 2024-09-13T23:06:09.823 INFO:tasks.workunit.client.0.smithi115.stdout:3/440: write d3/d16/d1a/d29/f62 [57615,34453] 0 2024-09-13T23:06:09.825 INFO:tasks.workunit.client.0.smithi115.stdout:5/316: dwrite d8/dd/d20/d35/f44 [0,4194304] 0 2024-09-13T23:06:09.825 INFO:tasks.workunit.client.0.smithi115.stdout:5/317: chown d8/dd/d5d 48752 1 2024-09-13T23:06:09.826 INFO:tasks.workunit.client.0.smithi115.stdout:2/404: rename da/d23/f7e to da/d21/d2d/d66/d41/d69/f87 0 2024-09-13T23:06:09.826 INFO:tasks.workunit.client.0.smithi115.stdout:2/405: stat da/d21/d2d/d78/d56/d1a/d7f 0 2024-09-13T23:06:09.826 INFO:tasks.workunit.client.0.smithi115.stdout:8/342: dwrite d3/d5/dc/d23/d4e/f77 [0,4194304] 0 2024-09-13T23:06:09.828 INFO:tasks.workunit.client.0.smithi115.stdout:1/374: unlink d0/de/f34 0 2024-09-13T23:06:09.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/375: dread d0/de/d1b/d25/d4d/d51/f41 [4194304,4194304] 0 2024-09-13T23:06:09.831 INFO:tasks.workunit.client.0.smithi115.stdout:3/441: truncate d3/d5/d35/d71/d3b/d47/f86 4003023 0 2024-09-13T23:06:09.831 INFO:tasks.workunit.client.0.smithi115.stdout:3/442: stat d3/d5/db/le 0 2024-09-13T23:06:09.835 INFO:tasks.workunit.client.0.smithi115.stdout:5/318: unlink d8/f9 0 2024-09-13T23:06:09.838 INFO:tasks.workunit.client.0.smithi115.stdout:1/376: dread d0/de/d1b/d25/d4d/d51/d23/d65/f70 [0,4194304] 0 2024-09-13T23:06:09.840 INFO:tasks.workunit.client.0.smithi115.stdout:9/336: read d0/d13/d17/d36/f46 [3632658,5732] 0 2024-09-13T23:06:09.840 INFO:tasks.workunit.client.0.smithi115.stdout:7/333: dwrite da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:09.840 INFO:tasks.workunit.client.0.smithi115.stdout:7/334: stat da/dd/d16/c47 0 2024-09-13T23:06:09.848 INFO:tasks.workunit.client.0.smithi115.stdout:9/337: link d0/d13/c4a d0/d13/d17/d1f/c6c 0 2024-09-13T23:06:09.850 INFO:tasks.workunit.client.0.smithi115.stdout:7/335: link da/dd/d13/d36/l57 da/l79 0 2024-09-13T23:06:09.852 INFO:tasks.workunit.client.0.smithi115.stdout:1/377: write d0/de/d1a/f61 [3228604,93809] 0 2024-09-13T23:06:09.853 INFO:tasks.workunit.client.0.smithi115.stdout:0/373: dwrite d6/d62/f83 [0,4194304] 0 2024-09-13T23:06:09.857 INFO:tasks.workunit.client.0.smithi115.stdout:0/374: mknod d6/d24/d25/d2b/d61/c84 0 2024-09-13T23:06:09.858 INFO:tasks.workunit.client.0.smithi115.stdout:1/378: getdents d0/de/d1a/d29 0 2024-09-13T23:06:09.862 INFO:tasks.workunit.client.0.smithi115.stdout:0/375: getdents d6/d24/d25/d2b/d82 0 2024-09-13T23:06:09.863 INFO:tasks.workunit.client.0.smithi115.stdout:7/336: write da/dd/f59 [1599951,79129] 0 2024-09-13T23:06:09.864 INFO:tasks.workunit.client.0.smithi115.stdout:8/343: dwrite d3/d5/d1c/d41/d42/f14 [4194304,4194304] 0 2024-09-13T23:06:09.864 INFO:tasks.workunit.client.0.smithi115.stdout:9/338: dwrite d0/d13/d17/d1f/d35/f60 [0,4194304] 0 2024-09-13T23:06:09.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/319: dwrite d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:09.865 INFO:tasks.workunit.client.0.smithi115.stdout:1/379: rename d0/de/d1b/c3c to d0/de/d1b/d25/d4d/d51/d31/d37/c76 0 2024-09-13T23:06:09.867 INFO:tasks.workunit.client.0.smithi115.stdout:8/344: mknod d3/d5/dc/d16/c7e 0 2024-09-13T23:06:09.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/320: mkdir d8/dd/d5d/d5e 0 2024-09-13T23:06:09.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/321: readlink d8/dd/d20/l28 0 2024-09-13T23:06:09.879 INFO:tasks.workunit.client.0.smithi115.stdout:5/322: creat d8/dd/f5f x:0 0 0 2024-09-13T23:06:09.879 INFO:tasks.workunit.client.0.smithi115.stdout:7/337: getdents da/dd/d13 0 2024-09-13T23:06:09.880 INFO:tasks.workunit.client.0.smithi115.stdout:8/345: mkdir d3/d5/dc/d23/d4e/d54/d7f 0 2024-09-13T23:06:09.882 INFO:tasks.workunit.client.0.smithi115.stdout:8/346: dread d3/d5/dc/f35 [0,4194304] 0 2024-09-13T23:06:09.882 INFO:tasks.workunit.client.0.smithi115.stdout:8/347: creat d3/d5/d1c/d41/f80 x:0 0 0 2024-09-13T23:06:09.882 INFO:tasks.workunit.client.0.smithi115.stdout:8/348: readlink d3/d5/d1c/d41/l6d 0 2024-09-13T23:06:09.883 INFO:tasks.workunit.client.0.smithi115.stdout:5/323: creat d8/dd/d20/d35/f60 x:0 0 0 2024-09-13T23:06:09.883 INFO:tasks.workunit.client.0.smithi115.stdout:5/324: write d8/dd/ff [1938066,64561] 0 2024-09-13T23:06:09.883 INFO:tasks.workunit.client.0.smithi115.stdout:5/325: dread - d8/dd/d20/f52 zero size 2024-09-13T23:06:09.886 INFO:tasks.workunit.client.0.smithi115.stdout:1/380: unlink d0/de/f19 0 2024-09-13T23:06:09.888 INFO:tasks.workunit.client.0.smithi115.stdout:0/376: dwrite d6/d24/d25/d58/f7a [0,4194304] 0 2024-09-13T23:06:09.889 INFO:tasks.workunit.client.0.smithi115.stdout:9/339: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:09.890 INFO:tasks.workunit.client.0.smithi115.stdout:5/326: mknod d8/d36/c61 0 2024-09-13T23:06:09.890 INFO:tasks.workunit.client.0.smithi115.stdout:5/327: dread - d8/dd/d20/f52 zero size 2024-09-13T23:06:09.892 INFO:tasks.workunit.client.0.smithi115.stdout:1/381: link d0/de/d1b/d25/d4d/d51/d23/d65/f70 d0/de/d1b/d25/f77 0 2024-09-13T23:06:09.893 INFO:tasks.workunit.client.0.smithi115.stdout:4/440: sync 2024-09-13T23:06:09.894 INFO:tasks.workunit.client.0.smithi115.stdout:4/441: chown db/d16/d3f/d66/d68/d6a/f7a 0 1 2024-09-13T23:06:09.894 INFO:tasks.workunit.client.0.smithi115.stdout:8/349: dread d3/d5/dc/d16/d1f/d27/f60 [0,4194304] 0 2024-09-13T23:06:09.894 INFO:tasks.workunit.client.0.smithi115.stdout:8/350: fsync d3/d5/dc/d16/d1f/d27/d79/f7c 0 2024-09-13T23:06:09.895 INFO:tasks.workunit.client.0.smithi115.stdout:9/340: link d0/d13/d17/d1f/d4e/f5d d0/d43/f6d 0 2024-09-13T23:06:09.895 INFO:tasks.workunit.client.0.smithi115.stdout:9/341: stat d0/d43/d53/f59 0 2024-09-13T23:06:09.896 INFO:tasks.workunit.client.0.smithi115.stdout:9/342: chown d0/f2 0 1 2024-09-13T23:06:09.896 INFO:tasks.workunit.client.0.smithi115.stdout:9/343: chown d0/l3c 236838800 1 2024-09-13T23:06:09.896 INFO:tasks.workunit.client.0.smithi115.stdout:5/328: getdents d8/dd/d20/d27 0 2024-09-13T23:06:09.899 INFO:tasks.workunit.client.0.smithi115.stdout:7/338: dwrite da/f10 [4194304,4194304] 0 2024-09-13T23:06:09.899 INFO:tasks.workunit.client.0.smithi115.stdout:7/339: fsync da/fc 0 2024-09-13T23:06:09.902 INFO:tasks.workunit.client.0.smithi115.stdout:7/340: stat da/dd/d13/d36/l4e 0 2024-09-13T23:06:09.908 INFO:tasks.workunit.client.0.smithi115.stdout:5/329: dread d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:09.908 INFO:tasks.workunit.client.0.smithi115.stdout:5/330: chown d8/f16 482933 1 2024-09-13T23:06:09.908 INFO:tasks.workunit.client.0.smithi115.stdout:1/382: dread d0/de/d1a/d29/f39 [0,4194304] 0 2024-09-13T23:06:09.911 INFO:tasks.workunit.client.0.smithi115.stdout:5/331: rename d8/l49 to d8/d36/l62 0 2024-09-13T23:06:09.911 INFO:tasks.workunit.client.0.smithi115.stdout:5/332: write d8/dd/d20/d23/f55 [570606,11923] 0 2024-09-13T23:06:09.912 INFO:tasks.workunit.client.0.smithi115.stdout:7/341: dread da/df/f2c [0,4194304] 0 2024-09-13T23:06:09.913 INFO:tasks.workunit.client.0.smithi115.stdout:7/342: mknod da/dd/c7a 0 2024-09-13T23:06:09.915 INFO:tasks.workunit.client.0.smithi115.stdout:7/343: symlink da/dd/d1c/d2d/d41/l7b 0 2024-09-13T23:06:09.915 INFO:tasks.workunit.client.0.smithi115.stdout:9/344: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:09.917 INFO:tasks.workunit.client.0.smithi115.stdout:7/344: mkdir da/dd/d13/d24/d52/d7c 0 2024-09-13T23:06:09.919 INFO:tasks.workunit.client.0.smithi115.stdout:7/345: unlink da/dd/c30 0 2024-09-13T23:06:09.919 INFO:tasks.workunit.client.0.smithi115.stdout:0/377: dwrite d6/d24/d25/d2b/d82/d44/f56 [0,4194304] 0 2024-09-13T23:06:09.920 INFO:tasks.workunit.client.0.smithi115.stdout:4/442: dwrite db/d11/f46 [0,4194304] 0 2024-09-13T23:06:09.921 INFO:tasks.workunit.client.0.smithi115.stdout:9/345: rename d0/lf to d0/d13/d17/d1f/d35/d40/l6e 0 2024-09-13T23:06:09.921 INFO:tasks.workunit.client.0.smithi115.stdout:9/346: chown d0/d13/d3b/d42/c58 2 1 2024-09-13T23:06:09.923 INFO:tasks.workunit.client.0.smithi115.stdout:8/351: rmdir d3/d5/d1c/d41 39 2024-09-13T23:06:09.924 INFO:tasks.workunit.client.0.smithi115.stdout:0/378: write d6/d24/d25/d2b/d82/d44/f4b [2700434,98138] 0 2024-09-13T23:06:09.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/379: read d6/f4d [306633,95737] 0 2024-09-13T23:06:09.926 INFO:tasks.workunit.client.0.smithi115.stdout:0/380: write d6/d24/d25/d58/d5b/f80 [942447,16365] 0 2024-09-13T23:06:09.932 INFO:tasks.workunit.client.0.smithi115.stdout:4/443: symlink db/d16/d3f/d66/d68/d71/l7c 0 2024-09-13T23:06:09.932 INFO:tasks.workunit.client.0.smithi115.stdout:9/347: getdents d0/d13/d3b/d42 0 2024-09-13T23:06:09.933 INFO:tasks.workunit.client.0.smithi115.stdout:8/352: mknod d3/d5/dc/d16/d1f/d27/d79/c81 0 2024-09-13T23:06:09.936 INFO:tasks.workunit.client.0.smithi115.stdout:9/348: creat d0/d13/d17/d1f/d35/d62/f6f x:0 0 0 2024-09-13T23:06:09.937 INFO:tasks.workunit.client.0.smithi115.stdout:9/349: write d0/d13/d17/d1f/d28/f38 [240801,40536] 0 2024-09-13T23:06:09.943 INFO:tasks.workunit.client.0.smithi115.stdout:1/383: dwrite d0/de/d1b/d25/d4d/d51/d31/f53 [0,4194304] 0 2024-09-13T23:06:09.943 INFO:tasks.workunit.client.0.smithi115.stdout:1/384: getdents d0/de/d1a/d29/d47/d74 0 2024-09-13T23:06:09.943 INFO:tasks.workunit.client.0.smithi115.stdout:5/333: dwrite d8/dd/d20/d23/f3e [0,4194304] 0 2024-09-13T23:06:09.945 INFO:tasks.workunit.client.0.smithi115.stdout:9/350: dread d0/d43/d53/f59 [0,4194304] 0 2024-09-13T23:06:09.946 INFO:tasks.workunit.client.0.smithi115.stdout:7/346: dwrite da/dd/d1c/d2d/d45/d4d/f73 [0,4194304] 0 2024-09-13T23:06:09.951 INFO:tasks.workunit.client.0.smithi115.stdout:1/385: rename d0/de/d1b/f35 to d0/de/d1b/d25/d4d/d51/d31/d37/f78 0 2024-09-13T23:06:09.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/347: creat da/dd/d1c/f7d x:0 0 0 2024-09-13T23:06:09.959 INFO:tasks.workunit.client.0.smithi115.stdout:4/444: dwrite db/d11/d54/f44 [0,4194304] 0 2024-09-13T23:06:09.959 INFO:tasks.workunit.client.0.smithi115.stdout:4/445: fsync db/d16/d3f/f5a 0 2024-09-13T23:06:09.960 INFO:tasks.workunit.client.0.smithi115.stdout:8/353: dwrite d3/d5/dc/f4c [0,4194304] 0 2024-09-13T23:06:09.961 INFO:tasks.workunit.client.0.smithi115.stdout:1/386: truncate d0/de/d1b/d25/d4d/d51/d23/d65/f70 2996214 0 2024-09-13T23:06:09.961 INFO:tasks.workunit.client.0.smithi115.stdout:7/348: stat da/dd/d16/l56 0 2024-09-13T23:06:09.965 INFO:tasks.workunit.client.0.smithi115.stdout:4/446: creat db/d11/d2e/d33/d36/d51/f7d x:0 0 0 2024-09-13T23:06:09.968 INFO:tasks.workunit.client.0.smithi115.stdout:8/354: creat d3/d5/dc/d16/d1f/d27/d68/f82 x:0 0 0 2024-09-13T23:06:09.968 INFO:tasks.workunit.client.0.smithi115.stdout:8/355: truncate d3/d5/d6a/f75 299899 0 2024-09-13T23:06:09.969 INFO:tasks.workunit.client.0.smithi115.stdout:1/387: write d0/de/d1b/d25/f3d [2380675,123662] 0 2024-09-13T23:06:09.969 INFO:tasks.workunit.client.0.smithi115.stdout:1/388: readlink d0/de/d1b/d25/l5b 0 2024-09-13T23:06:09.969 INFO:tasks.workunit.client.0.smithi115.stdout:7/349: mkdir da/dd/d13/d7e 0 2024-09-13T23:06:09.970 INFO:tasks.workunit.client.0.smithi115.stdout:4/447: rmdir db/d19/d1d 39 2024-09-13T23:06:09.970 INFO:tasks.workunit.client.0.smithi115.stdout:4/448: chown db/d19/l20 5 1 2024-09-13T23:06:09.971 INFO:tasks.workunit.client.0.smithi115.stdout:5/334: rename d8/dd/d20/d35 to d8/dd/d20/d23/d54/d63 0 2024-09-13T23:06:09.971 INFO:tasks.workunit.client.0.smithi115.stdout:5/335: dread - d8/dd/f5c zero size 2024-09-13T23:06:09.971 INFO:tasks.workunit.client.0.smithi115.stdout:5/336: write d8/dd/ff [3113924,52235] 0 2024-09-13T23:06:09.973 INFO:tasks.workunit.client.0.smithi115.stdout:1/389: mkdir d0/de/d1b/d25/d4d/d51/d31/d79 0 2024-09-13T23:06:09.976 INFO:tasks.workunit.client.0.smithi115.stdout:9/351: rename d0/fd to d0/d13/d17/d1f/f70 0 2024-09-13T23:06:09.976 INFO:tasks.workunit.client.0.smithi115.stdout:9/352: fdatasync d0/d13/d17/d1f/d4e/f5d 0 2024-09-13T23:06:09.978 INFO:tasks.workunit.client.0.smithi115.stdout:8/356: dread d3/d5/dc/f4c [0,4194304] 0 2024-09-13T23:06:09.978 INFO:tasks.workunit.client.0.smithi115.stdout:8/357: dread - d3/d5/d1d/d63/f7d zero size 2024-09-13T23:06:09.978 INFO:tasks.workunit.client.0.smithi115.stdout:5/337: mkdir d8/dd/d64 0 2024-09-13T23:06:09.979 INFO:tasks.workunit.client.0.smithi115.stdout:7/350: rename da/f21 to da/dd/d1c/d2d/d45/f7f 0 2024-09-13T23:06:09.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/338: creat d8/dd/d20/d23/d54/d63/f65 x:0 0 0 2024-09-13T23:06:09.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/339: read d8/f2a [674593,27069] 0 2024-09-13T23:06:09.984 INFO:tasks.workunit.client.0.smithi115.stdout:1/390: rename d0/de/d1b/d25/d4d/d51/d31/d37/f3f to d0/de/d1a/d29/d47/d6a/f7a 0 2024-09-13T23:06:09.985 INFO:tasks.workunit.client.0.smithi115.stdout:7/351: mknod da/dd/d1c/d2d/d45/c80 0 2024-09-13T23:06:09.987 INFO:tasks.workunit.client.0.smithi115.stdout:5/340: unlink d8/lc 0 2024-09-13T23:06:09.989 INFO:tasks.workunit.client.0.smithi115.stdout:8/358: rename d3/d5/dc/d16/d1f/d28/d3e/f51 to d3/d5/dc/d16/f83 0 2024-09-13T23:06:09.989 INFO:tasks.workunit.client.0.smithi115.stdout:8/359: dread - d3/d5/dc/d16/d1f/f33 zero size 2024-09-13T23:06:09.989 INFO:tasks.workunit.client.0.smithi115.stdout:8/360: read - d3/d5/dc/d16/d1f/f33 zero size 2024-09-13T23:06:09.989 INFO:tasks.workunit.client.0.smithi115.stdout:1/391: rename d0/fc to d0/de/d1b/f7b 0 2024-09-13T23:06:09.990 INFO:tasks.workunit.client.0.smithi115.stdout:1/392: getdents d0/de/d1a/d29 0 2024-09-13T23:06:09.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/341: rename d8/dd/c1c to d8/d36/c66 0 2024-09-13T23:06:09.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/342: write d8/dd/f5c [696748,74525] 0 2024-09-13T23:06:09.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/343: fdatasync d8/dd/d20/d23/d54/d63/f65 0 2024-09-13T23:06:09.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/344: write d8/dd/d20/d23/f3e [4275762,126152] 0 2024-09-13T23:06:09.992 INFO:tasks.workunit.client.0.smithi115.stdout:8/361: getdents d3/d5/dc 0 2024-09-13T23:06:09.993 INFO:tasks.workunit.client.0.smithi115.stdout:1/393: rename d0/de/d1b/d25/d4d/d51/l58 to d0/de/d62/l7c 0 2024-09-13T23:06:09.995 INFO:tasks.workunit.client.0.smithi115.stdout:4/449: dwrite db/d16/d3f/f67 [0,4194304] 0 2024-09-13T23:06:09.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/353: dwrite d0/d13/d17/d1f/f45 [0,4194304] 0 2024-09-13T23:06:09.997 INFO:tasks.workunit.client.0.smithi115.stdout:9/354: fdatasync d0/d13/d17/d1f/f70 0 2024-09-13T23:06:10.000 INFO:tasks.workunit.client.0.smithi115.stdout:4/450: rename db/d11/f46 to db/d16/f7e 0 2024-09-13T23:06:10.000 INFO:tasks.workunit.client.0.smithi115.stdout:4/451: chown db/d11/c4d 333560 1 2024-09-13T23:06:10.000 INFO:tasks.workunit.client.0.smithi115.stdout:4/452: chown db/d11/d2e/d33/d36/f60 1419133 1 2024-09-13T23:06:10.001 INFO:tasks.workunit.client.0.smithi115.stdout:6/447: sync 2024-09-13T23:06:10.001 INFO:tasks.workunit.client.0.smithi115.stdout:6/448: read d4/df/d14/d38/d2a/d3e/d56/d7b/f53 [2158548,70389] 0 2024-09-13T23:06:10.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/394: dread d0/de/d1b/d25/f3d [0,4194304] 0 2024-09-13T23:06:10.003 INFO:tasks.workunit.client.0.smithi115.stdout:4/453: rename db/d11/d2e/d35 to db/d11/d2e/d33/d36/d7f 0 2024-09-13T23:06:10.004 INFO:tasks.workunit.client.0.smithi115.stdout:6/449: truncate d4/df/d14/d38/d2a/d3e/d56/d7b/f53 13541 0 2024-09-13T23:06:10.004 INFO:tasks.workunit.client.0.smithi115.stdout:6/450: write d4/df/d14/d38/f5e [1800902,79258] 0 2024-09-13T23:06:10.005 INFO:tasks.workunit.client.0.smithi115.stdout:9/355: dread d0/d13/d17/d1f/f70 [0,4194304] 0 2024-09-13T23:06:10.005 INFO:tasks.workunit.client.0.smithi115.stdout:9/356: truncate d0/d13/f2d 5025957 0 2024-09-13T23:06:10.006 INFO:tasks.workunit.client.0.smithi115.stdout:6/451: link d4/d57/c54 d4/df/d14/d76/c8a 0 2024-09-13T23:06:10.007 INFO:tasks.workunit.client.0.smithi115.stdout:9/357: creat d0/d13/f71 x:0 0 0 2024-09-13T23:06:10.007 INFO:tasks.workunit.client.0.smithi115.stdout:9/358: creat d0/d13/f72 x:0 0 0 2024-09-13T23:06:10.009 INFO:tasks.workunit.client.0.smithi115.stdout:6/452: mkdir d4/df/d14/d38/d44/d66/d8b 0 2024-09-13T23:06:10.009 INFO:tasks.workunit.client.0.smithi115.stdout:6/453: write d4/df/d14/d38/d2a/d31/f6a [555763,47492] 0 2024-09-13T23:06:10.009 INFO:tasks.workunit.client.0.smithi115.stdout:6/454: write d4/df/d14/d67/f7a [517821,64313] 0 2024-09-13T23:06:10.009 INFO:tasks.workunit.client.0.smithi115.stdout:4/454: dread db/d11/d2e/d33/f4c [0,4194304] 0 2024-09-13T23:06:10.010 INFO:tasks.workunit.client.0.smithi115.stdout:6/455: creat d4/df/d14/d35/f8c x:0 0 0 2024-09-13T23:06:10.014 INFO:tasks.workunit.client.0.smithi115.stdout:4/455: link db/d11/f70 db/d16/d3f/d66/d68/d71/d75/f80 0 2024-09-13T23:06:10.014 INFO:tasks.workunit.client.0.smithi115.stdout:4/456: dread - db/d11/d2e/d33/d36/f60 zero size 2024-09-13T23:06:10.014 INFO:tasks.workunit.client.0.smithi115.stdout:4/457: write db/d16/f47 [4150252,53900] 0 2024-09-13T23:06:10.015 INFO:tasks.workunit.client.0.smithi115.stdout:3/443: sync 2024-09-13T23:06:10.015 INFO:tasks.workunit.client.0.smithi115.stdout:2/406: sync 2024-09-13T23:06:10.016 INFO:tasks.workunit.client.0.smithi115.stdout:3/444: chown d3/d5/d35/d71/d42/l6d 6 1 2024-09-13T23:06:10.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/458: unlink db/l21 0 2024-09-13T23:06:10.029 INFO:tasks.workunit.client.0.smithi115.stdout:2/407: link da/d21/d2d/d66/d41/d62/l67 da/d21/d2d/d78/d56/l88 0 2024-09-13T23:06:10.030 INFO:tasks.workunit.client.0.smithi115.stdout:2/408: dread da/f73 [0,4194304] 0 2024-09-13T23:06:10.030 INFO:tasks.workunit.client.0.smithi115.stdout:2/409: stat da/d21/d2d/d78/d56/d1a/l6b 0 2024-09-13T23:06:10.030 INFO:tasks.workunit.client.0.smithi115.stdout:2/410: read da/d21/d2d/f6e [805826,119880] 0 2024-09-13T23:06:10.031 INFO:tasks.workunit.client.0.smithi115.stdout:3/445: getdents d3/d5/d35/d71/d3b/d47 0 2024-09-13T23:06:10.032 INFO:tasks.workunit.client.0.smithi115.stdout:3/446: write d3/d16/d1a/d29/d49/f67 [1336037,117313] 0 2024-09-13T23:06:10.033 INFO:tasks.workunit.client.0.smithi115.stdout:8/362: dwrite d3/d5/dc/d16/d1f/d27/f60 [0,4194304] 0 2024-09-13T23:06:10.036 INFO:tasks.workunit.client.0.smithi115.stdout:2/411: link da/d21/d2d/d66/d41/d62/f71 da/d21/f89 0 2024-09-13T23:06:10.036 INFO:tasks.workunit.client.0.smithi115.stdout:2/412: read da/d21/f33 [3026994,100834] 0 2024-09-13T23:06:10.036 INFO:tasks.workunit.client.0.smithi115.stdout:5/345: dwrite d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:10.036 INFO:tasks.workunit.client.0.smithi115.stdout:8/363: mknod d3/d5/d1c/c84 0 2024-09-13T23:06:10.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/359: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:10.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/360: chown d0/d13/d17/d1f/d28/c4f 919725609 1 2024-09-13T23:06:10.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/361: chown d0/d13/d17/c27 0 1 2024-09-13T23:06:10.038 INFO:tasks.workunit.client.0.smithi115.stdout:9/362: creat d0/d13/f73 x:0 0 0 2024-09-13T23:06:10.039 INFO:tasks.workunit.client.0.smithi115.stdout:2/413: mknod da/d21/d2d/d78/d56/d74/c8a 0 2024-09-13T23:06:10.043 INFO:tasks.workunit.client.0.smithi115.stdout:8/364: rename d3/d5/dc/d16/c6e to d3/d5/dc/d23/d4e/c85 0 2024-09-13T23:06:10.043 INFO:tasks.workunit.client.0.smithi115.stdout:8/365: creat d3/d5/dc/d23/d4e/f86 x:0 0 0 2024-09-13T23:06:10.044 INFO:tasks.workunit.client.0.smithi115.stdout:1/395: dwrite d0/de/d1b/f4a [0,4194304] 0 2024-09-13T23:06:10.048 INFO:tasks.workunit.client.0.smithi115.stdout:8/366: dread d3/d5/d1d/f20 [0,4194304] 0 2024-09-13T23:06:10.050 INFO:tasks.workunit.client.0.smithi115.stdout:6/456: getdents d4/df/d14/d38/d44/d66 0 2024-09-13T23:06:10.050 INFO:tasks.workunit.client.0.smithi115.stdout:6/457: fsync d4/f3c 0 2024-09-13T23:06:10.051 INFO:tasks.workunit.client.0.smithi115.stdout:5/346: rmdir d8/dd/d20 39 2024-09-13T23:06:10.051 INFO:tasks.workunit.client.0.smithi115.stdout:2/414: write da/d21/d2d/d78/d56/f24 [1099244,122534] 0 2024-09-13T23:06:10.054 INFO:tasks.workunit.client.0.smithi115.stdout:8/367: getdents d3/d5/dc/d16/d1f/d28/d3e 0 2024-09-13T23:06:10.054 INFO:tasks.workunit.client.0.smithi115.stdout:5/347: mknod d8/dd/d20/d23/d54/d63/d5a/c67 0 2024-09-13T23:06:10.055 INFO:tasks.workunit.client.0.smithi115.stdout:5/348: chown d8/dd/d20/d23/f3e 14174 1 2024-09-13T23:06:10.056 INFO:tasks.workunit.client.0.smithi115.stdout:1/396: rmdir d0/de/d1a/d29/d47/d63 39 2024-09-13T23:06:10.056 INFO:tasks.workunit.client.0.smithi115.stdout:1/397: chown d0/de/d1a/d29/f48 1 1 2024-09-13T23:06:10.057 INFO:tasks.workunit.client.0.smithi115.stdout:8/368: mkdir d3/d87 0 2024-09-13T23:06:10.058 INFO:tasks.workunit.client.0.smithi115.stdout:6/458: dread d4/df/f74 [0,4194304] 0 2024-09-13T23:06:10.059 INFO:tasks.workunit.client.0.smithi115.stdout:5/349: mknod d8/dd/d20/c68 0 2024-09-13T23:06:10.061 INFO:tasks.workunit.client.0.smithi115.stdout:1/398: creat d0/de/d1b/d25/d4d/d51/d23/d65/f7d x:0 0 0 2024-09-13T23:06:10.061 INFO:tasks.workunit.client.0.smithi115.stdout:1/399: write d0/de/d1b/f26 [2374445,51165] 0 2024-09-13T23:06:10.062 INFO:tasks.workunit.client.0.smithi115.stdout:8/369: link d3/d5/dc/d23/c53 d3/d5/dc/d16/d1f/d28/d3e/c88 0 2024-09-13T23:06:10.062 INFO:tasks.workunit.client.0.smithi115.stdout:8/370: truncate d3/d5/fb 582781 0 2024-09-13T23:06:10.063 INFO:tasks.workunit.client.0.smithi115.stdout:4/459: dwrite db/d11/d54/f79 [0,4194304] 0 2024-09-13T23:06:10.063 INFO:tasks.workunit.client.0.smithi115.stdout:6/459: mknod d4/d57/d5a/c8d 0 2024-09-13T23:06:10.064 INFO:tasks.workunit.client.0.smithi115.stdout:5/350: link d8/d36/c66 d8/dd/d64/c69 0 2024-09-13T23:06:10.067 INFO:tasks.workunit.client.0.smithi115.stdout:1/400: unlink d0/l15 0 2024-09-13T23:06:10.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/371: symlink d3/d5/d1d/d72/l89 0 2024-09-13T23:06:10.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/372: truncate d3/d5/dc/d16/d1f/f22 1155197 0 2024-09-13T23:06:10.069 INFO:tasks.workunit.client.0.smithi115.stdout:6/460: mkdir d4/df/d14/d38/d2a/d3e/d56/d7b/d8e 0 2024-09-13T23:06:10.070 INFO:tasks.workunit.client.0.smithi115.stdout:5/351: mkdir d8/dd/d6a 0 2024-09-13T23:06:10.072 INFO:tasks.workunit.client.0.smithi115.stdout:3/447: dwrite d3/d5/d35/d71/f4b [0,4194304] 0 2024-09-13T23:06:10.073 INFO:tasks.workunit.client.0.smithi115.stdout:5/352: rename d8/c56 to d8/c6b 0 2024-09-13T23:06:10.073 INFO:tasks.workunit.client.0.smithi115.stdout:3/448: readlink d3/d5/d35/l54 0 2024-09-13T23:06:10.073 INFO:tasks.workunit.client.0.smithi115.stdout:3/449: dread - d3/d5/d35/d71/d45/d59/f6f zero size 2024-09-13T23:06:10.074 INFO:tasks.workunit.client.0.smithi115.stdout:9/363: dwrite d0/d13/d17/d1f/f45 [0,4194304] 0 2024-09-13T23:06:10.074 INFO:tasks.workunit.client.0.smithi115.stdout:2/415: dwrite da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/416: creat da/d21/d2d/d66/d41/f8b x:0 0 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/417: fsync da/d21/d2d/f6e 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/418: dread - da/d21/d2d/f80 zero size 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/419: readlink da/d21/d2d/d78/l4f 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/420: write da/d21/d2d/d78/d56/f24 [2059945,77846] 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/421: fsync da/d21/d2d/d78/f4c 0 2024-09-13T23:06:10.075 INFO:tasks.workunit.client.0.smithi115.stdout:2/422: write da/d21/f5f [894162,38476] 0 2024-09-13T23:06:10.095 INFO:tasks.workunit.client.0.smithi115.stdout:5/353: dread d8/f26 [0,4194304] 0 2024-09-13T23:06:10.097 INFO:tasks.workunit.client.0.smithi115.stdout:4/460: dwrite db/f10 [4194304,4194304] 0 2024-09-13T23:06:10.123 INFO:tasks.workunit.client.0.smithi115.stdout:3/450: dwrite d3/d5/d35/d71/d3b/d47/d28/f32 [0,4194304] 0 2024-09-13T23:06:10.123 INFO:tasks.workunit.client.0.smithi115.stdout:3/451: truncate d3/d5/db/f40 379848 0 2024-09-13T23:06:10.124 INFO:tasks.workunit.client.0.smithi115.stdout:3/452: mkdir d3/d5/d35/d71/d3b/d4d/d9f 0 2024-09-13T23:06:10.124 INFO:tasks.workunit.client.0.smithi115.stdout:3/453: mknod d3/d16/d1a/d1e/d94/ca0 0 2024-09-13T23:06:10.125 INFO:tasks.workunit.client.0.smithi115.stdout:3/454: unlink d3/d16/d1a/c85 0 2024-09-13T23:06:10.126 INFO:tasks.workunit.client.0.smithi115.stdout:3/455: mknod d3/d5/d35/d71/d3b/d4d/d9f/ca1 0 2024-09-13T23:06:10.126 INFO:tasks.workunit.client.0.smithi115.stdout:3/456: fdatasync d3/d16/d1a/f26 0 2024-09-13T23:06:10.127 INFO:tasks.workunit.client.0.smithi115.stdout:6/461: dwrite d4/df/d14/d35/f8c [0,4194304] 0 2024-09-13T23:06:10.129 INFO:tasks.workunit.client.0.smithi115.stdout:6/462: mknod d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/c8f 0 2024-09-13T23:06:10.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/463: link d4/df/d14/d38/d2a/d3e/d56/d7b/f69 d4/df/d14/d38/d2a/f90 0 2024-09-13T23:06:10.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/457: dread d3/d16/d1a/d29/f62 [0,4194304] 0 2024-09-13T23:06:10.131 INFO:tasks.workunit.client.0.smithi115.stdout:3/458: dread - d3/d5/d35/d71/d3b/f7e zero size 2024-09-13T23:06:10.131 INFO:tasks.workunit.client.0.smithi115.stdout:8/373: dwrite d3/d5/dc/f31 [0,4194304] 0 2024-09-13T23:06:10.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/364: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:10.132 INFO:tasks.workunit.client.0.smithi115.stdout:9/365: truncate d0/d13/f73 201312 0 2024-09-13T23:06:10.132 INFO:tasks.workunit.client.0.smithi115.stdout:1/401: dwrite d0/de/d1b/d25/d67/f6e [0,4194304] 0 2024-09-13T23:06:10.133 INFO:tasks.workunit.client.0.smithi115.stdout:5/354: dwrite d8/f3c [8388608,4194304] 0 2024-09-13T23:06:10.133 INFO:tasks.workunit.client.0.smithi115.stdout:4/461: dwrite db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:10.133 INFO:tasks.workunit.client.0.smithi115.stdout:4/462: stat db/d11/d2e/d33/d36/d51/d57/f63 0 2024-09-13T23:06:10.134 INFO:tasks.workunit.client.0.smithi115.stdout:0/381: sync 2024-09-13T23:06:10.134 INFO:tasks.workunit.client.0.smithi115.stdout:7/352: sync 2024-09-13T23:06:10.136 INFO:tasks.workunit.client.0.smithi115.stdout:1/402: mknod d0/de/d1b/d25/d4d/d51/c7e 0 2024-09-13T23:06:10.136 INFO:tasks.workunit.client.0.smithi115.stdout:1/403: creat d0/de/d1b/d25/d4d/d51/d23/d65/f7f x:0 0 0 2024-09-13T23:06:10.137 INFO:tasks.workunit.client.0.smithi115.stdout:2/423: rename da/d21/d2d/d66 to da/d21/d8c 0 2024-09-13T23:06:10.142 INFO:tasks.workunit.client.0.smithi115.stdout:5/355: dread d8/dd/d14/f50 [0,4194304] 0 2024-09-13T23:06:10.143 INFO:tasks.workunit.client.0.smithi115.stdout:1/404: truncate d0/dd/f3e 1242835 0 2024-09-13T23:06:10.145 INFO:tasks.workunit.client.0.smithi115.stdout:2/424: truncate da/f11 3787669 0 2024-09-13T23:06:10.146 INFO:tasks.workunit.client.0.smithi115.stdout:2/425: write da/d21/f89 [812935,127145] 0 2024-09-13T23:06:10.146 INFO:tasks.workunit.client.0.smithi115.stdout:2/426: chown da/d21/d2d/d78/d56/f45 58918 1 2024-09-13T23:06:10.148 INFO:tasks.workunit.client.0.smithi115.stdout:5/356: dread d8/dd/d20/d23/f3f [0,4194304] 0 2024-09-13T23:06:10.148 INFO:tasks.workunit.client.0.smithi115.stdout:7/353: rmdir da/df/d3b 39 2024-09-13T23:06:10.148 INFO:tasks.workunit.client.0.smithi115.stdout:5/357: truncate d8/dd/d20/f52 914065 0 2024-09-13T23:06:10.149 INFO:tasks.workunit.client.0.smithi115.stdout:2/427: creat da/d21/d8c/d41/f8d x:0 0 0 2024-09-13T23:06:10.153 INFO:tasks.workunit.client.0.smithi115.stdout:7/354: unlink da/dd/d1c/d2d/c37 0 2024-09-13T23:06:10.153 INFO:tasks.workunit.client.0.smithi115.stdout:5/358: mknod d8/dd/d5d/d5e/c6c 0 2024-09-13T23:06:10.153 INFO:tasks.workunit.client.0.smithi115.stdout:2/428: rename da/d21/d2d/d78/d56/c3c to da/d21/d2d/d78/d53/c8e 0 2024-09-13T23:06:10.155 INFO:tasks.workunit.client.0.smithi115.stdout:5/359: mkdir d8/dd/d20/d6d 0 2024-09-13T23:06:10.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/429: creat da/d21/d2d/d78/d56/d4b/f8f x:0 0 0 2024-09-13T23:06:10.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/430: fsync da/d21/d2d/d78/d56/f45 0 2024-09-13T23:06:10.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/360: dread d8/fb [0,4194304] 0 2024-09-13T23:06:10.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/361: creat d8/dd/d5d/f6e x:0 0 0 2024-09-13T23:06:10.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/362: write d8/fa [3928674,57075] 0 2024-09-13T23:06:10.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/363: truncate d8/dd/f5c 779935 0 2024-09-13T23:06:10.168 INFO:tasks.workunit.client.0.smithi115.stdout:5/364: readlink d8/dd/l22 0 2024-09-13T23:06:10.180 INFO:tasks.workunit.client.0.smithi115.stdout:5/365: dread d8/dd/d20/d23/f2f [0,4194304] 0 2024-09-13T23:06:10.180 INFO:tasks.workunit.client.0.smithi115.stdout:6/464: dwrite d4/df/d14/d38/d44/f58 [0,4194304] 0 2024-09-13T23:06:10.180 INFO:tasks.workunit.client.0.smithi115.stdout:6/465: write d4/df/d14/f18 [5178720,60767] 0 2024-09-13T23:06:10.181 INFO:tasks.workunit.client.0.smithi115.stdout:5/366: link d8/d36/c66 d8/dd/d6a/c6f 0 2024-09-13T23:06:10.183 INFO:tasks.workunit.client.0.smithi115.stdout:6/466: unlink d4/df/d14/c21 0 2024-09-13T23:06:10.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/467: chown d4/df/d14/d76/c7d 227 1 2024-09-13T23:06:10.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/468: chown d4/df/d14/d38/d44/f55 3718478 1 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:5/367: dread d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:5/368: stat d8/dd/d14/f37 0 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/374: dwrite d3/d5/d1c/d41/f57 [0,4194304] 0 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:8/375: rename d3/d5/dc/d16 to d3/d5/dc/d16/d1f/d28/d3e/d8a 22 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:5/369: getdents d8/dd/d4c 0 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/459: dwrite d3/d5/d35/d71/d45/f58 [0,4194304] 0 2024-09-13T23:06:10.186 INFO:tasks.workunit.client.0.smithi115.stdout:3/460: readlink d3/d16/l6e 0 2024-09-13T23:06:10.189 INFO:tasks.workunit.client.0.smithi115.stdout:5/370: creat d8/dd/d20/d23/f70 x:0 0 0 2024-09-13T23:06:10.191 INFO:tasks.workunit.client.0.smithi115.stdout:7/355: dwrite da/dd/d16/d29/f55 [0,4194304] 0 2024-09-13T23:06:10.191 INFO:tasks.workunit.client.0.smithi115.stdout:1/405: dwrite d0/de/d1b/f7b [0,4194304] 0 2024-09-13T23:06:10.191 INFO:tasks.workunit.client.0.smithi115.stdout:4/463: dwrite db/d11/d2e/d33/d36/f3c [0,4194304] 0 2024-09-13T23:06:10.191 INFO:tasks.workunit.client.0.smithi115.stdout:4/464: chown db/d11/d2e/d33/d36/d7f 8130826 1 2024-09-13T23:06:10.191 INFO:tasks.workunit.client.0.smithi115.stdout:3/461: link d3/d5/d5b/f68 d3/d5/d35/d71/d3b/d4d/d9f/fa2 0 2024-09-13T23:06:10.193 INFO:tasks.workunit.client.0.smithi115.stdout:2/431: dwrite f4 [0,4194304] 0 2024-09-13T23:06:10.193 INFO:tasks.workunit.client.0.smithi115.stdout:2/432: write da/d21/d2d/d78/d56/f24 [2146588,107876] 0 2024-09-13T23:06:10.193 INFO:tasks.workunit.client.0.smithi115.stdout:2/433: write da/d21/d2d/d78/d56/d4b/f8f [1012135,91042] 0 2024-09-13T23:06:10.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/356: rename da/dd/d1c/d2d/d45/d4d/d74 to da/dd/d13/d24/d67/d81 0 2024-09-13T23:06:10.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/357: chown da/dd/d1c/d2d/d45/f7f 4293 1 2024-09-13T23:06:10.195 INFO:tasks.workunit.client.0.smithi115.stdout:1/406: mkdir d0/de/d1a/d29/d47/d6a/d80 0 2024-09-13T23:06:10.200 INFO:tasks.workunit.client.0.smithi115.stdout:2/434: creat da/d21/d2d/d78/d56/d1a/f90 x:0 0 0 2024-09-13T23:06:10.202 INFO:tasks.workunit.client.0.smithi115.stdout:4/465: write db/d11/d2e/f1f [1242714,130215] 0 2024-09-13T23:06:10.202 INFO:tasks.workunit.client.0.smithi115.stdout:7/358: getdents da/dd 0 2024-09-13T23:06:10.203 INFO:tasks.workunit.client.0.smithi115.stdout:4/466: stat db/d16/c2d 0 2024-09-13T23:06:10.203 INFO:tasks.workunit.client.0.smithi115.stdout:4/467: chown db/d19/d1d/l37 213 1 2024-09-13T23:06:10.204 INFO:tasks.workunit.client.0.smithi115.stdout:7/359: getdents da/df/d3b 0 2024-09-13T23:06:10.205 INFO:tasks.workunit.client.0.smithi115.stdout:4/468: mknod db/d16/c81 0 2024-09-13T23:06:10.207 INFO:tasks.workunit.client.0.smithi115.stdout:4/469: rmdir db/d16/d3f/d66/d68 39 2024-09-13T23:06:10.207 INFO:tasks.workunit.client.0.smithi115.stdout:4/470: creat db/d16/d3f/d66/d68/d6a/f82 x:0 0 0 2024-09-13T23:06:10.208 INFO:tasks.workunit.client.0.smithi115.stdout:1/407: dread d0/de/d1a/d29/f2a [0,4194304] 0 2024-09-13T23:06:10.208 INFO:tasks.workunit.client.0.smithi115.stdout:1/408: fdatasync d0/de/d1b/d25/d4d/d51/d23/d65/f70 0 2024-09-13T23:06:10.208 INFO:tasks.workunit.client.0.smithi115.stdout:4/471: write db/d11/d54/f38 [177204,3993] 0 2024-09-13T23:06:10.209 INFO:tasks.workunit.client.0.smithi115.stdout:1/409: mknod d0/de/d1a/c81 0 2024-09-13T23:06:10.210 INFO:tasks.workunit.client.0.smithi115.stdout:1/410: write d0/f3 [3130458,65449] 0 2024-09-13T23:06:10.212 INFO:tasks.workunit.client.0.smithi115.stdout:1/411: symlink d0/de/d1a/d29/d47/d6a/d80/l82 0 2024-09-13T23:06:10.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:09 smithi152 ceph-mon[34465]: pgmap v243: 65 pgs: 65 active+clean; 436 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 40 MiB/s wr, 863 op/s 2024-09-13T23:06:10.222 INFO:tasks.workunit.client.0.smithi115.stdout:4/472: read db/d16/f7e [4181998,57485] 0 2024-09-13T23:06:10.223 INFO:tasks.workunit.client.0.smithi115.stdout:4/473: creat db/d16/d3f/d66/f83 x:0 0 0 2024-09-13T23:06:10.223 INFO:tasks.workunit.client.0.smithi115.stdout:4/474: mkdir db/d16/d3f/d66/d68/d71/d84 0 2024-09-13T23:06:10.225 INFO:tasks.workunit.client.0.smithi115.stdout:5/371: dwrite d8/dd/d20/d23/d54/d63/f65 [0,4194304] 0 2024-09-13T23:06:10.225 INFO:tasks.workunit.client.0.smithi115.stdout:4/475: unlink db/d16/d3f/d66/d68/l76 0 2024-09-13T23:06:10.225 INFO:tasks.workunit.client.0.smithi115.stdout:4/476: chown db/d16/f7e 414515 1 2024-09-13T23:06:10.226 INFO:tasks.workunit.client.0.smithi115.stdout:5/372: getdents d8/dd/d20 0 2024-09-13T23:06:10.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/477: unlink db/d16/c4f 0 2024-09-13T23:06:10.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/478: write db/d11/d54/f38 [481156,126380] 0 2024-09-13T23:06:10.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/479: creat db/d11/d54/f85 x:0 0 0 2024-09-13T23:06:10.233 INFO:tasks.workunit.client.0.smithi115.stdout:3/462: dwrite d3/d5/d35/d71/d3b/f7e [0,4194304] 0 2024-09-13T23:06:10.233 INFO:tasks.workunit.client.0.smithi115.stdout:3/463: chown d3/d5/d35/d71/d3b/d4d/l8b 156202 1 2024-09-13T23:06:10.233 INFO:tasks.workunit.client.0.smithi115.stdout:7/360: dwrite da/dd/d13/d36/f71 [0,4194304] 0 2024-09-13T23:06:10.233 INFO:tasks.workunit.client.0.smithi115.stdout:4/480: creat db/d11/d2e/d33/d36/d7f/f86 x:0 0 0 2024-09-13T23:06:10.236 INFO:tasks.workunit.client.0.smithi115.stdout:1/412: dwrite d0/de/d1a/f61 [0,4194304] 0 2024-09-13T23:06:10.236 INFO:tasks.workunit.client.0.smithi115.stdout:1/413: read - d0/f75 zero size 2024-09-13T23:06:10.237 INFO:tasks.workunit.client.0.smithi115.stdout:3/464: mknod d3/d16/d84/ca3 0 2024-09-13T23:06:10.239 INFO:tasks.workunit.client.0.smithi115.stdout:7/361: mkdir da/dd/d1c/d2d/d60/d82 0 2024-09-13T23:06:10.244 INFO:tasks.workunit.client.0.smithi115.stdout:1/414: rename d0/f75 to d0/f83 0 2024-09-13T23:06:10.249 INFO:tasks.workunit.client.0.smithi115.stdout:7/362: mknod da/dd/d1c/d2d/d45/c83 0 2024-09-13T23:06:10.251 INFO:tasks.workunit.client.0.smithi115.stdout:3/465: rename d3/d16/d1a/d29 to d3/d5/d35/d71/d3b/d4d/d9f/da4 0 2024-09-13T23:06:10.252 INFO:tasks.workunit.client.0.smithi115.stdout:3/466: mknod d3/d5/d35/ca5 0 2024-09-13T23:06:10.252 INFO:tasks.workunit.client.0.smithi115.stdout:7/363: write da/df/f2c [390752,66008] 0 2024-09-13T23:06:10.252 INFO:tasks.workunit.client.0.smithi115.stdout:7/364: stat l0 0 2024-09-13T23:06:10.253 INFO:tasks.workunit.client.0.smithi115.stdout:7/365: chown l0 1183829061 1 2024-09-13T23:06:10.253 INFO:tasks.workunit.client.0.smithi115.stdout:4/481: dwrite db/f10 [0,4194304] 0 2024-09-13T23:06:10.253 INFO:tasks.workunit.client.0.smithi115.stdout:3/467: creat d3/d5/d35/d71/d3b/d4d/d9f/da4/d49/fa6 x:0 0 0 2024-09-13T23:06:10.254 INFO:tasks.workunit.client.0.smithi115.stdout:4/482: rmdir db/d11/d2e/d33 39 2024-09-13T23:06:10.255 INFO:tasks.workunit.client.0.smithi115.stdout:3/468: mkdir d3/d16/d1a/da7 0 2024-09-13T23:06:10.256 INFO:tasks.workunit.client.0.smithi115.stdout:4/483: creat db/d19/f87 x:0 0 0 2024-09-13T23:06:10.256 INFO:tasks.workunit.client.0.smithi115.stdout:4/484: chown db/d19/f27 630 1 2024-09-13T23:06:10.266 INFO:tasks.workunit.client.0.smithi115.stdout:7/366: dread da/dd/d1c/d2d/d45/d4d/f6f [0,4194304] 0 2024-09-13T23:06:10.267 INFO:tasks.workunit.client.0.smithi115.stdout:5/373: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:10.267 INFO:tasks.workunit.client.0.smithi115.stdout:5/374: readlink d8/dd/d14/l39 0 2024-09-13T23:06:10.267 INFO:tasks.workunit.client.0.smithi115.stdout:1/415: dwrite d0/de/d1b/d25/d4d/d51/d31/d37/f3b [0,4194304] 0 2024-09-13T23:06:10.268 INFO:tasks.workunit.client.0.smithi115.stdout:5/375: rmdir d8/dd/d20/d27 39 2024-09-13T23:06:10.271 INFO:tasks.workunit.client.0.smithi115.stdout:7/367: dread da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:10.271 INFO:tasks.workunit.client.0.smithi115.stdout:3/469: rename d3/d5/d35/d71/d3b/d4d/d9f to d3/d5/d65/da8 0 2024-09-13T23:06:10.271 INFO:tasks.workunit.client.0.smithi115.stdout:3/470: chown d3/d16/d1a/d1e/f80 5 1 2024-09-13T23:06:10.271 INFO:tasks.workunit.client.0.smithi115.stdout:1/416: write d0/de/d1a/d29/f2a [2909344,76973] 0 2024-09-13T23:06:10.273 INFO:tasks.workunit.client.0.smithi115.stdout:5/376: symlink d8/dd/d14/l71 0 2024-09-13T23:06:10.274 INFO:tasks.workunit.client.0.smithi115.stdout:3/471: mknod d3/d16/d1a/da7/ca9 0 2024-09-13T23:06:10.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/368: dread da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:10.276 INFO:tasks.workunit.client.0.smithi115.stdout:1/417: truncate d0/de/d1a/d29/d47/d6a/f7a 984792 0 2024-09-13T23:06:10.276 INFO:tasks.workunit.client.0.smithi115.stdout:1/418: creat d0/de/d62/f84 x:0 0 0 2024-09-13T23:06:10.276 INFO:tasks.workunit.client.0.smithi115.stdout:5/377: rmdir d8/dd/d6a 39 2024-09-13T23:06:10.278 INFO:tasks.workunit.client.0.smithi115.stdout:3/472: creat d3/d16/d1a/d1e/d8e/faa x:0 0 0 2024-09-13T23:06:10.278 INFO:tasks.workunit.client.0.smithi115.stdout:0/382: sync 2024-09-13T23:06:10.279 INFO:tasks.workunit.client.0.smithi115.stdout:9/366: sync 2024-09-13T23:06:10.279 INFO:tasks.workunit.client.0.smithi115.stdout:1/419: creat d0/de/d1b/f85 x:0 0 0 2024-09-13T23:06:10.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/378: creat d8/dd/d20/d27/f72 x:0 0 0 2024-09-13T23:06:10.280 INFO:tasks.workunit.client.0.smithi115.stdout:5/379: truncate d8/dd/d20/d23/d54/d63/f60 4843 0 2024-09-13T23:06:10.281 INFO:tasks.workunit.client.0.smithi115.stdout:3/473: mkdir d3/d16/dab 0 2024-09-13T23:06:10.282 INFO:tasks.workunit.client.0.smithi115.stdout:0/383: creat d6/d24/d25/d2b/d61/f85 x:0 0 0 2024-09-13T23:06:10.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/367: symlink d0/d13/d17/d1f/d4e/d61/l74 0 2024-09-13T23:06:10.285 INFO:tasks.workunit.client.0.smithi115.stdout:9/368: chown d0/d13/d17/d1f/d28/c4f 1 1 2024-09-13T23:06:10.285 INFO:tasks.workunit.client.0.smithi115.stdout:3/474: truncate d3/d5/d35/d71/d3b/f7e 483015 0 2024-09-13T23:06:10.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/384: link d6/f81 d6/d24/d25/d2b/d61/f86 0 2024-09-13T23:06:10.288 INFO:tasks.workunit.client.0.smithi115.stdout:0/385: mkdir d6/d24/d25/d2b/d82/d44/d5c/d87 0 2024-09-13T23:06:10.288 INFO:tasks.workunit.client.0.smithi115.stdout:5/380: dread d8/fb [0,4194304] 0 2024-09-13T23:06:10.289 INFO:tasks.workunit.client.0.smithi115.stdout:3/475: getdents d3/d5/db 0 2024-09-13T23:06:10.290 INFO:tasks.workunit.client.0.smithi115.stdout:3/476: creat d3/d16/d1a/d1e/d76/fac x:0 0 0 2024-09-13T23:06:10.291 INFO:tasks.workunit.client.0.smithi115.stdout:0/386: getdents d6/d24/d25/d58/d5b 0 2024-09-13T23:06:10.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/477: unlink d3/d16/d1c/f2b 0 2024-09-13T23:06:10.294 INFO:tasks.workunit.client.0.smithi115.stdout:0/387: rmdir d6/d62 39 2024-09-13T23:06:10.294 INFO:tasks.workunit.client.0.smithi115.stdout:0/388: fsync d6/d24/f3d 0 2024-09-13T23:06:10.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/389: mknod d6/d24/d25/d2b/d82/d44/d64/c88 0 2024-09-13T23:06:10.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/390: dread - d6/d24/d25/d2b/d82/d44/d5c/f6c zero size 2024-09-13T23:06:10.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/391: write d6/d24/d25/d58/f7e [310762,43490] 0 2024-09-13T23:06:10.297 INFO:tasks.workunit.client.0.smithi115.stdout:1/420: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:10.298 INFO:tasks.workunit.client.0.smithi115.stdout:0/392: creat d6/d24/d25/d7f/f89 x:0 0 0 2024-09-13T23:06:10.298 INFO:tasks.workunit.client.0.smithi115.stdout:0/393: dread - d6/d24/d25/d2b/d82/d44/d5c/f6c zero size 2024-09-13T23:06:10.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:09 smithi115 ceph-mon[27601]: pgmap v243: 65 pgs: 65 active+clean; 436 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 40 MiB/s wr, 863 op/s 2024-09-13T23:06:10.300 INFO:tasks.workunit.client.0.smithi115.stdout:1/421: mknod d0/de/d1b/d25/d4d/d51/d31/d37/c86 0 2024-09-13T23:06:10.300 INFO:tasks.workunit.client.0.smithi115.stdout:1/422: dread - d0/de/d62/f6c zero size 2024-09-13T23:06:10.301 INFO:tasks.workunit.client.0.smithi115.stdout:0/394: creat d6/d24/d25/d58/d5b/f8a x:0 0 0 2024-09-13T23:06:10.301 INFO:tasks.workunit.client.0.smithi115.stdout:0/395: chown d6/d24/d25/d2b/d82/d44/d5c/f6c 25219 1 2024-09-13T23:06:10.301 INFO:tasks.workunit.client.0.smithi115.stdout:7/369: dwrite da/dd/d1c/f20 [4194304,4194304] 0 2024-09-13T23:06:10.303 INFO:tasks.workunit.client.0.smithi115.stdout:1/423: creat d0/de/d1a/d29/f87 x:0 0 0 2024-09-13T23:06:10.303 INFO:tasks.workunit.client.0.smithi115.stdout:1/424: chown d0/de/d62/l7c 29870877 1 2024-09-13T23:06:10.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/425: mknod d0/de/d1b/d25/d4d/d51/d23/d65/c88 0 2024-09-13T23:06:10.308 INFO:tasks.workunit.client.0.smithi115.stdout:1/426: getdents d0/de/d1a/d29/d47/d74 0 2024-09-13T23:06:10.316 INFO:tasks.workunit.client.0.smithi115.stdout:7/370: read da/df/f26 [1932994,95325] 0 2024-09-13T23:06:10.323 INFO:tasks.workunit.client.0.smithi115.stdout:9/369: dwrite d0/d13/f2d [4194304,4194304] 0 2024-09-13T23:06:10.325 INFO:tasks.workunit.client.0.smithi115.stdout:3/478: dwrite d3/d5/d35/d71/d45/f58 [0,4194304] 0 2024-09-13T23:06:10.325 INFO:tasks.workunit.client.0.smithi115.stdout:3/479: write d3/d16/d1a/d1e/d76/f83 [637152,128652] 0 2024-09-13T23:06:10.326 INFO:tasks.workunit.client.0.smithi115.stdout:5/381: dwrite d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:10.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/382: write d8/dd/d5d/f6e [276901,109615] 0 2024-09-13T23:06:10.327 INFO:tasks.workunit.client.0.smithi115.stdout:3/480: creat d3/d16/d84/fad x:0 0 0 2024-09-13T23:06:10.329 INFO:tasks.workunit.client.0.smithi115.stdout:3/481: creat d3/d5/d35/d71/d3b/d47/fae x:0 0 0 2024-09-13T23:06:10.330 INFO:tasks.workunit.client.0.smithi115.stdout:3/482: write d3/d5/d5b/f72 [276858,63641] 0 2024-09-13T23:06:10.340 INFO:tasks.workunit.client.0.smithi115.stdout:3/483: dread d3/f1b [0,4194304] 0 2024-09-13T23:06:10.340 INFO:tasks.workunit.client.0.smithi115.stdout:3/484: truncate d3/d5/d65/da8/fa2 804454 0 2024-09-13T23:06:10.341 INFO:tasks.workunit.client.0.smithi115.stdout:3/485: creat d3/d5/db/faf x:0 0 0 2024-09-13T23:06:10.341 INFO:tasks.workunit.client.0.smithi115.stdout:3/486: truncate d3/d5/d65/da8/da4/f52 679778 0 2024-09-13T23:06:10.342 INFO:tasks.workunit.client.0.smithi115.stdout:3/487: dread d3/d5/d65/da8/da4/f52 [0,4194304] 0 2024-09-13T23:06:10.342 INFO:tasks.workunit.client.0.smithi115.stdout:3/488: fsync d3/d16/d1a/f26 0 2024-09-13T23:06:10.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/489: rename d3/d5/d35/d71/f4e to d3/d16/d84/fb0 0 2024-09-13T23:06:10.343 INFO:tasks.workunit.client.0.smithi115.stdout:3/490: dread - d3/d16/d1a/d1e/d76/fac zero size 2024-09-13T23:06:10.344 INFO:tasks.workunit.client.0.smithi115.stdout:3/491: dread - d3/d5/d35/d71/d45/d59/f6f zero size 2024-09-13T23:06:10.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/492: link d3/d16/d1a/d1e/d76/c93 d3/d5/d65/cb1 0 2024-09-13T23:06:10.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/493: mknod d3/d16/d1c/cb2 0 2024-09-13T23:06:10.346 INFO:tasks.workunit.client.0.smithi115.stdout:3/494: readlink d3/d16/d1a/d1e/l99 0 2024-09-13T23:06:10.346 INFO:tasks.workunit.client.0.smithi115.stdout:3/495: chown d3/d5/d65/cb1 2 1 2024-09-13T23:06:10.346 INFO:tasks.workunit.client.0.smithi115.stdout:3/496: creat d3/d5/d5b/fb3 x:0 0 0 2024-09-13T23:06:10.347 INFO:tasks.workunit.client.0.smithi115.stdout:3/497: rename d3/c43 to d3/d5/d35/d71/d3b/d4d/cb4 0 2024-09-13T23:06:10.348 INFO:tasks.workunit.client.0.smithi115.stdout:3/498: unlink d3/d5/d35/d71/f4b 0 2024-09-13T23:06:10.349 INFO:tasks.workunit.client.0.smithi115.stdout:9/370: dwrite d0/d13/f72 [0,4194304] 0 2024-09-13T23:06:10.350 INFO:tasks.workunit.client.0.smithi115.stdout:7/371: dwrite da/dd/d1c/f7d [0,4194304] 0 2024-09-13T23:06:10.350 INFO:tasks.workunit.client.0.smithi115.stdout:5/383: dwrite d8/dd/d20/d23/d54/d63/f60 [0,4194304] 0 2024-09-13T23:06:10.350 INFO:tasks.workunit.client.0.smithi115.stdout:5/384: chown d8/d36/f41 200551 1 2024-09-13T23:06:10.350 INFO:tasks.workunit.client.0.smithi115.stdout:5/385: chown d8/dd/d64 23523 1 2024-09-13T23:06:10.351 INFO:tasks.workunit.client.0.smithi115.stdout:3/499: truncate d3/d16/d1a/f57 4707585 0 2024-09-13T23:06:10.351 INFO:tasks.workunit.client.0.smithi115.stdout:3/500: truncate d3/d5/db/faf 896373 0 2024-09-13T23:06:10.354 INFO:tasks.workunit.client.0.smithi115.stdout:5/386: dread d8/dd/d20/d23/f3f [0,4194304] 0 2024-09-13T23:06:10.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/371: symlink d0/d13/d17/d1f/d4e/d61/l75 0 2024-09-13T23:06:10.357 INFO:tasks.workunit.client.0.smithi115.stdout:9/372: chown d0/d13/d17/d36 134 1 2024-09-13T23:06:10.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/373: stat d0/d13/d17/d36 0 2024-09-13T23:06:10.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/374: read d0/d13/d17/d1f/f70 [1619374,113670] 0 2024-09-13T23:06:10.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/375: fdatasync d0/d13/f2e 0 2024-09-13T23:06:10.363 INFO:tasks.workunit.client.0.smithi115.stdout:9/376: dread d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:10.368 INFO:tasks.workunit.client.0.smithi115.stdout:5/387: creat d8/dd/d5d/d5e/f73 x:0 0 0 2024-09-13T23:06:10.369 INFO:tasks.workunit.client.0.smithi115.stdout:5/388: mkdir d8/dd/d74 0 2024-09-13T23:06:10.371 INFO:tasks.workunit.client.0.smithi115.stdout:5/389: creat d8/dd/d4c/f75 x:0 0 0 2024-09-13T23:06:10.373 INFO:tasks.workunit.client.0.smithi115.stdout:5/390: write d8/dd/d20/d23/f59 [421467,121598] 0 2024-09-13T23:06:10.381 INFO:tasks.workunit.client.0.smithi115.stdout:7/372: dwrite da/df/d3b/f62 [0,4194304] 0 2024-09-13T23:06:10.394 INFO:tasks.workunit.client.0.smithi115.stdout:3/501: dwrite d3/d5/d35/d71/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:10.394 INFO:tasks.workunit.client.0.smithi115.stdout:3/502: fdatasync d3/d5/d35/d71/d3b/d47/d28/f34 0 2024-09-13T23:06:10.394 INFO:tasks.workunit.client.0.smithi115.stdout:6/469: sync 2024-09-13T23:06:10.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/377: dwrite d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:10.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/391: dwrite d8/d36/f41 [0,4194304] 0 2024-09-13T23:06:10.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/392: dread - d8/dd/d20/d27/f72 zero size 2024-09-13T23:06:10.398 INFO:tasks.workunit.client.0.smithi115.stdout:5/393: readlink d8/l11 0 2024-09-13T23:06:10.398 INFO:tasks.workunit.client.0.smithi115.stdout:3/503: dread d3/d5/d35/d71/d45/d59/f5a [0,4194304] 0 2024-09-13T23:06:10.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/504: creat d3/d16/d1a/d1e/d8e/fb5 x:0 0 0 2024-09-13T23:06:10.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/505: chown d3/d5/d35/d71/d3b 844 1 2024-09-13T23:06:10.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/506: unlink d3/d16/d1c/c2e 0 2024-09-13T23:06:10.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/507: write d3/d5/d35/d71/d3b/d47/f39 [4337861,23313] 0 2024-09-13T23:06:10.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/508: dread - d3/d5/d5b/f70 zero size 2024-09-13T23:06:10.405 INFO:tasks.workunit.client.0.smithi115.stdout:6/470: dread d4/df/d14/d38/d2a/f33 [4194304,4194304] 0 2024-09-13T23:06:10.405 INFO:tasks.workunit.client.0.smithi115.stdout:3/509: getdents d3/d16/d1a/d1e/d76 0 2024-09-13T23:06:10.406 INFO:tasks.workunit.client.0.smithi115.stdout:7/373: dwrite da/dd/d1c/d2d/d45/d4d/f73 [4194304,4194304] 0 2024-09-13T23:06:10.406 INFO:tasks.workunit.client.0.smithi115.stdout:7/374: chown da/dd/d1c/d2d/d45/d4d/f6f 0 1 2024-09-13T23:06:10.406 INFO:tasks.workunit.client.0.smithi115.stdout:6/471: symlink d4/df/d14/d38/d44/d66/l91 0 2024-09-13T23:06:10.408 INFO:tasks.workunit.client.0.smithi115.stdout:3/510: rename d3/d16/f9d to d3/d16/d1a/d1e/d94/fb6 0 2024-09-13T23:06:10.411 INFO:tasks.workunit.client.0.smithi115.stdout:7/375: write da/dd/d1c/f1f [6302351,21724] 0 2024-09-13T23:06:10.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/472: mknod d4/df/d14/d38/d2a/d3e/c92 0 2024-09-13T23:06:10.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/473: chown d4/df/l3d 6437895 1 2024-09-13T23:06:10.412 INFO:tasks.workunit.client.0.smithi115.stdout:6/474: readlink d4/df/d14/d38/d2a/l52 0 2024-09-13T23:06:10.413 INFO:tasks.workunit.client.0.smithi115.stdout:7/376: read da/dd/d13/f6b [539595,44219] 0 2024-09-13T23:06:10.413 INFO:tasks.workunit.client.0.smithi115.stdout:6/475: symlink d4/df/l93 0 2024-09-13T23:06:10.415 INFO:tasks.workunit.client.0.smithi115.stdout:7/377: unlink da/dd/c34 0 2024-09-13T23:06:10.416 INFO:tasks.workunit.client.0.smithi115.stdout:7/378: mkdir da/dd/d1c/d84 0 2024-09-13T23:06:10.416 INFO:tasks.workunit.client.0.smithi115.stdout:7/379: fsync da/dd/d13/d36/f3a 0 2024-09-13T23:06:10.417 INFO:tasks.workunit.client.0.smithi115.stdout:9/378: dwrite d0/d13/d17/d1f/f70 [0,4194304] 0 2024-09-13T23:06:10.417 INFO:tasks.workunit.client.0.smithi115.stdout:9/379: write d0/f2 [4029556,65967] 0 2024-09-13T23:06:10.423 INFO:tasks.workunit.client.0.smithi115.stdout:9/380: dread d0/d13/d17/d1f/d28/f38 [0,4194304] 0 2024-09-13T23:06:10.429 INFO:tasks.workunit.client.0.smithi115.stdout:2/435: sync 2024-09-13T23:06:10.429 INFO:tasks.workunit.client.0.smithi115.stdout:8/376: sync 2024-09-13T23:06:10.429 INFO:tasks.workunit.client.0.smithi115.stdout:2/436: readlink da/d21/l79 0 2024-09-13T23:06:10.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/511: dwrite d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:10.431 INFO:tasks.workunit.client.0.smithi115.stdout:3/512: write d3/d5/f7f [585191,99824] 0 2024-09-13T23:06:10.432 INFO:tasks.workunit.client.0.smithi115.stdout:7/380: dread da/dd/d1c/d2d/d45/d4d/f73 [4194304,4194304] 0 2024-09-13T23:06:10.432 INFO:tasks.workunit.client.0.smithi115.stdout:7/381: write da/dd/d16/d29/f55 [4868747,22539] 0 2024-09-13T23:06:10.433 INFO:tasks.workunit.client.0.smithi115.stdout:3/513: mkdir d3/d5/d35/d71/d45/d98/db7 0 2024-09-13T23:06:10.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/382: mkdir da/dd/d13/d36/d85 0 2024-09-13T23:06:10.436 INFO:tasks.workunit.client.0.smithi115.stdout:7/383: read da/dd/d13/d36/f42 [219948,80613] 0 2024-09-13T23:06:10.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/384: getdents da/dd/d13/d24/d67 0 2024-09-13T23:06:10.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/385: fsync da/dd/d13/d36/f3a 0 2024-09-13T23:06:10.440 INFO:tasks.workunit.client.0.smithi115.stdout:8/377: dread d3/f2f [0,4194304] 0 2024-09-13T23:06:10.440 INFO:tasks.workunit.client.0.smithi115.stdout:8/378: truncate d3/d5/dc/d16/f83 4587294 0 2024-09-13T23:06:10.440 INFO:tasks.workunit.client.0.smithi115.stdout:8/379: write d3/d5/dc/f12 [3844242,93154] 0 2024-09-13T23:06:10.440 INFO:tasks.workunit.client.0.smithi115.stdout:6/476: dwrite d4/df/f1f [0,4194304] 0 2024-09-13T23:06:10.442 INFO:tasks.workunit.client.0.smithi115.stdout:8/380: symlink d3/d5/dc/d16/d1f/d28/d3e/l8b 0 2024-09-13T23:06:10.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/477: mknod d4/df/d14/d67/d77/c94 0 2024-09-13T23:06:10.445 INFO:tasks.workunit.client.0.smithi115.stdout:8/381: unlink d3/d5/dc/d16/d1f/d28/c4a 0 2024-09-13T23:06:10.447 INFO:tasks.workunit.client.0.smithi115.stdout:6/478: symlink d4/df/d14/d35/l95 0 2024-09-13T23:06:10.448 INFO:tasks.workunit.client.0.smithi115.stdout:8/382: mkdir d3/d5/dc/d23/d4e/d54/d8c 0 2024-09-13T23:06:10.449 INFO:tasks.workunit.client.0.smithi115.stdout:6/479: mknod d4/df/d14/d38/d2a/d31/d5b/c96 0 2024-09-13T23:06:10.449 INFO:tasks.workunit.client.0.smithi115.stdout:2/437: dwrite da/f11 [4194304,4194304] 0 2024-09-13T23:06:10.449 INFO:tasks.workunit.client.0.smithi115.stdout:2/438: fsync da/d21/d2d/f65 0 2024-09-13T23:06:10.453 INFO:tasks.workunit.client.0.smithi115.stdout:6/480: dread d4/df/f74 [0,4194304] 0 2024-09-13T23:06:10.453 INFO:tasks.workunit.client.0.smithi115.stdout:6/481: creat d4/df/d14/d35/f97 x:0 0 0 2024-09-13T23:06:10.456 INFO:tasks.workunit.client.0.smithi115.stdout:3/514: dwrite d3/d5/d35/d71/d3b/d47/f39 [0,4194304] 0 2024-09-13T23:06:10.457 INFO:tasks.workunit.client.0.smithi115.stdout:3/515: write d3/d5/d35/d71/d45/f6c [912389,36367] 0 2024-09-13T23:06:10.470 INFO:tasks.workunit.client.0.smithi115.stdout:2/439: dwrite da/d21/d8c/d41/f85 [0,4194304] 0 2024-09-13T23:06:10.470 INFO:tasks.workunit.client.0.smithi115.stdout:2/440: readlink da/l3e 0 2024-09-13T23:06:10.471 INFO:tasks.workunit.client.0.smithi115.stdout:8/383: dwrite d3/d5/dc/f64 [0,4194304] 0 2024-09-13T23:06:10.473 INFO:tasks.workunit.client.0.smithi115.stdout:7/386: rmdir da/dd 39 2024-09-13T23:06:10.478 INFO:tasks.workunit.client.0.smithi115.stdout:7/387: dread da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:10.478 INFO:tasks.workunit.client.0.smithi115.stdout:6/482: creat d4/df/d14/d38/d44/d66/d8b/f98 x:0 0 0 2024-09-13T23:06:10.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/384: dread d3/d5/dc/f64 [0,4194304] 0 2024-09-13T23:06:10.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/385: chown d3/d5/dc/d16/d1f/d28/d3e/c66 2 1 2024-09-13T23:06:10.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/386: chown d3/d5/dc/d16/d1f/d27/c3b 1224 1 2024-09-13T23:06:10.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/387: fsync d3/d5/d1c/d41/d42/d4d/f74 0 2024-09-13T23:06:10.490 INFO:tasks.workunit.client.0.smithi115.stdout:8/388: dread d3/d5/dc/f64 [0,4194304] 0 2024-09-13T23:06:10.491 INFO:tasks.workunit.client.0.smithi115.stdout:7/388: dread da/df/d3b/f62 [0,4194304] 0 2024-09-13T23:06:10.495 INFO:tasks.workunit.client.0.smithi115.stdout:3/516: mknod d3/d5/d35/d71/cb8 0 2024-09-13T23:06:10.496 INFO:tasks.workunit.client.0.smithi115.stdout:3/517: write d3/d5/d35/d71/d45/d59/f6f [1027118,29219] 0 2024-09-13T23:06:10.496 INFO:tasks.workunit.client.0.smithi115.stdout:3/518: truncate d3/d16/f97 386797 0 2024-09-13T23:06:10.496 INFO:tasks.workunit.client.0.smithi115.stdout:3/519: chown d3/l11 32915552 1 2024-09-13T23:06:10.519 INFO:tasks.workunit.client.0.smithi115.stdout:2/441: creat da/d21/d8c/d41/d62/f91 x:0 0 0 2024-09-13T23:06:10.519 INFO:tasks.workunit.client.0.smithi115.stdout:2/442: chown da/d21/d8c/d41/d62/f71 905909155 1 2024-09-13T23:06:10.519 INFO:tasks.workunit.client.0.smithi115.stdout:2/443: fdatasync da/d21/d2d/f80 0 2024-09-13T23:06:10.519 INFO:tasks.workunit.client.0.smithi115.stdout:2/444: read - da/d21/d8c/d41/d62/f91 zero size 2024-09-13T23:06:10.519 INFO:tasks.workunit.client.0.smithi115.stdout:2/445: chown da/d21/d2d/d78/d56/d1a/l6b 351 1 2024-09-13T23:06:10.521 INFO:tasks.workunit.client.0.smithi115.stdout:6/483: mkdir d4/df/d14/d38/d44/d99 0 2024-09-13T23:06:10.527 INFO:tasks.workunit.client.0.smithi115.stdout:8/389: mknod d3/d5/d1c/d41/c8d 0 2024-09-13T23:06:10.528 INFO:tasks.workunit.client.0.smithi115.stdout:7/389: symlink da/dd/d13/d36/l86 0 2024-09-13T23:06:10.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/520: unlink d3/d5/d5b/f68 0 2024-09-13T23:06:10.533 INFO:tasks.workunit.client.0.smithi115.stdout:2/446: symlink da/d21/d2d/d78/d56/d4b/l92 0 2024-09-13T23:06:10.535 INFO:tasks.workunit.client.0.smithi115.stdout:7/390: rename da/df/c12 to da/dd/d1c/d2d/d41/c87 0 2024-09-13T23:06:10.537 INFO:tasks.workunit.client.0.smithi115.stdout:2/447: symlink da/d21/d2d/d78/d53/l93 0 2024-09-13T23:06:10.538 INFO:tasks.workunit.client.0.smithi115.stdout:3/521: rename d3/d16/d1a/d1e/l51 to d3/d16/dab/lb9 0 2024-09-13T23:06:10.540 INFO:tasks.workunit.client.0.smithi115.stdout:7/391: mknod da/dd/d13/d36/d85/c88 0 2024-09-13T23:06:10.541 INFO:tasks.workunit.client.0.smithi115.stdout:2/448: link da/d77/d83/c86 da/d21/d8c/d41/c94 0 2024-09-13T23:06:10.542 INFO:tasks.workunit.client.0.smithi115.stdout:2/449: write da/d21/d8c/d41/d69/f87 [315639,102070] 0 2024-09-13T23:06:10.543 INFO:tasks.workunit.client.0.smithi115.stdout:3/522: symlink d3/d5/d35/d71/d3b/d47/d28/lba 0 2024-09-13T23:06:10.546 INFO:tasks.workunit.client.0.smithi115.stdout:7/392: truncate da/dd/d1c/d2d/d45/f7f 1271498 0 2024-09-13T23:06:10.546 INFO:tasks.workunit.client.0.smithi115.stdout:2/450: mkdir da/d21/d8c/d41/d95 0 2024-09-13T23:06:10.546 INFO:tasks.workunit.client.0.smithi115.stdout:6/484: dwrite d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [4194304,4194304] 0 2024-09-13T23:06:10.548 INFO:tasks.workunit.client.0.smithi115.stdout:2/451: rename da/d21/d8c/d41/f8d to da/d23/d2c/f96 0 2024-09-13T23:06:10.548 INFO:tasks.workunit.client.0.smithi115.stdout:8/390: dwrite d3/d5/dc/f31 [0,4194304] 0 2024-09-13T23:06:10.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/485: rename d4/df/d14/d38/d2a/d31/c32 to d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/c9a 0 2024-09-13T23:06:10.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/486: chown d4/df/d14/d38/d2a/d31/f6a 4759199 1 2024-09-13T23:06:10.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/487: chown d4/df/d14/d38/d2a/f90 10798638 1 2024-09-13T23:06:10.554 INFO:tasks.workunit.client.0.smithi115.stdout:2/452: rename da/d21/d8c/d41/f85 to da/d21/d2d/d78/d56/d1a/d7f/f97 0 2024-09-13T23:06:10.555 INFO:tasks.workunit.client.0.smithi115.stdout:6/488: creat d4/df/d14/d38/d44/d99/f9b x:0 0 0 2024-09-13T23:06:10.556 INFO:tasks.workunit.client.0.smithi115.stdout:2/453: getdents da/d21/d2d/d78/d48 0 2024-09-13T23:06:10.556 INFO:tasks.workunit.client.0.smithi115.stdout:2/454: stat da/d77/d83 0 2024-09-13T23:06:10.556 INFO:tasks.workunit.client.0.smithi115.stdout:2/455: write da/d21/d2d/f6e [1222575,110705] 0 2024-09-13T23:06:10.557 INFO:tasks.workunit.client.0.smithi115.stdout:6/489: symlink d4/df/d14/d35/l9c 0 2024-09-13T23:06:10.558 INFO:tasks.workunit.client.0.smithi115.stdout:6/490: creat d4/df/d14/d38/d2a/f9d x:0 0 0 2024-09-13T23:06:10.559 INFO:tasks.workunit.client.0.smithi115.stdout:6/491: symlink d4/df/d14/d38/d44/l9e 0 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:4/485: sync 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:0/396: sync 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:1/427: sync 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:9/381: sync 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:5/394: sync 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:5/395: truncate d8/dd/d5d/f6e 1180897 0 2024-09-13T23:06:10.566 INFO:tasks.workunit.client.0.smithi115.stdout:2/456: write da/d23/d2c/f47 [1984355,116352] 0 2024-09-13T23:06:10.567 INFO:tasks.workunit.client.0.smithi115.stdout:8/391: dwrite d3/d5/d1d/f26 [0,4194304] 0 2024-09-13T23:06:10.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/397: rename d6/d24/d25/d2b/d82/d44/d64/c6e to d6/d24/d25/d2b/d82/d44/d5c/d87/c8b 0 2024-09-13T23:06:10.570 INFO:tasks.workunit.client.0.smithi115.stdout:1/428: symlink d0/dd/l89 0 2024-09-13T23:06:10.570 INFO:tasks.workunit.client.0.smithi115.stdout:5/396: truncate d8/dd/f46 1541812 0 2024-09-13T23:06:10.570 INFO:tasks.workunit.client.0.smithi115.stdout:5/397: write d8/dd/d20/d23/f3f [4289466,2517] 0 2024-09-13T23:06:10.572 INFO:tasks.workunit.client.0.smithi115.stdout:2/457: creat da/d21/d2d/d78/d56/f98 x:0 0 0 2024-09-13T23:06:10.572 INFO:tasks.workunit.client.0.smithi115.stdout:2/458: truncate da/d21/d8c/d41/d69/f87 1247113 0 2024-09-13T23:06:10.573 INFO:tasks.workunit.client.0.smithi115.stdout:8/392: symlink d3/d5/d1c/d41/d42/l8e 0 2024-09-13T23:06:10.573 INFO:tasks.workunit.client.0.smithi115.stdout:8/393: stat d3/d5/dc/d16/d1f/d27/l30 0 2024-09-13T23:06:10.574 INFO:tasks.workunit.client.0.smithi115.stdout:0/398: getdents d6/d24/d25/d2b 0 2024-09-13T23:06:10.576 INFO:tasks.workunit.client.0.smithi115.stdout:1/429: symlink d0/de/d1a/d29/d47/d6a/l8a 0 2024-09-13T23:06:10.577 INFO:tasks.workunit.client.0.smithi115.stdout:7/393: write da/dd/d1c/d2d/d45/f7f [528389,1432] 0 2024-09-13T23:06:10.577 INFO:tasks.workunit.client.0.smithi115.stdout:2/459: link da/c36 da/d23/c99 0 2024-09-13T23:06:10.578 INFO:tasks.workunit.client.0.smithi115.stdout:8/394: creat d3/d5/d1c/d41/d42/f8f x:0 0 0 2024-09-13T23:06:10.579 INFO:tasks.workunit.client.0.smithi115.stdout:6/492: dwrite d4/df/d14/d35/f97 [0,4194304] 0 2024-09-13T23:06:10.579 INFO:tasks.workunit.client.0.smithi115.stdout:9/382: write d0/d13/d17/f1e [3697694,27383] 0 2024-09-13T23:06:10.579 INFO:tasks.workunit.client.0.smithi115.stdout:9/383: fdatasync d0/d13/d17/d1f/f66 0 2024-09-13T23:06:10.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/460: write da/d21/d8c/f63 [166817,110998] 0 2024-09-13T23:06:10.580 INFO:tasks.workunit.client.0.smithi115.stdout:2/461: fsync da/d23/f38 0 2024-09-13T23:06:10.581 INFO:tasks.workunit.client.0.smithi115.stdout:1/430: unlink d0/de/d1a/d29/f48 0 2024-09-13T23:06:10.583 INFO:tasks.workunit.client.0.smithi115.stdout:1/431: dread d0/de/d1b/f59 [0,4194304] 0 2024-09-13T23:06:10.586 INFO:tasks.workunit.client.0.smithi115.stdout:7/394: link da/d53/c5e da/dd/d13/d24/d52/c89 0 2024-09-13T23:06:10.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/399: dread d6/d62/f83 [0,4194304] 0 2024-09-13T23:06:10.592 INFO:tasks.workunit.client.0.smithi115.stdout:9/384: mkdir d0/d13/d17/d1f/d28/d76 0 2024-09-13T23:06:10.592 INFO:tasks.workunit.client.0.smithi115.stdout:9/385: dread - d0/f5b zero size 2024-09-13T23:06:10.593 INFO:tasks.workunit.client.0.smithi115.stdout:6/493: dread d4/df/d14/d38/d2a/d31/f34 [0,4194304] 0 2024-09-13T23:06:10.593 INFO:tasks.workunit.client.0.smithi115.stdout:5/398: dwrite d8/dd/d20/d27/f72 [0,4194304] 0 2024-09-13T23:06:10.593 INFO:tasks.workunit.client.0.smithi115.stdout:2/462: creat da/d23/d2c/f9a x:0 0 0 2024-09-13T23:06:10.594 INFO:tasks.workunit.client.0.smithi115.stdout:8/395: dread d3/d5/dc/f2b [0,4194304] 0 2024-09-13T23:06:10.594 INFO:tasks.workunit.client.0.smithi115.stdout:7/395: creat da/dd/d13/d24/d52/f8a x:0 0 0 2024-09-13T23:06:10.595 INFO:tasks.workunit.client.0.smithi115.stdout:0/400: truncate d6/d24/d25/d2b/f42 1191675 0 2024-09-13T23:06:10.595 INFO:tasks.workunit.client.0.smithi115.stdout:0/401: readlink d6/d62/l77 0 2024-09-13T23:06:10.604 INFO:tasks.workunit.client.0.smithi115.stdout:5/399: symlink d8/dd/d64/l76 0 2024-09-13T23:06:10.604 INFO:tasks.workunit.client.0.smithi115.stdout:5/400: truncate d8/dd/d5d/d5e/f73 578466 0 2024-09-13T23:06:10.604 INFO:tasks.workunit.client.0.smithi115.stdout:5/401: creat d8/dd/d14/f77 x:0 0 0 2024-09-13T23:06:10.604 INFO:tasks.workunit.client.0.smithi115.stdout:5/402: chown d8/dd/d20/f1a 1402654 1 2024-09-13T23:06:10.606 INFO:tasks.workunit.client.0.smithi115.stdout:9/386: write d0/d13/f2d [6214749,95165] 0 2024-09-13T23:06:10.606 INFO:tasks.workunit.client.0.smithi115.stdout:2/463: rename da/d21/d2d/d78/d48/l7c to da/d21/d8c/l9b 0 2024-09-13T23:06:10.608 INFO:tasks.workunit.client.0.smithi115.stdout:6/494: dread d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [0,4194304] 0 2024-09-13T23:06:10.608 INFO:tasks.workunit.client.0.smithi115.stdout:6/495: chown d4/df/d14/d38/d44/d66/d8b 4006695 1 2024-09-13T23:06:10.608 INFO:tasks.workunit.client.0.smithi115.stdout:5/403: mkdir d8/dd/d78 0 2024-09-13T23:06:10.608 INFO:tasks.workunit.client.0.smithi115.stdout:5/404: truncate d8/dd/d20/d4a/f4f 8882558 0 2024-09-13T23:06:10.609 INFO:tasks.workunit.client.0.smithi115.stdout:9/387: mkdir d0/d13/d17/d1f/d77 0 2024-09-13T23:06:10.609 INFO:tasks.workunit.client.0.smithi115.stdout:9/388: truncate d0/d13/d17/d1f/d28/f38 1368550 0 2024-09-13T23:06:10.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/396: rename da/df/d3b/f62 to da/dd/d13/d36/d5a/d6d/f8b 0 2024-09-13T23:06:10.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/397: stat da/dd/d13/d7e 0 2024-09-13T23:06:10.611 INFO:tasks.workunit.client.0.smithi115.stdout:7/398: chown da/dd/d1c/f1f 116 1 2024-09-13T23:06:10.612 INFO:tasks.workunit.client.0.smithi115.stdout:2/464: mknod da/d21/d2d/d78/d56/c9c 0 2024-09-13T23:06:10.612 INFO:tasks.workunit.client.0.smithi115.stdout:9/389: symlink d0/d13/d17/d1f/d35/d62/l78 0 2024-09-13T23:06:10.616 INFO:tasks.workunit.client.0.smithi115.stdout:7/399: rename da/dd/d13/d36/l4e to da/d53/l8c 0 2024-09-13T23:06:10.616 INFO:tasks.workunit.client.0.smithi115.stdout:7/400: chown da/dd/d1c/d2d/d45/c83 139 1 2024-09-13T23:06:10.617 INFO:tasks.workunit.client.0.smithi115.stdout:2/465: symlink da/d21/d2d/d78/d56/d1a/d7f/l9d 0 2024-09-13T23:06:10.619 INFO:tasks.workunit.client.0.smithi115.stdout:7/401: link c9 da/dd/d13/d24/c8d 0 2024-09-13T23:06:10.619 INFO:tasks.workunit.client.0.smithi115.stdout:7/402: fsync da/f10 0 2024-09-13T23:06:10.622 INFO:tasks.workunit.client.0.smithi115.stdout:7/403: symlink da/dd/d1c/d2d/d60/d82/l8e 0 2024-09-13T23:06:10.622 INFO:tasks.workunit.client.0.smithi115.stdout:8/396: dwrite d3/d5/d1d/f26 [4194304,4194304] 0 2024-09-13T23:06:10.622 INFO:tasks.workunit.client.0.smithi115.stdout:6/496: write d4/df/d14/d35/f8c [218305,99053] 0 2024-09-13T23:06:10.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/466: getdents da/d21/d2d/d78/d56/d1a 0 2024-09-13T23:06:10.623 INFO:tasks.workunit.client.0.smithi115.stdout:2/467: write da/d21/d2d/d78/d56/d1a/f2f [975165,109660] 0 2024-09-13T23:06:10.625 INFO:tasks.workunit.client.0.smithi115.stdout:2/468: dread da/d21/d8c/d41/d62/f71 [0,4194304] 0 2024-09-13T23:06:10.626 INFO:tasks.workunit.client.0.smithi115.stdout:2/469: creat da/f9e x:0 0 0 2024-09-13T23:06:10.634 INFO:tasks.workunit.client.0.smithi115.stdout:6/497: write d4/df/f2e [1566182,37518] 0 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/498: mkdir d4/df/d14/d38/d2a/d31/d5b/d88/d9f 0 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/499: write d4/df/d14/d38/d2a/d3e/d56/f5c [881985,30385] 0 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/500: write d4/f3c [1066207,93737] 0 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/501: chown d4/df/d14/d38/f68 212384 1 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/502: fdatasync d4/df/d14/d38/f68 0 2024-09-13T23:06:10.635 INFO:tasks.workunit.client.0.smithi115.stdout:6/503: write d4/df/d14/d38/d2a/d31/f34 [4086105,15579] 0 2024-09-13T23:06:10.637 INFO:tasks.workunit.client.0.smithi115.stdout:5/405: dwrite d8/fa [0,4194304] 0 2024-09-13T23:06:10.637 INFO:tasks.workunit.client.0.smithi115.stdout:6/504: dread d4/df/d14/d38/d2a/d3e/d56/d7b/f53 [0,4194304] 0 2024-09-13T23:06:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:9/390: dwrite d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:9/391: creat d0/d13/f79 x:0 0 0 2024-09-13T23:06:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:9/392: creat d0/d13/f7a x:0 0 0 2024-09-13T23:06:10.641 INFO:tasks.workunit.client.0.smithi115.stdout:6/505: symlink d4/df/d14/d38/d2a/d3e/d56/d7b/la0 0 2024-09-13T23:06:10.647 INFO:tasks.workunit.client.0.smithi115.stdout:6/506: dread d4/df/d14/f18 [4194304,4194304] 0 2024-09-13T23:06:10.649 INFO:tasks.workunit.client.0.smithi115.stdout:6/507: mknod d4/df/d14/d38/d2a/d31/d5b/d88/d9f/ca1 0 2024-09-13T23:06:10.649 INFO:tasks.workunit.client.0.smithi115.stdout:6/508: chown d4/df/c15 448 1 2024-09-13T23:06:10.650 INFO:tasks.workunit.client.0.smithi115.stdout:6/509: link d4/df/d14/c72 d4/df/d14/d67/ca2 0 2024-09-13T23:06:10.651 INFO:tasks.workunit.client.0.smithi115.stdout:6/510: symlink d4/df/d14/d38/d44/d66/d8b/la3 0 2024-09-13T23:06:10.651 INFO:tasks.workunit.client.0.smithi115.stdout:6/511: chown d4/df/d14/d38/d2a/d31/d5b/c96 663440 1 2024-09-13T23:06:10.652 INFO:tasks.workunit.client.0.smithi115.stdout:6/512: rename d4/df/c2f to d4/df/d14/ca4 0 2024-09-13T23:06:10.655 INFO:tasks.workunit.client.0.smithi115.stdout:6/513: rename d4/df/d14/d38/d44/f58 to d4/df/d14/d38/d2a/d3e/fa5 0 2024-09-13T23:06:10.661 INFO:tasks.workunit.client.0.smithi115.stdout:5/406: dwrite d8/dd/d20/d4a/f4f [4194304,4194304] 0 2024-09-13T23:06:10.661 INFO:tasks.workunit.client.0.smithi115.stdout:5/407: creat d8/dd/d14/f79 x:0 0 0 2024-09-13T23:06:10.661 INFO:tasks.workunit.client.0.smithi115.stdout:9/393: dwrite d0/d13/d17/d1f/d35/f60 [0,4194304] 0 2024-09-13T23:06:10.662 INFO:tasks.workunit.client.0.smithi115.stdout:5/408: mkdir d8/d7a 0 2024-09-13T23:06:10.663 INFO:tasks.workunit.client.0.smithi115.stdout:9/394: rename d0/d13/d17/d1f/d35/c44 to d0/d13/d17/d1f/c7b 0 2024-09-13T23:06:10.664 INFO:tasks.workunit.client.0.smithi115.stdout:5/409: symlink d8/dd/d20/d23/d54/l7b 0 2024-09-13T23:06:10.665 INFO:tasks.workunit.client.0.smithi115.stdout:6/514: dread d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [4194304,4194304] 0 2024-09-13T23:06:10.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/515: rename d4/c6e to d4/ca6 0 2024-09-13T23:06:10.666 INFO:tasks.workunit.client.0.smithi115.stdout:6/516: chown d4/df/d14/d38/d2a/d3e/c61 704219 1 2024-09-13T23:06:10.668 INFO:tasks.workunit.client.0.smithi115.stdout:6/517: symlink d4/df/d14/d38/la7 0 2024-09-13T23:06:10.668 INFO:tasks.workunit.client.0.smithi115.stdout:6/518: write d4/df/d14/d38/d2a/d3e/d56/d7b/f53 [490773,95424] 0 2024-09-13T23:06:10.668 INFO:tasks.workunit.client.0.smithi115.stdout:6/519: readlink d4/df/l3d 0 2024-09-13T23:06:10.672 INFO:tasks.workunit.client.0.smithi115.stdout:6/520: getdents d4/df/d14/d38/d2a/d31/d5b 0 2024-09-13T23:06:10.672 INFO:tasks.workunit.client.0.smithi115.stdout:9/395: read d0/d13/d17/d1f/d35/f60 [210041,70302] 0 2024-09-13T23:06:10.672 INFO:tasks.workunit.client.0.smithi115.stdout:6/521: mkdir d4/df/d14/d38/d2a/d31/d5b/da8 0 2024-09-13T23:06:10.673 INFO:tasks.workunit.client.0.smithi115.stdout:9/396: mknod d0/d13/d17/d1f/d35/d40/c7c 0 2024-09-13T23:06:10.674 INFO:tasks.workunit.client.0.smithi115.stdout:9/397: mkdir d0/d13/d17/d1f/d4e/d61/d7d 0 2024-09-13T23:06:10.680 INFO:tasks.workunit.client.0.smithi115.stdout:6/522: write d4/df/d14/d38/d2a/d31/f42 [3952646,125970] 0 2024-09-13T23:06:10.682 INFO:tasks.workunit.client.0.smithi115.stdout:6/523: symlink d4/df/d14/d38/d2a/la9 0 2024-09-13T23:06:10.684 INFO:tasks.workunit.client.0.smithi115.stdout:6/524: creat d4/df/d14/d38/d2a/d31/d5b/d88/d9f/faa x:0 0 0 2024-09-13T23:06:10.700 INFO:tasks.workunit.client.0.smithi115.stdout:5/410: dwrite d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:10.700 INFO:tasks.workunit.client.0.smithi115.stdout:5/411: chown d8/dd/d20/d23/d54/d63/l3a 2213 1 2024-09-13T23:06:10.700 INFO:tasks.workunit.client.0.smithi115.stdout:9/398: dwrite d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:10.700 INFO:tasks.workunit.client.0.smithi115.stdout:5/412: read d8/dd/d14/f37 [1791664,29855] 0 2024-09-13T23:06:10.701 INFO:tasks.workunit.client.0.smithi115.stdout:5/413: write d8/dd/d5d/f6e [118103,41906] 0 2024-09-13T23:06:10.727 INFO:tasks.workunit.client.0.smithi115.stdout:3/523: sync 2024-09-13T23:06:10.728 INFO:tasks.workunit.client.0.smithi115.stdout:3/524: truncate d3/d16/d1a/f57 3869419 0 2024-09-13T23:06:10.728 INFO:tasks.workunit.client.0.smithi115.stdout:3/525: truncate d3/d5/d65/da8/da4/f52 1315437 0 2024-09-13T23:06:10.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/526: fsync d3/d16/d1a/d1e/d8e/fb5 0 2024-09-13T23:06:10.730 INFO:tasks.workunit.client.0.smithi115.stdout:3/527: rename d3/d5/d35/d71/d3b/d47/d28/l4f to d3/d5/d65/da8/lbb 0 2024-09-13T23:06:10.731 INFO:tasks.workunit.client.0.smithi115.stdout:3/528: dread d3/f7c [0,4194304] 0 2024-09-13T23:06:10.749 INFO:tasks.workunit.client.0.smithi115.stdout:3/529: dwrite d3/d16/d1a/f57 [0,4194304] 0 2024-09-13T23:06:10.750 INFO:tasks.workunit.client.0.smithi115.stdout:3/530: mkdir d3/d5/d35/d71/d45/d98/dbc 0 2024-09-13T23:06:10.751 INFO:tasks.workunit.client.0.smithi115.stdout:3/531: getdents d3/d5/d35/d71/d3b/d47 0 2024-09-13T23:06:10.752 INFO:tasks.workunit.client.0.smithi115.stdout:3/532: mkdir d3/d5/db/dbd 0 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:2/470: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:4/486: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:7/404: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:1/432: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:8/397: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:0/402: sync 2024-09-13T23:06:10.785 INFO:tasks.workunit.client.0.smithi115.stdout:0/403: fdatasync d6/d24/d25/d2b/d82/d44/d5c/f6c 0 2024-09-13T23:06:10.786 INFO:tasks.workunit.client.0.smithi115.stdout:8/398: symlink d3/d5/dc/d16/d1f/d27/d68/l90 0 2024-09-13T23:06:10.786 INFO:tasks.workunit.client.0.smithi115.stdout:8/399: dread - d3/d5/dc/d23/f6f zero size 2024-09-13T23:06:10.786 INFO:tasks.workunit.client.0.smithi115.stdout:0/404: symlink d6/l8c 0 2024-09-13T23:06:10.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/405: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/c8d 0 2024-09-13T23:06:10.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/406: stat d6/d24/d25/d2b/c2e 0 2024-09-13T23:06:10.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/407: write d6/d24/d25/d58/d5b/f8a [512244,4060] 0 2024-09-13T23:06:10.788 INFO:tasks.workunit.client.0.smithi115.stdout:0/408: mknod d6/d24/d25/d2b/d82/c8e 0 2024-09-13T23:06:10.803 INFO:tasks.workunit.client.0.smithi115.stdout:4/487: read db/d19/d4e/f5b [429215,21753] 0 2024-09-13T23:06:10.804 INFO:tasks.workunit.client.0.smithi115.stdout:4/488: stat db/d16/d3f/d66/d68/d71/l7b 0 2024-09-13T23:06:10.804 INFO:tasks.workunit.client.0.smithi115.stdout:4/489: dread - db/d11/d2e/d33/d36/d7f/f86 zero size 2024-09-13T23:06:10.829 INFO:tasks.workunit.client.0.smithi115.stdout:1/433: dwrite d0/de/d1a/f6d [0,4194304] 0 2024-09-13T23:06:10.829 INFO:tasks.workunit.client.0.smithi115.stdout:2/471: dwrite da/d21/d8c/d41/d62/f91 [0,4194304] 0 2024-09-13T23:06:10.829 INFO:tasks.workunit.client.0.smithi115.stdout:2/472: creat da/d21/f9f x:0 0 0 2024-09-13T23:06:10.829 INFO:tasks.workunit.client.0.smithi115.stdout:2/473: dread - da/d21/f72 zero size 2024-09-13T23:06:10.829 INFO:tasks.workunit.client.0.smithi115.stdout:2/474: read da/d21/d8c/f63 [232010,25924] 0 2024-09-13T23:06:10.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/434: rename d0/dd/f3e to d0/de/d1a/d29/d47/d6a/d80/f8b 0 2024-09-13T23:06:10.833 INFO:tasks.workunit.client.0.smithi115.stdout:2/475: link da/d21/d8c/d41/f7a da/d23/fa0 0 2024-09-13T23:06:10.833 INFO:tasks.workunit.client.0.smithi115.stdout:1/435: readlink d0/de/l17 0 2024-09-13T23:06:10.834 INFO:tasks.workunit.client.0.smithi115.stdout:2/476: creat da/d21/d2d/d78/fa1 x:0 0 0 2024-09-13T23:06:10.834 INFO:tasks.workunit.client.0.smithi115.stdout:2/477: dread - da/d21/d8c/d41/f8b zero size 2024-09-13T23:06:10.836 INFO:tasks.workunit.client.0.smithi115.stdout:1/436: creat d0/de/d71/f8c x:0 0 0 2024-09-13T23:06:10.836 INFO:tasks.workunit.client.0.smithi115.stdout:7/405: dwrite da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:10.836 INFO:tasks.workunit.client.0.smithi115.stdout:7/406: stat c4 0 2024-09-13T23:06:10.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/400: dwrite d3/d5/dc/f32 [4194304,4194304] 0 2024-09-13T23:06:10.837 INFO:tasks.workunit.client.0.smithi115.stdout:1/437: creat d0/de/d1b/d25/d4d/d51/d31/d37/f8d x:0 0 0 2024-09-13T23:06:10.837 INFO:tasks.workunit.client.0.smithi115.stdout:7/407: mkdir da/dd/d13/d36/d5a/d6d/d8f 0 2024-09-13T23:06:10.838 INFO:tasks.workunit.client.0.smithi115.stdout:7/408: stat da/dd/d1c/d2d/d60/d82/l8e 0 2024-09-13T23:06:10.838 INFO:tasks.workunit.client.0.smithi115.stdout:8/401: symlink d3/d5/dc/d16/d1f/d28/d3e/l91 0 2024-09-13T23:06:10.838 INFO:tasks.workunit.client.0.smithi115.stdout:0/409: dwrite d6/d24/d25/f29 [4194304,4194304] 0 2024-09-13T23:06:10.839 INFO:tasks.workunit.client.0.smithi115.stdout:1/438: rename d0/f5 to d0/dd/d69/f8e 0 2024-09-13T23:06:10.840 INFO:tasks.workunit.client.0.smithi115.stdout:7/409: creat da/dd/d1c/f90 x:0 0 0 2024-09-13T23:06:10.842 INFO:tasks.workunit.client.0.smithi115.stdout:8/402: symlink d3/d5/dc/d23/d4e/d54/l92 0 2024-09-13T23:06:10.843 INFO:tasks.workunit.client.0.smithi115.stdout:4/490: dwrite db/d16/d3f/f67 [0,4194304] 0 2024-09-13T23:06:10.845 INFO:tasks.workunit.client.0.smithi115.stdout:1/439: truncate d0/de/d1a/d29/f4e 4147431 0 2024-09-13T23:06:10.849 INFO:tasks.workunit.client.0.smithi115.stdout:8/403: mknod d3/d5/d1d/d72/c93 0 2024-09-13T23:06:10.849 INFO:tasks.workunit.client.0.smithi115.stdout:0/410: getdents d6/d24/d25/d2b/d82/d44/d5c/d87 0 2024-09-13T23:06:10.849 INFO:tasks.workunit.client.0.smithi115.stdout:0/411: stat d6/f20 0 2024-09-13T23:06:10.851 INFO:tasks.workunit.client.0.smithi115.stdout:4/491: creat db/d16/d3f/d66/d68/d71/d84/f88 x:0 0 0 2024-09-13T23:06:10.855 INFO:tasks.workunit.client.0.smithi115.stdout:0/412: unlink d6/d24/d25/d2b/d82/d44/f59 0 2024-09-13T23:06:10.857 INFO:tasks.workunit.client.0.smithi115.stdout:0/413: link d6/d24/d25/d2b/d61/f86 d6/d24/d25/d2b/d82/d44/d64/f8f 0 2024-09-13T23:06:10.860 INFO:tasks.workunit.client.0.smithi115.stdout:0/414: truncate d6/f9 10569762 0 2024-09-13T23:06:10.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/415: chown d6/d24/d25/d2b/d82/d44/f5d 15785 1 2024-09-13T23:06:10.861 INFO:tasks.workunit.client.0.smithi115.stdout:0/416: dread - d6/d24/d25/d2b/d82/d44/f65 zero size 2024-09-13T23:06:10.861 INFO:tasks.workunit.client.0.smithi115.stdout:2/478: dwrite da/d21/f9f [0,4194304] 0 2024-09-13T23:06:10.861 INFO:tasks.workunit.client.0.smithi115.stdout:4/492: dread db/d11/d2e/d33/d36/d7f/f3e [0,4194304] 0 2024-09-13T23:06:10.862 INFO:tasks.workunit.client.0.smithi115.stdout:2/479: fsync da/d21/d2d/f65 0 2024-09-13T23:06:10.862 INFO:tasks.workunit.client.0.smithi115.stdout:4/493: chown db/d11/d2e/f5d 62803224 1 2024-09-13T23:06:10.864 INFO:tasks.workunit.client.0.smithi115.stdout:4/494: dread db/d16/d3f/f45 [0,4194304] 0 2024-09-13T23:06:10.864 INFO:tasks.workunit.client.0.smithi115.stdout:4/495: readlink db/d11/d2e/d33/d36/d7f/l5f 0 2024-09-13T23:06:10.864 INFO:tasks.workunit.client.0.smithi115.stdout:4/496: dread - db/d11/d2e/d33/d36/f60 zero size 2024-09-13T23:06:10.865 INFO:tasks.workunit.client.0.smithi115.stdout:2/480: creat da/d21/d2d/d78/d53/fa2 x:0 0 0 2024-09-13T23:06:10.866 INFO:tasks.workunit.client.0.smithi115.stdout:7/410: dwrite da/dd/d1c/f1f [0,4194304] 0 2024-09-13T23:06:10.866 INFO:tasks.workunit.client.0.smithi115.stdout:7/411: write da/dd/d13/d36/f42 [302752,67393] 0 2024-09-13T23:06:10.866 INFO:tasks.workunit.client.0.smithi115.stdout:7/412: write da/df/d3b/f61 [4404032,5003] 0 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:2/481: symlink da/d21/d2d/d78/la3 0 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:9/399: sync 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:6/525: sync 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:5/414: sync 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:6/526: fdatasync d4/df/f1f 0 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:9/400: chown d0/d13/d17/l3a 1 1 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:5/415: creat d8/dd/d5d/d5e/f7c x:0 0 0 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:4/497: getdents db/d11/d2e/d33/d36/d7f 0 2024-09-13T23:06:10.867 INFO:tasks.workunit.client.0.smithi115.stdout:4/498: creat db/d19/d34/f89 x:0 0 0 2024-09-13T23:06:10.868 INFO:tasks.workunit.client.0.smithi115.stdout:8/404: dwrite d3/d5/dc/d23/d4e/f67 [0,4194304] 0 2024-09-13T23:06:10.868 INFO:tasks.workunit.client.0.smithi115.stdout:8/405: creat d3/d5/d1d/f94 x:0 0 0 2024-09-13T23:06:10.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/499: write db/d11/d54/f38 [346619,25988] 0 2024-09-13T23:06:10.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/500: write db/d19/d1d/f59 [278350,93086] 0 2024-09-13T23:06:10.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/501: readlink db/d16/d3f/d66/d68/l73 0 2024-09-13T23:06:10.870 INFO:tasks.workunit.client.0.smithi115.stdout:7/413: rmdir da/dd/d1c/d2d/d45/d4d 39 2024-09-13T23:06:10.871 INFO:tasks.workunit.client.0.smithi115.stdout:3/533: sync 2024-09-13T23:06:10.871 INFO:tasks.workunit.client.0.smithi115.stdout:3/534: chown d3/d16/f97 54096887 1 2024-09-13T23:06:10.872 INFO:tasks.workunit.client.0.smithi115.stdout:9/401: getdents d0/d13/d17/d1f 0 2024-09-13T23:06:10.873 INFO:tasks.workunit.client.0.smithi115.stdout:5/416: mknod d8/dd/d20/d6d/c7d 0 2024-09-13T23:06:10.879 INFO:tasks.workunit.client.0.smithi115.stdout:8/406: truncate d3/d5/dc/f2b 1055834 0 2024-09-13T23:06:10.880 INFO:tasks.workunit.client.0.smithi115.stdout:8/407: creat d3/d5/d1d/f95 x:0 0 0 2024-09-13T23:06:10.880 INFO:tasks.workunit.client.0.smithi115.stdout:8/408: chown d3/d5/dc/d23/d4e/d54/d8c 9850533 1 2024-09-13T23:06:10.880 INFO:tasks.workunit.client.0.smithi115.stdout:6/527: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:10.883 INFO:tasks.workunit.client.0.smithi115.stdout:4/502: symlink db/d11/d2e/d33/d36/d7f/l8a 0 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:1/440: rename d0/de/d1a to d0/de/d66/d8f 0 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:1/441: truncate d0/de/d1b/d25/d4d/d51/d31/d37/f8d 950798 0 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:1/442: dread - d0/de/d66/d8f/d29/f87 zero size 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:1/443: chown d0/de/d62/f6c 263391 1 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/414: symlink da/dd/d13/d24/d52/d7c/l91 0 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/415: truncate da/dd/d1c/d2d/d45/f7f 2306898 0 2024-09-13T23:06:10.887 INFO:tasks.workunit.client.0.smithi115.stdout:9/402: link d0/d13/d17/d36/f46 d0/d43/f7e 0 2024-09-13T23:06:10.895 INFO:tasks.workunit.client.0.smithi115.stdout:1/444: link d0/dd/c18 d0/de/d1b/c90 0 2024-09-13T23:06:10.897 INFO:tasks.workunit.client.0.smithi115.stdout:5/417: dwrite d8/dd/d20/d23/d54/d63/f60 [0,4194304] 0 2024-09-13T23:06:10.897 INFO:tasks.workunit.client.0.smithi115.stdout:5/418: write d8/dd/ff [1522920,40192] 0 2024-09-13T23:06:10.897 INFO:tasks.workunit.client.0.smithi115.stdout:6/528: rmdir d4/df/d14/d38/d44/d66/d8b 39 2024-09-13T23:06:10.897 INFO:tasks.workunit.client.0.smithi115.stdout:6/529: getdents d4/df/d14/d38/d2a/d31/d5b/da8 0 2024-09-13T23:06:10.899 INFO:tasks.workunit.client.0.smithi115.stdout:1/445: rmdir d0/de/d1b/d25/d67 39 2024-09-13T23:06:10.899 INFO:tasks.workunit.client.0.smithi115.stdout:7/416: dread da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:10.899 INFO:tasks.workunit.client.0.smithi115.stdout:5/419: creat d8/d7a/f7e x:0 0 0 2024-09-13T23:06:10.901 INFO:tasks.workunit.client.0.smithi115.stdout:6/530: mkdir d4/d57/dab 0 2024-09-13T23:06:10.901 INFO:tasks.workunit.client.0.smithi115.stdout:6/531: chown d4/df/c16 1791845 1 2024-09-13T23:06:10.901 INFO:tasks.workunit.client.0.smithi115.stdout:9/403: dread d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:10.901 INFO:tasks.workunit.client.0.smithi115.stdout:1/446: unlink d0/de/d1b/d25/d4d/d51/d31/d37/c76 0 2024-09-13T23:06:10.902 INFO:tasks.workunit.client.0.smithi115.stdout:1/447: stat d0/de/d66/d8f/d29/d47/d74 0 2024-09-13T23:06:10.902 INFO:tasks.workunit.client.0.smithi115.stdout:7/417: mkdir da/dd/d13/d7e/d92 0 2024-09-13T23:06:10.902 INFO:tasks.workunit.client.0.smithi115.stdout:7/418: write da/dd/d1c/f90 [987290,95532] 0 2024-09-13T23:06:10.904 INFO:tasks.workunit.client.0.smithi115.stdout:5/420: dread d8/dd/d20/d23/f3f [0,4194304] 0 2024-09-13T23:06:10.905 INFO:tasks.workunit.client.0.smithi115.stdout:7/419: link da/dd/d16/d29/c3d da/dd/d1c/d2d/d60/d82/c93 0 2024-09-13T23:06:10.907 INFO:tasks.workunit.client.0.smithi115.stdout:5/421: rename d8/dd/d20/d23/d54/d63/c48 to d8/dd/d64/c7f 0 2024-09-13T23:06:10.909 INFO:tasks.workunit.client.0.smithi115.stdout:7/420: unlink da/c35 0 2024-09-13T23:06:10.912 INFO:tasks.workunit.client.0.smithi115.stdout:9/404: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:10.913 INFO:tasks.workunit.client.0.smithi115.stdout:8/409: dwrite d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:10.914 INFO:tasks.workunit.client.0.smithi115.stdout:8/410: write d3/d5/fb [69602,118470] 0 2024-09-13T23:06:10.914 INFO:tasks.workunit.client.0.smithi115.stdout:8/411: fdatasync d3/d5/dc/f35 0 2024-09-13T23:06:10.914 INFO:tasks.workunit.client.0.smithi115.stdout:9/405: chown d0/c12 31882 1 2024-09-13T23:06:10.914 INFO:tasks.workunit.client.0.smithi115.stdout:9/406: readlink d0/d13/l14 0 2024-09-13T23:06:10.914 INFO:tasks.workunit.client.0.smithi115.stdout:4/503: dwrite db/d11/d2e/f5d [0,4194304] 0 2024-09-13T23:06:10.915 INFO:tasks.workunit.client.0.smithi115.stdout:6/532: dread d4/df/d51/f83 [0,4194304] 0 2024-09-13T23:06:10.916 INFO:tasks.workunit.client.0.smithi115.stdout:8/412: link d3/d5/dc/d23/d4e/f77 d3/d5/f96 0 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:1/448: write d0/de/f60 [4095282,48143] 0 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:7/421: dread da/dd/d13/d36/f3a [0,4194304] 0 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:7/422: read - da/dd/d13/d24/d52/f8a zero size 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:7/423: readlink da/d53/l8c 0 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:7/424: chown da/dd/d1c/d2d/d45 5720648 1 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:7/425: chown da/dd/d13/d36/l86 405887 1 2024-09-13T23:06:10.918 INFO:tasks.workunit.client.0.smithi115.stdout:9/407: symlink d0/d13/d17/d1f/d4e/d61/l7f 0 2024-09-13T23:06:10.919 INFO:tasks.workunit.client.0.smithi115.stdout:4/504: truncate db/d19/d4e/f5b 2782001 0 2024-09-13T23:06:10.920 INFO:tasks.workunit.client.0.smithi115.stdout:6/533: rmdir d4/df/d14/d38/d2a/d31/d5b/d88 39 2024-09-13T23:06:10.922 INFO:tasks.workunit.client.0.smithi115.stdout:1/449: rename d0/de/d1b/d25/d4d/d51/d23/d65/f70 to d0/de/d66/d8f/d29/f91 0 2024-09-13T23:06:10.922 INFO:tasks.workunit.client.0.smithi115.stdout:1/450: fsync d0/f83 0 2024-09-13T23:06:10.923 INFO:tasks.workunit.client.0.smithi115.stdout:7/426: truncate da/df/f28 1065239 0 2024-09-13T23:06:10.924 INFO:tasks.workunit.client.0.smithi115.stdout:9/408: truncate d0/d13/d17/f1e 4176274 0 2024-09-13T23:06:10.924 INFO:tasks.workunit.client.0.smithi115.stdout:9/409: chown d0/d13/c33 119 1 2024-09-13T23:06:10.924 INFO:tasks.workunit.client.0.smithi115.stdout:8/413: write d3/d5/dc/d16/f38 [1871789,125055] 0 2024-09-13T23:06:10.924 INFO:tasks.workunit.client.0.smithi115.stdout:8/414: chown d3/d5/d1c/d41/d42/l5a 1270404193 1 2024-09-13T23:06:10.925 INFO:tasks.workunit.client.0.smithi115.stdout:6/534: creat d4/df/d14/d38/d44/d66/fac x:0 0 0 2024-09-13T23:06:10.926 INFO:tasks.workunit.client.0.smithi115.stdout:7/427: creat da/dd/d1c/d2d/d60/f94 x:0 0 0 2024-09-13T23:06:10.927 INFO:tasks.workunit.client.0.smithi115.stdout:7/428: link da/dd/d13/c33 da/dd/d1c/d2d/d45/c95 0 2024-09-13T23:06:10.934 INFO:tasks.workunit.client.0.smithi115.stdout:4/505: write db/d11/d2e/d33/d36/d51/d57/f63 [663674,21690] 0 2024-09-13T23:06:10.934 INFO:tasks.workunit.client.0.smithi115.stdout:4/506: stat db/d16/d3f/d66/d68/c6b 0 2024-09-13T23:06:10.935 INFO:tasks.workunit.client.0.smithi115.stdout:6/535: dread d4/df/d14/d38/d44/f55 [0,4194304] 0 2024-09-13T23:06:10.936 INFO:tasks.workunit.client.0.smithi115.stdout:8/415: write d3/d5/d1c/d41/d42/f14 [6423085,124250] 0 2024-09-13T23:06:10.936 INFO:tasks.workunit.client.0.smithi115.stdout:6/536: chown d4/df/d14/d38/d2a/d3e 7034 1 2024-09-13T23:06:10.937 INFO:tasks.workunit.client.0.smithi115.stdout:8/416: creat d3/d5/dc/d23/d4e/d54/d8c/f97 x:0 0 0 2024-09-13T23:06:10.939 INFO:tasks.workunit.client.0.smithi115.stdout:7/429: write da/dd/d1c/d2d/d45/f5f [2372630,63021] 0 2024-09-13T23:06:10.943 INFO:tasks.workunit.client.0.smithi115.stdout:6/537: dread d4/df/d14/d35/f8c [0,4194304] 0 2024-09-13T23:06:10.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/422: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:10.946 INFO:tasks.workunit.client.0.smithi115.stdout:4/507: dread db/d11/d2e/f5d [0,4194304] 0 2024-09-13T23:06:10.949 INFO:tasks.workunit.client.0.smithi115.stdout:6/538: mknod d4/df/d14/d38/d2a/cad 0 2024-09-13T23:06:10.951 INFO:tasks.workunit.client.0.smithi115.stdout:6/539: mknod d4/d57/d75/cae 0 2024-09-13T23:06:10.951 INFO:tasks.workunit.client.0.smithi115.stdout:7/430: dread da/dd/d13/d36/f71 [0,4194304] 0 2024-09-13T23:06:10.952 INFO:tasks.workunit.client.0.smithi115.stdout:6/540: stat d4/df/d51 0 2024-09-13T23:06:10.952 INFO:tasks.workunit.client.0.smithi115.stdout:6/541: write d4/df/d14/d67/f7a [642955,9290] 0 2024-09-13T23:06:10.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/542: mkdir d4/df/d14/d67/d77/daf 0 2024-09-13T23:06:10.953 INFO:tasks.workunit.client.0.smithi115.stdout:6/543: fdatasync d4/df/d14/d35/f97 0 2024-09-13T23:06:10.959 INFO:tasks.workunit.client.0.smithi115.stdout:5/423: dread d8/dd/d20/d23/d54/f58 [0,4194304] 0 2024-09-13T23:06:10.959 INFO:tasks.workunit.client.0.smithi115.stdout:5/424: chown d8/dd/d20/d23 47519 1 2024-09-13T23:06:10.960 INFO:tasks.workunit.client.0.smithi115.stdout:5/425: readlink d8/dd/d20/d23/d54/d63/l3a 0 2024-09-13T23:06:10.960 INFO:tasks.workunit.client.0.smithi115.stdout:5/426: rename d8/dd/d20/d6d/c7d to d8/dd/d5d/d5e/c80 0 2024-09-13T23:06:10.961 INFO:tasks.workunit.client.0.smithi115.stdout:9/410: dwrite d0/d43/d53/f69 [0,4194304] 0 2024-09-13T23:06:10.961 INFO:tasks.workunit.client.0.smithi115.stdout:1/451: dwrite d0/de/f60 [4194304,4194304] 0 2024-09-13T23:06:10.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/411: stat d0/d13/d17/d1f/c6c 0 2024-09-13T23:06:10.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/412: fsync d0/d13/f79 0 2024-09-13T23:06:10.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/413: write d0/f2 [4678742,111568] 0 2024-09-13T23:06:10.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/414: chown d0/l3c 425013338 1 2024-09-13T23:06:10.965 INFO:tasks.workunit.client.0.smithi115.stdout:4/508: dwrite db/d16/f47 [0,4194304] 0 2024-09-13T23:06:10.965 INFO:tasks.workunit.client.0.smithi115.stdout:4/509: chown db/d19/f87 3972849 1 2024-09-13T23:06:10.965 INFO:tasks.workunit.client.0.smithi115.stdout:1/452: unlink d0/de/d66/l68 0 2024-09-13T23:06:10.967 INFO:tasks.workunit.client.0.smithi115.stdout:7/431: getdents da/dd/d1c/d2d/d45 0 2024-09-13T23:06:10.968 INFO:tasks.workunit.client.0.smithi115.stdout:9/415: mkdir d0/d13/d17/d36/d80 0 2024-09-13T23:06:10.969 INFO:tasks.workunit.client.0.smithi115.stdout:9/416: truncate d0/d43/d53/f69 4768337 0 2024-09-13T23:06:10.970 INFO:tasks.workunit.client.0.smithi115.stdout:8/417: rmdir d3/d5 39 2024-09-13T23:06:10.972 INFO:tasks.workunit.client.0.smithi115.stdout:4/510: symlink db/d11/l8b 0 2024-09-13T23:06:10.974 INFO:tasks.workunit.client.0.smithi115.stdout:1/453: rename d0/de/d1b/d25/d4d/d51/d31/d37/c86 to d0/de/d1b/d25/d4d/d51/d23/c92 0 2024-09-13T23:06:10.979 INFO:tasks.workunit.client.0.smithi115.stdout:7/432: creat da/df/f96 x:0 0 0 2024-09-13T23:06:10.979 INFO:tasks.workunit.client.0.smithi115.stdout:9/417: rmdir d0/d13/d3b/d42 39 2024-09-13T23:06:10.979 INFO:tasks.workunit.client.0.smithi115.stdout:9/418: write d0/d13/f73 [1144289,35800] 0 2024-09-13T23:06:10.980 INFO:tasks.workunit.client.0.smithi115.stdout:8/418: mkdir d3/d5/dc/d16/d1f/d27/d68/d98 0 2024-09-13T23:06:10.981 INFO:tasks.workunit.client.0.smithi115.stdout:4/511: mknod db/d16/d3f/d66/d68/d71/d75/c8c 0 2024-09-13T23:06:10.982 INFO:tasks.workunit.client.0.smithi115.stdout:1/454: unlink d0/de/d1b/f59 0 2024-09-13T23:06:10.982 INFO:tasks.workunit.client.0.smithi115.stdout:1/455: fdatasync d0/de/d1b/f4a 0 2024-09-13T23:06:10.983 INFO:tasks.workunit.client.0.smithi115.stdout:9/419: mkdir d0/d13/d17/d1f/d28/d76/d81 0 2024-09-13T23:06:10.984 INFO:tasks.workunit.client.0.smithi115.stdout:8/419: creat d3/d5/d1d/d63/f99 x:0 0 0 2024-09-13T23:06:10.985 INFO:tasks.workunit.client.0.smithi115.stdout:5/427: dwrite d8/f16 [0,4194304] 0 2024-09-13T23:06:10.985 INFO:tasks.workunit.client.0.smithi115.stdout:5/428: fdatasync d8/dd/d20/f17 0 2024-09-13T23:06:10.986 INFO:tasks.workunit.client.0.smithi115.stdout:4/512: creat db/d19/d1d/f8d x:0 0 0 2024-09-13T23:06:10.986 INFO:tasks.workunit.client.0.smithi115.stdout:4/513: write db/d19/d1d/f59 [434112,61308] 0 2024-09-13T23:06:10.986 INFO:tasks.workunit.client.0.smithi115.stdout:4/514: creat db/d19/d1d/f8e x:0 0 0 2024-09-13T23:06:10.986 INFO:tasks.workunit.client.0.smithi115.stdout:7/433: rmdir da/dd/d1c/d2d/d60 39 2024-09-13T23:06:10.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/420: mknod d0/d13/d17/d1f/d35/d40/c82 0 2024-09-13T23:06:10.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/421: chown d0/d13/f79 15279 1 2024-09-13T23:06:10.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/422: fdatasync d0/d13/d17/d1f/d28/f3e 0 2024-09-13T23:06:10.988 INFO:tasks.workunit.client.0.smithi115.stdout:8/420: stat d3/d5/dc/d23/d4e/l71 0 2024-09-13T23:06:10.988 INFO:tasks.workunit.client.0.smithi115.stdout:8/421: write d3/d5/d1d/f95 [814341,43140] 0 2024-09-13T23:06:10.988 INFO:tasks.workunit.client.0.smithi115.stdout:8/422: truncate d3/d5/d1c/d41/d42/d4d/f5f 334951 0 2024-09-13T23:06:10.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/429: mknod d8/dd/c81 0 2024-09-13T23:06:10.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/430: chown d8/dd/c81 3 1 2024-09-13T23:06:10.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/431: truncate d8/dd/d20/d23/f70 201754 0 2024-09-13T23:06:10.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/434: rename da/df/d3b/l75 to da/dd/d1c/d2d/l97 0 2024-09-13T23:06:10.994 INFO:tasks.workunit.client.0.smithi115.stdout:9/423: link d0/d13/d17/d1f/d35/d40/l51 d0/d13/d3b/l83 0 2024-09-13T23:06:10.995 INFO:tasks.workunit.client.0.smithi115.stdout:9/424: chown d0/d13/f72 1 1 2024-09-13T23:06:10.995 INFO:tasks.workunit.client.0.smithi115.stdout:4/515: getdents db/d16/d3f/d66 0 2024-09-13T23:06:10.997 INFO:tasks.workunit.client.0.smithi115.stdout:8/423: rename d3/d5/d1d/c5d to d3/d5/c9a 0 2024-09-13T23:06:10.997 INFO:tasks.workunit.client.0.smithi115.stdout:7/435: mkdir da/dd/d1c/d2d/d41/d98 0 2024-09-13T23:06:10.998 INFO:tasks.workunit.client.0.smithi115.stdout:4/516: creat db/d11/d2e/d33/d36/d51/d57/f8f x:0 0 0 2024-09-13T23:06:11.000 INFO:tasks.workunit.client.0.smithi115.stdout:8/424: symlink d3/d5/l9b 0 2024-09-13T23:06:11.001 INFO:tasks.workunit.client.0.smithi115.stdout:7/436: mkdir da/dd/d13/d36/d5a/d99 0 2024-09-13T23:06:11.002 INFO:tasks.workunit.client.0.smithi115.stdout:4/517: creat db/d11/d2e/d33/f90 x:0 0 0 2024-09-13T23:06:11.002 INFO:tasks.workunit.client.0.smithi115.stdout:4/518: dread - db/d11/d2e/d33/d36/d51/f7d zero size 2024-09-13T23:06:11.002 INFO:tasks.workunit.client.0.smithi115.stdout:4/519: write db/d16/d3f/d66/f83 [774570,55736] 0 2024-09-13T23:06:11.003 INFO:tasks.workunit.client.0.smithi115.stdout:9/425: dread d0/d13/d17/d1f/d35/d40/f52 [0,4194304] 0 2024-09-13T23:06:11.003 INFO:tasks.workunit.client.0.smithi115.stdout:9/426: chown d0/d13/f79 28314 1 2024-09-13T23:06:11.003 INFO:tasks.workunit.client.0.smithi115.stdout:1/456: dwrite d0/de/d66/d8f/d29/f42 [0,4194304] 0 2024-09-13T23:06:11.004 INFO:tasks.workunit.client.0.smithi115.stdout:8/425: rename d3/d5/d1d/d72/l89 to d3/d5/dc/d16/d1f/d27/d79/l9c 0 2024-09-13T23:06:11.006 INFO:tasks.workunit.client.0.smithi115.stdout:7/437: rename da/dd/d1c/f27 to da/dd/d13/d7e/d92/f9a 0 2024-09-13T23:06:11.008 INFO:tasks.workunit.client.0.smithi115.stdout:1/457: dread d0/de/d66/d8f/d29/d47/d6a/d80/f8b [0,4194304] 0 2024-09-13T23:06:11.008 INFO:tasks.workunit.client.0.smithi115.stdout:1/458: stat d0/de/d1b/d25/d4d/d51/d23/d65/f7d 0 2024-09-13T23:06:11.008 INFO:tasks.workunit.client.0.smithi115.stdout:1/459: dread - d0/de/d1b/d25/d4d/d51/d23/d65/f7d zero size 2024-09-13T23:06:11.009 INFO:tasks.workunit.client.0.smithi115.stdout:8/426: link d3/d5/d1c/f2e d3/d5/dc/d23/d4e/d54/d7f/f9d 0 2024-09-13T23:06:11.009 INFO:tasks.workunit.client.0.smithi115.stdout:8/427: readlink d3/d5/dc/d23/l3a 0 2024-09-13T23:06:11.016 INFO:tasks.workunit.client.0.smithi115.stdout:7/438: symlink da/dd/d13/d36/d5a/l9b 0 2024-09-13T23:06:11.019 INFO:tasks.workunit.client.0.smithi115.stdout:8/428: rename d3/d5/dc/d23/d4e/f77 to d3/d5/d1d/d72/f9e 0 2024-09-13T23:06:11.025 INFO:tasks.workunit.client.0.smithi115.stdout:4/520: rmdir db/d11/d2e/d33 39 2024-09-13T23:06:11.025 INFO:tasks.workunit.client.0.smithi115.stdout:4/521: write db/f43 [1468009,61762] 0 2024-09-13T23:06:11.025 INFO:tasks.workunit.client.0.smithi115.stdout:4/522: truncate db/d16/f7e 4940954 0 2024-09-13T23:06:11.027 INFO:tasks.workunit.client.0.smithi115.stdout:4/523: mknod db/d19/c91 0 2024-09-13T23:06:11.027 INFO:tasks.workunit.client.0.smithi115.stdout:4/524: dread - db/d16/d3f/f6c zero size 2024-09-13T23:06:11.030 INFO:tasks.workunit.client.0.smithi115.stdout:9/427: dwrite d0/d13/f7a [0,4194304] 0 2024-09-13T23:06:11.030 INFO:tasks.workunit.client.0.smithi115.stdout:9/428: write d0/d13/d17/d1f/d35/f60 [3556587,126356] 0 2024-09-13T23:06:11.031 INFO:tasks.workunit.client.0.smithi115.stdout:4/525: rename db/d19/d1d/l4b to db/d16/d3f/d66/l92 0 2024-09-13T23:06:11.032 INFO:tasks.workunit.client.0.smithi115.stdout:7/439: dread da/dd/d13/d7e/d92/f9a [0,4194304] 0 2024-09-13T23:06:11.034 INFO:tasks.workunit.client.0.smithi115.stdout:7/440: rename da/df/d3b/f61 to da/dd/d1c/f9c 0 2024-09-13T23:06:11.040 INFO:tasks.workunit.client.0.smithi115.stdout:1/460: dwrite d0/de/d1b/f4a [0,4194304] 0 2024-09-13T23:06:11.040 INFO:tasks.workunit.client.0.smithi115.stdout:1/461: truncate d0/de/d71/f8c 624792 0 2024-09-13T23:06:11.043 INFO:tasks.workunit.client.0.smithi115.stdout:1/462: symlink d0/de/d62/l93 0 2024-09-13T23:06:11.046 INFO:tasks.workunit.client.0.smithi115.stdout:8/429: dwrite d3/d5/f1e [0,4194304] 0 2024-09-13T23:06:11.046 INFO:tasks.workunit.client.0.smithi115.stdout:1/463: rename d0/de/d1b/d25/d4d/d51/d23/c5f to d0/c94 0 2024-09-13T23:06:11.046 INFO:tasks.workunit.client.0.smithi115.stdout:8/430: dread - d3/d5/dc/d16/d1f/d28/d62/f7b zero size 2024-09-13T23:06:11.046 INFO:tasks.workunit.client.0.smithi115.stdout:1/464: chown d0/de/d66/d8f/d29/f91 5699238 1 2024-09-13T23:06:11.048 INFO:tasks.workunit.client.0.smithi115.stdout:9/429: dread d0/d13/f7a [0,4194304] 0 2024-09-13T23:06:11.049 INFO:tasks.workunit.client.0.smithi115.stdout:1/465: truncate d0/f9 2573927 0 2024-09-13T23:06:11.051 INFO:tasks.workunit.client.0.smithi115.stdout:1/466: mknod d0/c95 0 2024-09-13T23:06:11.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/467: unlink d0/de/d66/d8f/d29/f91 0 2024-09-13T23:06:11.053 INFO:tasks.workunit.client.0.smithi115.stdout:9/430: write d0/d43/f6d [29605,84814] 0 2024-09-13T23:06:11.054 INFO:tasks.workunit.client.0.smithi115.stdout:1/468: truncate d0/de/d1b/d25/d67/f6e 375602 0 2024-09-13T23:06:11.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/431: symlink d0/d43/d53/l84 0 2024-09-13T23:06:11.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/432: chown d0/d13/d17/d1f/d35/d40/c49 523580 1 2024-09-13T23:06:11.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/433: read d0/d13/d17/d36/f46 [2261318,25045] 0 2024-09-13T23:06:11.055 INFO:tasks.workunit.client.0.smithi115.stdout:9/434: fdatasync d0/d43/d53/f59 0 2024-09-13T23:06:11.056 INFO:tasks.workunit.client.0.smithi115.stdout:1/469: creat d0/de/d1b/d25/d4d/d51/d31/d79/f96 x:0 0 0 2024-09-13T23:06:11.057 INFO:tasks.workunit.client.0.smithi115.stdout:7/441: dwrite da/dd/d1c/d2d/d45/f5f [0,4194304] 0 2024-09-13T23:06:11.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/435: symlink d0/d13/d17/d1f/d67/l85 0 2024-09-13T23:06:11.058 INFO:tasks.workunit.client.0.smithi115.stdout:1/470: unlink d0/de/d66/d8f/d29/f2a 0 2024-09-13T23:06:11.058 INFO:tasks.workunit.client.0.smithi115.stdout:1/471: fsync d0/dd/f13 0 2024-09-13T23:06:11.059 INFO:tasks.workunit.client.0.smithi115.stdout:7/442: mknod da/dd/c9d 0 2024-09-13T23:06:11.061 INFO:tasks.workunit.client.0.smithi115.stdout:7/443: symlink da/df/d3b/l9e 0 2024-09-13T23:06:11.061 INFO:tasks.workunit.client.0.smithi115.stdout:7/444: fsync da/dd/d13/d24/f4f 0 2024-09-13T23:06:11.070 INFO:tasks.workunit.client.0.smithi115.stdout:8/431: dwrite d3/d5/d1d/d63/f7d [0,4194304] 0 2024-09-13T23:06:11.070 INFO:tasks.workunit.client.0.smithi115.stdout:8/432: chown d3/d5/d1c/d41/d42/c2a 21 1 2024-09-13T23:06:11.073 INFO:tasks.workunit.client.0.smithi115.stdout:8/433: creat d3/d5/d1c/d41/d42/d4d/f9f x:0 0 0 2024-09-13T23:06:11.074 INFO:tasks.workunit.client.0.smithi115.stdout:8/434: read d3/d5/d6a/f75 [144381,60684] 0 2024-09-13T23:06:11.079 INFO:tasks.workunit.client.0.smithi115.stdout:9/436: dwrite d0/d13/d17/d1f/d28/f5a [0,4194304] 0 2024-09-13T23:06:11.079 INFO:tasks.workunit.client.0.smithi115.stdout:9/437: dread - d0/d13/f79 zero size 2024-09-13T23:06:11.079 INFO:tasks.workunit.client.0.smithi115.stdout:9/438: write d0/f5b [42667,109948] 0 2024-09-13T23:06:11.079 INFO:tasks.workunit.client.0.smithi115.stdout:7/445: read da/dd/d1c/f7d [2827192,63969] 0 2024-09-13T23:06:11.083 INFO:tasks.workunit.client.0.smithi115.stdout:8/435: mkdir d3/d5/dc/d16/d1f/d27/d79/da0 0 2024-09-13T23:06:11.084 INFO:tasks.workunit.client.0.smithi115.stdout:1/472: dwrite d0/de/d66/d8f/d29/f4e [0,4194304] 0 2024-09-13T23:06:11.086 INFO:tasks.workunit.client.0.smithi115.stdout:9/439: symlink d0/d13/d3b/d42/l86 0 2024-09-13T23:06:11.087 INFO:tasks.workunit.client.0.smithi115.stdout:7/446: rmdir da/dd/d13/d24/d67 39 2024-09-13T23:06:11.094 INFO:tasks.workunit.client.0.smithi115.stdout:8/436: dread d3/d5/f44 [0,4194304] 0 2024-09-13T23:06:11.094 INFO:tasks.workunit.client.0.smithi115.stdout:7/447: symlink da/dd/d1c/d2d/d41/d98/l9f 0 2024-09-13T23:06:11.095 INFO:tasks.workunit.client.0.smithi115.stdout:1/473: mknod d0/de/d66/d8f/d29/d47/d6a/d80/c97 0 2024-09-13T23:06:11.097 INFO:tasks.workunit.client.0.smithi115.stdout:8/437: creat d3/d5/dc/d16/d1f/d28/d62/fa1 x:0 0 0 2024-09-13T23:06:11.097 INFO:tasks.workunit.client.0.smithi115.stdout:8/438: chown d3/d5/dc/f2b 1 1 2024-09-13T23:06:11.099 INFO:tasks.workunit.client.0.smithi115.stdout:1/474: write d0/de/f46 [1303354,20819] 0 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:2/482: sync 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/417: sync 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:3/535: sync 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/418: stat d6/c22 0 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:3/536: readlink d3/l9 0 2024-09-13T23:06:11.104 INFO:tasks.workunit.client.0.smithi115.stdout:2/483: readlink da/d21/d2d/d78/la3 0 2024-09-13T23:06:11.105 INFO:tasks.workunit.client.0.smithi115.stdout:0/419: readlink d6/d24/d25/d2b/d82/d44/l53 0 2024-09-13T23:06:11.105 INFO:tasks.workunit.client.0.smithi115.stdout:0/420: mknod d6/c90 0 2024-09-13T23:06:11.106 INFO:tasks.workunit.client.0.smithi115.stdout:2/484: creat da/d77/d83/fa4 x:0 0 0 2024-09-13T23:06:11.106 INFO:tasks.workunit.client.0.smithi115.stdout:2/485: readlink da/l6d 0 2024-09-13T23:06:11.106 INFO:tasks.workunit.client.0.smithi115.stdout:2/486: fsync da/d21/d2d/d78/d56/d1a/f2f 0 2024-09-13T23:06:11.107 INFO:tasks.workunit.client.0.smithi115.stdout:3/537: unlink d3/d5/d35/d4c/f61 0 2024-09-13T23:06:11.107 INFO:tasks.workunit.client.0.smithi115.stdout:3/538: stat d3/d5/d35/d71/d3b/d47/d28/f32 0 2024-09-13T23:06:11.107 INFO:tasks.workunit.client.0.smithi115.stdout:0/421: truncate d6/fd 6781508 0 2024-09-13T23:06:11.108 INFO:tasks.workunit.client.0.smithi115.stdout:2/487: mknod da/d21/d2d/d78/d56/d4b/ca5 0 2024-09-13T23:06:11.109 INFO:tasks.workunit.client.0.smithi115.stdout:3/539: symlink d3/d5/d35/d71/d3b/lbe 0 2024-09-13T23:06:11.109 INFO:tasks.workunit.client.0.smithi115.stdout:0/422: mknod d6/d24/d25/d2b/c91 0 2024-09-13T23:06:11.109 INFO:tasks.workunit.client.0.smithi115.stdout:2/488: mkdir da/d21/da6 0 2024-09-13T23:06:11.110 INFO:tasks.workunit.client.0.smithi115.stdout:0/423: creat d6/d24/d25/d58/f92 x:0 0 0 2024-09-13T23:06:11.111 INFO:tasks.workunit.client.0.smithi115.stdout:2/489: mknod da/d21/d2d/d78/d56/ca7 0 2024-09-13T23:06:11.111 INFO:tasks.workunit.client.0.smithi115.stdout:2/490: write da/d21/d2d/d78/d56/f45 [4986515,119592] 0 2024-09-13T23:06:11.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/424: rename d6/d24/d25/d58/d5b/f67 to d6/d24/d25/d2b/d82/d44/d64/f93 0 2024-09-13T23:06:11.112 INFO:tasks.workunit.client.0.smithi115.stdout:0/425: write d6/f72 [3701492,4535] 0 2024-09-13T23:06:11.113 INFO:tasks.workunit.client.0.smithi115.stdout:0/426: symlink d6/d24/d25/d7f/l94 0 2024-09-13T23:06:11.113 INFO:tasks.workunit.client.0.smithi115.stdout:0/427: fdatasync d6/d24/d25/d2b/d82/d44/f46 0 2024-09-13T23:06:11.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/439: dwrite d3/d5/dc/d16/f83 [0,4194304] 0 2024-09-13T23:06:11.137 INFO:tasks.workunit.client.0.smithi115.stdout:1/475: dwrite d0/dd/d69/f8e [0,4194304] 0 2024-09-13T23:06:11.137 INFO:tasks.workunit.client.0.smithi115.stdout:1/476: truncate d0/de/d66/d8f/f61 5019186 0 2024-09-13T23:06:11.137 INFO:tasks.workunit.client.0.smithi115.stdout:8/440: mknod d3/d5/d1d/ca2 0 2024-09-13T23:06:11.137 INFO:tasks.workunit.client.0.smithi115.stdout:1/477: symlink d0/de/d66/d8f/d29/d47/l98 0 2024-09-13T23:06:11.138 INFO:tasks.workunit.client.0.smithi115.stdout:8/441: rename d3/d5/dc/d23/d4e/d54/l92 to d3/d5/d1d/d63/la3 0 2024-09-13T23:06:11.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/478: dread - d0/de/d1b/d25/d4d/d51/d31/d79/f96 zero size 2024-09-13T23:06:11.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/479: chown d0/de 233577 1 2024-09-13T23:06:11.140 INFO:tasks.workunit.client.0.smithi115.stdout:8/442: unlink d3/d5/d1d/d72/c93 0 2024-09-13T23:06:11.140 INFO:tasks.workunit.client.0.smithi115.stdout:8/443: fsync d3/d5/d1d/d63/f99 0 2024-09-13T23:06:11.141 INFO:tasks.workunit.client.0.smithi115.stdout:8/444: truncate d3/d5/f96 2603738 0 2024-09-13T23:06:11.141 INFO:tasks.workunit.client.0.smithi115.stdout:8/445: write d3/d5/dc/d16/d1f/d28/d3e/f43 [350865,78267] 0 2024-09-13T23:06:11.142 INFO:tasks.workunit.client.0.smithi115.stdout:8/446: write d3/d5/d1c/d41/d42/f8f [860116,67210] 0 2024-09-13T23:06:11.142 INFO:tasks.workunit.client.0.smithi115.stdout:8/447: dread - d3/d5/d1c/d41/f80 zero size 2024-09-13T23:06:11.157 INFO:tasks.workunit.client.0.smithi115.stdout:8/448: dwrite d3/d5/d1c/d41/d42/f15 [0,4194304] 0 2024-09-13T23:06:11.157 INFO:tasks.workunit.client.0.smithi115.stdout:8/449: write d3/d5/dc/d16/d1f/d28/d62/f65 [608010,42564] 0 2024-09-13T23:06:11.158 INFO:tasks.workunit.client.0.smithi115.stdout:8/450: creat d3/d5/dc/d16/d1f/d27/d79/da0/fa4 x:0 0 0 2024-09-13T23:06:11.158 INFO:tasks.workunit.client.0.smithi115.stdout:8/451: dread - d3/d5/dc/d16/d1f/d27/d79/da0/fa4 zero size 2024-09-13T23:06:11.242 INFO:tasks.workunit.client.0.smithi115.stdout:2/491: dread da/d21/d8c/f63 [0,4194304] 0 2024-09-13T23:06:11.243 INFO:tasks.workunit.client.0.smithi115.stdout:9/440: dwrite d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:11.244 INFO:tasks.workunit.client.0.smithi115.stdout:2/492: mkdir da/d21/da8 0 2024-09-13T23:06:11.247 INFO:tasks.workunit.client.0.smithi115.stdout:0/428: dread d6/d24/d25/d2b/f31 [0,4194304] 0 2024-09-13T23:06:11.247 INFO:tasks.workunit.client.0.smithi115.stdout:9/441: creat d0/d13/d17/d36/d80/f87 x:0 0 0 2024-09-13T23:06:11.249 INFO:tasks.workunit.client.0.smithi115.stdout:2/493: rename da/d21/d2d/d78/d56/d1a/f2f to da/fa9 0 2024-09-13T23:06:11.250 INFO:tasks.workunit.client.0.smithi115.stdout:0/429: creat d6/d24/f95 x:0 0 0 2024-09-13T23:06:11.251 INFO:tasks.workunit.client.0.smithi115.stdout:9/442: symlink d0/d13/d17/d1f/d35/l88 0 2024-09-13T23:06:11.251 INFO:tasks.workunit.client.0.smithi115.stdout:9/443: truncate d0/d13/d17/d1f/d28/f38 2242603 0 2024-09-13T23:06:11.251 INFO:tasks.workunit.client.0.smithi115.stdout:9/444: chown d0/d13/d17/d1f/d28/f5a 1920862 1 2024-09-13T23:06:11.252 INFO:tasks.workunit.client.0.smithi115.stdout:9/445: stat d0/d13/d17/d19/l1a 0 2024-09-13T23:06:11.254 INFO:tasks.workunit.client.0.smithi115.stdout:0/430: getdents d6 0 2024-09-13T23:06:11.254 INFO:tasks.workunit.client.0.smithi115.stdout:2/494: dread da/d21/f5f [0,4194304] 0 2024-09-13T23:06:11.256 INFO:tasks.workunit.client.0.smithi115.stdout:2/495: write da/d21/d8c/d41/d69/f50 [479375,71720] 0 2024-09-13T23:06:11.257 INFO:tasks.workunit.client.0.smithi115.stdout:9/446: creat d0/d13/d17/d1f/d28/d76/d81/f89 x:0 0 0 2024-09-13T23:06:11.257 INFO:tasks.workunit.client.0.smithi115.stdout:0/431: rename f2 to d6/d24/d25/d2b/d61/f96 0 2024-09-13T23:06:11.257 INFO:tasks.workunit.client.0.smithi115.stdout:0/432: chown d6/d24/d25/d2b/d82/d44/d64/c88 49833765 1 2024-09-13T23:06:11.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/496: mkdir da/d21/d2d/d78/d56/d1a/d7f/daa 0 2024-09-13T23:06:11.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/497: write da/f73 [636741,88626] 0 2024-09-13T23:06:11.258 INFO:tasks.workunit.client.0.smithi115.stdout:9/447: mkdir d0/d13/d17/d1f/d35/d8a 0 2024-09-13T23:06:11.259 INFO:tasks.workunit.client.0.smithi115.stdout:0/433: rename d6/d24/d25/d2b/d61/c84 to d6/d24/d25/d2b/d61/c97 0 2024-09-13T23:06:11.259 INFO:tasks.workunit.client.0.smithi115.stdout:0/434: creat d6/d24/d25/d7f/f98 x:0 0 0 2024-09-13T23:06:11.260 INFO:tasks.workunit.client.0.smithi115.stdout:8/452: fsync d3/d5/f96 0 2024-09-13T23:06:11.261 INFO:tasks.workunit.client.0.smithi115.stdout:8/453: write d3/d5/d1c/d41/d42/d4d/f5f [1000546,9115] 0 2024-09-13T23:06:11.261 INFO:tasks.workunit.client.0.smithi115.stdout:8/454: write d3/d5/d1c/d41/d42/d4d/f9f [27060,97077] 0 2024-09-13T23:06:11.261 INFO:tasks.workunit.client.0.smithi115.stdout:8/455: fsync d3/d5/dc/d16/d1f/f22 0 2024-09-13T23:06:11.261 INFO:tasks.workunit.client.0.smithi115.stdout:2/498: symlink da/d21/d8c/d41/lab 0 2024-09-13T23:06:11.262 INFO:tasks.workunit.client.0.smithi115.stdout:9/448: creat d0/d13/d17/d1f/d67/f8b x:0 0 0 2024-09-13T23:06:11.262 INFO:tasks.workunit.client.0.smithi115.stdout:9/449: fdatasync d0/d13/d17/d1f/d4e/f5d 0 2024-09-13T23:06:11.262 INFO:tasks.workunit.client.0.smithi115.stdout:9/450: fdatasync d0/d13/f71 0 2024-09-13T23:06:11.263 INFO:tasks.workunit.client.0.smithi115.stdout:3/540: dwrite d3/d16/d1a/d1e/f80 [0,4194304] 0 2024-09-13T23:06:11.263 INFO:tasks.workunit.client.0.smithi115.stdout:7/448: dwrite da/dd/d1c/f22 [4194304,4194304] 0 2024-09-13T23:06:11.263 INFO:tasks.workunit.client.0.smithi115.stdout:2/499: dread da/d21/f5f [0,4194304] 0 2024-09-13T23:06:11.263 INFO:tasks.workunit.client.0.smithi115.stdout:2/500: truncate da/d21/d8c/d41/d62/f71 1706472 0 2024-09-13T23:06:11.264 INFO:tasks.workunit.client.0.smithi115.stdout:7/449: write da/dd/d13/d7e/d92/f9a [4915677,55305] 0 2024-09-13T23:06:11.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/435: creat d6/d62/f99 x:0 0 0 2024-09-13T23:06:11.264 INFO:tasks.workunit.client.0.smithi115.stdout:0/436: fsync d6/d24/f3d 0 2024-09-13T23:06:11.265 INFO:tasks.workunit.client.0.smithi115.stdout:8/456: symlink d3/d5/d1d/d72/la5 0 2024-09-13T23:06:11.265 INFO:tasks.workunit.client.0.smithi115.stdout:8/457: chown d3/d5/d1c/d41/d42/f14 13545 1 2024-09-13T23:06:11.267 INFO:tasks.workunit.client.0.smithi115.stdout:3/541: mknod d3/d16/d1a/da7/cbf 0 2024-09-13T23:06:11.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/501: mkdir da/d21/d2d/dac 0 2024-09-13T23:06:11.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/502: fdatasync da/d21/d8c/d41/d62/f71 0 2024-09-13T23:06:11.281 INFO:tasks.workunit.client.0.smithi115.stdout:7/450: creat da/dd/d1c/d2d/d41/fa0 x:0 0 0 2024-09-13T23:06:11.283 INFO:tasks.workunit.client.0.smithi115.stdout:3/542: creat d3/d5/d35/d71/d3b/d4d/d8d/fc0 x:0 0 0 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:3/543: creat d3/d5/d65/da8/fc1 x:0 0 0 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:3/544: chown d3/d16/d1c/l8a 11348 1 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:7/451: dread da/dd/d1c/f90 [0,4194304] 0 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:7/452: truncate da/dd/d1c/d2d/d45/d4d/f6f 4562987 0 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:7/453: chown da/dd/d13/d36/l57 8 1 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/451: dwrite d0/d13/d3b/f68 [4194304,4194304] 0 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/452: chown d0/d13/d17/d36/c48 16178 1 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/453: chown d0/d13/d17/d19/l1a 363075 1 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/454: chown d0/d13/d17/d1f/d67 8141 1 2024-09-13T23:06:11.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/455: truncate d0/d13/d17/d1f/d35/d62/f6f 878064 0 2024-09-13T23:06:11.287 INFO:tasks.workunit.client.0.smithi115.stdout:3/545: rmdir d3/d16/d1a/d1e 39 2024-09-13T23:06:11.287 INFO:tasks.workunit.client.0.smithi115.stdout:7/454: rmdir da/df/d3b 39 2024-09-13T23:06:11.287 INFO:tasks.workunit.client.0.smithi115.stdout:7/455: chown da/dd/c25 89289 1 2024-09-13T23:06:11.287 INFO:tasks.workunit.client.0.smithi115.stdout:9/456: unlink d0/d13/f71 0 2024-09-13T23:06:11.289 INFO:tasks.workunit.client.0.smithi115.stdout:7/456: mkdir da/dd/d13/d24/d52/da1 0 2024-09-13T23:06:11.290 INFO:tasks.workunit.client.0.smithi115.stdout:9/457: symlink d0/d13/d17/d1f/d35/l8c 0 2024-09-13T23:06:11.291 INFO:tasks.workunit.client.0.smithi115.stdout:3/546: mkdir d3/d5/d35/d4c/dc2 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:7/457: mknod da/dd/d16/d29/ca2 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:8/458: write d3/d5/f1e [1885467,52972] 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:8/459: truncate d3/d5/dc/d16/d1f/d28/d62/f65 1469101 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/437: dwrite d6/d24/d25/d58/f7a [0,4194304] 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/438: truncate d6/d24/d25/d2b/d82/d44/f56 4485184 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/439: creat d6/d24/d25/d7f/f9a x:0 0 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/440: creat d6/d24/d25/d58/d5b/f9b x:0 0 0 2024-09-13T23:06:11.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/441: chown d6/d24/d25/d2b/d82/d44/d5c 3204913 1 2024-09-13T23:06:11.293 INFO:tasks.workunit.client.0.smithi115.stdout:0/442: dread - d6/d24/d25/d58/d5b/f9b zero size 2024-09-13T23:06:11.293 INFO:tasks.workunit.client.0.smithi115.stdout:9/458: creat d0/d13/d17/d36/f8d x:0 0 0 2024-09-13T23:06:11.293 INFO:tasks.workunit.client.0.smithi115.stdout:3/547: symlink d3/d5/d35/d71/d3b/lc3 0 2024-09-13T23:06:11.294 INFO:tasks.workunit.client.0.smithi115.stdout:7/458: unlink da/dd/d13/d36/f48 0 2024-09-13T23:06:11.294 INFO:tasks.workunit.client.0.smithi115.stdout:7/459: write da/dd/f59 [1212487,130918] 0 2024-09-13T23:06:11.295 INFO:tasks.workunit.client.0.smithi115.stdout:2/503: dwrite da/fa9 [0,4194304] 0 2024-09-13T23:06:11.296 INFO:tasks.workunit.client.0.smithi115.stdout:2/504: fsync da/d23/d2c/f47 0 2024-09-13T23:06:11.296 INFO:tasks.workunit.client.0.smithi115.stdout:4/526: sync 2024-09-13T23:06:11.296 INFO:tasks.workunit.client.0.smithi115.stdout:6/544: sync 2024-09-13T23:06:11.296 INFO:tasks.workunit.client.0.smithi115.stdout:5/432: sync 2024-09-13T23:06:11.297 INFO:tasks.workunit.client.0.smithi115.stdout:0/443: dread d6/f20 [0,4194304] 0 2024-09-13T23:06:11.299 INFO:tasks.workunit.client.0.smithi115.stdout:8/460: getdents d3/d5/dc/d23/d4e 0 2024-09-13T23:06:11.299 INFO:tasks.workunit.client.0.smithi115.stdout:2/505: write da/d21/d8c/d41/d69/f87 [1005944,110552] 0 2024-09-13T23:06:11.299 INFO:tasks.workunit.client.0.smithi115.stdout:2/506: readlink da/d21/d2d/d78/d56/d1a/l6b 0 2024-09-13T23:06:11.301 INFO:tasks.workunit.client.0.smithi115.stdout:6/545: write d4/df/f74 [392079,88362] 0 2024-09-13T23:06:11.302 INFO:tasks.workunit.client.0.smithi115.stdout:9/459: symlink d0/d13/d17/d1f/d4e/d61/d7d/l8e 0 2024-09-13T23:06:11.303 INFO:tasks.workunit.client.0.smithi115.stdout:3/548: creat d3/d5/d35/d71/d45/fc4 x:0 0 0 2024-09-13T23:06:11.303 INFO:tasks.workunit.client.0.smithi115.stdout:3/549: fdatasync d3/d5/d65/da8/da4/f8c 0 2024-09-13T23:06:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/460: mknod da/dd/d13/d24/d67/ca3 0 2024-09-13T23:06:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/461: fsync da/dd/d13/d24/f4f 0 2024-09-13T23:06:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/462: fdatasync da/df/f28 0 2024-09-13T23:06:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/463: write da/dd/d13/f43 [695483,122778] 0 2024-09-13T23:06:11.304 INFO:tasks.workunit.client.0.smithi115.stdout:7/464: chown da/dd/d1c/d2d/d60/d82/c93 0 1 2024-09-13T23:06:11.307 INFO:tasks.workunit.client.0.smithi115.stdout:5/433: rename d8/dd/d20/d23/d54 to d8/dd/d6a/d82 0 2024-09-13T23:06:11.308 INFO:tasks.workunit.client.0.smithi115.stdout:0/444: symlink d6/l9c 0 2024-09-13T23:06:11.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/461: truncate d3/d5/dc/f12 1632304 0 2024-09-13T23:06:11.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/462: truncate d3/d5/d1d/f94 727533 0 2024-09-13T23:06:11.309 INFO:tasks.workunit.client.0.smithi115.stdout:8/463: chown d3/d5/dc/f32 1150981409 1 2024-09-13T23:06:11.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/464: stat d3/d5/dc/d23/d4e 0 2024-09-13T23:06:11.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/465: creat d3/d5/d1d/d63/fa6 x:0 0 0 2024-09-13T23:06:11.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/466: chown d3/d5/dc/d16/d1f 660261741 1 2024-09-13T23:06:11.313 INFO:tasks.workunit.client.0.smithi115.stdout:1/480: sync 2024-09-13T23:06:11.314 INFO:tasks.workunit.client.0.smithi115.stdout:6/546: mknod d4/d57/dab/cb0 0 2024-09-13T23:06:11.315 INFO:tasks.workunit.client.0.smithi115.stdout:6/547: write d4/df/d14/d38/d44/f55 [2243216,113826] 0 2024-09-13T23:06:11.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/460: symlink d0/d13/d17/d19/l8f 0 2024-09-13T23:06:11.316 INFO:tasks.workunit.client.0.smithi115.stdout:3/550: mknod d3/d5/db/dbd/cc5 0 2024-09-13T23:06:11.317 INFO:tasks.workunit.client.0.smithi115.stdout:9/461: read d0/d13/d17/d1f/d28/f38 [2118732,126674] 0 2024-09-13T23:06:11.317 INFO:tasks.workunit.client.0.smithi115.stdout:9/462: dread - d0/d13/d17/d1f/d67/f8b zero size 2024-09-13T23:06:11.317 INFO:tasks.workunit.client.0.smithi115.stdout:7/465: mknod da/ca4 0 2024-09-13T23:06:11.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/507: rename da/d21/d2d/c7d to da/d21/cad 0 2024-09-13T23:06:11.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/508: fdatasync da/d21/d2d/d78/d56/f45 0 2024-09-13T23:06:11.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/509: creat da/d23/d2c/fae x:0 0 0 2024-09-13T23:06:11.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/510: stat da/d21/d8c/d41/d95 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:1/481: dread d0/de/d1b/d25/d67/f6e [0,4194304] 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:1/482: creat d0/de/d1b/f99 x:0 0 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:1/483: write d0/dd/f13 [4524143,87608] 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:1/484: dread - d0/f83 zero size 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:6/548: creat d4/d57/d75/fb1 x:0 0 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:6/549: creat d4/df/d14/d38/d2a/fb2 x:0 0 0 2024-09-13T23:06:11.323 INFO:tasks.workunit.client.0.smithi115.stdout:6/550: write d4/f1d [2157575,75202] 0 2024-09-13T23:06:11.324 INFO:tasks.workunit.client.0.smithi115.stdout:3/551: creat d3/d5/d65/da8/fc6 x:0 0 0 2024-09-13T23:06:11.325 INFO:tasks.workunit.client.0.smithi115.stdout:0/445: rename d6/d24/d25/f29 to d6/d24/d25/d7f/f9d 0 2024-09-13T23:06:11.326 INFO:tasks.workunit.client.0.smithi115.stdout:0/446: write d6/d24/d25/d2b/f42 [606672,81063] 0 2024-09-13T23:06:11.326 INFO:tasks.workunit.client.0.smithi115.stdout:0/447: fdatasync d6/d24/f3d 0 2024-09-13T23:06:11.327 INFO:tasks.workunit.client.0.smithi115.stdout:0/448: truncate d6/d24/d25/d2b/d61/f86 720778 0 2024-09-13T23:06:11.327 INFO:tasks.workunit.client.0.smithi115.stdout:0/449: stat d6/d24/d25/d2b/d82/d44/f4b 0 2024-09-13T23:06:11.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/511: creat da/d21/d2d/d78/d48/faf x:0 0 0 2024-09-13T23:06:11.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/512: dread - da/d21/d2d/f65 zero size 2024-09-13T23:06:11.328 INFO:tasks.workunit.client.0.smithi115.stdout:5/434: getdents d8/dd/d4c 0 2024-09-13T23:06:11.330 INFO:tasks.workunit.client.0.smithi115.stdout:8/467: dwrite d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:11.330 INFO:tasks.workunit.client.0.smithi115.stdout:8/468: readlink d3/d5/dc/d16/d1f/d28/d3e/l91 0 2024-09-13T23:06:11.331 INFO:tasks.workunit.client.0.smithi115.stdout:1/485: dread - d0/de/d66/d8f/d29/f4c zero size 2024-09-13T23:06:11.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/551: mknod d4/d57/dab/cb3 0 2024-09-13T23:06:11.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/486: dread d0/de/d66/d8f/d29/d47/d6a/d80/f8b [0,4194304] 0 2024-09-13T23:06:11.334 INFO:tasks.workunit.client.0.smithi115.stdout:3/552: rmdir d3/d16/d1a/da7 39 2024-09-13T23:06:11.337 INFO:tasks.workunit.client.0.smithi115.stdout:9/463: rename d0/d13/d17/d1f/d35/d8a to d0/d13/d17/d1f/d4e/d90 0 2024-09-13T23:06:11.337 INFO:tasks.workunit.client.0.smithi115.stdout:0/450: mknod d6/d24/d25/d2b/c9e 0 2024-09-13T23:06:11.337 INFO:tasks.workunit.client.0.smithi115.stdout:0/451: chown d6/d24/d25/d2b/c2e 29928191 1 2024-09-13T23:06:11.338 INFO:tasks.workunit.client.0.smithi115.stdout:0/452: dread - d6/d24/d25/d7f/f98 zero size 2024-09-13T23:06:11.338 INFO:tasks.workunit.client.0.smithi115.stdout:5/435: rmdir d8/dd/d6a 39 2024-09-13T23:06:11.339 INFO:tasks.workunit.client.0.smithi115.stdout:3/553: creat d3/d5/d35/d71/d45/d98/dbc/fc7 x:0 0 0 2024-09-13T23:06:11.341 INFO:tasks.workunit.client.0.smithi115.stdout:7/466: rename da/dd/d13/d24/d67/ca3 to da/dd/d1c/d84/ca5 0 2024-09-13T23:06:11.341 INFO:tasks.workunit.client.0.smithi115.stdout:7/467: creat da/df/fa6 x:0 0 0 2024-09-13T23:06:11.344 INFO:tasks.workunit.client.0.smithi115.stdout:8/469: write d3/d5/d1d/f20 [3065254,8954] 0 2024-09-13T23:06:11.344 INFO:tasks.workunit.client.0.smithi115.stdout:8/470: chown d3/d5/dc/d16 5704489 1 2024-09-13T23:06:11.344 INFO:tasks.workunit.client.0.smithi115.stdout:9/464: rename d0/d13/d17/d1f/d67/f8b to d0/d13/d17/d1f/d28/f91 0 2024-09-13T23:06:11.344 INFO:tasks.workunit.client.0.smithi115.stdout:9/465: chown d0/d13/d17/d1f/d28/f5a 103863991 1 2024-09-13T23:06:11.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/554: getdents d3/d16/d1c 0 2024-09-13T23:06:11.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/555: write d3/d16/d1a/d1e/d94/fb6 [919468,116335] 0 2024-09-13T23:06:11.345 INFO:tasks.workunit.client.0.smithi115.stdout:3/556: read d3/d5/d5b/f72 [4112,27716] 0 2024-09-13T23:06:11.345 INFO:tasks.workunit.client.0.smithi115.stdout:5/436: dread d8/fa [0,4194304] 0 2024-09-13T23:06:11.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/437: unlink d8/dd/d6a/d82/d63/c40 0 2024-09-13T23:06:11.347 INFO:tasks.workunit.client.0.smithi115.stdout:5/438: write d8/dd/d20/d23/f70 [472797,76816] 0 2024-09-13T23:06:11.348 INFO:tasks.workunit.client.0.smithi115.stdout:5/439: creat d8/d7a/f83 x:0 0 0 2024-09-13T23:06:11.350 INFO:tasks.workunit.client.0.smithi115.stdout:0/453: rename d6/d62 to d6/d24/d25/d2b/d82/d6b/d9f 0 2024-09-13T23:06:11.350 INFO:tasks.workunit.client.0.smithi115.stdout:5/440: write d8/dd/d6a/d82/f58 [1280585,27205] 0 2024-09-13T23:06:11.353 INFO:tasks.workunit.client.0.smithi115.stdout:8/471: rename d3/d5/dc/f64 to d3/d5/fa7 0 2024-09-13T23:06:11.353 INFO:tasks.workunit.client.0.smithi115.stdout:5/441: rmdir d8/dd/d20/d4a 39 2024-09-13T23:06:11.354 INFO:tasks.workunit.client.0.smithi115.stdout:5/442: creat d8/d7a/f84 x:0 0 0 2024-09-13T23:06:11.354 INFO:tasks.workunit.client.0.smithi115.stdout:0/454: mkdir d6/da0 0 2024-09-13T23:06:11.355 INFO:tasks.workunit.client.0.smithi115.stdout:9/466: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:11.355 INFO:tasks.workunit.client.0.smithi115.stdout:3/557: rename d3/d5/d5b/c95 to d3/d16/d1a/d1e/cc8 0 2024-09-13T23:06:11.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/558: chown d3/la 130303565 1 2024-09-13T23:06:11.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/559: getdents d3/d16/d1c 0 2024-09-13T23:06:11.356 INFO:tasks.workunit.client.0.smithi115.stdout:3/560: write d3/d5/d65/da8/da4/d49/f7d [1653260,5301] 0 2024-09-13T23:06:11.359 INFO:tasks.workunit.client.0.smithi115.stdout:8/472: rename d3/d5/dc/d16/d1f/d27/d68/f82 to d3/d5/d1d/d72/fa8 0 2024-09-13T23:06:11.359 INFO:tasks.workunit.client.0.smithi115.stdout:6/552: dwrite d4/df/f74 [0,4194304] 0 2024-09-13T23:06:11.359 INFO:tasks.workunit.client.0.smithi115.stdout:3/561: symlink d3/d5/d35/d71/d45/d98/lc9 0 2024-09-13T23:06:11.360 INFO:tasks.workunit.client.0.smithi115.stdout:9/467: dread d0/d13/d17/d1f/d28/f3e [0,4194304] 0 2024-09-13T23:06:11.360 INFO:tasks.workunit.client.0.smithi115.stdout:1/487: dwrite d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:11.360 INFO:tasks.workunit.client.0.smithi115.stdout:1/488: write d0/de/d1b/d25/d4d/d51/d31/d79/f96 [628922,5551] 0 2024-09-13T23:06:11.360 INFO:tasks.workunit.client.0.smithi115.stdout:0/455: dread d6/d24/d25/d2b/d61/f69 [0,4194304] 0 2024-09-13T23:06:11.360 INFO:tasks.workunit.client.0.smithi115.stdout:0/456: fdatasync d6/d24/d25/d2b/d61/f86 0 2024-09-13T23:06:11.361 INFO:tasks.workunit.client.0.smithi115.stdout:5/443: dread d8/fb [0,4194304] 0 2024-09-13T23:06:11.361 INFO:tasks.workunit.client.0.smithi115.stdout:8/473: creat d3/d5/dc/d16/d1f/d27/d68/d98/fa9 x:0 0 0 2024-09-13T23:06:11.361 INFO:tasks.workunit.client.0.smithi115.stdout:8/474: fsync d3/d5/dc/d23/d4e/d54/d7f/f9d 0 2024-09-13T23:06:11.363 INFO:tasks.workunit.client.0.smithi115.stdout:6/553: mkdir d4/d57/d5a/db4 0 2024-09-13T23:06:11.364 INFO:tasks.workunit.client.0.smithi115.stdout:3/562: mknod d3/d5/cca 0 2024-09-13T23:06:11.364 INFO:tasks.workunit.client.0.smithi115.stdout:3/563: fsync d3/d16/d1a/f57 0 2024-09-13T23:06:11.364 INFO:tasks.workunit.client.0.smithi115.stdout:3/564: creat d3/d5/d5b/fcb x:0 0 0 2024-09-13T23:06:11.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/468: symlink d0/d13/d17/d1f/d4e/d61/d7d/l92 0 2024-09-13T23:06:11.366 INFO:tasks.workunit.client.0.smithi115.stdout:8/475: getdents d3/d5/dc/d23/d4e/d54/d8c 0 2024-09-13T23:06:11.367 INFO:tasks.workunit.client.0.smithi115.stdout:6/554: dread d4/df/f1c [0,4194304] 0 2024-09-13T23:06:11.367 INFO:tasks.workunit.client.0.smithi115.stdout:6/555: write d4/df/d14/d38/d2a/fb2 [934117,102977] 0 2024-09-13T23:06:11.367 INFO:tasks.workunit.client.0.smithi115.stdout:6/556: truncate d4/df/d14/d38/d2a/f9d 1045010 0 2024-09-13T23:06:11.368 INFO:tasks.workunit.client.0.smithi115.stdout:8/476: dread d3/d5/d1c/d41/d42/f61 [0,4194304] 0 2024-09-13T23:06:11.371 INFO:tasks.workunit.client.0.smithi115.stdout:3/565: rename d3/d16/d1a/da7 to d3/d5/d35/d71/d45/d98/db7/dcc 0 2024-09-13T23:06:11.372 INFO:tasks.workunit.client.0.smithi115.stdout:9/469: creat d0/d13/d17/d1f/d77/f93 x:0 0 0 2024-09-13T23:06:11.372 INFO:tasks.workunit.client.0.smithi115.stdout:6/557: creat d4/df/d14/d38/d2a/d31/fb5 x:0 0 0 2024-09-13T23:06:11.373 INFO:tasks.workunit.client.0.smithi115.stdout:1/489: dread d0/de/f46 [0,4194304] 0 2024-09-13T23:06:11.374 INFO:tasks.workunit.client.0.smithi115.stdout:8/477: symlink d3/d5/d6a/laa 0 2024-09-13T23:06:11.374 INFO:tasks.workunit.client.0.smithi115.stdout:8/478: fsync d3/d5/dc/d16/d1f/d27/f48 0 2024-09-13T23:06:11.374 INFO:tasks.workunit.client.0.smithi115.stdout:8/479: read d3/d5/dc/d16/d1f/d28/f55 [3323514,102096] 0 2024-09-13T23:06:11.375 INFO:tasks.workunit.client.0.smithi115.stdout:8/480: write d3/d5/dc/d16/d1f/d28/d62/f65 [1613685,52960] 0 2024-09-13T23:06:11.376 INFO:tasks.workunit.client.0.smithi115.stdout:0/457: write d6/f9 [3651289,48755] 0 2024-09-13T23:06:11.377 INFO:tasks.workunit.client.0.smithi115.stdout:3/566: dread d3/d5/d35/f53 [0,4194304] 0 2024-09-13T23:06:11.377 INFO:tasks.workunit.client.0.smithi115.stdout:0/458: creat d6/d24/d25/d2b/d82/d6b/fa1 x:0 0 0 2024-09-13T23:06:11.378 INFO:tasks.workunit.client.0.smithi115.stdout:3/567: mkdir d3/dcd 0 2024-09-13T23:06:11.383 INFO:tasks.workunit.client.0.smithi115.stdout:8/481: read d3/d5/dc/d16/f83 [3630009,12112] 0 2024-09-13T23:06:11.383 INFO:tasks.workunit.client.0.smithi115.stdout:9/470: write d0/d13/d17/d1f/d28/f5a [2324868,94453] 0 2024-09-13T23:06:11.383 INFO:tasks.workunit.client.0.smithi115.stdout:9/471: chown d0/d13/d17 1351165244 1 2024-09-13T23:06:11.384 INFO:tasks.workunit.client.0.smithi115.stdout:8/482: symlink d3/d5/dc/d16/d1f/d28/d62/lab 0 2024-09-13T23:06:11.386 INFO:tasks.workunit.client.0.smithi115.stdout:9/472: symlink d0/d13/d17/d1f/d28/l94 0 2024-09-13T23:06:11.388 INFO:tasks.workunit.client.0.smithi115.stdout:8/483: rename d3/d5/d1d/f95 to d3/d5/dc/d16/d1f/fac 0 2024-09-13T23:06:11.389 INFO:tasks.workunit.client.0.smithi115.stdout:9/473: mkdir d0/d13/d3b/d42/d95 0 2024-09-13T23:06:11.390 INFO:tasks.workunit.client.0.smithi115.stdout:9/474: chown d0/d13/d17/d1f/d35/d62 133371 1 2024-09-13T23:06:11.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/484: truncate d3/d5/d1c/d41/f57 2511641 0 2024-09-13T23:06:11.391 INFO:tasks.workunit.client.0.smithi115.stdout:8/485: chown c1 3112 1 2024-09-13T23:06:11.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/475: write d0/d13/d17/d19/f50 [463188,110945] 0 2024-09-13T23:06:11.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/476: readlink d0/d13/d17/d1f/d67/l85 0 2024-09-13T23:06:11.391 INFO:tasks.workunit.client.0.smithi115.stdout:0/459: read d6/d24/d25/d2b/d82/f36 [2382303,102636] 0 2024-09-13T23:06:11.392 INFO:tasks.workunit.client.0.smithi115.stdout:8/486: rmdir d3/d5/dc/d16/d1f/d27/d68 39 2024-09-13T23:06:11.392 INFO:tasks.workunit.client.0.smithi115.stdout:3/568: dread d3/d5/d35/d71/d45/f58 [0,4194304] 0 2024-09-13T23:06:11.392 INFO:tasks.workunit.client.0.smithi115.stdout:1/490: dwrite d0/de/d66/d8f/d29/d47/d63/f6b [0,4194304] 0 2024-09-13T23:06:11.392 INFO:tasks.workunit.client.0.smithi115.stdout:1/491: stat d0/de/d66/d8f/d29/d47/d6a/d80/f8b 0 2024-09-13T23:06:11.393 INFO:tasks.workunit.client.0.smithi115.stdout:9/477: truncate d0/d43/f6d 1060840 0 2024-09-13T23:06:11.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/478: dread d0/d13/d17/d1f/d28/f5a [0,4194304] 0 2024-09-13T23:06:11.400 INFO:tasks.workunit.client.0.smithi115.stdout:3/569: mknod d3/d5/d35/d71/d45/d98/dbc/cce 0 2024-09-13T23:06:11.400 INFO:tasks.workunit.client.0.smithi115.stdout:3/570: stat d3/d16/d1a/d1e/d8e/f8f 0 2024-09-13T23:06:11.403 INFO:tasks.workunit.client.0.smithi115.stdout:1/492: rename d0/de/d1b/d25/d4d/d51/f41 to d0/de/d66/d8f/d29/d47/d6a/d80/f9a 0 2024-09-13T23:06:11.406 INFO:tasks.workunit.client.0.smithi115.stdout:9/479: symlink d0/d13/d3b/d42/d95/l96 0 2024-09-13T23:06:11.408 INFO:tasks.workunit.client.0.smithi115.stdout:1/493: link d0/de/l17 d0/de/d66/d8f/l9b 0 2024-09-13T23:06:11.411 INFO:tasks.workunit.client.0.smithi115.stdout:9/480: truncate d0/d13/d3b/f68 1377263 0 2024-09-13T23:06:11.411 INFO:tasks.workunit.client.0.smithi115.stdout:9/481: write d0/d13/d17/d1f/d28/f91 [271638,69674] 0 2024-09-13T23:06:11.412 INFO:tasks.workunit.client.0.smithi115.stdout:8/487: dwrite d3/d5/d1d/d72/fa8 [0,4194304] 0 2024-09-13T23:06:11.414 INFO:tasks.workunit.client.0.smithi115.stdout:1/494: mkdir d0/de/d66/d8f/d29/d9c 0 2024-09-13T23:06:11.417 INFO:tasks.workunit.client.0.smithi115.stdout:9/482: creat d0/d13/d3b/f97 x:0 0 0 2024-09-13T23:06:11.421 INFO:tasks.workunit.client.0.smithi115.stdout:1/495: mkdir d0/de/d66/d8f/d29/d47/d74/d9d 0 2024-09-13T23:06:11.422 INFO:tasks.workunit.client.0.smithi115.stdout:9/483: mkdir d0/d13/d17/d1f/d4e/d61/d7d/d98 0 2024-09-13T23:06:11.423 INFO:tasks.workunit.client.0.smithi115.stdout:9/484: mknod d0/d13/d17/d36/c99 0 2024-09-13T23:06:11.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/485: rename d0/d13/d17/d1f/d67/l85 to d0/d13/d17/d1f/d28/d76/d81/l9a 0 2024-09-13T23:06:11.425 INFO:tasks.workunit.client.0.smithi115.stdout:9/486: write d0/d13/d17/d1f/d28/f3e [272018,35420] 0 2024-09-13T23:06:11.426 INFO:tasks.workunit.client.0.smithi115.stdout:9/487: mkdir d0/d13/d17/d1f/d4e/d61/d9b 0 2024-09-13T23:06:11.435 INFO:tasks.workunit.client.0.smithi115.stdout:0/460: dwrite d6/f9 [0,4194304] 0 2024-09-13T23:06:11.435 INFO:tasks.workunit.client.0.smithi115.stdout:3/571: dwrite d3/d5/d65/da8/da4/d49/f67 [0,4194304] 0 2024-09-13T23:06:11.435 INFO:tasks.workunit.client.0.smithi115.stdout:9/488: dread d0/d13/f2e [0,4194304] 0 2024-09-13T23:06:11.436 INFO:tasks.workunit.client.0.smithi115.stdout:0/461: creat d6/da0/fa2 x:0 0 0 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/488: dwrite d3/d5/dc/d16/d1f/d28/d62/fa1 [0,4194304] 0 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/572: getdents d3/d5/d65 0 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:1/496: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:1/497: chown d0/de/d1b/d25/d4d/d51/d23/c92 8 1 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:1/498: write d0/dd/f10 [4842164,73426] 0 2024-09-13T23:06:11.441 INFO:tasks.workunit.client.0.smithi115.stdout:3/573: write d3/f7c [486237,12943] 0 2024-09-13T23:06:11.442 INFO:tasks.workunit.client.0.smithi115.stdout:9/489: symlink d0/d13/d17/d36/l9c 0 2024-09-13T23:06:11.442 INFO:tasks.workunit.client.0.smithi115.stdout:0/462: mkdir d6/d24/d25/da3 0 2024-09-13T23:06:11.443 INFO:tasks.workunit.client.0.smithi115.stdout:0/463: write d6/d24/d25/d2b/d82/f48 [847117,54703] 0 2024-09-13T23:06:11.445 INFO:tasks.workunit.client.0.smithi115.stdout:4/527: sync 2024-09-13T23:06:11.446 INFO:tasks.workunit.client.0.smithi115.stdout:8/489: creat d3/d5/dc/d16/d1f/d28/d3e/fad x:0 0 0 2024-09-13T23:06:11.447 INFO:tasks.workunit.client.0.smithi115.stdout:1/499: creat d0/de/f9e x:0 0 0 2024-09-13T23:06:11.450 INFO:tasks.workunit.client.0.smithi115.stdout:9/490: mkdir d0/d13/d17/d1f/d28/d76/d81/d9d 0 2024-09-13T23:06:11.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/528: mknod db/d11/d2e/c93 0 2024-09-13T23:06:11.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/529: fdatasync db/d16/d3f/f72 0 2024-09-13T23:06:11.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/530: chown db/f43 4055041 1 2024-09-13T23:06:11.452 INFO:tasks.workunit.client.0.smithi115.stdout:1/500: unlink d0/de/d1b/d25/d4d/d51/c6f 0 2024-09-13T23:06:11.453 INFO:tasks.workunit.client.0.smithi115.stdout:3/574: symlink d3/d5/d65/da8/lcf 0 2024-09-13T23:06:11.454 INFO:tasks.workunit.client.0.smithi115.stdout:9/491: rename d0/d13/f73 to d0/d43/f9e 0 2024-09-13T23:06:11.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/501: unlink d0/de/l17 0 2024-09-13T23:06:11.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/575: symlink d3/d16/d1c/ld0 0 2024-09-13T23:06:11.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/576: stat d3/d5/d35/d71/d3b/d47/f86 0 2024-09-13T23:06:11.458 INFO:tasks.workunit.client.0.smithi115.stdout:3/577: write d3/f1b [5119357,20841] 0 2024-09-13T23:06:11.459 INFO:tasks.workunit.client.0.smithi115.stdout:9/492: creat d0/d13/d17/d1f/d28/d76/f9f x:0 0 0 2024-09-13T23:06:11.459 INFO:tasks.workunit.client.0.smithi115.stdout:4/531: rmdir db/d19/d34 39 2024-09-13T23:06:11.460 INFO:tasks.workunit.client.0.smithi115.stdout:4/532: readlink db/d16/d3f/d66/l92 0 2024-09-13T23:06:11.464 INFO:tasks.workunit.client.0.smithi115.stdout:4/533: dread db/d11/d2e/d33/d36/f3b [0,4194304] 0 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:4/534: chown db/d16/d3f/f45 339 1 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/502: unlink d0/de/d62/l7c 0 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:9/493: truncate d0/d13/f7a 3168054 0 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/503: creat d0/de/d1b/d25/d4d/d51/d23/f9f x:0 0 0 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:9/494: mkdir d0/d13/d17/d1f/d4e/d61/d7d/da0 0 2024-09-13T23:06:11.465 INFO:tasks.workunit.client.0.smithi115.stdout:9/495: chown d0/d13/d17/d19/c3d 5191 1 2024-09-13T23:06:11.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/496: chown d0/d13/d17/d1f/d4e 2799 1 2024-09-13T23:06:11.466 INFO:tasks.workunit.client.0.smithi115.stdout:1/504: stat d0/de/d66/d8f/d29/f2d 0 2024-09-13T23:06:11.466 INFO:tasks.workunit.client.0.smithi115.stdout:9/497: symlink d0/d13/d17/d1f/d28/d76/d81/la1 0 2024-09-13T23:06:11.467 INFO:tasks.workunit.client.0.smithi115.stdout:8/490: dwrite d3/d5/dc/d16/d1f/d28/d62/f7b [0,4194304] 0 2024-09-13T23:06:11.468 INFO:tasks.workunit.client.0.smithi115.stdout:0/464: dwrite d6/d24/d25/d2b/d82/d44/f4b [0,4194304] 0 2024-09-13T23:06:11.468 INFO:tasks.workunit.client.0.smithi115.stdout:0/465: fsync d6/d24/d25/d58/f7a 0 2024-09-13T23:06:11.468 INFO:tasks.workunit.client.0.smithi115.stdout:0/466: write d6/d24/d25/d2b/d61/f96 [5657441,5494] 0 2024-09-13T23:06:11.468 INFO:tasks.workunit.client.0.smithi115.stdout:1/505: link d0/de/d66/d8f/d29/c43 d0/de/d62/ca0 0 2024-09-13T23:06:11.472 INFO:tasks.workunit.client.0.smithi115.stdout:8/491: truncate d3/d5/dc/d16/d1f/d28/d62/f65 808173 0 2024-09-13T23:06:11.472 INFO:tasks.workunit.client.0.smithi115.stdout:8/492: readlink d3/d5/d1c/d41/d42/l8e 0 2024-09-13T23:06:11.473 INFO:tasks.workunit.client.0.smithi115.stdout:8/493: fdatasync d3/d5/dc/d16/d1f/f22 0 2024-09-13T23:06:11.473 INFO:tasks.workunit.client.0.smithi115.stdout:8/494: write d3/d5/f3d [4742477,47999] 0 2024-09-13T23:06:11.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/535: write db/f10 [7721488,43317] 0 2024-09-13T23:06:11.474 INFO:tasks.workunit.client.0.smithi115.stdout:4/536: dread - db/d16/d3f/f6c zero size 2024-09-13T23:06:11.477 INFO:tasks.workunit.client.0.smithi115.stdout:3/578: dwrite d3/d5/d65/da8/da4/d49/f67 [0,4194304] 0 2024-09-13T23:06:11.479 INFO:tasks.workunit.client.0.smithi115.stdout:0/467: truncate d6/d24/d25/d2b/d82/d44/f66 1289907 0 2024-09-13T23:06:11.481 INFO:tasks.workunit.client.0.smithi115.stdout:3/579: dread d3/d5/d5b/f72 [0,4194304] 0 2024-09-13T23:06:11.481 INFO:tasks.workunit.client.0.smithi115.stdout:3/580: write d3/d5/d5b/fcb [791374,39163] 0 2024-09-13T23:06:11.483 INFO:tasks.workunit.client.0.smithi115.stdout:8/495: truncate d3/d5/d1c/d41/d42/f14 2805187 0 2024-09-13T23:06:11.492 INFO:tasks.workunit.client.0.smithi115.stdout:1/506: rmdir d0/de/d1b/d25/d4d/d51 39 2024-09-13T23:06:11.495 INFO:tasks.workunit.client.0.smithi115.stdout:9/498: dread d0/d13/f7a [0,4194304] 0 2024-09-13T23:06:11.495 INFO:tasks.workunit.client.0.smithi115.stdout:8/496: creat d3/d5/d1c/fae x:0 0 0 2024-09-13T23:06:11.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/499: write d0/d43/f9e [599150,16709] 0 2024-09-13T23:06:11.499 INFO:tasks.workunit.client.0.smithi115.stdout:2/513: sync 2024-09-13T23:06:11.502 INFO:tasks.workunit.client.0.smithi115.stdout:2/514: getdents da/d21 0 2024-09-13T23:06:11.502 INFO:tasks.workunit.client.0.smithi115.stdout:2/515: dread - da/d21/d2d/f80 zero size 2024-09-13T23:06:11.502 INFO:tasks.workunit.client.0.smithi115.stdout:2/516: creat da/d23/d2c/fb0 x:0 0 0 2024-09-13T23:06:11.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/517: creat da/d21/d2d/d78/d56/d1a/d7f/fb1 x:0 0 0 2024-09-13T23:06:11.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/518: stat da/d21/d8c 0 2024-09-13T23:06:11.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/519: mknod da/d23/d2c/cb2 0 2024-09-13T23:06:11.504 INFO:tasks.workunit.client.0.smithi115.stdout:2/520: getdents da/d21/d8c/d41/d95 0 2024-09-13T23:06:11.505 INFO:tasks.workunit.client.0.smithi115.stdout:2/521: rename da/d21/d8c/d41/d62/f59 to da/d21/fb3 0 2024-09-13T23:06:11.506 INFO:tasks.workunit.client.0.smithi115.stdout:2/522: mkdir da/d23/db4 0 2024-09-13T23:06:11.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/523: chown da/fa9 121 1 2024-09-13T23:06:11.507 INFO:tasks.workunit.client.0.smithi115.stdout:0/468: dwrite d6/d24/d25/d2b/d82/d6b/d9f/f99 [0,4194304] 0 2024-09-13T23:06:11.508 INFO:tasks.workunit.client.0.smithi115.stdout:3/581: dwrite d3/d5/d35/d71/d3b/d47/d28/f34 [0,4194304] 0 2024-09-13T23:06:11.511 INFO:tasks.workunit.client.0.smithi115.stdout:0/469: mkdir d6/d24/d25/d2b/d82/d44/d5c/d87/da4 0 2024-09-13T23:06:11.512 INFO:tasks.workunit.client.0.smithi115.stdout:8/497: dwrite d3/d5/dc/d23/f6f [0,4194304] 0 2024-09-13T23:06:11.514 INFO:tasks.workunit.client.0.smithi115.stdout:3/582: link d3/d5/d65/da8/da4/d49/l92 d3/d5/d65/da8/da4/d49/ld1 0 2024-09-13T23:06:11.514 INFO:tasks.workunit.client.0.smithi115.stdout:3/583: truncate d3/d5/d65/da8/da4/f8c 377764 0 2024-09-13T23:06:11.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/507: dread d0/de/d66/d8f/d29/d47/d63/f6b [0,4194304] 0 2024-09-13T23:06:11.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/508: chown d0/de/d1b/d25/d4d/d51/d23 1256 1 2024-09-13T23:06:11.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/509: truncate d0/de/d1b/d25/d4d/d51/d23/d65/f7f 1032893 0 2024-09-13T23:06:11.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/510: chown d0/de/d1b/d25/d4d/d51/d31/d79 10603571 1 2024-09-13T23:06:11.516 INFO:tasks.workunit.client.0.smithi115.stdout:8/498: symlink d3/d5/dc/laf 0 2024-09-13T23:06:11.516 INFO:tasks.workunit.client.0.smithi115.stdout:8/499: chown d3/d5/d1c/fae 5 1 2024-09-13T23:06:11.518 INFO:tasks.workunit.client.0.smithi115.stdout:1/511: creat d0/de/d66/d8f/d29/d9c/fa1 x:0 0 0 2024-09-13T23:06:11.518 INFO:tasks.workunit.client.0.smithi115.stdout:1/512: rename d0/de/d1b/d25/d4d/d51 to d0/de/d1b/d25/d4d/d51/d31/d79/da2 22 2024-09-13T23:06:11.523 INFO:tasks.workunit.client.0.smithi115.stdout:1/513: mkdir d0/de/d66/d8f/d29/d47/d74/d9d/da3 0 2024-09-13T23:06:11.524 INFO:tasks.workunit.client.0.smithi115.stdout:2/524: dwrite da/d23/f7b [0,4194304] 0 2024-09-13T23:06:11.525 INFO:tasks.workunit.client.0.smithi115.stdout:2/525: dread - da/d23/d2c/fb0 zero size 2024-09-13T23:06:11.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/584: dread d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:11.527 INFO:tasks.workunit.client.0.smithi115.stdout:2/526: mknod da/d21/da8/cb5 0 2024-09-13T23:06:11.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/527: write da/d23/d2c/fb0 [67299,114134] 0 2024-09-13T23:06:11.528 INFO:tasks.workunit.client.0.smithi115.stdout:2/528: write da/d77/d83/fa4 [538724,86993] 0 2024-09-13T23:06:11.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/585: truncate d3/d5/d35/d71/d3b/d47/f86 3487173 0 2024-09-13T23:06:11.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/586: dread - d3/d5/d35/d71/d45/d98/dbc/fc7 zero size 2024-09-13T23:06:11.530 INFO:tasks.workunit.client.0.smithi115.stdout:2/529: link f4 da/d21/da8/fb6 0 2024-09-13T23:06:11.530 INFO:tasks.workunit.client.0.smithi115.stdout:3/587: mkdir d3/d5/d5b/dd2 0 2024-09-13T23:06:11.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/500: dread d3/d5/d1d/f26 [4194304,4194304] 0 2024-09-13T23:06:11.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/501: truncate d3/d5/d6a/f75 860494 0 2024-09-13T23:06:11.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/502: fdatasync d3/d5/dc/d16/d1f/d27/d79/da0/fa4 0 2024-09-13T23:06:11.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/503: dread - d3/d5/dc/d16/d1f/d27/f7a zero size 2024-09-13T23:06:11.531 INFO:tasks.workunit.client.0.smithi115.stdout:8/504: creat d3/d5/d1c/fb0 x:0 0 0 2024-09-13T23:06:11.532 INFO:tasks.workunit.client.0.smithi115.stdout:2/530: truncate da/d21/d8c/d41/d62/f91 1788386 0 2024-09-13T23:06:11.532 INFO:tasks.workunit.client.0.smithi115.stdout:3/588: mkdir d3/d16/d1a/d1e/dd3 0 2024-09-13T23:06:11.532 INFO:tasks.workunit.client.0.smithi115.stdout:3/589: read d3/f7c [245527,22836] 0 2024-09-13T23:06:11.533 INFO:tasks.workunit.client.0.smithi115.stdout:8/505: creat d3/d5/d1d/fb1 x:0 0 0 2024-09-13T23:06:11.533 INFO:tasks.workunit.client.0.smithi115.stdout:8/506: stat d3/d5/l9b 0 2024-09-13T23:06:11.534 INFO:tasks.workunit.client.0.smithi115.stdout:0/470: dwrite d6/d24/f49 [4194304,4194304] 0 2024-09-13T23:06:11.535 INFO:tasks.workunit.client.0.smithi115.stdout:2/531: rename da/d23/fa0 to da/d21/da8/fb7 0 2024-09-13T23:06:11.535 INFO:tasks.workunit.client.0.smithi115.stdout:2/532: chown da/d21/d8c/d41/lab 16 1 2024-09-13T23:06:11.536 INFO:tasks.workunit.client.0.smithi115.stdout:2/533: creat da/d77/d83/fb8 x:0 0 0 2024-09-13T23:06:11.536 INFO:tasks.workunit.client.0.smithi115.stdout:3/590: mkdir d3/d5/d35/d71/d45/d98/db7/dcc/dd4 0 2024-09-13T23:06:11.536 INFO:tasks.workunit.client.0.smithi115.stdout:8/507: getdents d3/d5/dc/d16 0 2024-09-13T23:06:11.537 INFO:tasks.workunit.client.0.smithi115.stdout:8/508: read d3/d5/d6a/f75 [759767,39401] 0 2024-09-13T23:06:11.538 INFO:tasks.workunit.client.0.smithi115.stdout:1/514: dread d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:11.542 INFO:tasks.workunit.client.0.smithi115.stdout:0/471: dread d6/d24/d25/d2b/d82/d44/f55 [0,4194304] 0 2024-09-13T23:06:11.543 INFO:tasks.workunit.client.0.smithi115.stdout:3/591: creat d3/d5/d35/d4c/fd5 x:0 0 0 2024-09-13T23:06:11.544 INFO:tasks.workunit.client.0.smithi115.stdout:8/509: truncate d3/d5/d1c/f2e 475242 0 2024-09-13T23:06:11.545 INFO:tasks.workunit.client.0.smithi115.stdout:1/515: mknod d0/de/d66/d8f/d29/d47/d6a/ca4 0 2024-09-13T23:06:11.547 INFO:tasks.workunit.client.0.smithi115.stdout:3/592: symlink d3/d5/d35/d71/d42/ld6 0 2024-09-13T23:06:11.547 INFO:tasks.workunit.client.0.smithi115.stdout:3/593: read - d3/d5/d65/da8/da4/d49/fa6 zero size 2024-09-13T23:06:11.547 INFO:tasks.workunit.client.0.smithi115.stdout:3/594: write d3/f7c [1041234,31033] 0 2024-09-13T23:06:11.549 INFO:tasks.workunit.client.0.smithi115.stdout:0/472: getdents d6/d24 0 2024-09-13T23:06:11.549 INFO:tasks.workunit.client.0.smithi115.stdout:0/473: chown d6/d24/d25/da3 27 1 2024-09-13T23:06:11.549 INFO:tasks.workunit.client.0.smithi115.stdout:0/474: stat d6/c90 0 2024-09-13T23:06:11.552 INFO:tasks.workunit.client.0.smithi115.stdout:0/475: mkdir d6/da5 0 2024-09-13T23:06:11.553 INFO:tasks.workunit.client.0.smithi115.stdout:0/476: symlink d6/d24/d25/d2b/d61/la6 0 2024-09-13T23:06:11.554 INFO:tasks.workunit.client.0.smithi115.stdout:0/477: mkdir d6/d24/d25/da7 0 2024-09-13T23:06:11.556 INFO:tasks.workunit.client.0.smithi115.stdout:0/478: creat d6/d24/d25/d2b/d82/d44/d5c/d87/da4/fa8 x:0 0 0 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:7/468: sync 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:6/558: sync 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:5/444: sync 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:7/469: write da/dd/d13/d36/f42 [575604,119145] 0 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:7/470: fdatasync da/df/f28 0 2024-09-13T23:06:11.557 INFO:tasks.workunit.client.0.smithi115.stdout:7/471: dread - da/dd/d13/d24/f6c zero size 2024-09-13T23:06:11.558 INFO:tasks.workunit.client.0.smithi115.stdout:7/472: write da/dd/d13/d36/f3a [213476,94656] 0 2024-09-13T23:06:11.558 INFO:tasks.workunit.client.0.smithi115.stdout:0/479: creat d6/fa9 x:0 0 0 2024-09-13T23:06:11.558 INFO:tasks.workunit.client.0.smithi115.stdout:1/516: write d0/f6 [7436642,34943] 0 2024-09-13T23:06:11.558 INFO:tasks.workunit.client.0.smithi115.stdout:0/480: fdatasync d6/d24/d25/d2b/d82/f36 0 2024-09-13T23:06:11.559 INFO:tasks.workunit.client.0.smithi115.stdout:7/473: mkdir da/dd/d13/d24/d52/d7c/da7 0 2024-09-13T23:06:11.560 INFO:tasks.workunit.client.0.smithi115.stdout:1/517: unlink d0/dd/l89 0 2024-09-13T23:06:11.562 INFO:tasks.workunit.client.0.smithi115.stdout:0/481: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/da4/caa 0 2024-09-13T23:06:11.562 INFO:tasks.workunit.client.0.smithi115.stdout:8/510: read d3/d5/dc/d23/d4e/d54/d7f/f9d [324270,62241] 0 2024-09-13T23:06:11.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/595: dwrite d3/d5/d65/da8/fc6 [0,4194304] 0 2024-09-13T23:06:11.563 INFO:tasks.workunit.client.0.smithi115.stdout:3/596: chown d3/f7c 119951 1 2024-09-13T23:06:11.566 INFO:tasks.workunit.client.0.smithi115.stdout:0/482: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab 0 2024-09-13T23:06:11.569 INFO:tasks.workunit.client.0.smithi115.stdout:3/597: unlink d3/d5/d35/d71/d3b/d47/d28/f34 0 2024-09-13T23:06:11.570 INFO:tasks.workunit.client.0.smithi115.stdout:2/534: truncate da/d21/d8c/d41/d62/f91 1188781 0 2024-09-13T23:06:11.572 INFO:tasks.workunit.client.0.smithi115.stdout:0/483: symlink d6/da5/lac 0 2024-09-13T23:06:11.572 INFO:tasks.workunit.client.0.smithi115.stdout:0/484: fdatasync d6/d24/d25/d2b/d82/d44/f4b 0 2024-09-13T23:06:11.575 INFO:tasks.workunit.client.0.smithi115.stdout:2/535: mknod da/d23/db4/cb9 0 2024-09-13T23:06:11.577 INFO:tasks.workunit.client.0.smithi115.stdout:3/598: rmdir d3/d5/d35/d71/d45 39 2024-09-13T23:06:11.579 INFO:tasks.workunit.client.0.smithi115.stdout:2/536: unlink da/cb 0 2024-09-13T23:06:11.579 INFO:tasks.workunit.client.0.smithi115.stdout:2/537: truncate da/d21/d2d/d78/d48/faf 554254 0 2024-09-13T23:06:11.579 INFO:tasks.workunit.client.0.smithi115.stdout:3/599: link d3/d5/d35/ca5 d3/cd7 0 2024-09-13T23:06:11.580 INFO:tasks.workunit.client.0.smithi115.stdout:7/474: write da/dd/d1c/d2d/f54 [3313901,82947] 0 2024-09-13T23:06:11.580 INFO:tasks.workunit.client.0.smithi115.stdout:0/485: rename d6/d24/d25/d58/d5b to d6/d24/d25/da3/dad 0 2024-09-13T23:06:11.581 INFO:tasks.workunit.client.0.smithi115.stdout:3/600: unlink d3/d5/db/dbd/cc5 0 2024-09-13T23:06:11.582 INFO:tasks.workunit.client.0.smithi115.stdout:7/475: link l0 da/la8 0 2024-09-13T23:06:11.582 INFO:tasks.workunit.client.0.smithi115.stdout:0/486: rmdir d6/d24/d25/d2b/d82/d6b/d9f 39 2024-09-13T23:06:11.583 INFO:tasks.workunit.client.0.smithi115.stdout:7/476: creat da/dd/d13/d36/fa9 x:0 0 0 2024-09-13T23:06:11.585 INFO:tasks.workunit.client.0.smithi115.stdout:0/487: unlink d6/d24/d25/d2b/d82/d44/f57 0 2024-09-13T23:06:11.586 INFO:tasks.workunit.client.0.smithi115.stdout:5/445: dwrite d8/dd/d6a/d82/d63/f65 [0,4194304] 0 2024-09-13T23:06:11.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/488: mknod d6/d24/d25/d2b/d82/d44/cae 0 2024-09-13T23:06:11.588 INFO:tasks.workunit.client.0.smithi115.stdout:2/538: dread da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:11.588 INFO:tasks.workunit.client.0.smithi115.stdout:8/511: dwrite d3/d5/dc/d23/d4e/d54/d7f/f9d [0,4194304] 0 2024-09-13T23:06:11.588 INFO:tasks.workunit.client.0.smithi115.stdout:6/559: dwrite d4/df/d14/d38/d2a/d31/d5b/d88/d9f/faa [0,4194304] 0 2024-09-13T23:06:11.589 INFO:tasks.workunit.client.0.smithi115.stdout:5/446: mknod d8/c85 0 2024-09-13T23:06:11.591 INFO:tasks.workunit.client.0.smithi115.stdout:0/489: rename d6/d24/d25/d2b/d82/d44/d64 to d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf 0 2024-09-13T23:06:11.591 INFO:tasks.workunit.client.0.smithi115.stdout:0/490: creat d6/fb0 x:0 0 0 2024-09-13T23:06:11.594 INFO:tasks.workunit.client.0.smithi115.stdout:6/560: creat d4/d57/dab/fb6 x:0 0 0 2024-09-13T23:06:11.597 INFO:tasks.workunit.client.0.smithi115.stdout:5/447: rename d8/dd/d6a/c6f to d8/dd/d5d/c86 0 2024-09-13T23:06:11.600 INFO:tasks.workunit.client.0.smithi115.stdout:6/561: dread d4/df/d14/d38/d2a/d3e/d56/d7b/f53 [0,4194304] 0 2024-09-13T23:06:11.600 INFO:tasks.workunit.client.0.smithi115.stdout:5/448: dread d8/dd/d20/f17 [0,4194304] 0 2024-09-13T23:06:11.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/491: mknod d6/d24/d25/da3/dad/cb1 0 2024-09-13T23:06:11.601 INFO:tasks.workunit.client.0.smithi115.stdout:0/492: write d6/d24/d25/d2b/d61/f69 [1091517,32482] 0 2024-09-13T23:06:11.601 INFO:tasks.workunit.client.0.smithi115.stdout:6/562: dread d4/df/d14/d38/d2a/f9d [0,4194304] 0 2024-09-13T23:06:11.602 INFO:tasks.workunit.client.0.smithi115.stdout:6/563: creat d4/d57/dab/fb7 x:0 0 0 2024-09-13T23:06:11.602 INFO:tasks.workunit.client.0.smithi115.stdout:4/537: sync 2024-09-13T23:06:11.603 INFO:tasks.workunit.client.0.smithi115.stdout:5/449: rmdir d8/dd/d78 0 2024-09-13T23:06:11.604 INFO:tasks.workunit.client.0.smithi115.stdout:0/493: rename d6/d24/d25/l4a to d6/d24/d25/d2b/d61/lb2 0 2024-09-13T23:06:11.606 INFO:tasks.workunit.client.0.smithi115.stdout:6/564: creat d4/df/d14/d38/d2a/d31/d5b/d88/fb8 x:0 0 0 2024-09-13T23:06:11.609 INFO:tasks.workunit.client.0.smithi115.stdout:0/494: unlink d6/d24/d25/d2b/d61/f86 0 2024-09-13T23:06:11.610 INFO:tasks.workunit.client.0.smithi115.stdout:3/601: dwrite d3/d16/f97 [0,4194304] 0 2024-09-13T23:06:11.610 INFO:tasks.workunit.client.0.smithi115.stdout:6/565: getdents d4/d57/d5a/d79 0 2024-09-13T23:06:11.611 INFO:tasks.workunit.client.0.smithi115.stdout:4/538: dread db/d11/d2e/d33/d36/d7f/f53 [0,4194304] 0 2024-09-13T23:06:11.611 INFO:tasks.workunit.client.0.smithi115.stdout:2/539: dwrite da/d23/d2c/f9a [0,4194304] 0 2024-09-13T23:06:11.612 INFO:tasks.workunit.client.0.smithi115.stdout:5/450: rmdir d8/dd/d20/d23 39 2024-09-13T23:06:11.612 INFO:tasks.workunit.client.0.smithi115.stdout:5/451: chown d8/dd/f2b 20 1 2024-09-13T23:06:11.613 INFO:tasks.workunit.client.0.smithi115.stdout:5/452: read d8/dd/d20/f52 [321110,4046] 0 2024-09-13T23:06:11.615 INFO:tasks.workunit.client.0.smithi115.stdout:3/602: mkdir d3/d16/d1a/dd8 0 2024-09-13T23:06:11.616 INFO:tasks.workunit.client.0.smithi115.stdout:6/566: creat d4/df/d14/d38/d2a/d31/d5b/da8/fb9 x:0 0 0 2024-09-13T23:06:11.616 INFO:tasks.workunit.client.0.smithi115.stdout:3/603: dread d3/d5/d35/d71/d3b/d47/d28/f79 [0,4194304] 0 2024-09-13T23:06:11.619 INFO:tasks.workunit.client.0.smithi115.stdout:4/539: truncate db/d11/d2e/d33/d36/d7f/f53 234166 0 2024-09-13T23:06:11.619 INFO:tasks.workunit.client.0.smithi115.stdout:4/540: fdatasync db/d11/d2e/d33/d36/f42 0 2024-09-13T23:06:11.619 INFO:tasks.workunit.client.0.smithi115.stdout:4/541: chown db/d19/d1d/d2a/c32 134415 1 2024-09-13T23:06:11.626 INFO:tasks.workunit.client.0.smithi115.stdout:5/453: mknod d8/dd/d74/c87 0 2024-09-13T23:06:11.626 INFO:tasks.workunit.client.0.smithi115.stdout:2/540: dread da/d23/d2c/f3d [0,4194304] 0 2024-09-13T23:06:11.626 INFO:tasks.workunit.client.0.smithi115.stdout:3/604: truncate d3/d16/d1a/f57 96841 0 2024-09-13T23:06:11.626 INFO:tasks.workunit.client.0.smithi115.stdout:3/605: readlink d3/d5/d65/da8/da4/d49/l92 0 2024-09-13T23:06:11.627 INFO:tasks.workunit.client.0.smithi115.stdout:6/567: dread d4/df/d14/d38/d2a/f33 [0,4194304] 0 2024-09-13T23:06:11.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/542: unlink db/d16/d3f/d66/f83 0 2024-09-13T23:06:11.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/543: dread - db/d19/d34/f55 zero size 2024-09-13T23:06:11.630 INFO:tasks.workunit.client.0.smithi115.stdout:6/568: dread d4/df/d14/d38/f5e [0,4194304] 0 2024-09-13T23:06:11.630 INFO:tasks.workunit.client.0.smithi115.stdout:5/454: mknod d8/dd/d20/d23/c88 0 2024-09-13T23:06:11.630 INFO:tasks.workunit.client.0.smithi115.stdout:5/455: chown d8/dd/d74 10586798 1 2024-09-13T23:06:11.630 INFO:tasks.workunit.client.0.smithi115.stdout:0/495: dwrite d6/d24/d25/d58/f92 [0,4194304] 0 2024-09-13T23:06:11.631 INFO:tasks.workunit.client.0.smithi115.stdout:2/541: getdents da/d23/db4 0 2024-09-13T23:06:11.633 INFO:tasks.workunit.client.0.smithi115.stdout:3/606: creat d3/fd9 x:0 0 0 2024-09-13T23:06:11.633 INFO:tasks.workunit.client.0.smithi115.stdout:3/607: creat d3/d5/d35/d71/d3b/fda x:0 0 0 2024-09-13T23:06:11.633 INFO:tasks.workunit.client.0.smithi115.stdout:3/608: fsync d3/d16/d1c/f38 0 2024-09-13T23:06:11.633 INFO:tasks.workunit.client.0.smithi115.stdout:6/569: write d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [8130038,28117] 0 2024-09-13T23:06:11.634 INFO:tasks.workunit.client.0.smithi115.stdout:4/544: rename db/d19/d1d/f8e to db/d16/d3f/f94 0 2024-09-13T23:06:11.636 INFO:tasks.workunit.client.0.smithi115.stdout:5/456: mknod d8/dd/d6a/d82/d63/d5a/c89 0 2024-09-13T23:06:11.641 INFO:tasks.workunit.client.0.smithi115.stdout:3/609: creat d3/d16/d1a/d1e/dd3/fdb x:0 0 0 2024-09-13T23:06:11.641 INFO:tasks.workunit.client.0.smithi115.stdout:3/610: fsync d3/d5/db/f40 0 2024-09-13T23:06:11.641 INFO:tasks.workunit.client.0.smithi115.stdout:3/611: readlink d3/d16/d1a/d1e/l99 0 2024-09-13T23:06:11.643 INFO:tasks.workunit.client.0.smithi115.stdout:6/570: mkdir d4/df/d14/d38/d2a/dba 0 2024-09-13T23:06:11.644 INFO:tasks.workunit.client.0.smithi115.stdout:4/545: mknod db/d16/d3f/c95 0 2024-09-13T23:06:11.646 INFO:tasks.workunit.client.0.smithi115.stdout:3/612: readlink d3/d5/d35/d71/d45/d59/l5c 0 2024-09-13T23:06:11.646 INFO:tasks.workunit.client.0.smithi115.stdout:3/613: chown d3/d5/db/f17 288 1 2024-09-13T23:06:11.646 INFO:tasks.workunit.client.0.smithi115.stdout:9/500: sync 2024-09-13T23:06:11.647 INFO:tasks.workunit.client.0.smithi115.stdout:4/546: mkdir db/d16/d3f/d66/d68/d71/d84/d96 0 2024-09-13T23:06:11.648 INFO:tasks.workunit.client.0.smithi115.stdout:5/457: rmdir d8/dd/d5d/d5e 39 2024-09-13T23:06:11.648 INFO:tasks.workunit.client.0.smithi115.stdout:5/458: chown d8/dd/f46 2 1 2024-09-13T23:06:11.649 INFO:tasks.workunit.client.0.smithi115.stdout:5/459: fdatasync d8/dd/d5d/f6e 0 2024-09-13T23:06:11.650 INFO:tasks.workunit.client.0.smithi115.stdout:3/614: creat d3/dcd/fdc x:0 0 0 2024-09-13T23:06:11.651 INFO:tasks.workunit.client.0.smithi115.stdout:0/496: dwrite d6/d24/d25/d2b/d61/f96 [4194304,4194304] 0 2024-09-13T23:06:11.652 INFO:tasks.workunit.client.0.smithi115.stdout:6/571: dread d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:11.652 INFO:tasks.workunit.client.0.smithi115.stdout:9/501: rmdir d0/d13/d17/d1f/d4e/d61/d7d/da0 0 2024-09-13T23:06:11.652 INFO:tasks.workunit.client.0.smithi115.stdout:6/572: chown d4/df/d14/l7e 60130 1 2024-09-13T23:06:11.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/460: mkdir d8/dd/d6a/d8a 0 2024-09-13T23:06:11.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/461: chown d8/l11 201109296 1 2024-09-13T23:06:11.655 INFO:tasks.workunit.client.0.smithi115.stdout:0/497: unlink d6/d24/f49 0 2024-09-13T23:06:11.658 INFO:tasks.workunit.client.0.smithi115.stdout:6/573: creat d4/d57/d5a/d79/fbb x:0 0 0 2024-09-13T23:06:11.659 INFO:tasks.workunit.client.0.smithi115.stdout:5/462: truncate d8/dd/ff 2604643 0 2024-09-13T23:06:11.659 INFO:tasks.workunit.client.0.smithi115.stdout:5/463: truncate d8/dd/d4c/f75 566938 0 2024-09-13T23:06:11.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/498: truncate d6/d24/d25/d2b/d82/d44/f46 1011352 0 2024-09-13T23:06:11.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/499: fsync d6/fa9 0 2024-09-13T23:06:11.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/500: chown d6/d24/d25/d2b/d82/f36 0 1 2024-09-13T23:06:11.660 INFO:tasks.workunit.client.0.smithi115.stdout:3/615: dread d3/d5/d65/da8/da4/d49/f7d [0,4194304] 0 2024-09-13T23:06:11.660 INFO:tasks.workunit.client.0.smithi115.stdout:3/616: fsync d3/d16/f97 0 2024-09-13T23:06:11.664 INFO:tasks.workunit.client.0.smithi115.stdout:0/501: creat d6/d24/d25/fb3 x:0 0 0 2024-09-13T23:06:11.665 INFO:tasks.workunit.client.0.smithi115.stdout:0/502: write d6/d24/d25/d2b/d61/f85 [378520,50450] 0 2024-09-13T23:06:11.665 INFO:tasks.workunit.client.0.smithi115.stdout:3/617: mknod d3/d16/d1a/d1e/d94/cdd 0 2024-09-13T23:06:11.666 INFO:tasks.workunit.client.0.smithi115.stdout:3/618: dread d3/d5/d5b/f72 [0,4194304] 0 2024-09-13T23:06:11.672 INFO:tasks.workunit.client.0.smithi115.stdout:9/502: dwrite d0/d13/d3b/f97 [0,4194304] 0 2024-09-13T23:06:11.674 INFO:tasks.workunit.client.0.smithi115.stdout:9/503: rmdir d0/d13/d17/d1f/d35/d40 39 2024-09-13T23:06:11.675 INFO:tasks.workunit.client.0.smithi115.stdout:4/547: dwrite db/d11/d2e/d33/d36/d7f/f86 [0,4194304] 0 2024-09-13T23:06:11.680 INFO:tasks.workunit.client.0.smithi115.stdout:4/548: creat db/d11/d2e/d33/d36/d51/d57/f97 x:0 0 0 2024-09-13T23:06:11.683 INFO:tasks.workunit.client.0.smithi115.stdout:4/549: creat db/d16/d3f/d66/d68/d71/d84/d96/f98 x:0 0 0 2024-09-13T23:06:11.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/550: mknod db/d11/d2e/d33/d36/d51/c99 0 2024-09-13T23:06:11.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/551: dread - db/d11/d2e/d33/d36/d51/f7d zero size 2024-09-13T23:06:11.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/552: fsync db/d11/d2e/d33/f6d 0 2024-09-13T23:06:11.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/553: stat db/d16/f7e 0 2024-09-13T23:06:11.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/554: fdatasync db/d16/d3f/f6c 0 2024-09-13T23:06:11.687 INFO:tasks.workunit.client.0.smithi115.stdout:0/503: write d6/d24/d25/d2b/d82/d44/f46 [1424728,23803] 0 2024-09-13T23:06:11.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/555: creat db/d11/d54/d17/f9a x:0 0 0 2024-09-13T23:06:11.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/556: chown db/d16/d3f/d66/d68/d71/l7b 65 1 2024-09-13T23:06:11.689 INFO:tasks.workunit.client.0.smithi115.stdout:0/504: mkdir d6/d24/d25/d58/db4 0 2024-09-13T23:06:11.690 INFO:tasks.workunit.client.0.smithi115.stdout:4/557: creat db/d11/d2e/d33/d36/f9b x:0 0 0 2024-09-13T23:06:11.690 INFO:tasks.workunit.client.0.smithi115.stdout:4/558: write db/d19/d4e/f5b [1130463,86836] 0 2024-09-13T23:06:11.690 INFO:tasks.workunit.client.0.smithi115.stdout:4/559: dread - db/d19/d4e/f64 zero size 2024-09-13T23:06:11.690 INFO:tasks.workunit.client.0.smithi115.stdout:4/560: write db/d11/d2e/d33/f4c [1186413,64340] 0 2024-09-13T23:06:11.690 INFO:tasks.workunit.client.0.smithi115.stdout:4/561: readlink db/d11/l8b 0 2024-09-13T23:06:11.691 INFO:tasks.workunit.client.0.smithi115.stdout:4/562: chown db/d11/d2e/f5d 1359 1 2024-09-13T23:06:11.691 INFO:tasks.workunit.client.0.smithi115.stdout:4/563: creat db/d11/d2e/d33/d36/f9c x:0 0 0 2024-09-13T23:06:11.691 INFO:tasks.workunit.client.0.smithi115.stdout:0/505: mknod d6/d24/d25/d2b/d82/d6b/d9f/cb5 0 2024-09-13T23:06:11.692 INFO:tasks.workunit.client.0.smithi115.stdout:0/506: creat d6/d24/d25/da3/dad/fb6 x:0 0 0 2024-09-13T23:06:11.692 INFO:tasks.workunit.client.0.smithi115.stdout:0/507: truncate d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/f8f 1518944 0 2024-09-13T23:06:11.693 INFO:tasks.workunit.client.0.smithi115.stdout:0/508: creat d6/d24/d25/d2b/d82/d44/fb7 x:0 0 0 2024-09-13T23:06:11.694 INFO:tasks.workunit.client.0.smithi115.stdout:0/509: mknod d6/d24/cb8 0 2024-09-13T23:06:11.700 INFO:tasks.workunit.client.0.smithi115.stdout:3/619: dwrite d3/d5/db/faf [0,4194304] 0 2024-09-13T23:06:11.700 INFO:tasks.workunit.client.0.smithi115.stdout:3/620: chown d3/d16/f97 225597921 1 2024-09-13T23:06:11.700 INFO:tasks.workunit.client.0.smithi115.stdout:6/574: dwrite d4/df/d14/d38/d44/d66/fac [0,4194304] 0 2024-09-13T23:06:11.704 INFO:tasks.workunit.client.0.smithi115.stdout:3/621: mknod d3/d5/d35/d71/d3b/d4d/cde 0 2024-09-13T23:06:11.704 INFO:tasks.workunit.client.0.smithi115.stdout:3/622: creat d3/d16/fdf x:0 0 0 2024-09-13T23:06:11.705 INFO:tasks.workunit.client.0.smithi115.stdout:9/504: dwrite d0/d13/d17/d1f/f66 [0,4194304] 0 2024-09-13T23:06:11.707 INFO:tasks.workunit.client.0.smithi115.stdout:5/464: dwrite d8/dd/d14/f77 [0,4194304] 0 2024-09-13T23:06:11.709 INFO:tasks.workunit.client.0.smithi115.stdout:1/518: sync 2024-09-13T23:06:11.709 INFO:tasks.workunit.client.0.smithi115.stdout:8/512: sync 2024-09-13T23:06:11.709 INFO:tasks.workunit.client.0.smithi115.stdout:7/477: sync 2024-09-13T23:06:11.709 INFO:tasks.workunit.client.0.smithi115.stdout:8/513: fsync d3/d5/dc/d16/d1f/f22 0 2024-09-13T23:06:11.709 INFO:tasks.workunit.client.0.smithi115.stdout:8/514: truncate d3/d5/d6a/f75 1880994 0 2024-09-13T23:06:11.713 INFO:tasks.workunit.client.0.smithi115.stdout:5/465: creat d8/dd/d6a/d82/d63/f8b x:0 0 0 2024-09-13T23:06:11.713 INFO:tasks.workunit.client.0.smithi115.stdout:9/505: rmdir d0/d13/d17/d36/d80 39 2024-09-13T23:06:11.715 INFO:tasks.workunit.client.0.smithi115.stdout:6/575: dread d4/df/f2e [0,4194304] 0 2024-09-13T23:06:11.718 INFO:tasks.workunit.client.0.smithi115.stdout:8/515: link d3/d5/d1c/d41/d42/l5a d3/d5/d1d/d72/lb2 0 2024-09-13T23:06:11.718 INFO:tasks.workunit.client.0.smithi115.stdout:8/516: creat d3/fb3 x:0 0 0 2024-09-13T23:06:11.720 INFO:tasks.workunit.client.0.smithi115.stdout:6/576: creat d4/d57/d5a/d79/d85/fbc x:0 0 0 2024-09-13T23:06:11.723 INFO:tasks.workunit.client.0.smithi115.stdout:8/517: getdents d3/d5/dc/d16/d1f/d27 0 2024-09-13T23:06:11.723 INFO:tasks.workunit.client.0.smithi115.stdout:8/518: fsync d3/d5/d1d/d72/f9e 0 2024-09-13T23:06:11.723 INFO:tasks.workunit.client.0.smithi115.stdout:8/519: dread - d3/d5/d1d/fb1 zero size 2024-09-13T23:06:11.724 INFO:tasks.workunit.client.0.smithi115.stdout:0/510: dwrite d6/d24/d25/da3/dad/f80 [0,4194304] 0 2024-09-13T23:06:11.724 INFO:tasks.workunit.client.0.smithi115.stdout:0/511: chown d6/d24/d25/da3 309 1 2024-09-13T23:06:11.724 INFO:tasks.workunit.client.0.smithi115.stdout:0/512: dread - d6/d24/d25/da3/dad/f9b zero size 2024-09-13T23:06:11.726 INFO:tasks.workunit.client.0.smithi115.stdout:4/564: dwrite db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:11.726 INFO:tasks.workunit.client.0.smithi115.stdout:8/520: creat d3/d5/dc/d16/d1f/d27/d79/fb4 x:0 0 0 2024-09-13T23:06:11.726 INFO:tasks.workunit.client.0.smithi115.stdout:3/623: read d3/d5/d35/d71/d3b/d47/f39 [1847798,99670] 0 2024-09-13T23:06:11.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/577: rmdir d4/df/d14/d67 39 2024-09-13T23:06:11.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/578: stat d4/d57/dab/cb0 0 2024-09-13T23:06:11.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/579: creat d4/df/d14/d38/d2a/d31/fbd x:0 0 0 2024-09-13T23:06:11.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/580: fsync d4/df/d14/d38/d2a/d3e/fa5 0 2024-09-13T23:06:11.727 INFO:tasks.workunit.client.0.smithi115.stdout:6/581: write d4/df/d14/d38/d2a/d3e/d56/d7b/f69 [2784730,118627] 0 2024-09-13T23:06:11.728 INFO:tasks.workunit.client.0.smithi115.stdout:6/582: chown d4/df/l3d 4 1 2024-09-13T23:06:11.728 INFO:tasks.workunit.client.0.smithi115.stdout:6/583: write d4/f3c [1855520,40559] 0 2024-09-13T23:06:11.728 INFO:tasks.workunit.client.0.smithi115.stdout:6/584: chown d4/d57/d5a 14679774 1 2024-09-13T23:06:11.728 INFO:tasks.workunit.client.0.smithi115.stdout:6/585: write d4/df/f28 [627279,36617] 0 2024-09-13T23:06:11.730 INFO:tasks.workunit.client.0.smithi115.stdout:6/586: write d4/df/d14/d38/f68 [4518652,85775] 0 2024-09-13T23:06:11.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/565: symlink db/d16/d3f/d66/d68/l9d 0 2024-09-13T23:06:11.732 INFO:tasks.workunit.client.0.smithi115.stdout:3/624: dread d3/d16/d1a/d1e/d76/f83 [0,4194304] 0 2024-09-13T23:06:11.732 INFO:tasks.workunit.client.0.smithi115.stdout:3/625: stat d3/d5/cf 0 2024-09-13T23:06:11.733 INFO:tasks.workunit.client.0.smithi115.stdout:8/521: truncate d3/d5/dc/d16/f38 1848393 0 2024-09-13T23:06:11.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/566: creat db/d16/d3f/d66/d68/d71/f9e x:0 0 0 2024-09-13T23:06:11.739 INFO:tasks.workunit.client.0.smithi115.stdout:4/567: chown db/d11/d2e/d33/d36/d7f/f3e 2398661 1 2024-09-13T23:06:11.740 INFO:tasks.workunit.client.0.smithi115.stdout:8/522: creat d3/d5/dc/d23/d4e/d54/d7f/fb5 x:0 0 0 2024-09-13T23:06:11.740 INFO:tasks.workunit.client.0.smithi115.stdout:8/523: getdents d3/d5/dc/d23/d4e 0 2024-09-13T23:06:11.740 INFO:tasks.workunit.client.0.smithi115.stdout:8/524: truncate d3/d5/dc/d16/d1f/d27/f48 386141 0 2024-09-13T23:06:11.741 INFO:tasks.workunit.client.0.smithi115.stdout:4/568: symlink db/d11/d2e/d33/l9f 0 2024-09-13T23:06:11.743 INFO:tasks.workunit.client.0.smithi115.stdout:4/569: getdents db/d11/d2e 0 2024-09-13T23:06:11.745 INFO:tasks.workunit.client.0.smithi115.stdout:4/570: getdents db/d11/d2e/d33/d36 0 2024-09-13T23:06:11.759 INFO:tasks.workunit.client.0.smithi115.stdout:9/506: dwrite d0/d43/d53/f69 [0,4194304] 0 2024-09-13T23:06:11.759 INFO:tasks.workunit.client.0.smithi115.stdout:4/571: write db/d11/d2e/d33/d36/d7f/f86 [437639,1333] 0 2024-09-13T23:06:11.761 INFO:tasks.workunit.client.0.smithi115.stdout:4/572: getdents db/d19 0 2024-09-13T23:06:11.762 INFO:tasks.workunit.client.0.smithi115.stdout:4/573: link db/d11/d2e/l39 db/d16/d3f/d66/d68/la0 0 2024-09-13T23:06:11.763 INFO:tasks.workunit.client.0.smithi115.stdout:4/574: mknod db/d19/d4e/ca1 0 2024-09-13T23:06:11.763 INFO:tasks.workunit.client.0.smithi115.stdout:4/575: write db/d19/d1d/f59 [728396,9993] 0 2024-09-13T23:06:11.763 INFO:tasks.workunit.client.0.smithi115.stdout:4/576: fsync db/d11/d54/d17/f9a 0 2024-09-13T23:06:11.765 INFO:tasks.workunit.client.0.smithi115.stdout:4/577: symlink db/d19/d4e/la2 0 2024-09-13T23:06:11.765 INFO:tasks.workunit.client.0.smithi115.stdout:4/578: write db/f43 [2895258,97687] 0 2024-09-13T23:06:11.766 INFO:tasks.workunit.client.0.smithi115.stdout:4/579: link db/d19/d34/f89 db/d11/fa3 0 2024-09-13T23:06:11.767 INFO:tasks.workunit.client.0.smithi115.stdout:4/580: stat db/d16/d3f/l61 0 2024-09-13T23:06:11.768 INFO:tasks.workunit.client.0.smithi115.stdout:1/519: dwrite d0/de/d1b/f99 [0,4194304] 0 2024-09-13T23:06:11.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/478: dwrite da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:11.770 INFO:tasks.workunit.client.0.smithi115.stdout:2/542: sync 2024-09-13T23:06:11.770 INFO:tasks.workunit.client.0.smithi115.stdout:2/543: chown da/d23/d2c/cb2 147767625 1 2024-09-13T23:06:11.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/626: dwrite d3/d5/db/f17 [0,4194304] 0 2024-09-13T23:06:11.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/627: write d3/d5/d35/d4c/fd5 [203359,86737] 0 2024-09-13T23:06:11.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/628: truncate d3/d5/d2c/f90 1042158 0 2024-09-13T23:06:11.771 INFO:tasks.workunit.client.0.smithi115.stdout:6/587: dwrite d4/f1d [0,4194304] 0 2024-09-13T23:06:11.772 INFO:tasks.workunit.client.0.smithi115.stdout:0/513: dwrite d6/d24/f38 [0,4194304] 0 2024-09-13T23:06:11.773 INFO:tasks.workunit.client.0.smithi115.stdout:7/479: symlink da/laa 0 2024-09-13T23:06:11.773 INFO:tasks.workunit.client.0.smithi115.stdout:7/480: truncate da/df/fa6 718564 0 2024-09-13T23:06:11.773 INFO:tasks.workunit.client.0.smithi115.stdout:7/481: readlink da/dd/d1c/d2d/d41/l7b 0 2024-09-13T23:06:11.779 INFO:tasks.workunit.client.0.smithi115.stdout:9/507: dwrite d0/d13/d17/d1f/d28/f91 [0,4194304] 0 2024-09-13T23:06:11.779 INFO:tasks.workunit.client.0.smithi115.stdout:9/508: chown d0/d13/d17/d1f/d35/d40/l51 8 1 2024-09-13T23:06:11.779 INFO:tasks.workunit.client.0.smithi115.stdout:7/482: dread da/df/f26 [0,4194304] 0 2024-09-13T23:06:11.779 INFO:tasks.workunit.client.0.smithi115.stdout:7/483: read da/dd/d13/f6b [477007,70034] 0 2024-09-13T23:06:11.780 INFO:tasks.workunit.client.0.smithi115.stdout:3/629: rename d3/d5/db/f40 to d3/d5/d35/d71/d3b/d47/d28/fe0 0 2024-09-13T23:06:11.781 INFO:tasks.workunit.client.0.smithi115.stdout:3/630: getdents d3/d5/d35/d71/d3b/d47 0 2024-09-13T23:06:11.781 INFO:tasks.workunit.client.0.smithi115.stdout:2/544: write da/d21/d2d/d78/d56/d1a/f1f [2868969,34330] 0 2024-09-13T23:06:11.781 INFO:tasks.workunit.client.0.smithi115.stdout:2/545: stat da/d23/d2c/fae 0 2024-09-13T23:06:11.781 INFO:tasks.workunit.client.0.smithi115.stdout:8/525: dwrite d3/f2f [0,4194304] 0 2024-09-13T23:06:11.781 INFO:tasks.workunit.client.0.smithi115.stdout:2/546: chown da/d23/f7b 11 1 2024-09-13T23:06:11.782 INFO:tasks.workunit.client.0.smithi115.stdout:6/588: creat d4/d57/fbe x:0 0 0 2024-09-13T23:06:11.789 INFO:tasks.workunit.client.0.smithi115.stdout:7/484: creat da/dd/d13/d24/d67/d81/fab x:0 0 0 2024-09-13T23:06:11.789 INFO:tasks.workunit.client.0.smithi115.stdout:7/485: write da/dd/d13/d24/d52/f8a [200866,809] 0 2024-09-13T23:06:11.790 INFO:tasks.workunit.client.0.smithi115.stdout:8/526: mknod d3/d5/dc/d16/d1f/d27/d68/cb6 0 2024-09-13T23:06:11.792 INFO:tasks.workunit.client.0.smithi115.stdout:6/589: mkdir d4/d57/d5a/d79/d85/dbf 0 2024-09-13T23:06:11.793 INFO:tasks.workunit.client.0.smithi115.stdout:3/631: write d3/d16/f97 [1163930,76146] 0 2024-09-13T23:06:11.793 INFO:tasks.workunit.client.0.smithi115.stdout:3/632: dread - d3/dcd/fdc zero size 2024-09-13T23:06:11.794 INFO:tasks.workunit.client.0.smithi115.stdout:7/486: rename da/laa to da/dd/d13/d24/d67/d81/lac 0 2024-09-13T23:06:11.794 INFO:tasks.workunit.client.0.smithi115.stdout:7/487: write da/dd/d13/d36/fa9 [748878,74766] 0 2024-09-13T23:06:11.795 INFO:tasks.workunit.client.0.smithi115.stdout:8/527: symlink d3/d5/d1d/d63/lb7 0 2024-09-13T23:06:11.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/590: rmdir d4/df/d51 39 2024-09-13T23:06:11.797 INFO:tasks.workunit.client.0.smithi115.stdout:3/633: dread d3/d5/d35/d71/d45/f6c [0,4194304] 0 2024-09-13T23:06:11.797 INFO:tasks.workunit.client.0.smithi115.stdout:3/634: dread - d3/dcd/fdc zero size 2024-09-13T23:06:11.798 INFO:tasks.workunit.client.0.smithi115.stdout:8/528: creat d3/d5/dc/d23/d4e/d54/d8c/fb8 x:0 0 0 2024-09-13T23:06:11.798 INFO:tasks.workunit.client.0.smithi115.stdout:6/591: mkdir d4/df/d14/d38/d44/d99/dc0 0 2024-09-13T23:06:11.799 INFO:tasks.workunit.client.0.smithi115.stdout:3/635: write d3/d5/d35/d71/d45/d59/f6f [325652,3338] 0 2024-09-13T23:06:11.799 INFO:tasks.workunit.client.0.smithi115.stdout:8/529: creat d3/d5/dc/d23/d4e/fb9 x:0 0 0 2024-09-13T23:06:11.800 INFO:tasks.workunit.client.0.smithi115.stdout:6/592: mkdir d4/df/d14/d67/d77/dc1 0 2024-09-13T23:06:11.800 INFO:tasks.workunit.client.0.smithi115.stdout:6/593: fdatasync d4/df/d14/d38/d2a/f9d 0 2024-09-13T23:06:11.802 INFO:tasks.workunit.client.0.smithi115.stdout:3/636: rename d3/d5/d35/d71/d45/d98/db7 to d3/d5/d35/d71/d3b/d47/de1 0 2024-09-13T23:06:11.804 INFO:tasks.workunit.client.0.smithi115.stdout:3/637: mkdir d3/d5/d35/d71/d3b/d47/de1/dcc/dd4/de2 0 2024-09-13T23:06:11.805 INFO:tasks.workunit.client.0.smithi115.stdout:3/638: symlink d3/d16/d84/le3 0 2024-09-13T23:06:11.805 INFO:tasks.workunit.client.0.smithi115.stdout:3/639: chown d3/d16/d1a/d1e/d94/fb6 211110 1 2024-09-13T23:06:11.805 INFO:tasks.workunit.client.0.smithi115.stdout:3/640: mknod d3/d5/d65/ce4 0 2024-09-13T23:06:11.805 INFO:tasks.workunit.client.0.smithi115.stdout:3/641: readlink d3/d5/d35/d71/d3b/d4d/l8b 0 2024-09-13T23:06:11.808 INFO:tasks.workunit.client.0.smithi115.stdout:7/488: dread da/dd/d1c/f9c [0,4194304] 0 2024-09-13T23:06:11.808 INFO:tasks.workunit.client.0.smithi115.stdout:7/489: fdatasync da/dd/d13/d36/f71 0 2024-09-13T23:06:11.808 INFO:tasks.workunit.client.0.smithi115.stdout:7/490: write da/dd/d13/d24/f6c [1033110,124981] 0 2024-09-13T23:06:11.809 INFO:tasks.workunit.client.0.smithi115.stdout:1/520: dwrite d0/de/d66/d8f/d29/d47/d63/f6b [0,4194304] 0 2024-09-13T23:06:11.811 INFO:tasks.workunit.client.0.smithi115.stdout:2/547: dwrite da/d21/d8c/d41/d69/f50 [0,4194304] 0 2024-09-13T23:06:11.811 INFO:tasks.workunit.client.0.smithi115.stdout:6/594: dread d4/df/d51/f83 [0,4194304] 0 2024-09-13T23:06:11.812 INFO:tasks.workunit.client.0.smithi115.stdout:2/548: readlink da/d21/d2d/d78/d56/d4b/l92 0 2024-09-13T23:06:11.812 INFO:tasks.workunit.client.0.smithi115.stdout:6/595: fsync d4/df/d14/d38/d2a/d3e/f4c 0 2024-09-13T23:06:11.812 INFO:tasks.workunit.client.0.smithi115.stdout:1/521: link d0/c95 d0/de/d66/ca5 0 2024-09-13T23:06:11.813 INFO:tasks.workunit.client.0.smithi115.stdout:9/509: dwrite d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:11.815 INFO:tasks.workunit.client.0.smithi115.stdout:2/549: symlink da/d21/d2d/d78/d48/lba 0 2024-09-13T23:06:11.815 INFO:tasks.workunit.client.0.smithi115.stdout:3/642: write d3/d5/d35/d71/f44 [2745170,51069] 0 2024-09-13T23:06:11.816 INFO:tasks.workunit.client.0.smithi115.stdout:6/596: symlink d4/df/d14/d38/d44/d66/d8b/lc2 0 2024-09-13T23:06:11.816 INFO:tasks.workunit.client.0.smithi115.stdout:1/522: rmdir d0/de/d66/d8f/d29/d47/d6a/d80 39 2024-09-13T23:06:11.816 INFO:tasks.workunit.client.0.smithi115.stdout:1/523: creat d0/de/d62/fa6 x:0 0 0 2024-09-13T23:06:11.818 INFO:tasks.workunit.client.0.smithi115.stdout:9/510: getdents d0/d13/d17/d1f/d28 0 2024-09-13T23:06:11.818 INFO:tasks.workunit.client.0.smithi115.stdout:9/511: chown d0/d13/d17/d1f/d35/l88 49 1 2024-09-13T23:06:11.824 INFO:tasks.workunit.client.0.smithi115.stdout:2/550: symlink da/d21/d8c/d41/d95/lbb 0 2024-09-13T23:06:11.824 INFO:tasks.workunit.client.0.smithi115.stdout:2/551: write da/d21/d2d/d78/d56/d1a/d7f/f97 [5025612,32099] 0 2024-09-13T23:06:11.825 INFO:tasks.workunit.client.0.smithi115.stdout:6/597: mkdir d4/df/d14/d38/d44/d66/dc3 0 2024-09-13T23:06:11.825 INFO:tasks.workunit.client.0.smithi115.stdout:6/598: chown d4/df/f2e 71252793 1 2024-09-13T23:06:11.826 INFO:tasks.workunit.client.0.smithi115.stdout:1/524: creat d0/de/d66/d8f/d29/d47/fa7 x:0 0 0 2024-09-13T23:06:11.827 INFO:tasks.workunit.client.0.smithi115.stdout:9/512: mkdir d0/d13/d17/d1f/d4e/da2 0 2024-09-13T23:06:11.830 INFO:tasks.workunit.client.0.smithi115.stdout:7/491: dwrite da/dd/d13/f6b [0,4194304] 0 2024-09-13T23:06:11.831 INFO:tasks.workunit.client.0.smithi115.stdout:2/552: mkdir da/d21/da8/dbc 0 2024-09-13T23:06:11.831 INFO:tasks.workunit.client.0.smithi115.stdout:2/553: fdatasync da/d21/d8c/d41/f7a 0 2024-09-13T23:06:11.831 INFO:tasks.workunit.client.0.smithi115.stdout:2/554: dread - da/d23/d2c/fae zero size 2024-09-13T23:06:11.831 INFO:tasks.workunit.client.0.smithi115.stdout:2/555: chown da/d21/d8c/d41/d62/l67 835138064 1 2024-09-13T23:06:11.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/643: dwrite d3/d5/d35/d4c/fd5 [0,4194304] 0 2024-09-13T23:06:11.832 INFO:tasks.workunit.client.0.smithi115.stdout:3/644: write d3/d5/d35/d71/d3b/d47/d28/f79 [214510,113558] 0 2024-09-13T23:06:11.833 INFO:tasks.workunit.client.0.smithi115.stdout:3/645: write d3/f1b [2846916,7637] 0 2024-09-13T23:06:11.833 INFO:tasks.workunit.client.0.smithi115.stdout:6/599: mkdir d4/df/d14/d38/d2a/d3e/d56/dc4 0 2024-09-13T23:06:11.833 INFO:tasks.workunit.client.0.smithi115.stdout:1/525: symlink d0/de/d66/d8f/d29/d47/d74/d9d/da3/la8 0 2024-09-13T23:06:11.833 INFO:tasks.workunit.client.0.smithi115.stdout:6/600: creat d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fc5 x:0 0 0 2024-09-13T23:06:11.833 INFO:tasks.workunit.client.0.smithi115.stdout:6/601: creat d4/df/d14/d38/d44/d99/fc6 x:0 0 0 2024-09-13T23:06:11.837 INFO:tasks.workunit.client.0.smithi115.stdout:3/646: dread d3/d5/d5b/fcb [0,4194304] 0 2024-09-13T23:06:11.839 INFO:tasks.workunit.client.0.smithi115.stdout:3/647: write d3/d16/d84/fb0 [629799,46459] 0 2024-09-13T23:06:11.839 INFO:tasks.workunit.client.0.smithi115.stdout:3/648: read d3/f1b [2727935,1429] 0 2024-09-13T23:06:11.844 INFO:tasks.workunit.client.0.smithi115.stdout:1/526: rename d0/c24 to d0/de/d1b/d25/d4d/d51/d31/d37/ca9 0 2024-09-13T23:06:11.844 INFO:tasks.workunit.client.0.smithi115.stdout:1/527: chown d0/de/d1b/d25/d4d 323 1 2024-09-13T23:06:11.845 INFO:tasks.workunit.client.0.smithi115.stdout:1/528: truncate d0/de/d1b/d25/d4d/d51/d31/f53 1824287 0 2024-09-13T23:06:11.845 INFO:tasks.workunit.client.0.smithi115.stdout:1/529: chown d0/de/d1b/d25/d4d/d51/d23/c4f 37158459 1 2024-09-13T23:06:11.848 INFO:tasks.workunit.client.0.smithi115.stdout:6/602: creat d4/df/d14/d38/d44/fc7 x:0 0 0 2024-09-13T23:06:11.849 INFO:tasks.workunit.client.0.smithi115.stdout:6/603: getdents d4/df/d51 0 2024-09-13T23:06:11.850 INFO:tasks.workunit.client.0.smithi115.stdout:6/604: write d4/df/d14/d67/f7a [243437,96734] 0 2024-09-13T23:06:11.851 INFO:tasks.workunit.client.0.smithi115.stdout:6/605: symlink d4/df/d14/lc8 0 2024-09-13T23:06:11.851 INFO:tasks.workunit.client.0.smithi115.stdout:6/606: creat d4/df/d14/d38/d44/d66/fc9 x:0 0 0 2024-09-13T23:06:11.856 INFO:tasks.workunit.client.0.smithi115.stdout:9/513: dwrite d0/d13/f79 [0,4194304] 0 2024-09-13T23:06:11.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/514: fsync d0/d43/d53/f69 0 2024-09-13T23:06:11.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/515: creat d0/d13/d17/d1f/d77/fa3 x:0 0 0 2024-09-13T23:06:11.857 INFO:tasks.workunit.client.0.smithi115.stdout:9/516: chown d0/l3c 11196819 1 2024-09-13T23:06:11.861 INFO:tasks.workunit.client.0.smithi115.stdout:3/649: dread d3/d16/d84/fb0 [0,4194304] 0 2024-09-13T23:06:11.861 INFO:tasks.workunit.client.0.smithi115.stdout:3/650: truncate d3/d5/d65/da8/da4/d49/fa6 266844 0 2024-09-13T23:06:11.861 INFO:tasks.workunit.client.0.smithi115.stdout:3/651: chown d3/d5/d65/da8/da4/d49/l92 479660 1 2024-09-13T23:06:11.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/652: link d3/d16/d1a/d1e/d94/ca0 d3/d5/d35/d71/d45/d59/ce5 0 2024-09-13T23:06:11.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/653: fsync d3/d5/d5b/f72 0 2024-09-13T23:06:11.863 INFO:tasks.workunit.client.0.smithi115.stdout:7/492: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:11.864 INFO:tasks.workunit.client.0.smithi115.stdout:2/556: dwrite da/f11 [0,4194304] 0 2024-09-13T23:06:11.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/493: rename da/dd/d1c/d2d/d60/f94 to da/dd/d1c/fad 0 2024-09-13T23:06:11.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/494: chown da/dd/d13/d36/d5a/d6d/f8b 2 1 2024-09-13T23:06:11.869 INFO:tasks.workunit.client.0.smithi115.stdout:6/607: dread d4/df/d14/d38/f68 [0,4194304] 0 2024-09-13T23:06:11.869 INFO:tasks.workunit.client.0.smithi115.stdout:2/557: mkdir da/d23/dbd 0 2024-09-13T23:06:11.869 INFO:tasks.workunit.client.0.smithi115.stdout:2/558: fdatasync f7 0 2024-09-13T23:06:11.869 INFO:tasks.workunit.client.0.smithi115.stdout:7/495: creat da/dd/d13/d24/d52/d7c/da7/fae x:0 0 0 2024-09-13T23:06:11.869 INFO:tasks.workunit.client.0.smithi115.stdout:6/608: rmdir d4/df/d14/d38/d2a/d31/d5b 39 2024-09-13T23:06:11.870 INFO:tasks.workunit.client.0.smithi115.stdout:6/609: write d4/d57/d5a/d79/d85/fbc [671969,101700] 0 2024-09-13T23:06:11.870 INFO:tasks.workunit.client.0.smithi115.stdout:9/517: dread d0/d13/f79 [0,4194304] 0 2024-09-13T23:06:11.871 INFO:tasks.workunit.client.0.smithi115.stdout:6/610: rename d4/df/f1f to d4/df/d51/fca 0 2024-09-13T23:06:11.871 INFO:tasks.workunit.client.0.smithi115.stdout:6/611: mkdir d4/d57/dcb 0 2024-09-13T23:06:11.872 INFO:tasks.workunit.client.0.smithi115.stdout:6/612: getdents d4/df/d14/d38/d2a/d3e 0 2024-09-13T23:06:11.873 INFO:tasks.workunit.client.0.smithi115.stdout:6/613: creat d4/df/d14/d38/d2a/d31/d5b/da8/fcc x:0 0 0 2024-09-13T23:06:11.874 INFO:tasks.workunit.client.0.smithi115.stdout:6/614: symlink d4/df/d14/d38/d44/d66/d8b/lcd 0 2024-09-13T23:06:11.874 INFO:tasks.workunit.client.0.smithi115.stdout:6/615: truncate d4/df/d14/d38/d2a/d31/d5b/d88/fb8 1003529 0 2024-09-13T23:06:11.875 INFO:tasks.workunit.client.0.smithi115.stdout:6/616: mkdir d4/d57/dce 0 2024-09-13T23:06:11.875 INFO:tasks.workunit.client.0.smithi115.stdout:6/617: mkdir d4/df/d14/d67/d77/dcf 0 2024-09-13T23:06:11.875 INFO:tasks.workunit.client.0.smithi115.stdout:2/559: read da/d21/d8c/f4d [3771945,102271] 0 2024-09-13T23:06:11.876 INFO:tasks.workunit.client.0.smithi115.stdout:6/618: mknod d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/cd0 0 2024-09-13T23:06:11.877 INFO:tasks.workunit.client.0.smithi115.stdout:6/619: symlink d4/df/d14/d67/d77/dc1/ld1 0 2024-09-13T23:06:11.883 INFO:tasks.workunit.client.0.smithi115.stdout:7/496: dwrite da/dd/d13/d24/d52/d7c/da7/fae [0,4194304] 0 2024-09-13T23:06:11.885 INFO:tasks.workunit.client.0.smithi115.stdout:7/497: rename da/dd/d13/d24/d52/f8a to da/d53/faf 0 2024-09-13T23:06:11.886 INFO:tasks.workunit.client.0.smithi115.stdout:7/498: rmdir da/dd/d1c/d2d/d45/d4d 39 2024-09-13T23:06:11.886 INFO:tasks.workunit.client.0.smithi115.stdout:7/499: write da/dd/d13/d24/f4f [328988,77483] 0 2024-09-13T23:06:11.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/500: write da/dd/d1c/d2d/d45/f7f [1257374,23228] 0 2024-09-13T23:06:11.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/501: write da/dd/d13/d24/f4f [370460,130750] 0 2024-09-13T23:06:11.887 INFO:tasks.workunit.client.0.smithi115.stdout:2/560: dread da/d21/f9f [0,4194304] 0 2024-09-13T23:06:11.887 INFO:tasks.workunit.client.0.smithi115.stdout:7/502: truncate da/dd/d1c/f9c 1190800 0 2024-09-13T23:06:11.889 INFO:tasks.workunit.client.0.smithi115.stdout:2/561: symlink da/d23/lbe 0 2024-09-13T23:06:11.891 INFO:tasks.workunit.client.0.smithi115.stdout:2/562: dread da/d21/d8c/d41/d62/f71 [0,4194304] 0 2024-09-13T23:06:11.892 INFO:tasks.workunit.client.0.smithi115.stdout:2/563: dread da/d21/d8c/f63 [0,4194304] 0 2024-09-13T23:06:11.894 INFO:tasks.workunit.client.0.smithi115.stdout:2/564: rename da/d21/d2d/d78/d56/d1a/l6b to da/d21/d8c/d41/lbf 0 2024-09-13T23:06:11.895 INFO:tasks.workunit.client.0.smithi115.stdout:7/503: dread da/dd/f2e [0,4194304] 0 2024-09-13T23:06:11.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/565: mknod da/d21/d2d/d78/d56/d1a/d7f/daa/cc0 0 2024-09-13T23:06:11.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/566: write da/d21/d2d/d78/d56/f24 [3046741,54379] 0 2024-09-13T23:06:11.900 INFO:tasks.workunit.client.0.smithi115.stdout:2/567: readlink da/d21/d8c/l1b 0 2024-09-13T23:06:11.902 INFO:tasks.workunit.client.0.smithi115.stdout:2/568: rename da/d21/d2d/d78/d48/l75 to da/d21/d2d/d78/d56/d1a/d7f/daa/lc1 0 2024-09-13T23:06:11.902 INFO:tasks.workunit.client.0.smithi115.stdout:2/569: write da/d21/d8c/d41/d62/f91 [1285679,569] 0 2024-09-13T23:06:11.902 INFO:tasks.workunit.client.0.smithi115.stdout:2/570: dread - da/f9e zero size 2024-09-13T23:06:11.902 INFO:tasks.workunit.client.0.smithi115.stdout:2/571: mkdir da/d23/d2c/dc2 0 2024-09-13T23:06:11.903 INFO:tasks.workunit.client.0.smithi115.stdout:2/572: truncate da/d21/d2d/d78/f54 127460 0 2024-09-13T23:06:11.904 INFO:tasks.workunit.client.0.smithi115.stdout:7/504: read da/dd/d13/d24/d52/d7c/da7/fae [285909,88743] 0 2024-09-13T23:06:11.905 INFO:tasks.workunit.client.0.smithi115.stdout:2/573: creat da/d21/d8c/d41/d95/fc3 x:0 0 0 2024-09-13T23:06:11.905 INFO:tasks.workunit.client.0.smithi115.stdout:2/574: mkdir da/d21/da8/dc4 0 2024-09-13T23:06:11.905 INFO:tasks.workunit.client.0.smithi115.stdout:2/575: fsync da/d23/d2c/fae 0 2024-09-13T23:06:11.906 INFO:tasks.workunit.client.0.smithi115.stdout:2/576: symlink da/d21/d2d/d78/d48/lc5 0 2024-09-13T23:06:11.906 INFO:tasks.workunit.client.0.smithi115.stdout:2/577: fsync da/d21/d8c/d41/d62/f71 0 2024-09-13T23:06:11.906 INFO:tasks.workunit.client.0.smithi115.stdout:2/578: creat da/d21/d2d/d78/fc6 x:0 0 0 2024-09-13T23:06:11.907 INFO:tasks.workunit.client.0.smithi115.stdout:2/579: fdatasync da/d21/d8c/d41/d62/f71 0 2024-09-13T23:06:11.929 INFO:tasks.workunit.client.0.smithi115.stdout:7/505: dwrite da/dd/d1c/f22 [8388608,4194304] 0 2024-09-13T23:06:11.929 INFO:tasks.workunit.client.0.smithi115.stdout:2/580: dwrite da/d21/d2d/d78/d56/d1a/f1d [0,4194304] 0 2024-09-13T23:06:11.930 INFO:tasks.workunit.client.0.smithi115.stdout:7/506: mkdir da/dd/d1c/db0 0 2024-09-13T23:06:11.932 INFO:tasks.workunit.client.0.smithi115.stdout:2/581: mkdir da/d21/d2d/d78/d56/d74/dc7 0 2024-09-13T23:06:11.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/582: truncate da/d77/d83/fa4 800749 0 2024-09-13T23:06:11.935 INFO:tasks.workunit.client.0.smithi115.stdout:2/583: mknod da/d21/cc8 0 2024-09-13T23:06:11.947 INFO:tasks.workunit.client.0.smithi115.stdout:7/507: dwrite da/fc [4194304,4194304] 0 2024-09-13T23:06:11.955 INFO:tasks.workunit.client.0.smithi115.stdout:7/508: dread da/dd/d16/d29/f55 [0,4194304] 0 2024-09-13T23:06:11.956 INFO:tasks.workunit.client.0.smithi115.stdout:7/509: dread da/df/fa6 [0,4194304] 0 2024-09-13T23:06:11.957 INFO:tasks.workunit.client.0.smithi115.stdout:7/510: mkdir da/dd/d13/d7e/d92/db1 0 2024-09-13T23:06:11.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/511: creat da/dd/d13/d36/d85/fb2 x:0 0 0 2024-09-13T23:06:11.959 INFO:tasks.workunit.client.0.smithi115.stdout:7/512: mknod da/dd/cb3 0 2024-09-13T23:06:11.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/513: rename da/dd/d16/d29/c3d to da/dd/d13/d36/cb4 0 2024-09-13T23:06:11.963 INFO:tasks.workunit.client.0.smithi115.stdout:4/581: sync 2024-09-13T23:06:11.964 INFO:tasks.workunit.client.0.smithi115.stdout:5/466: sync 2024-09-13T23:06:11.964 INFO:tasks.workunit.client.0.smithi115.stdout:0/514: sync 2024-09-13T23:06:11.964 INFO:tasks.workunit.client.0.smithi115.stdout:5/467: mknod d8/dd/d20/d4a/c8c 0 2024-09-13T23:06:11.964 INFO:tasks.workunit.client.0.smithi115.stdout:5/468: truncate d8/d7a/f7e 364754 0 2024-09-13T23:06:11.965 INFO:tasks.workunit.client.0.smithi115.stdout:5/469: mknod d8/dd/d20/d27/c8d 0 2024-09-13T23:06:11.966 INFO:tasks.workunit.client.0.smithi115.stdout:5/470: creat d8/dd/d5d/f8e x:0 0 0 2024-09-13T23:06:11.968 INFO:tasks.workunit.client.0.smithi115.stdout:7/514: write da/dd/d13/f6b [3932394,49220] 0 2024-09-13T23:06:11.968 INFO:tasks.workunit.client.0.smithi115.stdout:5/471: creat d8/dd/d20/d4a/f8f x:0 0 0 2024-09-13T23:06:11.970 INFO:tasks.workunit.client.0.smithi115.stdout:5/472: symlink d8/dd/d5d/d5e/l90 0 2024-09-13T23:06:11.975 INFO:tasks.workunit.client.0.smithi115.stdout:7/515: read da/dd/d1c/f22 [9496091,65225] 0 2024-09-13T23:06:11.980 INFO:tasks.workunit.client.0.smithi115.stdout:4/582: dwrite db/d19/d34/f89 [0,4194304] 0 2024-09-13T23:06:11.980 INFO:tasks.workunit.client.0.smithi115.stdout:4/583: creat db/d16/d3f/d66/d68/d71/fa4 x:0 0 0 2024-09-13T23:06:11.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/473: dread d8/d36/f41 [0,4194304] 0 2024-09-13T23:06:11.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/474: write d8/dd/d5d/f6e [52442,64173] 0 2024-09-13T23:06:11.981 INFO:tasks.workunit.client.0.smithi115.stdout:5/475: stat d8/dd/d14/f50 0 2024-09-13T23:06:11.982 INFO:tasks.workunit.client.0.smithi115.stdout:4/584: truncate db/d11/d2e/d33/d36/f3c 3301039 0 2024-09-13T23:06:11.983 INFO:tasks.workunit.client.0.smithi115.stdout:4/585: dread - db/d19/d4e/f65 zero size 2024-09-13T23:06:11.983 INFO:tasks.workunit.client.0.smithi115.stdout:4/586: chown db/d16/d3f/d66/d68/d71/d84/d96 76628 1 2024-09-13T23:06:11.983 INFO:tasks.workunit.client.0.smithi115.stdout:5/476: mknod d8/dd/d6a/d82/d63/d5a/c91 0 2024-09-13T23:06:11.983 INFO:tasks.workunit.client.0.smithi115.stdout:5/477: dread - d8/d7a/f83 zero size 2024-09-13T23:06:11.983 INFO:tasks.workunit.client.0.smithi115.stdout:5/478: creat d8/d36/f92 x:0 0 0 2024-09-13T23:06:11.984 INFO:tasks.workunit.client.0.smithi115.stdout:5/479: write d8/dd/f2b [1648156,9429] 0 2024-09-13T23:06:11.984 INFO:tasks.workunit.client.0.smithi115.stdout:4/587: truncate db/d16/f47 2845314 0 2024-09-13T23:06:11.984 INFO:tasks.workunit.client.0.smithi115.stdout:5/480: write d8/dd/d14/f50 [368752,62980] 0 2024-09-13T23:06:11.984 INFO:tasks.workunit.client.0.smithi115.stdout:4/588: creat db/d19/d1d/d2a/fa5 x:0 0 0 2024-09-13T23:06:11.984 INFO:tasks.workunit.client.0.smithi115.stdout:4/589: readlink db/lc 0 2024-09-13T23:06:11.985 INFO:tasks.workunit.client.0.smithi115.stdout:7/516: write da/f10 [4060701,618] 0 2024-09-13T23:06:11.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/481: getdents d8/dd/d20/d27 0 2024-09-13T23:06:11.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/482: creat d8/dd/d20/d4a/f93 x:0 0 0 2024-09-13T23:06:11.989 INFO:tasks.workunit.client.0.smithi115.stdout:5/483: creat d8/dd/d14/f94 x:0 0 0 2024-09-13T23:06:11.993 INFO:tasks.workunit.client.0.smithi115.stdout:5/484: dread d8/dd/d4c/f75 [0,4194304] 0 2024-09-13T23:06:11.995 INFO:tasks.workunit.client.0.smithi115.stdout:5/485: link d8/dd/d20/d23/f2f d8/dd/d14/f95 0 2024-09-13T23:06:12.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/486: write d8/f16 [1633240,6128] 0 2024-09-13T23:06:12.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/487: chown d8/dd/d14/f94 1 1 2024-09-13T23:06:12.006 INFO:tasks.workunit.client.0.smithi115.stdout:4/590: dwrite db/d11/d2e/d33/d36/d51/f7d [0,4194304] 0 2024-09-13T23:06:12.006 INFO:tasks.workunit.client.0.smithi115.stdout:4/591: fsync db/d16/d3f/f94 0 2024-09-13T23:06:12.012 INFO:tasks.workunit.client.0.smithi115.stdout:7/517: dwrite da/dd/d13/d24/f4f [0,4194304] 0 2024-09-13T23:06:12.016 INFO:tasks.workunit.client.0.smithi115.stdout:5/488: write d8/dd/d20/f25 [1305680,74537] 0 2024-09-13T23:06:12.016 INFO:tasks.workunit.client.0.smithi115.stdout:5/489: write d8/dd/d5d/f6e [1846947,100596] 0 2024-09-13T23:06:12.017 INFO:tasks.workunit.client.0.smithi115.stdout:7/518: write da/dd/d13/d36/f71 [2314825,83536] 0 2024-09-13T23:06:12.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/490: creat d8/dd/d20/d27/f96 x:0 0 0 2024-09-13T23:06:12.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/491: chown d8/dd/d6a/d82/d63/d5a/c91 0 1 2024-09-13T23:06:12.018 INFO:tasks.workunit.client.0.smithi115.stdout:4/592: dread db/d11/d2e/d33/d36/d51/f7d [0,4194304] 0 2024-09-13T23:06:12.019 INFO:tasks.workunit.client.0.smithi115.stdout:5/492: symlink d8/d7a/l97 0 2024-09-13T23:06:12.028 INFO:tasks.workunit.client.0.smithi115.stdout:4/593: dread db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:12.028 INFO:tasks.workunit.client.0.smithi115.stdout:4/594: chown db/d11/d2e/d33/f90 314577 1 2024-09-13T23:06:12.028 INFO:tasks.workunit.client.0.smithi115.stdout:4/595: readlink db/d16/d3f/l61 0 2024-09-13T23:06:12.028 INFO:tasks.workunit.client.0.smithi115.stdout:4/596: write db/f43 [209844,69956] 0 2024-09-13T23:06:12.028 INFO:tasks.workunit.client.0.smithi115.stdout:4/597: chown db/d19/f87 8805109 1 2024-09-13T23:06:12.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/598: rmdir db/d11/d2e/d33/d36/d7f 39 2024-09-13T23:06:12.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/599: fsync db/d11/d54/d17/f9a 0 2024-09-13T23:06:12.030 INFO:tasks.workunit.client.0.smithi115.stdout:5/493: dread d8/d36/f41 [0,4194304] 0 2024-09-13T23:06:12.030 INFO:tasks.workunit.client.0.smithi115.stdout:4/600: mkdir db/d16/d3f/d66/da6 0 2024-09-13T23:06:12.031 INFO:tasks.workunit.client.0.smithi115.stdout:5/494: creat d8/dd/d6a/d8a/f98 x:0 0 0 2024-09-13T23:06:12.032 INFO:tasks.workunit.client.0.smithi115.stdout:5/495: symlink d8/dd/d6a/l99 0 2024-09-13T23:06:12.033 INFO:tasks.workunit.client.0.smithi115.stdout:5/496: mkdir d8/dd/d5d/d5e/d9a 0 2024-09-13T23:06:12.033 INFO:tasks.workunit.client.0.smithi115.stdout:5/497: stat d8/d7a/f83 0 2024-09-13T23:06:12.038 INFO:tasks.workunit.client.0.smithi115.stdout:7/519: dwrite da/dd/d1c/d2d/d41/fa0 [0,4194304] 0 2024-09-13T23:06:12.042 INFO:tasks.workunit.client.0.smithi115.stdout:7/520: unlink da/dd/d1c/d2d/d45/f7f 0 2024-09-13T23:06:12.042 INFO:tasks.workunit.client.0.smithi115.stdout:7/521: chown da/dd/d1c/f9c 895 1 2024-09-13T23:06:12.042 INFO:tasks.workunit.client.0.smithi115.stdout:7/522: mknod da/d53/cb5 0 2024-09-13T23:06:12.043 INFO:tasks.workunit.client.0.smithi115.stdout:7/523: chown da/l5d 5814 1 2024-09-13T23:06:12.043 INFO:tasks.workunit.client.0.smithi115.stdout:5/498: getdents d8/dd/d6a/d8a 0 2024-09-13T23:06:12.045 INFO:tasks.workunit.client.0.smithi115.stdout:5/499: mkdir d8/dd/d5d/d9b 0 2024-09-13T23:06:12.045 INFO:tasks.workunit.client.0.smithi115.stdout:5/500: symlink d8/dd/d20/d27/l9c 0 2024-09-13T23:06:12.046 INFO:tasks.workunit.client.0.smithi115.stdout:5/501: read d8/dd/d20/d23/f55 [574587,52524] 0 2024-09-13T23:06:12.046 INFO:tasks.workunit.client.0.smithi115.stdout:5/502: mknod d8/dd/d5d/c9d 0 2024-09-13T23:06:12.046 INFO:tasks.workunit.client.0.smithi115.stdout:5/503: chown d8/dd/d6a 1640 1 2024-09-13T23:06:12.047 INFO:tasks.workunit.client.0.smithi115.stdout:4/601: dwrite db/d11/fa3 [0,4194304] 0 2024-09-13T23:06:12.047 INFO:tasks.workunit.client.0.smithi115.stdout:4/602: fsync db/d11/d2e/d33/d36/f3b 0 2024-09-13T23:06:12.047 INFO:tasks.workunit.client.0.smithi115.stdout:4/603: write db/d19/d1d/d2a/f6f [615580,85638] 0 2024-09-13T23:06:12.048 INFO:tasks.workunit.client.0.smithi115.stdout:8/530: sync 2024-09-13T23:06:12.049 INFO:tasks.workunit.client.0.smithi115.stdout:5/504: dread d8/dd/d20/d23/f55 [0,4194304] 0 2024-09-13T23:06:12.049 INFO:tasks.workunit.client.0.smithi115.stdout:8/531: symlink d3/d5/dc/d16/d1f/d28/d3e/lba 0 2024-09-13T23:06:12.049 INFO:tasks.workunit.client.0.smithi115.stdout:8/532: readlink d3/d5/dc/d16/d1f/d28/d3e/l8b 0 2024-09-13T23:06:12.049 INFO:tasks.workunit.client.0.smithi115.stdout:8/533: dread - d3/d5/dc/d16/d1f/d27/d68/d98/fa9 zero size 2024-09-13T23:06:12.050 INFO:tasks.workunit.client.0.smithi115.stdout:8/534: rename d3/d5/d6a/laa to d3/d5/dc/d16/d1f/lbb 0 2024-09-13T23:06:12.057 INFO:tasks.workunit.client.0.smithi115.stdout:5/505: dread d8/fa [0,4194304] 0 2024-09-13T23:06:12.058 INFO:tasks.workunit.client.0.smithi115.stdout:5/506: truncate d8/fb 1708077 0 2024-09-13T23:06:12.058 INFO:tasks.workunit.client.0.smithi115.stdout:5/507: truncate d8/dd/f5c 1091413 0 2024-09-13T23:06:12.061 INFO:tasks.workunit.client.0.smithi115.stdout:5/508: read d8/fa [2193916,8914] 0 2024-09-13T23:06:12.064 INFO:tasks.workunit.client.0.smithi115.stdout:8/535: dread d3/d5/d1d/d72/fa8 [0,4194304] 0 2024-09-13T23:06:12.067 INFO:tasks.workunit.client.0.smithi115.stdout:8/536: mkdir d3/d5/dc/d16/d1f/d27/d79/da0/dbc 0 2024-09-13T23:06:12.067 INFO:tasks.workunit.client.0.smithi115.stdout:4/604: dwrite db/d11/d2e/d33/d36/f3c [0,4194304] 0 2024-09-13T23:06:12.071 INFO:tasks.workunit.client.0.smithi115.stdout:5/509: dread d8/f2a [4194304,4194304] 0 2024-09-13T23:06:12.071 INFO:tasks.workunit.client.0.smithi115.stdout:5/510: chown d8/dd/d20/d27/f72 0 1 2024-09-13T23:06:12.082 INFO:tasks.workunit.client.0.smithi115.stdout:8/537: dwrite d3/d5/dc/d16/d1f/d27/d79/da0/fa4 [0,4194304] 0 2024-09-13T23:06:12.082 INFO:tasks.workunit.client.0.smithi115.stdout:8/538: fsync d3/d5/fb 0 2024-09-13T23:06:12.089 INFO:tasks.workunit.client.0.smithi115.stdout:8/539: dread d3/d5/d1c/f2e [0,4194304] 0 2024-09-13T23:06:12.096 INFO:tasks.workunit.client.0.smithi115.stdout:8/540: write d3/d5/dc/f32 [4625369,41982] 0 2024-09-13T23:06:12.096 INFO:tasks.workunit.client.0.smithi115.stdout:8/541: creat d3/d5/dc/d16/d1f/d27/d68/d98/fbd x:0 0 0 2024-09-13T23:06:12.100 INFO:tasks.workunit.client.0.smithi115.stdout:8/542: rmdir d3/d5/d1d 39 2024-09-13T23:06:12.101 INFO:tasks.workunit.client.0.smithi115.stdout:8/543: mkdir d3/d5/dc/d23/d4e/dbe 0 2024-09-13T23:06:12.103 INFO:tasks.workunit.client.0.smithi115.stdout:8/544: rename d3/d5/d1d/fb1 to d3/d5/dc/d16/d1f/d27/d68/fbf 0 2024-09-13T23:06:12.104 INFO:tasks.workunit.client.0.smithi115.stdout:8/545: truncate d3/d5/dc/d16/d1f/d27/d79/fb4 698358 0 2024-09-13T23:06:12.104 INFO:tasks.workunit.client.0.smithi115.stdout:8/546: write d3/d5/d1d/f94 [1622956,72870] 0 2024-09-13T23:06:12.104 INFO:tasks.workunit.client.0.smithi115.stdout:8/547: dread - d3/fb3 zero size 2024-09-13T23:06:12.113 INFO:tasks.workunit.client.0.smithi115.stdout:1/530: sync 2024-09-13T23:06:12.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/548: read d3/d5/dc/d23/d4e/f67 [162553,29786] 0 2024-09-13T23:06:12.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/549: dread - d3/d5/dc/d16/d1f/d27/f7a zero size 2024-09-13T23:06:12.113 INFO:tasks.workunit.client.0.smithi115.stdout:8/550: getdents d3/d5/d1d/d63 0 2024-09-13T23:06:12.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/551: mkdir d3/d5/dc/d16/d1f/d28/dc0 0 2024-09-13T23:06:12.116 INFO:tasks.workunit.client.0.smithi115.stdout:8/552: truncate d3/d5/dc/d23/d4e/d54/d7f/f9d 3944575 0 2024-09-13T23:06:12.118 INFO:tasks.workunit.client.0.smithi115.stdout:8/553: unlink d3/d5/dc/d16/d1f/d27/f7a 0 2024-09-13T23:06:12.118 INFO:tasks.workunit.client.0.smithi115.stdout:8/554: fdatasync d3/d5/dc/d23/f36 0 2024-09-13T23:06:12.123 INFO:tasks.workunit.client.0.smithi115.stdout:1/531: write d0/de/d66/d8f/d29/d47/d6a/d80/f9a [2819489,88367] 0 2024-09-13T23:06:12.124 INFO:tasks.workunit.client.0.smithi115.stdout:8/555: rename d3/d5/d1c/d41/d42/f14 to d3/d5/d1d/d72/fc1 0 2024-09-13T23:06:12.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/532: rename d0/dd/d69/f8e to d0/de/d66/faa 0 2024-09-13T23:06:12.127 INFO:tasks.workunit.client.0.smithi115.stdout:1/533: getdents d0/de/d1b/d25/d4d/d51/d31/d37 0 2024-09-13T23:06:12.127 INFO:tasks.workunit.client.0.smithi115.stdout:1/534: chown d0/de/d66/d8f/d29/c43 1 1 2024-09-13T23:06:12.128 INFO:tasks.workunit.client.0.smithi115.stdout:1/535: read - d0/de/d1b/d25/d4d/d51/d23/d65/f7d zero size 2024-09-13T23:06:12.135 INFO:tasks.workunit.client.0.smithi115.stdout:8/556: write d3/d5/f3d [2673447,106510] 0 2024-09-13T23:06:12.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/557: link d3/d5/f3d d3/d5/dc/d16/d1f/d27/d68/d98/fc2 0 2024-09-13T23:06:12.137 INFO:tasks.workunit.client.0.smithi115.stdout:1/536: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:12.137 INFO:tasks.workunit.client.0.smithi115.stdout:8/558: getdents d3/d5/dc/d16/d1f/d28/d62 0 2024-09-13T23:06:12.138 INFO:tasks.workunit.client.0.smithi115.stdout:1/537: truncate d0/dd/f10 3219378 0 2024-09-13T23:06:12.140 INFO:tasks.workunit.client.0.smithi115.stdout:1/538: symlink d0/de/d66/d8f/d29/d47/d74/d9d/da3/lab 0 2024-09-13T23:06:12.142 INFO:tasks.workunit.client.0.smithi115.stdout:1/539: mkdir d0/de/d66/d8f/d29/d47/d63/dac 0 2024-09-13T23:06:12.145 INFO:tasks.workunit.client.0.smithi115.stdout:1/540: mkdir d0/de/d66/d8f/dad 0 2024-09-13T23:06:12.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/559: write d3/d5/dc/d16/d1f/d28/f29 [1173216,11997] 0 2024-09-13T23:06:12.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/560: creat d3/d5/d1c/d41/d42/d4d/fc3 x:0 0 0 2024-09-13T23:06:12.147 INFO:tasks.workunit.client.0.smithi115.stdout:8/561: truncate d3/d5/d1d/d63/fa6 453399 0 2024-09-13T23:06:12.148 INFO:tasks.workunit.client.0.smithi115.stdout:1/541: symlink d0/de/d1b/d25/d4d/d51/d31/d79/lae 0 2024-09-13T23:06:12.148 INFO:tasks.workunit.client.0.smithi115.stdout:1/542: fdatasync d0/de/d66/d8f/d29/d47/d6a/d80/f8b 0 2024-09-13T23:06:12.148 INFO:tasks.workunit.client.0.smithi115.stdout:1/543: fdatasync d0/de/d66/d8f/d29/d47/fa7 0 2024-09-13T23:06:12.150 INFO:tasks.workunit.client.0.smithi115.stdout:8/562: symlink d3/d5/dc/d23/d4e/d54/d8c/lc4 0 2024-09-13T23:06:12.151 INFO:tasks.workunit.client.0.smithi115.stdout:8/563: readlink d3/d5/dc/d16/d1f/lbb 0 2024-09-13T23:06:12.152 INFO:tasks.workunit.client.0.smithi115.stdout:1/544: symlink d0/de/d1b/d25/laf 0 2024-09-13T23:06:12.155 INFO:tasks.workunit.client.0.smithi115.stdout:1/545: rmdir d0/dd/d69 0 2024-09-13T23:06:12.157 INFO:tasks.workunit.client.0.smithi115.stdout:1/546: link d0/de/d66/d8f/d29/f4c d0/fb0 0 2024-09-13T23:06:12.157 INFO:tasks.workunit.client.0.smithi115.stdout:1/547: getdents d0/de/d66/d8f/d29/d47/d63/dac 0 2024-09-13T23:06:12.160 INFO:tasks.workunit.client.0.smithi115.stdout:8/564: dread d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:12.161 INFO:tasks.workunit.client.0.smithi115.stdout:8/565: stat d3/d5/dc/d16/d1f/d28/d62 0 2024-09-13T23:06:12.161 INFO:tasks.workunit.client.0.smithi115.stdout:8/566: truncate d3/d5/dc/d23/d4e/d54/d8c/f97 650937 0 2024-09-13T23:06:12.161 INFO:tasks.workunit.client.0.smithi115.stdout:7/524: sync 2024-09-13T23:06:12.161 INFO:tasks.workunit.client.0.smithi115.stdout:0/515: sync 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:2/584: sync 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:6/620: sync 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:9/518: sync 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:0/516: write d6/d24/d25/d2b/d82/d44/fb7 [878236,102364] 0 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:0/517: truncate d6/d24/f3d 660110 0 2024-09-13T23:06:12.162 INFO:tasks.workunit.client.0.smithi115.stdout:9/519: creat d0/d13/d17/d1f/d35/d62/fa4 x:0 0 0 2024-09-13T23:06:12.163 INFO:tasks.workunit.client.0.smithi115.stdout:0/518: stat d6/d24/d25/d58/db4 0 2024-09-13T23:06:12.163 INFO:tasks.workunit.client.0.smithi115.stdout:9/520: readlink d0/d13/d17/d1f/d4e/d61/l7f 0 2024-09-13T23:06:12.163 INFO:tasks.workunit.client.0.smithi115.stdout:9/521: chown d0/d13/d17/d1f/d28/d76/d81/d9d 0 1 2024-09-13T23:06:12.163 INFO:tasks.workunit.client.0.smithi115.stdout:1/548: link d0/de/d1b/d25/d4d/d51/c2e d0/de/d66/d8f/d29/d47/cb1 0 2024-09-13T23:06:12.163 INFO:tasks.workunit.client.0.smithi115.stdout:1/549: chown d0/dd/c73 1911 1 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/550: chown d0/de/d71/f8c 8190 1 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/551: dread - d0/de/f9e zero size 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:3/654: sync 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:3/655: dread - d3/dcd/fdc zero size 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:3/656: chown d3/d5/d35/d71/d45/d98/dbc/cce 414772045 1 2024-09-13T23:06:12.164 INFO:tasks.workunit.client.0.smithi115.stdout:7/525: symlink da/dd/d1c/d2d/d45/lb6 0 2024-09-13T23:06:12.165 INFO:tasks.workunit.client.0.smithi115.stdout:2/585: creat da/d21/d2d/d78/d56/d1a/d7f/daa/fc9 x:0 0 0 2024-09-13T23:06:12.165 INFO:tasks.workunit.client.0.smithi115.stdout:6/621: link d4/df/d14/d38/d2a/d31/f34 d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/fd2 0 2024-09-13T23:06:12.166 INFO:tasks.workunit.client.0.smithi115.stdout:1/552: rename d0/de/d1b/d25/d4d/d51/c3a to d0/de/d71/cb2 0 2024-09-13T23:06:12.167 INFO:tasks.workunit.client.0.smithi115.stdout:6/622: link d4/df/d14/d35/c50 d4/d57/cd3 0 2024-09-13T23:06:12.168 INFO:tasks.workunit.client.0.smithi115.stdout:1/553: mknod d0/de/d66/d8f/dad/cb3 0 2024-09-13T23:06:12.172 INFO:tasks.workunit.client.0.smithi115.stdout:2/586: rename da/f9e to da/d21/d2d/d78/d56/d1a/d7f/fca 0 2024-09-13T23:06:12.173 INFO:tasks.workunit.client.0.smithi115.stdout:2/587: chown da/d21/l52 125 1 2024-09-13T23:06:12.173 INFO:tasks.workunit.client.0.smithi115.stdout:6/623: symlink d4/df/d14/d38/d44/ld4 0 2024-09-13T23:06:12.173 INFO:tasks.workunit.client.0.smithi115.stdout:7/526: dread da/dd/d13/f66 [0,4194304] 0 2024-09-13T23:06:12.175 INFO:tasks.workunit.client.0.smithi115.stdout:2/588: unlink da/d21/f9f 0 2024-09-13T23:06:12.177 INFO:tasks.workunit.client.0.smithi115.stdout:7/527: rename da/d53/cb5 to da/dd/d13/d36/d5a/cb7 0 2024-09-13T23:06:12.177 INFO:tasks.workunit.client.0.smithi115.stdout:1/554: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:12.179 INFO:tasks.workunit.client.0.smithi115.stdout:2/589: truncate da/d23/f7b 1827849 0 2024-09-13T23:06:12.180 INFO:tasks.workunit.client.0.smithi115.stdout:1/555: mknod d0/de/d66/d8f/d29/d47/d63/cb4 0 2024-09-13T23:06:12.180 INFO:tasks.workunit.client.0.smithi115.stdout:1/556: readlink d0/la 0 2024-09-13T23:06:12.180 INFO:tasks.workunit.client.0.smithi115.stdout:1/557: stat d0/de 0 2024-09-13T23:06:12.180 INFO:tasks.workunit.client.0.smithi115.stdout:1/558: dread - d0/de/d1b/d25/d4d/d51/d23/f9f zero size 2024-09-13T23:06:12.183 INFO:tasks.workunit.client.0.smithi115.stdout:2/590: symlink da/d23/d2c/dc2/lcb 0 2024-09-13T23:06:12.183 INFO:tasks.workunit.client.0.smithi115.stdout:2/591: truncate da/d21/d8c/d41/f61 597720 0 2024-09-13T23:06:12.183 INFO:tasks.workunit.client.0.smithi115.stdout:6/624: dread d4/df/d14/d38/d2a/d3e/fa5 [0,4194304] 0 2024-09-13T23:06:12.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/625: fdatasync d4/d57/d75/f6f 0 2024-09-13T23:06:12.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/626: fsync d4/f6c 0 2024-09-13T23:06:12.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/627: rename d4/df/d14/d38/d2a/d3e/c92 to d4/d57/dab/cd5 0 2024-09-13T23:06:12.186 INFO:tasks.workunit.client.0.smithi115.stdout:4/605: sync 2024-09-13T23:06:12.186 INFO:tasks.workunit.client.0.smithi115.stdout:5/511: sync 2024-09-13T23:06:12.189 INFO:tasks.workunit.client.0.smithi115.stdout:6/628: dread d4/df/d14/d35/f39 [0,4194304] 0 2024-09-13T23:06:12.189 INFO:tasks.workunit.client.0.smithi115.stdout:6/629: write d4/df/d14/d38/d44/d99/fc6 [917805,33033] 0 2024-09-13T23:06:12.189 INFO:tasks.workunit.client.0.smithi115.stdout:6/630: stat d4/df/d14/d38/d2a/d31/d5b/d88 0 2024-09-13T23:06:12.191 INFO:tasks.workunit.client.0.smithi115.stdout:6/631: symlink d4/df/d14/d67/d77/dc1/ld6 0 2024-09-13T23:06:12.192 INFO:tasks.workunit.client.0.smithi115.stdout:6/632: symlink d4/df/d14/d38/d2a/d31/ld7 0 2024-09-13T23:06:12.193 INFO:tasks.workunit.client.0.smithi115.stdout:7/528: dread da/dd/f59 [0,4194304] 0 2024-09-13T23:06:12.193 INFO:tasks.workunit.client.0.smithi115.stdout:1/559: write d0/de/f60 [5183245,82097] 0 2024-09-13T23:06:12.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/529: symlink da/dd/d1c/d2d/d41/lb8 0 2024-09-13T23:06:12.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/567: dwrite d3/d5/d1c/d41/d42/d4d/f9f [0,4194304] 0 2024-09-13T23:06:12.196 INFO:tasks.workunit.client.0.smithi115.stdout:8/568: fdatasync d3/d5/dc/d16/d1f/d28/d62/fa1 0 2024-09-13T23:06:12.197 INFO:tasks.workunit.client.0.smithi115.stdout:3/657: dwrite d3/d5/d35/d71/d3b/d47/d28/fe0 [0,4194304] 0 2024-09-13T23:06:12.197 INFO:tasks.workunit.client.0.smithi115.stdout:3/658: write d3/d5/d35/d71/d3b/fda [963844,42547] 0 2024-09-13T23:06:12.197 INFO:tasks.workunit.client.0.smithi115.stdout:3/659: write d3/d5/d35/d4c/fd5 [4620638,108694] 0 2024-09-13T23:06:12.198 INFO:tasks.workunit.client.0.smithi115.stdout:6/633: getdents d4/d57/d75 0 2024-09-13T23:06:12.199 INFO:tasks.workunit.client.0.smithi115.stdout:6/634: chown d4/df/d14/d38/d2a/d31/d5b/d88/fb8 1682072 1 2024-09-13T23:06:12.199 INFO:tasks.workunit.client.0.smithi115.stdout:7/530: mknod da/dd/d1c/d2d/cb9 0 2024-09-13T23:06:12.205 INFO:tasks.workunit.client.0.smithi115.stdout:6/635: creat d4/d57/d5a/db4/fd8 x:0 0 0 2024-09-13T23:06:12.205 INFO:tasks.workunit.client.0.smithi115.stdout:6/636: chown d4/df/d14/d38/d2a 123848088 1 2024-09-13T23:06:12.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/560: write d0/de/d1b/f7b [671969,68952] 0 2024-09-13T23:06:12.207 INFO:tasks.workunit.client.0.smithi115.stdout:1/561: write d0/de/d1b/f99 [4760247,13551] 0 2024-09-13T23:06:12.207 INFO:tasks.workunit.client.0.smithi115.stdout:1/562: chown d0/de/d1b/d25/d4d/d51/c7e 3967 1 2024-09-13T23:06:12.207 INFO:tasks.workunit.client.0.smithi115.stdout:9/522: dwrite d0/d13/d3b/f97 [0,4194304] 0 2024-09-13T23:06:12.207 INFO:tasks.workunit.client.0.smithi115.stdout:9/523: fsync d0/d13/f72 0 2024-09-13T23:06:12.207 INFO:tasks.workunit.client.0.smithi115.stdout:7/531: rmdir da/dd/d1c/d2d/d41/d98 39 2024-09-13T23:06:12.208 INFO:tasks.workunit.client.0.smithi115.stdout:2/592: dread da/d23/d2c/f9a [0,4194304] 0 2024-09-13T23:06:12.208 INFO:tasks.workunit.client.0.smithi115.stdout:6/637: mknod d4/df/d14/d38/d2a/cd9 0 2024-09-13T23:06:12.214 INFO:tasks.workunit.client.0.smithi115.stdout:9/524: mknod d0/d13/ca5 0 2024-09-13T23:06:12.214 INFO:tasks.workunit.client.0.smithi115.stdout:7/532: dread da/f10 [0,4194304] 0 2024-09-13T23:06:12.216 INFO:tasks.workunit.client.0.smithi115.stdout:2/593: symlink da/d21/da8/dbc/lcc 0 2024-09-13T23:06:12.217 INFO:tasks.workunit.client.0.smithi115.stdout:9/525: rename d0/d13/d17/d1f/d28/d76/f9f to d0/d13/d17/d1f/d4e/d61/d7d/fa6 0 2024-09-13T23:06:12.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:11 smithi152 ceph-mon[34465]: pgmap v244: 65 pgs: 65 active+clean; 808 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 83 MiB/s rd, 106 MiB/s wr, 970 op/s 2024-09-13T23:06:12.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/526: link d0/c2b d0/d13/d17/d1f/d4e/da2/ca7 0 2024-09-13T23:06:12.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/527: link d0/l2c d0/d13/d17/d1f/d4e/d61/d7d/d98/la8 0 2024-09-13T23:06:12.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/528: write d0/f5b [1182603,125050] 0 2024-09-13T23:06:12.223 INFO:tasks.workunit.client.0.smithi115.stdout:9/529: write d0/d13/d17/d1f/d35/d62/f6f [1680171,16707] 0 2024-09-13T23:06:12.225 INFO:tasks.workunit.client.0.smithi115.stdout:4/606: dwrite db/d19/d1d/f8d [0,4194304] 0 2024-09-13T23:06:12.229 INFO:tasks.workunit.client.0.smithi115.stdout:1/563: read d0/de/d66/d8f/f6d [1630135,42927] 0 2024-09-13T23:06:12.229 INFO:tasks.workunit.client.0.smithi115.stdout:9/530: read d0/d13/f7a [353171,19243] 0 2024-09-13T23:06:12.229 INFO:tasks.workunit.client.0.smithi115.stdout:9/531: chown d0/d43/f9e 3035 1 2024-09-13T23:06:12.231 INFO:tasks.workunit.client.0.smithi115.stdout:1/564: link d0/de/f46 d0/de/d1b/d25/d4d/d51/d31/d79/fb5 0 2024-09-13T23:06:12.231 INFO:tasks.workunit.client.0.smithi115.stdout:1/565: write d0/de/d62/f6c [41680,92829] 0 2024-09-13T23:06:12.231 INFO:tasks.workunit.client.0.smithi115.stdout:4/607: dread db/d11/d54/f38 [0,4194304] 0 2024-09-13T23:06:12.233 INFO:tasks.workunit.client.0.smithi115.stdout:1/566: mkdir d0/de/d1b/d25/d4d/d51/d23/d65/db6 0 2024-09-13T23:06:12.233 INFO:tasks.workunit.client.0.smithi115.stdout:8/569: dwrite d3/d5/dc/d16/d1f/d27/f48 [0,4194304] 0 2024-09-13T23:06:12.235 INFO:tasks.workunit.client.0.smithi115.stdout:8/570: rmdir d3/d5/dc/d16 39 2024-09-13T23:06:12.238 INFO:tasks.workunit.client.0.smithi115.stdout:3/660: dwrite d3/d16/d84/fb0 [0,4194304] 0 2024-09-13T23:06:12.238 INFO:tasks.workunit.client.0.smithi115.stdout:3/661: chown d3/d5/d35/d71/d42/c87 27 1 2024-09-13T23:06:12.238 INFO:tasks.workunit.client.0.smithi115.stdout:3/662: chown d3/cd7 3 1 2024-09-13T23:06:12.238 INFO:tasks.workunit.client.0.smithi115.stdout:3/663: read - d3/d5/d5b/f70 zero size 2024-09-13T23:06:12.239 INFO:tasks.workunit.client.0.smithi115.stdout:3/664: write d3/d5/d35/f53 [1519480,21598] 0 2024-09-13T23:06:12.240 INFO:tasks.workunit.client.0.smithi115.stdout:6/638: dwrite d4/df/d14/d38/d2a/f90 [4194304,4194304] 0 2024-09-13T23:06:12.240 INFO:tasks.workunit.client.0.smithi115.stdout:8/571: unlink d3/d5/dc/d16/d1f/d27/f48 0 2024-09-13T23:06:12.240 INFO:tasks.workunit.client.0.smithi115.stdout:6/639: chown d4/df/l5d 222537013 1 2024-09-13T23:06:12.240 INFO:tasks.workunit.client.0.smithi115.stdout:8/572: read d3/d5/f44 [1620013,51241] 0 2024-09-13T23:06:12.240 INFO:tasks.workunit.client.0.smithi115.stdout:5/512: dwrite d8/dd/d5d/f8e [0,4194304] 0 2024-09-13T23:06:12.241 INFO:tasks.workunit.client.0.smithi115.stdout:7/533: dwrite da/dd/d13/d36/fa9 [0,4194304] 0 2024-09-13T23:06:12.242 INFO:tasks.workunit.client.0.smithi115.stdout:2/594: dwrite da/d21/fb3 [0,4194304] 0 2024-09-13T23:06:12.243 INFO:tasks.workunit.client.0.smithi115.stdout:6/640: stat d4/df/d14/d35/c50 0 2024-09-13T23:06:12.245 INFO:tasks.workunit.client.0.smithi115.stdout:8/573: creat d3/d5/dc/d23/fc5 x:0 0 0 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/513: mkdir d8/d9e 0 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/514: chown d8/f3c 731374307 1 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/515: truncate d8/f51 1017414 0 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/516: fdatasync d8/dd/f2b 0 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/517: stat d8/dd/d20/d27/f96 0 2024-09-13T23:06:12.248 INFO:tasks.workunit.client.0.smithi115.stdout:5/518: readlink d8/dd/d20/l1d 0 2024-09-13T23:06:12.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/534: mkdir da/dd/d1c/d84/dba 0 2024-09-13T23:06:12.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/535: creat da/dd/d1c/d2d/d41/fbb x:0 0 0 2024-09-13T23:06:12.251 INFO:tasks.workunit.client.0.smithi115.stdout:7/536: creat da/dd/d1c/d2d/d41/fbc x:0 0 0 2024-09-13T23:06:12.253 INFO:tasks.workunit.client.0.smithi115.stdout:2/595: link da/d21/d2d/d78/l4f da/d21/d8c/d41/d69/lcd 0 2024-09-13T23:06:12.253 INFO:tasks.workunit.client.0.smithi115.stdout:3/665: write d3/d5/d65/da8/da4/d49/f67 [1285760,47227] 0 2024-09-13T23:06:12.253 INFO:tasks.workunit.client.0.smithi115.stdout:3/666: readlink d3/d5/d5b/l69 0 2024-09-13T23:06:12.254 INFO:tasks.workunit.client.0.smithi115.stdout:2/596: creat da/d21/d8c/d41/d62/fce x:0 0 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/641: rename d4/df/d14/d67/d77/dc1/ld6 to d4/lda 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/642: creat d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb x:0 0 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/643: fsync d4/d57/dab/fb6 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/644: truncate d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fc5 920004 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/645: creat d4/d57/d5a/d79/fdc x:0 0 0 2024-09-13T23:06:12.256 INFO:tasks.workunit.client.0.smithi115.stdout:6/646: chown d4/df/d14/d38/d44/d66/c7c 124804298 1 2024-09-13T23:06:12.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/597: dread da/d21/d2d/d78/f4c [0,4194304] 0 2024-09-13T23:06:12.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/598: chown da/d21/d2d/d78/d56/d1a/d7f/daa/fc9 0 1 2024-09-13T23:06:12.257 INFO:tasks.workunit.client.0.smithi115.stdout:2/599: chown da/d21/d2d/d78/d56/d1a/l68 261 1 2024-09-13T23:06:12.257 INFO:tasks.workunit.client.0.smithi115.stdout:5/519: creat d8/dd/d6a/d8a/f9f x:0 0 0 2024-09-13T23:06:12.259 INFO:tasks.workunit.client.0.smithi115.stdout:7/537: truncate da/dd/d1c/f9c 950177 0 2024-09-13T23:06:12.264 INFO:tasks.workunit.client.0.smithi115.stdout:6/647: mkdir d4/ddd 0 2024-09-13T23:06:12.264 INFO:tasks.workunit.client.0.smithi115.stdout:6/648: dread - d4/df/d14/d38/d2a/d31/d5b/da8/fcc zero size 2024-09-13T23:06:12.265 INFO:tasks.workunit.client.0.smithi115.stdout:2/600: unlink da/d21/d2d/d78/d56/d1a/d7f/daa/cc0 0 2024-09-13T23:06:12.269 INFO:tasks.workunit.client.0.smithi115.stdout:7/538: creat da/dd/d1c/d2d/d41/d98/fbd x:0 0 0 2024-09-13T23:06:12.270 INFO:tasks.workunit.client.0.smithi115.stdout:1/567: dwrite d0/de/d66/d8f/d29/f4e [4194304,4194304] 0 2024-09-13T23:06:12.270 INFO:tasks.workunit.client.0.smithi115.stdout:4/608: dwrite db/d16/f7e [0,4194304] 0 2024-09-13T23:06:12.272 INFO:tasks.workunit.client.0.smithi115.stdout:3/667: rename d3/d5/d35/d71/d3b/d47/d28/f79 to d3/d5/d65/da8/fe6 0 2024-09-13T23:06:12.272 INFO:tasks.workunit.client.0.smithi115.stdout:8/574: dwrite d3/fb3 [0,4194304] 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:6/649: creat d4/d57/d5a/fde x:0 0 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/532: dwrite d0/d13/d17/d1f/f66 [4194304,4194304] 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:6/650: chown d4/d57/d5a/d79/fbb 246 1 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/533: creat d0/d13/d17/d1f/d28/d76/fa9 x:0 0 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:5/520: getdents d8/dd/d20/d27 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:8/575: write d3/d5/dc/d16/d1f/d28/d62/f65 [217690,29621] 0 2024-09-13T23:06:12.273 INFO:tasks.workunit.client.0.smithi115.stdout:5/521: readlink d8/dd/d20/d27/l9c 0 2024-09-13T23:06:12.274 INFO:tasks.workunit.client.0.smithi115.stdout:8/576: chown d3/d5/dc/d16/d1f/c3c 5797859 1 2024-09-13T23:06:12.274 INFO:tasks.workunit.client.0.smithi115.stdout:8/577: chown d3/d5/dc/d23/d4e 547 1 2024-09-13T23:06:12.274 INFO:tasks.workunit.client.0.smithi115.stdout:5/522: creat d8/d36/fa0 x:0 0 0 2024-09-13T23:06:12.280 INFO:tasks.workunit.client.0.smithi115.stdout:6/651: creat d4/ddd/fdf x:0 0 0 2024-09-13T23:06:12.280 INFO:tasks.workunit.client.0.smithi115.stdout:9/534: mknod d0/d13/d17/caa 0 2024-09-13T23:06:12.283 INFO:tasks.workunit.client.0.smithi115.stdout:3/668: dread d3/d5/d35/f91 [0,4194304] 0 2024-09-13T23:06:12.283 INFO:tasks.workunit.client.0.smithi115.stdout:3/669: creat d3/d5/d5b/fe7 x:0 0 0 2024-09-13T23:06:12.283 INFO:tasks.workunit.client.0.smithi115.stdout:8/578: truncate d3/d5/dc/d23/f6f 2037883 0 2024-09-13T23:06:12.283 INFO:tasks.workunit.client.0.smithi115.stdout:5/523: creat d8/dd/d6a/fa1 x:0 0 0 2024-09-13T23:06:12.283 INFO:tasks.workunit.client.0.smithi115.stdout:5/524: readlink d8/dd/d14/l71 0 2024-09-13T23:06:12.284 INFO:tasks.workunit.client.0.smithi115.stdout:4/609: dread db/d19/d1d/d2a/f40 [0,4194304] 0 2024-09-13T23:06:12.287 INFO:tasks.workunit.client.0.smithi115.stdout:7/539: dread da/dd/d1c/f1f [4194304,4194304] 0 2024-09-13T23:06:12.287 INFO:tasks.workunit.client.0.smithi115.stdout:3/670: symlink d3/d5/d35/d71/d45/d98/dbc/le8 0 2024-09-13T23:06:12.289 INFO:tasks.workunit.client.0.smithi115.stdout:8/579: link d3/d5/dc/d23/f36 d3/d87/fc6 0 2024-09-13T23:06:12.289 INFO:tasks.workunit.client.0.smithi115.stdout:8/580: fsync d3/d5/dc/d23/f2d 0 2024-09-13T23:06:12.290 INFO:tasks.workunit.client.0.smithi115.stdout:4/610: mknod db/d11/ca7 0 2024-09-13T23:06:12.294 INFO:tasks.workunit.client.0.smithi115.stdout:6/652: dread d4/df/d14/d38/d44/f55 [0,4194304] 0 2024-09-13T23:06:12.295 INFO:tasks.workunit.client.0.smithi115.stdout:4/611: symlink db/d16/d3f/d66/d68/d6a/la8 0 2024-09-13T23:06:12.298 INFO:tasks.workunit.client.0.smithi115.stdout:3/671: link d3/d5/d65/da8/ca1 d3/d5/d35/d71/d3b/d47/de1/dcc/ce9 0 2024-09-13T23:06:12.299 INFO:tasks.workunit.client.0.smithi115.stdout:2/601: dwrite da/d21/f5f [0,4194304] 0 2024-09-13T23:06:12.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:11 smithi115 ceph-mon[27601]: pgmap v244: 65 pgs: 65 active+clean; 808 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 83 MiB/s rd, 106 MiB/s wr, 970 op/s 2024-09-13T23:06:12.299 INFO:tasks.workunit.client.0.smithi115.stdout:1/568: dwrite d0/de/d66/faa [0,4194304] 0 2024-09-13T23:06:12.299 INFO:tasks.workunit.client.0.smithi115.stdout:1/569: truncate d0/de/d66/d8f/d29/f2d 54491 0 2024-09-13T23:06:12.304 INFO:tasks.workunit.client.0.smithi115.stdout:2/602: unlink da/d21/d2d/d78/d53/fa2 0 2024-09-13T23:06:12.307 INFO:tasks.workunit.client.0.smithi115.stdout:9/535: dwrite d0/d43/d53/f59 [0,4194304] 0 2024-09-13T23:06:12.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/570: rename d0/de/d66/d8f/d29/d47/c64 to d0/de/d66/d8f/d29/d47/d74/d9d/da3/cb7 0 2024-09-13T23:06:12.316 INFO:tasks.workunit.client.0.smithi115.stdout:2/603: creat da/d21/d2d/dac/fcf x:0 0 0 2024-09-13T23:06:12.321 INFO:tasks.workunit.client.0.smithi115.stdout:1/571: link d0/de/d66/d8f/d29/f42 d0/de/d66/d8f/d29/d47/d63/fb8 0 2024-09-13T23:06:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:3/672: dread d3/f1b [0,4194304] 0 2024-09-13T23:06:12.322 INFO:tasks.workunit.client.0.smithi115.stdout:1/572: read d0/de/d1b/d25/f77 [2272343,52041] 0 2024-09-13T23:06:12.323 INFO:tasks.workunit.client.0.smithi115.stdout:1/573: mkdir d0/de/d1b/d25/d4d/db9 0 2024-09-13T23:06:12.332 INFO:tasks.workunit.client.0.smithi115.stdout:2/604: dread da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:12.333 INFO:tasks.workunit.client.0.smithi115.stdout:2/605: link da/d23/d2c/f9a da/d77/d83/fd0 0 2024-09-13T23:06:12.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/606: chown da/d21/f72 156011 1 2024-09-13T23:06:12.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/607: creat da/d21/d8c/fd1 x:0 0 0 2024-09-13T23:06:12.336 INFO:tasks.workunit.client.0.smithi115.stdout:7/540: dwrite da/dd/d1c/f22 [0,4194304] 0 2024-09-13T23:06:12.336 INFO:tasks.workunit.client.0.smithi115.stdout:7/541: readlink da/dd/d1c/d2d/l97 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/542: write da/dd/d13/d24/d67/d81/fab [847895,13430] 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/653: dwrite d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb [0,4194304] 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/654: creat d4/df/d14/d38/d44/fe0 x:0 0 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:6/655: truncate d4/d57/d5a/d79/fdc 811271 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:4/612: dwrite db/d11/d54/f44 [0,4194304] 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:9/536: dwrite d0/d13/d17/d1f/d35/d40/f52 [4194304,4194304] 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:9/537: creat d0/d13/d17/d1f/d28/d76/d81/fab x:0 0 0 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:9/538: chown d0/d13/d17/d36/c54 654317116 1 2024-09-13T23:06:12.337 INFO:tasks.workunit.client.0.smithi115.stdout:2/608: dread da/d77/d83/fa4 [0,4194304] 0 2024-09-13T23:06:12.338 INFO:tasks.workunit.client.0.smithi115.stdout:1/574: dread d0/de/d1b/d25/d4d/d51/d23/f2c [0,4194304] 0 2024-09-13T23:06:12.338 INFO:tasks.workunit.client.0.smithi115.stdout:1/575: readlink d0/de/d66/d8f/d29/d47/l98 0 2024-09-13T23:06:12.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/543: truncate da/dd/d16/d29/f55 629783 0 2024-09-13T23:06:12.341 INFO:tasks.workunit.client.0.smithi115.stdout:3/673: read d3/d5/db/faf [2282912,29456] 0 2024-09-13T23:06:12.342 INFO:tasks.workunit.client.0.smithi115.stdout:9/539: rmdir d0/d13/d17/d1f/d28/d76/d81/d9d 0 2024-09-13T23:06:12.342 INFO:tasks.workunit.client.0.smithi115.stdout:9/540: read d0/f2 [3597171,6094] 0 2024-09-13T23:06:12.343 INFO:tasks.workunit.client.0.smithi115.stdout:7/544: symlink da/dd/d1c/db0/lbe 0 2024-09-13T23:06:12.343 INFO:tasks.workunit.client.0.smithi115.stdout:7/545: dread - da/dd/d1c/d2d/d41/fbc zero size 2024-09-13T23:06:12.345 INFO:tasks.workunit.client.0.smithi115.stdout:9/541: rmdir d0/d13/d17/d19 39 2024-09-13T23:06:12.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/546: mknod da/df/cbf 0 2024-09-13T23:06:12.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/547: fsync da/dd/d13/d36/f3a 0 2024-09-13T23:06:12.348 INFO:tasks.workunit.client.0.smithi115.stdout:2/609: dread da/d21/f33 [0,4194304] 0 2024-09-13T23:06:12.350 INFO:tasks.workunit.client.0.smithi115.stdout:2/610: mknod da/d21/d2d/d78/d48/cd2 0 2024-09-13T23:06:12.351 INFO:tasks.workunit.client.0.smithi115.stdout:1/576: read d0/de/d66/d8f/d29/d47/d63/f6b [2002941,53258] 0 2024-09-13T23:06:12.351 INFO:tasks.workunit.client.0.smithi115.stdout:1/577: chown d0/dd/c28 486357 1 2024-09-13T23:06:12.351 INFO:tasks.workunit.client.0.smithi115.stdout:1/578: readlink d0/de/d1b/d25/d4d/d51/d31/l44 0 2024-09-13T23:06:12.351 INFO:tasks.workunit.client.0.smithi115.stdout:9/542: link d0/d13/d17/l4b d0/lac 0 2024-09-13T23:06:12.352 INFO:tasks.workunit.client.0.smithi115.stdout:7/548: rmdir da/dd/d1c/d2d/d41/d98 39 2024-09-13T23:06:12.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/611: mknod da/d23/d2c/dc2/cd3 0 2024-09-13T23:06:12.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/612: stat da/d21/da8/dbc 0 2024-09-13T23:06:12.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/613: fdatasync da/d21/d2d/f80 0 2024-09-13T23:06:12.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/614: creat da/d21/d2d/d78/d56/d1a/d7f/fd4 x:0 0 0 2024-09-13T23:06:12.354 INFO:tasks.workunit.client.0.smithi115.stdout:4/613: dwrite db/d16/d3f/d66/d68/d71/d84/f88 [0,4194304] 0 2024-09-13T23:06:12.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/579: link d0/de/d1b/d25/d4d/d51/d31/d79/fb5 d0/de/d1b/d25/d67/fba 0 2024-09-13T23:06:12.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/580: write d0/f83 [985660,12703] 0 2024-09-13T23:06:12.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/581: fdatasync d0/de/d1b/f99 0 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/582: symlink d0/de/d66/d8f/d29/d47/lbb 0 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/583: write d0/dd/f20 [321213,23359] 0 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/584: chown d0/de/d1b/d25/d4d/db9 2 1 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/585: fsync d0/de/d1b/d25/d4d/d51/d31/f53 0 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/519: sync 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/520: chown d6/c52 249838778 1 2024-09-13T23:06:12.359 INFO:tasks.workunit.client.0.smithi115.stdout:0/521: creat d6/da0/fb9 x:0 0 0 2024-09-13T23:06:12.363 INFO:tasks.workunit.client.0.smithi115.stdout:1/586: symlink d0/de/d66/d8f/d29/d47/d63/dac/lbc 0 2024-09-13T23:06:12.365 INFO:tasks.workunit.client.0.smithi115.stdout:1/587: link d0/de/d62/fa6 d0/de/d66/d8f/d29/d47/d6a/fbd 0 2024-09-13T23:06:12.367 INFO:tasks.workunit.client.0.smithi115.stdout:1/588: rename d0/de/d66/d8f/d29/d47/d6a/d80/l82 to d0/de/d1b/d25/d4d/d51/d23/lbe 0 2024-09-13T23:06:12.371 INFO:tasks.workunit.client.0.smithi115.stdout:4/614: write db/d19/d34/f89 [1721521,29036] 0 2024-09-13T23:06:12.372 INFO:tasks.workunit.client.0.smithi115.stdout:4/615: creat db/fa9 x:0 0 0 2024-09-13T23:06:12.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/616: mkdir db/d19/daa 0 2024-09-13T23:06:12.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/617: write db/f10 [6433821,79027] 0 2024-09-13T23:06:12.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/549: dwrite da/dd/d1c/d2d/d41/fbc [0,4194304] 0 2024-09-13T23:06:12.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/522: dread d6/f9 [4194304,4194304] 0 2024-09-13T23:06:12.378 INFO:tasks.workunit.client.0.smithi115.stdout:0/523: write d6/d24/f63 [1013599,14828] 0 2024-09-13T23:06:12.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/550: mknod da/dd/d13/d36/d5a/d6d/cc0 0 2024-09-13T23:06:12.379 INFO:tasks.workunit.client.0.smithi115.stdout:0/524: symlink d6/d24/d25/d58/lba 0 2024-09-13T23:06:12.380 INFO:tasks.workunit.client.0.smithi115.stdout:3/674: dwrite d3/d5/d35/d71/d3b/f7e [0,4194304] 0 2024-09-13T23:06:12.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/525: creat d6/da5/fbb x:0 0 0 2024-09-13T23:06:12.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/543: dwrite d0/d13/d17/d1f/d28/f91 [0,4194304] 0 2024-09-13T23:06:12.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/544: creat d0/d13/d17/d1f/d77/fad x:0 0 0 2024-09-13T23:06:12.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/545: fsync d0/d13/d17/d1f/d35/f60 0 2024-09-13T23:06:12.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/546: write d0/d13/d17/d1f/d28/f3e [3644387,59928] 0 2024-09-13T23:06:12.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/547: chown d0/d13/d17/d1f/d28/d76/d81/la1 0 1 2024-09-13T23:06:12.383 INFO:tasks.workunit.client.0.smithi115.stdout:3/675: symlink d3/d5/db/dbd/lea 0 2024-09-13T23:06:12.383 INFO:tasks.workunit.client.0.smithi115.stdout:3/676: write d3/d5/d35/d71/f44 [3003726,103055] 0 2024-09-13T23:06:12.383 INFO:tasks.workunit.client.0.smithi115.stdout:1/589: read d0/de/d66/d8f/f61 [1005992,118742] 0 2024-09-13T23:06:12.384 INFO:tasks.workunit.client.0.smithi115.stdout:0/526: creat d6/d24/d25/d2b/d82/d6b/d9f/fbc x:0 0 0 2024-09-13T23:06:12.385 INFO:tasks.workunit.client.0.smithi115.stdout:7/551: dread da/dd/d1c/f9c [0,4194304] 0 2024-09-13T23:06:12.385 INFO:tasks.workunit.client.0.smithi115.stdout:7/552: write da/dd/d13/d7e/d92/f9a [5774934,39847] 0 2024-09-13T23:06:12.387 INFO:tasks.workunit.client.0.smithi115.stdout:9/548: truncate d0/d13/d17/d1f/d28/f38 215837 0 2024-09-13T23:06:12.387 INFO:tasks.workunit.client.0.smithi115.stdout:9/549: creat d0/d13/d3b/fae x:0 0 0 2024-09-13T23:06:12.387 INFO:tasks.workunit.client.0.smithi115.stdout:9/550: write d0/d13/f79 [4928633,29510] 0 2024-09-13T23:06:12.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/615: dwrite da/d21/d8c/d41/d62/f71 [0,4194304] 0 2024-09-13T23:06:12.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/616: dread - da/d21/d2d/d78/d56/d1a/d7f/fca zero size 2024-09-13T23:06:12.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/617: chown da/d23/d2c/f47 156451 1 2024-09-13T23:06:12.390 INFO:tasks.workunit.client.0.smithi115.stdout:1/590: rmdir d0/de/d1b/d25/d4d/d51/d31/d79 39 2024-09-13T23:06:12.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/553: getdents da/dd/d13/d7e 0 2024-09-13T23:06:12.394 INFO:tasks.workunit.client.0.smithi115.stdout:7/554: chown da/dd/d1c/l46 923 1 2024-09-13T23:06:12.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/551: truncate d0/d43/f9e 551226 0 2024-09-13T23:06:12.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/552: readlink d0/d13/d17/d1f/d4e/d61/l75 0 2024-09-13T23:06:12.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/553: write d0/d13/d17/d1f/d28/d76/d81/fab [453987,21380] 0 2024-09-13T23:06:12.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/554: fsync d0/d43/f6d 0 2024-09-13T23:06:12.401 INFO:tasks.workunit.client.0.smithi115.stdout:1/591: symlink d0/de/d66/d8f/d29/d47/d74/d9d/lbf 0 2024-09-13T23:06:12.401 INFO:tasks.workunit.client.0.smithi115.stdout:7/555: dread da/dd/d13/f6b [0,4194304] 0 2024-09-13T23:06:12.402 INFO:tasks.workunit.client.0.smithi115.stdout:9/555: rename d0/c6b to d0/d13/d3b/caf 0 2024-09-13T23:06:12.403 INFO:tasks.workunit.client.0.smithi115.stdout:1/592: symlink d0/de/d1b/d25/d4d/lc0 0 2024-09-13T23:06:12.405 INFO:tasks.workunit.client.0.smithi115.stdout:9/556: rename d0/l3c to d0/d13/d17/d19/lb0 0 2024-09-13T23:06:12.406 INFO:tasks.workunit.client.0.smithi115.stdout:1/593: creat d0/de/d1b/d25/fc1 x:0 0 0 2024-09-13T23:06:12.407 INFO:tasks.workunit.client.0.smithi115.stdout:7/556: getdents da/df 0 2024-09-13T23:06:12.408 INFO:tasks.workunit.client.0.smithi115.stdout:7/557: mknod da/dd/d1c/d2d/d60/cc1 0 2024-09-13T23:06:12.408 INFO:tasks.workunit.client.0.smithi115.stdout:7/558: chown c4 8800903 1 2024-09-13T23:06:12.408 INFO:tasks.workunit.client.0.smithi115.stdout:7/559: getdents da/dd/d1c/d84/dba 0 2024-09-13T23:06:12.410 INFO:tasks.workunit.client.0.smithi115.stdout:1/594: dread d0/f83 [0,4194304] 0 2024-09-13T23:06:12.412 INFO:tasks.workunit.client.0.smithi115.stdout:1/595: getdents d0/de/d1b/d25/d4d/d51 0 2024-09-13T23:06:12.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/527: dwrite d6/da0/fb9 [0,4194304] 0 2024-09-13T23:06:12.412 INFO:tasks.workunit.client.0.smithi115.stdout:0/528: readlink d6/d24/d25/d7f/l94 0 2024-09-13T23:06:12.414 INFO:tasks.workunit.client.0.smithi115.stdout:2/618: dwrite da/d21/d2d/d78/d56/d1a/f90 [0,4194304] 0 2024-09-13T23:06:12.415 INFO:tasks.workunit.client.0.smithi115.stdout:1/596: rename d0/de/d1b/d25/fc1 to d0/de/d1b/d25/d4d/d51/d31/d79/fc2 0 2024-09-13T23:06:12.415 INFO:tasks.workunit.client.0.smithi115.stdout:1/597: truncate d0/de/d62/f84 43444 0 2024-09-13T23:06:12.416 INFO:tasks.workunit.client.0.smithi115.stdout:3/677: dwrite d3/d16/d1a/d1e/dd3/fdb [0,4194304] 0 2024-09-13T23:06:12.417 INFO:tasks.workunit.client.0.smithi115.stdout:2/619: dread da/d21/d2d/d78/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:12.421 INFO:tasks.workunit.client.0.smithi115.stdout:1/598: creat d0/de/d1b/d25/d67/fc3 x:0 0 0 2024-09-13T23:06:12.422 INFO:tasks.workunit.client.0.smithi115.stdout:0/529: getdents d6/d24 0 2024-09-13T23:06:12.423 INFO:tasks.workunit.client.0.smithi115.stdout:9/557: dwrite d0/d13/f2e [0,4194304] 0 2024-09-13T23:06:12.423 INFO:tasks.workunit.client.0.smithi115.stdout:3/678: mknod d3/d5/d35/d71/d3b/d47/de1/dcc/dd4/de2/ceb 0 2024-09-13T23:06:12.425 INFO:tasks.workunit.client.0.smithi115.stdout:2/620: mkdir da/d23/dd5 0 2024-09-13T23:06:12.426 INFO:tasks.workunit.client.0.smithi115.stdout:2/621: chown da/d21/d8c/d41/c94 15854 1 2024-09-13T23:06:12.426 INFO:tasks.workunit.client.0.smithi115.stdout:2/622: chown da/d21/d2d/d78/d56/d1a/l68 5077 1 2024-09-13T23:06:12.426 INFO:tasks.workunit.client.0.smithi115.stdout:0/530: mknod d6/d24/d25/da3/cbd 0 2024-09-13T23:06:12.428 INFO:tasks.workunit.client.0.smithi115.stdout:9/558: rename d0/d13/d3b/l83 to d0/d13/d17/d1f/d4e/lb1 0 2024-09-13T23:06:12.429 INFO:tasks.workunit.client.0.smithi115.stdout:3/679: symlink d3/d5/d5b/dd2/lec 0 2024-09-13T23:06:12.429 INFO:tasks.workunit.client.0.smithi115.stdout:2/623: mknod da/d21/d2d/d78/d56/d74/dc7/cd6 0 2024-09-13T23:06:12.430 INFO:tasks.workunit.client.0.smithi115.stdout:2/624: chown da/d21/d2d/d78/d53/f6f 0 1 2024-09-13T23:06:12.430 INFO:tasks.workunit.client.0.smithi115.stdout:0/531: link d6/d24/d25/d2b/d61/f69 d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe 0 2024-09-13T23:06:12.431 INFO:tasks.workunit.client.0.smithi115.stdout:9/559: mknod d0/d43/cb2 0 2024-09-13T23:06:12.431 INFO:tasks.workunit.client.0.smithi115.stdout:9/560: chown d0/d13/d17/d1f/c4d 17 1 2024-09-13T23:06:12.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/625: mknod da/d21/d2d/d78/d48/cd7 0 2024-09-13T23:06:12.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/626: dread - da/d21/d2d/dac/fcf zero size 2024-09-13T23:06:12.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/627: creat da/fd8 x:0 0 0 2024-09-13T23:06:12.432 INFO:tasks.workunit.client.0.smithi115.stdout:2/628: chown da/d21/d2d/d78/d56/d4b/ca5 0 1 2024-09-13T23:06:12.434 INFO:tasks.workunit.client.0.smithi115.stdout:0/532: rename d6/da5/fbb to d6/d24/d25/d2b/d82/d6b/fbf 0 2024-09-13T23:06:12.434 INFO:tasks.workunit.client.0.smithi115.stdout:0/533: write d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/f93 [388931,57953] 0 2024-09-13T23:06:12.435 INFO:tasks.workunit.client.0.smithi115.stdout:0/534: creat d6/d24/d25/d2b/d82/d44/d5c/fc0 x:0 0 0 2024-09-13T23:06:12.436 INFO:tasks.workunit.client.0.smithi115.stdout:0/535: truncate d6/d24/d25/d7f/f9a 820298 0 2024-09-13T23:06:12.436 INFO:tasks.workunit.client.0.smithi115.stdout:0/536: unlink d6/da0/fb9 0 2024-09-13T23:06:12.446 INFO:tasks.workunit.client.0.smithi115.stdout:0/537: dread d6/d24/d25/d2b/d82/d6b/d9f/f83 [0,4194304] 0 2024-09-13T23:06:12.447 INFO:tasks.workunit.client.0.smithi115.stdout:0/538: mknod d6/d24/d25/cc1 0 2024-09-13T23:06:12.447 INFO:tasks.workunit.client.0.smithi115.stdout:0/539: mkdir d6/d24/d25/d2b/d82/d44/d5c/d87/dc2 0 2024-09-13T23:06:12.447 INFO:tasks.workunit.client.0.smithi115.stdout:0/540: chown d6/d24/d25/d7f 846 1 2024-09-13T23:06:12.448 INFO:tasks.workunit.client.0.smithi115.stdout:0/541: creat d6/d24/d25/da7/fc3 x:0 0 0 2024-09-13T23:06:12.448 INFO:tasks.workunit.client.0.smithi115.stdout:0/542: truncate d6/fb0 619207 0 2024-09-13T23:06:12.449 INFO:tasks.workunit.client.0.smithi115.stdout:0/543: symlink d6/d24/d25/d2b/d61/lc4 0 2024-09-13T23:06:12.449 INFO:tasks.workunit.client.0.smithi115.stdout:0/544: truncate d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/f8f 235971 0 2024-09-13T23:06:12.450 INFO:tasks.workunit.client.0.smithi115.stdout:0/545: mknod d6/da5/cc5 0 2024-09-13T23:06:12.455 INFO:tasks.workunit.client.0.smithi115.stdout:2/629: dwrite da/d21/f5f [4194304,4194304] 0 2024-09-13T23:06:12.456 INFO:tasks.workunit.client.0.smithi115.stdout:9/561: dwrite d0/d13/f7a [0,4194304] 0 2024-09-13T23:06:12.456 INFO:tasks.workunit.client.0.smithi115.stdout:9/562: chown d0/d13/d17/d1f/d67 3987181 1 2024-09-13T23:06:12.456 INFO:tasks.workunit.client.0.smithi115.stdout:2/630: read da/d21/d2d/d78/d48/faf [15073,67633] 0 2024-09-13T23:06:12.456 INFO:tasks.workunit.client.0.smithi115.stdout:2/631: write da/d21/d2d/f65 [1042415,94286] 0 2024-09-13T23:06:12.459 INFO:tasks.workunit.client.0.smithi115.stdout:2/632: link da/d21/d2d/f80 da/d23/dd5/fd9 0 2024-09-13T23:06:12.460 INFO:tasks.workunit.client.0.smithi115.stdout:9/563: truncate d0/d13/d17/d1f/d28/f3e 26749 0 2024-09-13T23:06:12.463 INFO:tasks.workunit.client.0.smithi115.stdout:9/564: creat d0/d13/d17/d1f/d4e/d61/d7d/fb3 x:0 0 0 2024-09-13T23:06:12.463 INFO:tasks.workunit.client.0.smithi115.stdout:9/565: chown d0/d13/d3b/d42/l86 11576 1 2024-09-13T23:06:12.466 INFO:tasks.workunit.client.0.smithi115.stdout:0/546: dwrite d6/d24/d25/d2b/d82/d44/f66 [0,4194304] 0 2024-09-13T23:06:12.469 INFO:tasks.workunit.client.0.smithi115.stdout:0/547: link d6/d24/d25/d2b/d82/d6b/d9f/f99 d6/d24/fc6 0 2024-09-13T23:06:12.469 INFO:tasks.workunit.client.0.smithi115.stdout:0/548: chown d6/d24/d25/d2b/d82/d44/d5c/f6c 1281018 1 2024-09-13T23:06:12.469 INFO:tasks.workunit.client.0.smithi115.stdout:0/549: write d6/d24/d25/da3/dad/f9b [718534,122953] 0 2024-09-13T23:06:12.470 INFO:tasks.workunit.client.0.smithi115.stdout:0/550: mkdir d6/d24/d25/dc7 0 2024-09-13T23:06:12.472 INFO:tasks.workunit.client.0.smithi115.stdout:0/551: unlink d6/d24/d25/d2b/d82/d44/l71 0 2024-09-13T23:06:12.473 INFO:tasks.workunit.client.0.smithi115.stdout:9/566: dread d0/d13/d17/d1f/f45 [0,4194304] 0 2024-09-13T23:06:12.473 INFO:tasks.workunit.client.0.smithi115.stdout:0/552: symlink d6/d24/d25/da3/lc8 0 2024-09-13T23:06:12.474 INFO:tasks.workunit.client.0.smithi115.stdout:2/633: dwrite da/d21/d2d/d78/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:12.474 INFO:tasks.workunit.client.0.smithi115.stdout:9/567: read d0/d13/d17/d19/f50 [12020,45095] 0 2024-09-13T23:06:12.476 INFO:tasks.workunit.client.0.smithi115.stdout:9/568: dread d0/d13/d17/d1f/d28/f38 [0,4194304] 0 2024-09-13T23:06:12.477 INFO:tasks.workunit.client.0.smithi115.stdout:9/569: fdatasync d0/d13/d17/d1f/d35/d40/f52 0 2024-09-13T23:06:12.478 INFO:tasks.workunit.client.0.smithi115.stdout:2/634: unlink da/d21/d2d/d78/d56/d1a/d7f/fca 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:9/570: creat d0/d13/d17/d1f/d35/fb4 x:0 0 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:0/553: dread d6/f9 [4194304,4194304] 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:0/554: write d6/fa9 [713256,116905] 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:0/555: fsync d6/d24/d25/d2b/d82/d44/fb7 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:2/635: mkdir da/d21/d2d/d78/d56/dda 0 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:2/636: dread - da/d21/d2d/d78/d53/f6f zero size 2024-09-13T23:06:12.479 INFO:tasks.workunit.client.0.smithi115.stdout:2/637: readlink da/d21/d2d/d78/d56/d4b/l92 0 2024-09-13T23:06:12.484 INFO:tasks.workunit.client.0.smithi115.stdout:0/556: rename d6/d24/d25/d2b/d82/d44/l53 to d6/da0/lc9 0 2024-09-13T23:06:12.484 INFO:tasks.workunit.client.0.smithi115.stdout:0/557: fsync d6/d24/d25/d2b/f42 0 2024-09-13T23:06:12.484 INFO:tasks.workunit.client.0.smithi115.stdout:0/558: stat d6/d24/d25/d2b/d82/d44/d5c 0 2024-09-13T23:06:12.484 INFO:tasks.workunit.client.0.smithi115.stdout:2/638: rename da/d21/f89 to da/d21/d2d/d78/d56/d74/fdb 0 2024-09-13T23:06:12.485 INFO:tasks.workunit.client.0.smithi115.stdout:0/559: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dca 0 2024-09-13T23:06:12.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/571: dread d0/d43/d53/f59 [0,4194304] 0 2024-09-13T23:06:12.488 INFO:tasks.workunit.client.0.smithi115.stdout:9/572: fdatasync d0/f2 0 2024-09-13T23:06:12.490 INFO:tasks.workunit.client.0.smithi115.stdout:9/573: link d0/d43/d53/f69 d0/d13/d17/d1f/d4e/d61/d9b/fb5 0 2024-09-13T23:06:12.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/574: mknod d0/d13/d17/d1f/d35/d40/cb6 0 2024-09-13T23:06:12.491 INFO:tasks.workunit.client.0.smithi115.stdout:9/575: chown d0/d13/d17/d19/f1d 3121226 1 2024-09-13T23:06:12.493 INFO:tasks.workunit.client.0.smithi115.stdout:9/576: creat d0/d13/d3b/d42/d95/fb7 x:0 0 0 2024-09-13T23:06:12.494 INFO:tasks.workunit.client.0.smithi115.stdout:9/577: creat d0/fb8 x:0 0 0 2024-09-13T23:06:12.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/639: dwrite da/d21/d2d/d78/d56/d1a/f90 [0,4194304] 0 2024-09-13T23:06:12.507 INFO:tasks.workunit.client.0.smithi115.stdout:0/560: dwrite d6/d24/d25/d2b/d82/d44/f46 [0,4194304] 0 2024-09-13T23:06:12.508 INFO:tasks.workunit.client.0.smithi115.stdout:0/561: mknod d6/d24/d25/d2b/d61/ccb 0 2024-09-13T23:06:12.509 INFO:tasks.workunit.client.0.smithi115.stdout:0/562: creat d6/d24/d25/d2b/d82/fcc x:0 0 0 2024-09-13T23:06:12.516 INFO:tasks.workunit.client.0.smithi115.stdout:9/578: dwrite d0/d13/d17/d19/f1d [0,4194304] 0 2024-09-13T23:06:12.516 INFO:tasks.workunit.client.0.smithi115.stdout:9/579: fdatasync d0/d13/d17/d36/f8d 0 2024-09-13T23:06:12.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/580: mknod d0/d13/d17/d1f/d28/d76/d81/cb9 0 2024-09-13T23:06:12.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/581: write d0/d43/d53/f59 [4263676,92309] 0 2024-09-13T23:06:12.517 INFO:tasks.workunit.client.0.smithi115.stdout:9/582: dread - d0/fb8 zero size 2024-09-13T23:06:12.518 INFO:tasks.workunit.client.0.smithi115.stdout:2/640: dread da/d21/d2d/d78/d56/d74/fdb [0,4194304] 0 2024-09-13T23:06:12.518 INFO:tasks.workunit.client.0.smithi115.stdout:2/641: chown da/d21/d2d/d78/d48/lc5 2350 1 2024-09-13T23:06:12.519 INFO:tasks.workunit.client.0.smithi115.stdout:9/583: symlink d0/d43/lba 0 2024-09-13T23:06:12.520 INFO:tasks.workunit.client.0.smithi115.stdout:2/642: truncate da/d21/d2d/d78/d56/d1a/f44 68722 0 2024-09-13T23:06:12.522 INFO:tasks.workunit.client.0.smithi115.stdout:9/584: rename d0/d13/d17/d1f/d28/f5a to d0/d13/d17/d1f/d67/fbb 0 2024-09-13T23:06:12.522 INFO:tasks.workunit.client.0.smithi115.stdout:9/585: read - d0/d13/d17/d1f/d77/fad zero size 2024-09-13T23:06:12.522 INFO:tasks.workunit.client.0.smithi115.stdout:2/643: mknod da/d21/cdc 0 2024-09-13T23:06:12.524 INFO:tasks.workunit.client.0.smithi115.stdout:2/644: rename da/d21/l81 to da/d23/dd5/ldd 0 2024-09-13T23:06:12.526 INFO:tasks.workunit.client.0.smithi115.stdout:9/586: dread d0/d13/d3b/f68 [0,4194304] 0 2024-09-13T23:06:12.526 INFO:tasks.workunit.client.0.smithi115.stdout:9/587: read d0/d13/d17/d36/f46 [616893,41224] 0 2024-09-13T23:06:12.526 INFO:tasks.workunit.client.0.smithi115.stdout:9/588: creat d0/d13/fbc x:0 0 0 2024-09-13T23:06:12.526 INFO:tasks.workunit.client.0.smithi115.stdout:9/589: write d0/d13/d17/d1f/d28/f38 [438791,79511] 0 2024-09-13T23:06:12.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/590: rename d0/d13/f2e to d0/d13/d3b/d42/fbd 0 2024-09-13T23:06:12.549 INFO:tasks.workunit.client.0.smithi115.stdout:9/591: dwrite d0/d13/d17/d1f/d28/d76/d81/f89 [0,4194304] 0 2024-09-13T23:06:12.549 INFO:tasks.workunit.client.0.smithi115.stdout:9/592: chown d0/d13/d17/f1e 1008 1 2024-09-13T23:06:12.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/581: sync 2024-09-13T23:06:12.691 INFO:tasks.workunit.client.0.smithi115.stdout:5/525: sync 2024-09-13T23:06:12.691 INFO:tasks.workunit.client.0.smithi115.stdout:8/582: write d3/d5/d1c/fb0 [718396,57472] 0 2024-09-13T23:06:12.692 INFO:tasks.workunit.client.0.smithi115.stdout:5/526: rename d8/dd/d20/d23/f55 to d8/fa2 0 2024-09-13T23:06:12.692 INFO:tasks.workunit.client.0.smithi115.stdout:5/527: stat d8/dd/l3d 0 2024-09-13T23:06:12.692 INFO:tasks.workunit.client.0.smithi115.stdout:8/583: truncate d3/d5/dc/d16/d1f/d28/f55 1394512 0 2024-09-13T23:06:12.694 INFO:tasks.workunit.client.0.smithi115.stdout:5/528: unlink d8/dd/d6a/d82/d63/d5a/c89 0 2024-09-13T23:06:12.695 INFO:tasks.workunit.client.0.smithi115.stdout:8/584: mknod d3/d5/dc/d16/d1f/d27/d79/da0/cc7 0 2024-09-13T23:06:12.697 INFO:tasks.workunit.client.0.smithi115.stdout:5/529: dread d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:12.697 INFO:tasks.workunit.client.0.smithi115.stdout:8/585: dread d3/d5/dc/d16/d1f/d28/d3e/f43 [0,4194304] 0 2024-09-13T23:06:12.697 INFO:tasks.workunit.client.0.smithi115.stdout:8/586: readlink d3/d5/d1d/d72/la5 0 2024-09-13T23:06:12.698 INFO:tasks.workunit.client.0.smithi115.stdout:8/587: mkdir d3/d87/dc8 0 2024-09-13T23:06:12.699 INFO:tasks.workunit.client.0.smithi115.stdout:8/588: mkdir d3/d5/dc/d16/d1f/d27/d79/da0/dc9 0 2024-09-13T23:06:12.700 INFO:tasks.workunit.client.0.smithi115.stdout:8/589: creat d3/d5/dc/d23/fca x:0 0 0 2024-09-13T23:06:12.701 INFO:tasks.workunit.client.0.smithi115.stdout:8/590: mknod d3/d5/d1d/d63/ccb 0 2024-09-13T23:06:12.702 INFO:tasks.workunit.client.0.smithi115.stdout:8/591: mknod d3/d5/d1c/d41/ccc 0 2024-09-13T23:06:12.705 INFO:tasks.workunit.client.0.smithi115.stdout:5/530: dread d8/f16 [0,4194304] 0 2024-09-13T23:06:12.705 INFO:tasks.workunit.client.0.smithi115.stdout:5/531: write d8/d7a/f83 [517652,29185] 0 2024-09-13T23:06:12.705 INFO:tasks.workunit.client.0.smithi115.stdout:5/532: dread - d8/dd/d14/f79 zero size 2024-09-13T23:06:12.712 INFO:tasks.workunit.client.0.smithi115.stdout:5/533: read d8/d36/f41 [2968940,91417] 0 2024-09-13T23:06:12.712 INFO:tasks.workunit.client.0.smithi115.stdout:5/534: fsync d8/dd/d20/d27/f72 0 2024-09-13T23:06:12.715 INFO:tasks.workunit.client.0.smithi115.stdout:5/535: dread d8/dd/d20/d23/f59 [0,4194304] 0 2024-09-13T23:06:12.715 INFO:tasks.workunit.client.0.smithi115.stdout:5/536: write d8/dd/d20/d23/f70 [673738,31814] 0 2024-09-13T23:06:12.715 INFO:tasks.workunit.client.0.smithi115.stdout:5/537: write d8/dd/d6a/d82/d63/f60 [4785626,41365] 0 2024-09-13T23:06:12.715 INFO:tasks.workunit.client.0.smithi115.stdout:5/538: stat d8/dd/d20/d27/c8d 0 2024-09-13T23:06:12.715 INFO:tasks.workunit.client.0.smithi115.stdout:5/539: readlink d8/dd/d6a/d82/l7b 0 2024-09-13T23:06:12.726 INFO:tasks.workunit.client.0.smithi115.stdout:8/592: dwrite d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:12.729 INFO:tasks.workunit.client.0.smithi115.stdout:5/540: read d8/dd/d20/d23/f2f [6360149,51737] 0 2024-09-13T23:06:12.731 INFO:tasks.workunit.client.0.smithi115.stdout:5/541: rename d8/dd/d6a/l99 to d8/dd/d64/la3 0 2024-09-13T23:06:12.731 INFO:tasks.workunit.client.0.smithi115.stdout:5/542: read d8/dd/d4c/f75 [388255,27211] 0 2024-09-13T23:06:12.731 INFO:tasks.workunit.client.0.smithi115.stdout:5/543: chown d8/dd/d20/d6d 1284120412 1 2024-09-13T23:06:12.732 INFO:tasks.workunit.client.0.smithi115.stdout:5/544: creat d8/dd/d20/d27/fa4 x:0 0 0 2024-09-13T23:06:12.733 INFO:tasks.workunit.client.0.smithi115.stdout:5/545: creat d8/dd/d14/fa5 x:0 0 0 2024-09-13T23:06:12.735 INFO:tasks.workunit.client.0.smithi115.stdout:5/546: unlink d8/fa 0 2024-09-13T23:06:12.737 INFO:tasks.workunit.client.0.smithi115.stdout:5/547: symlink d8/dd/d20/d4a/la6 0 2024-09-13T23:06:12.737 INFO:tasks.workunit.client.0.smithi115.stdout:5/548: stat d8/dd/d20/d4a/c4b 0 2024-09-13T23:06:12.738 INFO:tasks.workunit.client.0.smithi115.stdout:5/549: write d8/dd/d20/f25 [269431,81411] 0 2024-09-13T23:06:12.739 INFO:tasks.workunit.client.0.smithi115.stdout:5/550: rename d8/dd/d20/d23/f3f to d8/dd/d64/fa7 0 2024-09-13T23:06:12.739 INFO:tasks.workunit.client.0.smithi115.stdout:5/551: chown d8/dd/d20/d23 1 1 2024-09-13T23:06:12.745 INFO:tasks.workunit.client.0.smithi115.stdout:8/593: dwrite d3/d5/dc/d23/d4e/f67 [0,4194304] 0 2024-09-13T23:06:12.750 INFO:tasks.workunit.client.0.smithi115.stdout:8/594: dread d3/d5/dc/d23/d4e/d54/d7f/f9d [0,4194304] 0 2024-09-13T23:06:12.751 INFO:tasks.workunit.client.0.smithi115.stdout:8/595: truncate d3/d5/dc/d23/d4e/d54/d7f/f9d 503857 0 2024-09-13T23:06:12.751 INFO:tasks.workunit.client.0.smithi115.stdout:8/596: chown d3/d5/f96 1358 1 2024-09-13T23:06:12.751 INFO:tasks.workunit.client.0.smithi115.stdout:8/597: chown d3/d5/d1d/f26 172 1 2024-09-13T23:06:12.752 INFO:tasks.workunit.client.0.smithi115.stdout:8/598: mkdir d3/d5/dc/d16/d1f/d28/dc0/dcd 0 2024-09-13T23:06:12.753 INFO:tasks.workunit.client.0.smithi115.stdout:8/599: symlink d3/d5/d1d/lce 0 2024-09-13T23:06:12.754 INFO:tasks.workunit.client.0.smithi115.stdout:8/600: unlink d3/d5/d1c/d41/f57 0 2024-09-13T23:06:12.756 INFO:tasks.workunit.client.0.smithi115.stdout:8/601: link d3/d5/c6 d3/d5/d1c/d41/ccf 0 2024-09-13T23:06:12.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/602: truncate d3/d5/f76 2480542 0 2024-09-13T23:06:12.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/603: dread - d3/d5/dc/d16/d1f/d27/d68/fbf zero size 2024-09-13T23:06:12.762 INFO:tasks.workunit.client.0.smithi115.stdout:8/604: creat d3/d5/dc/d16/d1f/d27/d79/da0/fd0 x:0 0 0 2024-09-13T23:06:12.763 INFO:tasks.workunit.client.0.smithi115.stdout:8/605: getdents d3/d5/dc 0 2024-09-13T23:06:12.768 INFO:tasks.workunit.client.0.smithi115.stdout:5/552: dwrite d8/d7a/f83 [0,4194304] 0 2024-09-13T23:06:12.769 INFO:tasks.workunit.client.0.smithi115.stdout:5/553: chown d8/dd/d20/d27/f72 105917 1 2024-09-13T23:06:12.769 INFO:tasks.workunit.client.0.smithi115.stdout:8/606: dread d3/d5/dc/d16/d1f/d28/f55 [0,4194304] 0 2024-09-13T23:06:12.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/607: mknod d3/d5/dc/d16/d1f/d27/d68/cd1 0 2024-09-13T23:06:12.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/608: write d3/d5/dc/d23/d4e/fb9 [264957,55234] 0 2024-09-13T23:06:12.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/609: write d3/d5/dc/d23/d4e/f86 [879363,3532] 0 2024-09-13T23:06:12.772 INFO:tasks.workunit.client.0.smithi115.stdout:8/610: write d3/d5/dc/f2b [159291,31768] 0 2024-09-13T23:06:12.772 INFO:tasks.workunit.client.0.smithi115.stdout:8/611: creat d3/d5/d1c/fd2 x:0 0 0 2024-09-13T23:06:12.772 INFO:tasks.workunit.client.0.smithi115.stdout:8/612: creat d3/d5/dc/d16/d1f/d27/d79/fd3 x:0 0 0 2024-09-13T23:06:12.775 INFO:tasks.workunit.client.0.smithi115.stdout:8/613: symlink d3/d87/ld4 0 2024-09-13T23:06:12.777 INFO:tasks.workunit.client.0.smithi115.stdout:5/554: truncate d8/dd/d20/d23/f70 252448 0 2024-09-13T23:06:12.777 INFO:tasks.workunit.client.0.smithi115.stdout:5/555: chown d8/dd/d20/d6d 2 1 2024-09-13T23:06:12.778 INFO:tasks.workunit.client.0.smithi115.stdout:5/556: mkdir d8/dd/d5d/d5e/da8 0 2024-09-13T23:06:12.778 INFO:tasks.workunit.client.0.smithi115.stdout:5/557: write d8/f2a [7264878,90424] 0 2024-09-13T23:06:12.778 INFO:tasks.workunit.client.0.smithi115.stdout:5/558: fdatasync d8/dd/d14/f37 0 2024-09-13T23:06:12.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/559: read d8/dd/f5c [671480,45055] 0 2024-09-13T23:06:12.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/560: chown d8/dd/d20/d4a/la6 63580504 1 2024-09-13T23:06:12.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/561: write d8/d7a/f84 [685536,105800] 0 2024-09-13T23:06:12.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/562: chown d8/dd/d20/f1a 0 1 2024-09-13T23:06:12.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/563: write d8/dd/d14/f37 [1542478,61963] 0 2024-09-13T23:06:12.781 INFO:tasks.workunit.client.0.smithi115.stdout:5/564: mkdir d8/dd/d20/d27/da9 0 2024-09-13T23:06:12.781 INFO:tasks.workunit.client.0.smithi115.stdout:5/565: creat d8/d36/faa x:0 0 0 2024-09-13T23:06:12.783 INFO:tasks.workunit.client.0.smithi115.stdout:8/614: dread d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:12.784 INFO:tasks.workunit.client.0.smithi115.stdout:5/566: rename d8/c85 to d8/dd/d20/d23/cab 0 2024-09-13T23:06:12.785 INFO:tasks.workunit.client.0.smithi115.stdout:8/615: rename d3/fb3 to d3/d5/d1c/d41/d42/fd5 0 2024-09-13T23:06:12.785 INFO:tasks.workunit.client.0.smithi115.stdout:8/616: truncate d3/d5/d1c/d41/d42/f8f 1134115 0 2024-09-13T23:06:12.786 INFO:tasks.workunit.client.0.smithi115.stdout:5/567: symlink d8/dd/d64/lac 0 2024-09-13T23:06:12.786 INFO:tasks.workunit.client.0.smithi115.stdout:8/617: mknod d3/d5/dc/cd6 0 2024-09-13T23:06:12.787 INFO:tasks.workunit.client.0.smithi115.stdout:8/618: chown d3/d5/d1c/d41/d42/d4d 32988530 1 2024-09-13T23:06:12.787 INFO:tasks.workunit.client.0.smithi115.stdout:5/568: rmdir d8/dd/d4c 39 2024-09-13T23:06:12.788 INFO:tasks.workunit.client.0.smithi115.stdout:5/569: mknod d8/cad 0 2024-09-13T23:06:12.789 INFO:tasks.workunit.client.0.smithi115.stdout:5/570: unlink d8/dd/d74/c87 0 2024-09-13T23:06:12.789 INFO:tasks.workunit.client.0.smithi115.stdout:5/571: chown d8/dd/d6a/d82/d63/f65 6807802 1 2024-09-13T23:06:12.808 INFO:tasks.workunit.client.0.smithi115.stdout:8/619: dwrite d3/d5/d1c/fae [0,4194304] 0 2024-09-13T23:06:12.808 INFO:tasks.workunit.client.0.smithi115.stdout:5/572: dwrite d8/dd/d14/fa5 [0,4194304] 0 2024-09-13T23:06:12.812 INFO:tasks.workunit.client.0.smithi115.stdout:8/620: link d3/d5/dc/f4c d3/d5/dc/d23/d4e/fd7 0 2024-09-13T23:06:12.814 INFO:tasks.workunit.client.0.smithi115.stdout:5/573: link d8/dd/d6a/d82/d63/f44 d8/dd/d6a/d8a/fae 0 2024-09-13T23:06:12.814 INFO:tasks.workunit.client.0.smithi115.stdout:8/621: mknod d3/d5/dc/d23/d4e/cd8 0 2024-09-13T23:06:12.815 INFO:tasks.workunit.client.0.smithi115.stdout:8/622: read d3/d5/dc/d16/d1f/f52 [20824,892] 0 2024-09-13T23:06:12.815 INFO:tasks.workunit.client.0.smithi115.stdout:5/574: mknod d8/dd/d20/d4a/caf 0 2024-09-13T23:06:12.815 INFO:tasks.workunit.client.0.smithi115.stdout:5/575: fsync d8/dd/d14/f77 0 2024-09-13T23:06:12.823 INFO:tasks.workunit.client.0.smithi115.stdout:8/623: write d3/d5/d1c/d41/d42/f15 [2189422,70364] 0 2024-09-13T23:06:12.830 INFO:tasks.workunit.client.0.smithi115.stdout:5/576: dwrite d8/dd/d20/f1a [4194304,4194304] 0 2024-09-13T23:06:12.838 INFO:tasks.workunit.client.0.smithi115.stdout:8/624: dread d3/d5/d1c/d41/d42/f15 [0,4194304] 0 2024-09-13T23:06:12.838 INFO:tasks.workunit.client.0.smithi115.stdout:8/625: fsync d3/d5/dc/d16/d1f/d27/d79/da0/fa4 0 2024-09-13T23:06:12.838 INFO:tasks.workunit.client.0.smithi115.stdout:8/626: dread - d3/d5/dc/d16/d1f/d27/d68/d98/fa9 zero size 2024-09-13T23:06:12.839 INFO:tasks.workunit.client.0.smithi115.stdout:8/627: rmdir d3/d5/dc/d23/d4e/dbe 0 2024-09-13T23:06:12.840 INFO:tasks.workunit.client.0.smithi115.stdout:5/577: read d8/dd/d14/fa5 [1422856,93448] 0 2024-09-13T23:06:12.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/578: rename d8/dd/d14/f79 to d8/dd/d64/fb0 0 2024-09-13T23:06:12.846 INFO:tasks.workunit.client.0.smithi115.stdout:5/579: dread d8/fb [0,4194304] 0 2024-09-13T23:06:12.846 INFO:tasks.workunit.client.0.smithi115.stdout:5/580: dread - d8/dd/d6a/fa1 zero size 2024-09-13T23:06:12.846 INFO:tasks.workunit.client.0.smithi115.stdout:5/581: mknod d8/d9e/cb1 0 2024-09-13T23:06:12.847 INFO:tasks.workunit.client.0.smithi115.stdout:5/582: creat d8/dd/d20/d27/fb2 x:0 0 0 2024-09-13T23:06:12.849 INFO:tasks.workunit.client.0.smithi115.stdout:5/583: link d8/dd/d20/d27/l9c d8/dd/d20/lb3 0 2024-09-13T23:06:12.849 INFO:tasks.workunit.client.0.smithi115.stdout:8/628: write d3/d5/dc/f4c [1550461,59802] 0 2024-09-13T23:06:12.849 INFO:tasks.workunit.client.0.smithi115.stdout:5/584: symlink d8/dd/d5d/lb4 0 2024-09-13T23:06:12.849 INFO:tasks.workunit.client.0.smithi115.stdout:5/585: mkdir d8/d36/db5 0 2024-09-13T23:06:12.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/656: sync 2024-09-13T23:06:12.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/657: truncate d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/fd2 4686361 0 2024-09-13T23:06:12.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/658: write d4/df/d14/d38/d2a/f90 [3505307,51147] 0 2024-09-13T23:06:12.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/659: chown d4/df/d14/d38/d44/d66/d8b/la3 0 1 2024-09-13T23:06:12.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/660: rmdir d4/df/d14/d38/d44/d66/d8b 39 2024-09-13T23:06:12.857 INFO:tasks.workunit.client.0.smithi115.stdout:6/661: mknod d4/d57/d5a/d79/d85/ce1 0 2024-09-13T23:06:12.857 INFO:tasks.workunit.client.0.smithi115.stdout:6/662: getdents d4/df/d14/d67/d77 0 2024-09-13T23:06:12.858 INFO:tasks.workunit.client.0.smithi115.stdout:6/663: symlink d4/df/le2 0 2024-09-13T23:06:12.860 INFO:tasks.workunit.client.0.smithi115.stdout:6/664: creat d4/df/d14/d38/d44/d99/dc0/fe3 x:0 0 0 2024-09-13T23:06:12.861 INFO:tasks.workunit.client.0.smithi115.stdout:6/665: link d4/lda d4/df/d14/d38/d2a/d31/d5b/d88/le4 0 2024-09-13T23:06:12.863 INFO:tasks.workunit.client.0.smithi115.stdout:5/586: dwrite d8/dd/d14/fa5 [0,4194304] 0 2024-09-13T23:06:12.863 INFO:tasks.workunit.client.0.smithi115.stdout:5/587: stat d8/dd/d20 0 2024-09-13T23:06:12.864 INFO:tasks.workunit.client.0.smithi115.stdout:6/666: dread d4/df/d14/d38/d2a/fb2 [0,4194304] 0 2024-09-13T23:06:12.872 INFO:tasks.workunit.client.0.smithi115.stdout:5/588: dread d8/dd/d14/f77 [0,4194304] 0 2024-09-13T23:06:12.873 INFO:tasks.workunit.client.0.smithi115.stdout:5/589: mknod d8/dd/d20/d27/cb6 0 2024-09-13T23:06:12.874 INFO:tasks.workunit.client.0.smithi115.stdout:5/590: mknod d8/dd/d74/cb7 0 2024-09-13T23:06:12.874 INFO:tasks.workunit.client.0.smithi115.stdout:5/591: chown d8/dd/d6a/d82/d63/f8b 0 1 2024-09-13T23:06:12.875 INFO:tasks.workunit.client.0.smithi115.stdout:5/592: truncate d8/dd/d4c/f75 556899 0 2024-09-13T23:06:12.875 INFO:tasks.workunit.client.0.smithi115.stdout:5/593: symlink d8/dd/lb8 0 2024-09-13T23:06:12.875 INFO:tasks.workunit.client.0.smithi115.stdout:5/594: fsync d8/dd/d20/d4a/f4f 0 2024-09-13T23:06:12.878 INFO:tasks.workunit.client.0.smithi115.stdout:5/595: dread d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:12.938 INFO:tasks.workunit.client.0.smithi115.stdout:5/596: dwrite d8/dd/ff [0,4194304] 0 2024-09-13T23:06:12.942 INFO:tasks.workunit.client.0.smithi115.stdout:4/618: sync 2024-09-13T23:06:12.942 INFO:tasks.workunit.client.0.smithi115.stdout:7/560: sync 2024-09-13T23:06:12.945 INFO:tasks.workunit.client.0.smithi115.stdout:5/597: rmdir d8 39 2024-09-13T23:06:12.945 INFO:tasks.workunit.client.0.smithi115.stdout:5/598: fdatasync d8/dd/d6a/d8a/f98 0 2024-09-13T23:06:12.952 INFO:tasks.workunit.client.0.smithi115.stdout:5/599: dread d8/dd/d20/f1a [0,4194304] 0 2024-09-13T23:06:12.953 INFO:tasks.workunit.client.0.smithi115.stdout:4/619: dread db/d19/f27 [0,4194304] 0 2024-09-13T23:06:12.953 INFO:tasks.workunit.client.0.smithi115.stdout:4/620: write db/d16/d3f/f5a [635058,30101] 0 2024-09-13T23:06:12.954 INFO:tasks.workunit.client.0.smithi115.stdout:4/621: creat db/d11/d2e/d33/d36/d51/d57/fab x:0 0 0 2024-09-13T23:06:12.954 INFO:tasks.workunit.client.0.smithi115.stdout:5/600: creat d8/dd/d6a/d82/d63/fb9 x:0 0 0 2024-09-13T23:06:12.955 INFO:tasks.workunit.client.0.smithi115.stdout:7/561: write da/f10 [6205253,110249] 0 2024-09-13T23:06:12.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/562: mknod da/dd/d1c/d2d/d45/cc2 0 2024-09-13T23:06:12.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/563: write da/f10 [911369,6499] 0 2024-09-13T23:06:12.959 INFO:tasks.workunit.client.0.smithi115.stdout:7/564: chown da/dd/d13/d36/d5a/d6d/f8b 3509844 1 2024-09-13T23:06:12.967 INFO:tasks.workunit.client.0.smithi115.stdout:7/565: dread da/dd/d13/d36/d5a/d6d/f8b [0,4194304] 0 2024-09-13T23:06:12.969 INFO:tasks.workunit.client.0.smithi115.stdout:7/566: truncate da/dd/d13/d36/f3a 651568 0 2024-09-13T23:06:12.992 INFO:tasks.workunit.client.0.smithi115.stdout:5/601: dwrite d8/dd/d6a/fa1 [0,4194304] 0 2024-09-13T23:06:12.993 INFO:tasks.workunit.client.0.smithi115.stdout:4/622: dwrite db/d11/d54/f44 [0,4194304] 0 2024-09-13T23:06:12.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/567: dwrite da/dd/d13/d36/d85/fb2 [0,4194304] 0 2024-09-13T23:06:12.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/568: truncate da/d53/faf 957933 0 2024-09-13T23:06:12.993 INFO:tasks.workunit.client.0.smithi115.stdout:7/569: fdatasync da/dd/d1c/d2d/d41/d98/fbd 0 2024-09-13T23:06:12.995 INFO:tasks.workunit.client.0.smithi115.stdout:5/602: mkdir d8/dd/d20/dba 0 2024-09-13T23:06:12.996 INFO:tasks.workunit.client.0.smithi115.stdout:4/623: rename db/d11/d2e/c93 to db/d16/d3f/d66/d68/d71/cac 0 2024-09-13T23:06:13.000 INFO:tasks.workunit.client.0.smithi115.stdout:7/570: creat da/fc3 x:0 0 0 2024-09-13T23:06:13.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/603: rename d8/d36 to d8/dd/d20/dbb 0 2024-09-13T23:06:13.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/604: write d8/f3c [13420233,16493] 0 2024-09-13T23:06:13.003 INFO:tasks.workunit.client.0.smithi115.stdout:4/624: mkdir db/d11/d2e/d33/d36/dad 0 2024-09-13T23:06:13.005 INFO:tasks.workunit.client.0.smithi115.stdout:7/571: rename da/dd/d13/f43 to da/dd/d13/d36/fc4 0 2024-09-13T23:06:13.005 INFO:tasks.workunit.client.0.smithi115.stdout:7/572: fdatasync da/dd/f59 0 2024-09-13T23:06:13.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/605: getdents d8/dd/d6a/d82 0 2024-09-13T23:06:13.006 INFO:tasks.workunit.client.0.smithi115.stdout:5/606: chown d8/dd/f5f 58 1 2024-09-13T23:06:13.007 INFO:tasks.workunit.client.0.smithi115.stdout:7/573: rmdir da/dd/d13/d24/d67/d81 39 2024-09-13T23:06:13.008 INFO:tasks.workunit.client.0.smithi115.stdout:5/607: creat d8/fbc x:0 0 0 2024-09-13T23:06:13.008 INFO:tasks.workunit.client.0.smithi115.stdout:5/608: fsync d8/dd/d6a/d82/d63/f8b 0 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/574: symlink da/dd/d1c/d2d/lc5 0 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/575: fsync da/dd/d1c/d2d/d41/fbc 0 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/599: sync 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:9/593: sync 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:2/645: sync 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/563: sync 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:3/680: sync 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:3/681: chown d3/d5/c2a 19478 1 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:9/594: truncate d0/d13/d17/d1f/d35/d62/fa4 60476 0 2024-09-13T23:06:13.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/600: write d0/de/d66/d8f/d29/d47/d63/f6b [5096484,115206] 0 2024-09-13T23:06:13.012 INFO:tasks.workunit.client.0.smithi115.stdout:5/609: mknod d8/dd/d64/cbd 0 2024-09-13T23:06:13.016 INFO:tasks.workunit.client.0.smithi115.stdout:4/625: rename db/d19/d1d/d2a to db/d16/d3f/dae 0 2024-09-13T23:06:13.016 INFO:tasks.workunit.client.0.smithi115.stdout:2/646: rmdir da/d21/d2d/d78/d56/d74 39 2024-09-13T23:06:13.017 INFO:tasks.workunit.client.0.smithi115.stdout:2/647: truncate da/d23/d2c/f96 855917 0 2024-09-13T23:06:13.018 INFO:tasks.workunit.client.0.smithi115.stdout:9/595: symlink d0/d13/d17/d1f/d28/d76/d81/lbe 0 2024-09-13T23:06:13.018 INFO:tasks.workunit.client.0.smithi115.stdout:5/610: link d8/dd/d20/lb3 d8/dd/d20/d23/lbe 0 2024-09-13T23:06:13.020 INFO:tasks.workunit.client.0.smithi115.stdout:7/576: read da/dd/d1c/d2d/d41/fbc [2177036,77740] 0 2024-09-13T23:06:13.020 INFO:tasks.workunit.client.0.smithi115.stdout:7/577: creat da/dd/d13/d36/d85/fc6 x:0 0 0 2024-09-13T23:06:13.021 INFO:tasks.workunit.client.0.smithi115.stdout:4/626: rename db/d19/f87 to db/d11/d2e/faf 0 2024-09-13T23:06:13.021 INFO:tasks.workunit.client.0.smithi115.stdout:4/627: write db/d16/d3f/dae/f40 [407386,47535] 0 2024-09-13T23:06:13.024 INFO:tasks.workunit.client.0.smithi115.stdout:5/611: link d8/dd/d6a/d82/d63/fb9 d8/dd/d20/d27/fbf 0 2024-09-13T23:06:13.029 INFO:tasks.workunit.client.0.smithi115.stdout:5/612: dread d8/dd/f46 [0,4194304] 0 2024-09-13T23:06:13.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/628: mkdir db/d16/d3f/db0 0 2024-09-13T23:06:13.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/629: fdatasync db/d16/d3f/f6c 0 2024-09-13T23:06:13.029 INFO:tasks.workunit.client.0.smithi115.stdout:7/578: getdents da/dd/d1c/d2d/d41 0 2024-09-13T23:06:13.029 INFO:tasks.workunit.client.0.smithi115.stdout:7/579: write da/df/fa6 [1043620,6081] 0 2024-09-13T23:06:13.030 INFO:tasks.workunit.client.0.smithi115.stdout:4/630: unlink db/fa9 0 2024-09-13T23:06:13.032 INFO:tasks.workunit.client.0.smithi115.stdout:7/580: symlink da/dd/d1c/d2d/d60/lc7 0 2024-09-13T23:06:13.032 INFO:tasks.workunit.client.0.smithi115.stdout:7/581: readlink da/d53/l63 0 2024-09-13T23:06:13.033 INFO:tasks.workunit.client.0.smithi115.stdout:4/631: symlink db/d11/d54/d17/lb1 0 2024-09-13T23:06:13.048 INFO:tasks.workunit.client.0.smithi115.stdout:8/629: sync 2024-09-13T23:06:13.048 INFO:tasks.workunit.client.0.smithi115.stdout:6/667: sync 2024-09-13T23:06:13.048 INFO:tasks.workunit.client.0.smithi115.stdout:6/668: dread - d4/df/d14/d38/d44/fe0 zero size 2024-09-13T23:06:13.049 INFO:tasks.workunit.client.1.smithi152.stdout:1/51: sync 2024-09-13T23:06:13.049 INFO:tasks.workunit.client.1.smithi152.stdout:1/52: getdents d4/d9/d11 0 2024-09-13T23:06:13.050 INFO:tasks.workunit.client.0.smithi115.stdout:8/630: mkdir d3/d5/dc/d23/d4e/d54/d8c/dd9 0 2024-09-13T23:06:13.050 INFO:tasks.workunit.client.0.smithi115.stdout:8/631: creat d3/d5/dc/d23/d4e/d54/d7f/fda x:0 0 0 2024-09-13T23:06:13.051 INFO:tasks.workunit.client.1.smithi152.stdout:6/3: sync 2024-09-13T23:06:13.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/96: sync 2024-09-13T23:06:13.051 INFO:tasks.workunit.client.1.smithi152.stdout:9/82: sync 2024-09-13T23:06:13.051 INFO:tasks.workunit.client.1.smithi152.stdout:5/34: sync 2024-09-13T23:06:13.052 INFO:tasks.workunit.client.1.smithi152.stdout:4/97: chown d3/d4/d5/c12 77633078 1 2024-09-13T23:06:13.053 INFO:tasks.workunit.client.0.smithi115.stdout:6/669: dread d4/df/d14/d38/d44/f55 [0,4194304] 0 2024-09-13T23:06:13.053 INFO:tasks.workunit.client.0.smithi115.stdout:6/670: read d4/df/d14/d38/d2a/d31/f42 [2459740,98683] 0 2024-09-13T23:06:13.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/1: sync 2024-09-13T23:06:13.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/2: write - no filename 2024-09-13T23:06:13.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/3: chown . 494 1 2024-09-13T23:06:13.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/4: dwrite - no filename 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/5: chown . 13 1 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/6: dwrite - no filename 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/7: write - no filename 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/9: sync 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:0/36: sync 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/1: sync 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/7: sync 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/2: fdatasync f0 0 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/4: symlink l0 0 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/5: write - no filename 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/6: dread - no filename 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/8: dread - d0/f1 zero size 2024-09-13T23:06:13.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/9: write d0/f1 [92672,17586] 0 2024-09-13T23:06:13.056 INFO:tasks.workunit.client.1.smithi152.stdout:4/98: creat d3/d4/d6/d8/f19 x:0 0 0 2024-09-13T23:06:13.056 INFO:tasks.workunit.client.1.smithi152.stdout:4/99: dread - d3/d4/d6/f14 zero size 2024-09-13T23:06:13.056 INFO:tasks.workunit.client.1.smithi152.stdout:4/100: stat d3/d4/d6/d8/l15 0 2024-09-13T23:06:13.056 INFO:tasks.workunit.client.1.smithi152.stdout:4/101: chown d3/lf 869 1 2024-09-13T23:06:13.057 INFO:tasks.workunit.client.0.smithi115.stdout:8/632: mknod d3/d5/dc/d23/cdb 0 2024-09-13T23:06:13.057 INFO:tasks.workunit.client.0.smithi115.stdout:8/633: readlink d3/d5/d1c/d41/d42/l6c 0 2024-09-13T23:06:13.057 INFO:tasks.workunit.client.0.smithi115.stdout:8/634: truncate d3/d5/dc/d16/d1f/d27/d79/fd3 524571 0 2024-09-13T23:06:13.057 INFO:tasks.workunit.client.1.smithi152.stdout:6/7: link l0 l1 0 2024-09-13T23:06:13.059 INFO:tasks.workunit.client.1.smithi152.stdout:6/8: rename l0 to l2 0 2024-09-13T23:06:13.061 INFO:tasks.workunit.client.0.smithi115.stdout:6/671: mknod d4/df/d14/d38/d2a/dba/ce5 0 2024-09-13T23:06:13.061 INFO:tasks.workunit.client.0.smithi115.stdout:6/672: readlink d4/l45 0 2024-09-13T23:06:13.061 INFO:tasks.workunit.client.0.smithi115.stdout:6/673: chown d4/df/c4d 2 1 2024-09-13T23:06:13.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/9: creat f3 x:0 0 0 2024-09-13T23:06:13.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/10: dread - f3 zero size 2024-09-13T23:06:13.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/11: write f3 [6228,23384] 0 2024-09-13T23:06:13.063 INFO:tasks.workunit.client.0.smithi115.stdout:4/632: dread db/d19/d1d/f8d [0,4194304] 0 2024-09-13T23:06:13.063 INFO:tasks.workunit.client.0.smithi115.stdout:8/635: creat d3/d5/d6a/fdc x:0 0 0 2024-09-13T23:06:13.063 INFO:tasks.workunit.client.0.smithi115.stdout:8/636: readlink d3/d5/dc/d16/d1f/d28/d62/lab 0 2024-09-13T23:06:13.063 INFO:tasks.workunit.client.0.smithi115.stdout:8/637: chown d3/d5/dc/d16/d1f/d27/d68 38093069 1 2024-09-13T23:06:13.064 INFO:tasks.workunit.client.0.smithi115.stdout:0/564: dwrite d6/d24/d25/fb3 [0,4194304] 0 2024-09-13T23:06:13.066 INFO:tasks.workunit.client.0.smithi115.stdout:3/682: dwrite d3/d5/d35/d71/f44 [0,4194304] 0 2024-09-13T23:06:13.069 INFO:tasks.workunit.client.0.smithi115.stdout:3/683: creat d3/d5/d5b/dd2/fed x:0 0 0 2024-09-13T23:06:13.071 INFO:tasks.workunit.client.1.smithi152.stdout:0/37: dread f2 [0,4194304] 0 2024-09-13T23:06:13.071 INFO:tasks.workunit.client.1.smithi152.stdout:0/38: dread - fb zero size 2024-09-13T23:06:13.071 INFO:tasks.workunit.client.1.smithi152.stdout:0/39: creat f10 x:0 0 0 2024-09-13T23:06:13.075 INFO:tasks.workunit.client.0.smithi115.stdout:3/684: read d3/d16/d1a/f57 [53606,114395] 0 2024-09-13T23:06:13.077 INFO:tasks.workunit.client.0.smithi115.stdout:2/648: dwrite da/d21/d2d/d78/f54 [0,4194304] 0 2024-09-13T23:06:13.079 INFO:tasks.workunit.client.0.smithi115.stdout:4/633: write db/d16/d3f/f72 [991058,376] 0 2024-09-13T23:06:13.079 INFO:tasks.workunit.client.1.smithi152.stdout:8/10: read f0 [3164456,82885] 0 2024-09-13T23:06:13.079 INFO:tasks.workunit.client.1.smithi152.stdout:8/11: write f0 [4859106,63269] 0 2024-09-13T23:06:13.079 INFO:tasks.workunit.client.1.smithi152.stdout:8/12: creat f3 x:0 0 0 2024-09-13T23:06:13.080 INFO:tasks.workunit.client.1.smithi152.stdout:8/13: dread - f3 zero size 2024-09-13T23:06:13.080 INFO:tasks.workunit.client.1.smithi152.stdout:8/14: write f3 [822164,15606] 0 2024-09-13T23:06:13.083 INFO:tasks.workunit.client.0.smithi115.stdout:4/634: rename db/d16/d3f/c95 to db/d16/d3f/d66/d68/d6a/cb2 0 2024-09-13T23:06:13.084 INFO:tasks.workunit.client.1.smithi152.stdout:8/15: mknod c4 0 2024-09-13T23:06:13.086 INFO:tasks.workunit.client.1.smithi152.stdout:8/16: unlink l2 0 2024-09-13T23:06:13.089 INFO:tasks.workunit.client.0.smithi115.stdout:8/638: write d3/d5/d1d/f20 [5550707,76629] 0 2024-09-13T23:06:13.091 INFO:tasks.workunit.client.1.smithi152.stdout:0/40: read f0 [2985523,122479] 0 2024-09-13T23:06:13.091 INFO:tasks.workunit.client.1.smithi152.stdout:0/41: write f10 [110230,26929] 0 2024-09-13T23:06:13.092 INFO:tasks.workunit.client.0.smithi115.stdout:8/639: creat d3/d5/dc/d16/d1f/d28/dc0/fdd x:0 0 0 2024-09-13T23:06:13.092 INFO:tasks.workunit.client.0.smithi115.stdout:8/640: mknod d3/d5/dc/d23/cde 0 2024-09-13T23:06:13.092 INFO:tasks.workunit.client.0.smithi115.stdout:8/641: write d3/d5/d1c/d41/d42/f61 [972715,83178] 0 2024-09-13T23:06:13.094 INFO:tasks.workunit.client.0.smithi115.stdout:8/642: creat d3/d5/dc/d16/d1f/d28/dc0/dcd/fdf x:0 0 0 2024-09-13T23:06:13.097 INFO:tasks.workunit.client.0.smithi115.stdout:2/649: write da/d21/d2d/d78/d56/d1a/f90 [542354,116308] 0 2024-09-13T23:06:13.107 INFO:tasks.workunit.client.0.smithi115.stdout:5/613: dwrite d8/dd/d14/f37 [0,4194304] 0 2024-09-13T23:06:13.107 INFO:tasks.workunit.client.0.smithi115.stdout:7/582: dwrite da/dd/d13/d24/d52/d7c/da7/fae [4194304,4194304] 0 2024-09-13T23:06:13.107 INFO:tasks.workunit.client.0.smithi115.stdout:7/583: stat da/dd/d13/d36/d5a/c69 0 2024-09-13T23:06:13.107 INFO:tasks.workunit.client.0.smithi115.stdout:5/614: dread - d8/dd/d20/dbb/faa zero size 2024-09-13T23:06:13.110 INFO:tasks.workunit.client.0.smithi115.stdout:5/615: creat d8/dd/d5d/d5e/fc0 x:0 0 0 2024-09-13T23:06:13.112 INFO:tasks.workunit.client.0.smithi115.stdout:5/616: creat d8/d7a/fc1 x:0 0 0 2024-09-13T23:06:13.112 INFO:tasks.workunit.client.0.smithi115.stdout:5/617: read - d8/dd/d5d/d5e/fc0 zero size 2024-09-13T23:06:13.119 INFO:tasks.workunit.client.1.smithi152.stdout:5/35: dwrite d5/f7 [0,4194304] 0 2024-09-13T23:06:13.120 INFO:tasks.workunit.client.0.smithi115.stdout:8/643: dread d3/d5/d1c/d41/d42/f8f [0,4194304] 0 2024-09-13T23:06:13.122 INFO:tasks.workunit.client.0.smithi115.stdout:7/584: write da/dd/d13/d24/f4f [4145830,109959] 0 2024-09-13T23:06:13.124 INFO:tasks.workunit.client.1.smithi152.stdout:5/36: read d5/f6 [434581,22853] 0 2024-09-13T23:06:13.124 INFO:tasks.workunit.client.1.smithi152.stdout:5/37: chown f0 299396 1 2024-09-13T23:06:13.125 INFO:tasks.workunit.client.0.smithi115.stdout:8/644: dread d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:13.126 INFO:tasks.workunit.client.0.smithi115.stdout:8/645: fdatasync d3/d5/dc/d23/d4e/fd7 0 2024-09-13T23:06:13.129 INFO:tasks.workunit.client.1.smithi152.stdout:1/53: dwrite f0 [0,4194304] 0 2024-09-13T23:06:13.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/674: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:13.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/675: write d4/df/d14/d38/d2a/d31/f6a [1224991,11544] 0 2024-09-13T23:06:13.131 INFO:tasks.workunit.client.0.smithi115.stdout:6/676: rename d4/df/d14/ca4 to d4/df/d14/d67/d77/dc1/ce6 0 2024-09-13T23:06:13.133 INFO:tasks.workunit.client.0.smithi115.stdout:6/677: truncate d4/df/d14/d35/f8c 601608 0 2024-09-13T23:06:13.138 INFO:tasks.workunit.client.1.smithi152.stdout:4/102: dwrite d3/d4/d6/d8/f19 [0,4194304] 0 2024-09-13T23:06:13.143 INFO:tasks.workunit.client.1.smithi152.stdout:1/54: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:13.150 INFO:tasks.workunit.client.1.smithi152.stdout:8/17: fdatasync f3 0 2024-09-13T23:06:13.150 INFO:tasks.workunit.client.1.smithi152.stdout:8/18: chown c4 2886 1 2024-09-13T23:06:13.151 INFO:tasks.workunit.client.0.smithi115.stdout:0/565: dwrite d6/d24/d25/d7f/f9d [4194304,4194304] 0 2024-09-13T23:06:13.151 INFO:tasks.workunit.client.0.smithi115.stdout:0/566: creat d6/d24/d25/d2b/d82/d44/d5c/d87/da4/fcd x:0 0 0 2024-09-13T23:06:13.151 INFO:tasks.workunit.client.0.smithi115.stdout:0/567: write d6/d24/d25/d2b/d82/d44/d5c/f6c [419345,88104] 0 2024-09-13T23:06:13.151 INFO:tasks.workunit.client.1.smithi152.stdout:8/19: rename c1 to c5 0 2024-09-13T23:06:13.152 INFO:tasks.workunit.client.1.smithi152.stdout:8/20: symlink l6 0 2024-09-13T23:06:13.152 INFO:tasks.workunit.client.1.smithi152.stdout:8/21: write f0 [1082018,1943] 0 2024-09-13T23:06:13.153 INFO:tasks.workunit.client.1.smithi152.stdout:8/22: link l6 l7 0 2024-09-13T23:06:13.154 INFO:tasks.workunit.client.1.smithi152.stdout:7/3: dwrite f0 [0,4194304] 0 2024-09-13T23:06:13.154 INFO:tasks.workunit.client.0.smithi115.stdout:4/635: dwrite db/d11/f52 [0,4194304] 0 2024-09-13T23:06:13.154 INFO:tasks.workunit.client.0.smithi115.stdout:4/636: getdents db/d11/d2e/d33/d36/dad 0 2024-09-13T23:06:13.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/637: chown db/d16/d3f/d66/d68/d71/d75/f80 8 1 2024-09-13T23:06:13.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/638: creat db/fb3 x:0 0 0 2024-09-13T23:06:13.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/639: write db/d19/d1d/f8d [5214923,42910] 0 2024-09-13T23:06:13.155 INFO:tasks.workunit.client.1.smithi152.stdout:7/4: symlink l1 0 2024-09-13T23:06:13.155 INFO:tasks.workunit.client.1.smithi152.stdout:7/5: rmdir - no directory 2024-09-13T23:06:13.156 INFO:tasks.workunit.client.1.smithi152.stdout:7/6: mknod c2 0 2024-09-13T23:06:13.158 INFO:tasks.workunit.client.0.smithi115.stdout:4/640: mkdir db/d11/d2e/db4 0 2024-09-13T23:06:13.160 INFO:tasks.workunit.client.0.smithi115.stdout:8/646: dwrite d3/d5/d1c/d41/d42/f15 [0,4194304] 0 2024-09-13T23:06:13.163 INFO:tasks.workunit.client.0.smithi115.stdout:0/568: dread d6/d24/fc6 [0,4194304] 0 2024-09-13T23:06:13.163 INFO:tasks.workunit.client.0.smithi115.stdout:0/569: truncate d6/d24/d25/d2b/d82/d6b/d9f/fbc 741267 0 2024-09-13T23:06:13.163 INFO:tasks.workunit.client.0.smithi115.stdout:0/570: chown d6/d24/d25/da7/fc3 32 1 2024-09-13T23:06:13.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/42: dwrite f1 [0,4194304] 0 2024-09-13T23:06:13.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/43: fsync f0 0 2024-09-13T23:06:13.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/44: dread - fb zero size 2024-09-13T23:06:13.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/45: fsync f2 0 2024-09-13T23:06:13.165 INFO:tasks.workunit.client.0.smithi115.stdout:6/678: dwrite d4/df/d14/d38/d2a/d3e/f4c [4194304,4194304] 0 2024-09-13T23:06:13.165 INFO:tasks.workunit.client.0.smithi115.stdout:6/679: write d4/df/d14/d35/f39 [1959672,96769] 0 2024-09-13T23:06:13.166 INFO:tasks.workunit.client.1.smithi152.stdout:0/46: mknod c11 0 2024-09-13T23:06:13.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/618: dwrite d8/dd/d14/f95 [4194304,4194304] 0 2024-09-13T23:06:13.166 INFO:tasks.workunit.client.0.smithi115.stdout:2/650: dwrite da/d21/d8c/fd1 [0,4194304] 0 2024-09-13T23:06:13.166 INFO:tasks.workunit.client.0.smithi115.stdout:8/647: truncate d3/d5/f96 1502673 0 2024-09-13T23:06:13.168 INFO:tasks.workunit.client.1.smithi152.stdout:0/47: mknod c12 0 2024-09-13T23:06:13.168 INFO:tasks.workunit.client.1.smithi152.stdout:0/48: chown la 32 1 2024-09-13T23:06:13.168 INFO:tasks.workunit.client.1.smithi152.stdout:0/49: creat f13 x:0 0 0 2024-09-13T23:06:13.168 INFO:tasks.workunit.client.1.smithi152.stdout:0/50: chown ce 1411477 1 2024-09-13T23:06:13.169 INFO:tasks.workunit.client.1.smithi152.stdout:0/51: dread - f13 zero size 2024-09-13T23:06:13.169 INFO:tasks.workunit.client.1.smithi152.stdout:0/52: creat f14 x:0 0 0 2024-09-13T23:06:13.169 INFO:tasks.workunit.client.1.smithi152.stdout:0/53: dread - f8 zero size 2024-09-13T23:06:13.169 INFO:tasks.workunit.client.0.smithi115.stdout:0/571: link d6/cc d6/d24/d25/d2b/d82/cce 0 2024-09-13T23:06:13.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/10: dwrite d0/f1 [0,4194304] 0 2024-09-13T23:06:13.173 INFO:tasks.workunit.client.0.smithi115.stdout:2/651: dread da/d21/d2d/d78/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:13.175 INFO:tasks.workunit.client.1.smithi152.stdout:2/11: symlink d0/l2 0 2024-09-13T23:06:13.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/12: fsync f3 0 2024-09-13T23:06:13.177 INFO:tasks.workunit.client.1.smithi152.stdout:2/12: mkdir d0/d3 0 2024-09-13T23:06:13.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/103: truncate d3/d4/d6/d8/f19 1897276 0 2024-09-13T23:06:13.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/104: dread - d3/f13 zero size 2024-09-13T23:06:13.180 INFO:tasks.workunit.client.0.smithi115.stdout:0/572: unlink d6/d24/d25/d2b/d82/fcc 0 2024-09-13T23:06:13.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/23: rename c5 to c8 0 2024-09-13T23:06:13.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/24: write f0 [1507750,65987] 0 2024-09-13T23:06:13.182 INFO:tasks.workunit.client.1.smithi152.stdout:8/25: write f0 [1699115,59246] 0 2024-09-13T23:06:13.182 INFO:tasks.workunit.client.0.smithi115.stdout:2/652: truncate da/d21/f33 187300 0 2024-09-13T23:06:13.183 INFO:tasks.workunit.client.1.smithi152.stdout:4/105: creat d3/d4/d6/f1a x:0 0 0 2024-09-13T23:06:13.184 INFO:tasks.workunit.client.1.smithi152.stdout:8/26: unlink f0 0 2024-09-13T23:06:13.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/653: dread da/d21/d8c/d41/f61 [0,4194304] 0 2024-09-13T23:06:13.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/654: write da/d21/d2d/d78/d56/d1a/d7f/fb1 [953685,32415] 0 2024-09-13T23:06:13.187 INFO:tasks.workunit.client.1.smithi152.stdout:8/27: mknod c9 0 2024-09-13T23:06:13.189 INFO:tasks.workunit.client.0.smithi115.stdout:0/573: dread d6/d24/d25/d58/f7e [0,4194304] 0 2024-09-13T23:06:13.189 INFO:tasks.workunit.client.0.smithi115.stdout:0/574: chown d6/d24/d25/d2b/d61/c97 36 1 2024-09-13T23:06:13.189 INFO:tasks.workunit.client.0.smithi115.stdout:2/655: truncate da/d21/d8c/f4d 1935316 0 2024-09-13T23:06:13.189 INFO:tasks.workunit.client.0.smithi115.stdout:2/656: creat da/fde x:0 0 0 2024-09-13T23:06:13.198 INFO:tasks.workunit.client.0.smithi115.stdout:0/575: read d6/d24/d25/d2b/d82/d44/f46 [1239568,104834] 0 2024-09-13T23:06:13.201 INFO:tasks.workunit.client.1.smithi152.stdout:2/13: dread d0/f1 [0,4194304] 0 2024-09-13T23:06:13.201 INFO:tasks.workunit.client.1.smithi152.stdout:2/14: readlink d0/l2 0 2024-09-13T23:06:13.201 INFO:tasks.workunit.client.1.smithi152.stdout:2/15: getdents d0/d3 0 2024-09-13T23:06:13.205 INFO:tasks.workunit.client.1.smithi152.stdout:2/16: write d0/f1 [3443483,13863] 0 2024-09-13T23:06:13.206 INFO:tasks.workunit.client.1.smithi152.stdout:8/28: read f3 [295020,62769] 0 2024-09-13T23:06:13.206 INFO:tasks.workunit.client.0.smithi115.stdout:8/648: read d3/d5/dc/f31 [1774501,69009] 0 2024-09-13T23:06:13.206 INFO:tasks.workunit.client.0.smithi115.stdout:8/649: read d3/d5/f44 [3236378,33309] 0 2024-09-13T23:06:13.208 INFO:tasks.workunit.client.0.smithi115.stdout:8/650: rmdir d3/d5/dc/d16/d1f/d28/dc0 39 2024-09-13T23:06:13.208 INFO:tasks.workunit.client.0.smithi115.stdout:8/651: fsync d3/d5/dc/d23/d4e/d54/d8c/fb8 0 2024-09-13T23:06:13.208 INFO:tasks.workunit.client.1.smithi152.stdout:6/13: dread f3 [0,4194304] 0 2024-09-13T23:06:13.209 INFO:tasks.workunit.client.0.smithi115.stdout:8/652: symlink d3/d5/d1c/d41/d42/d4d/le0 0 2024-09-13T23:06:13.209 INFO:tasks.workunit.client.0.smithi115.stdout:8/653: creat d3/d5/dc/d23/fe1 x:0 0 0 2024-09-13T23:06:13.218 INFO:tasks.workunit.client.0.smithi115.stdout:8/654: dread d3/d5/dc/d16/d1f/d27/d68/d98/fc2 [0,4194304] 0 2024-09-13T23:06:13.219 INFO:tasks.workunit.client.0.smithi115.stdout:8/655: mkdir d3/d5/dc/d23/d4e/d54/d8c/dd9/de2 0 2024-09-13T23:06:13.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/641: dwrite db/d11/fa3 [0,4194304] 0 2024-09-13T23:06:13.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/642: fsync db/d11/d2e/d33/f6d 0 2024-09-13T23:06:13.220 INFO:tasks.workunit.client.0.smithi115.stdout:8/656: rename d3/d5/dc/f32 to d3/d5/dc/d16/d1f/fe3 0 2024-09-13T23:06:13.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/643: mkdir db/d19/d1d/db5 0 2024-09-13T23:06:13.222 INFO:tasks.workunit.client.0.smithi115.stdout:8/657: mknod d3/d5/dc/d23/d4e/d54/d8c/dd9/ce4 0 2024-09-13T23:06:13.222 INFO:tasks.workunit.client.0.smithi115.stdout:6/680: dwrite d4/df/d14/d38/d2a/d31/d5b/da8/fb9 [0,4194304] 0 2024-09-13T23:06:13.222 INFO:tasks.workunit.client.0.smithi115.stdout:6/681: chown d4/l45 24997 1 2024-09-13T23:06:13.223 INFO:tasks.workunit.client.0.smithi115.stdout:5/619: dwrite d8/dd/d14/f94 [0,4194304] 0 2024-09-13T23:06:13.223 INFO:tasks.workunit.client.1.smithi152.stdout:7/7: dwrite f0 [0,4194304] 0 2024-09-13T23:06:13.223 INFO:tasks.workunit.client.1.smithi152.stdout:2/17: fsync d0/f1 0 2024-09-13T23:06:13.224 INFO:tasks.workunit.client.0.smithi115.stdout:2/657: dwrite da/d21/d2d/d78/d48/faf [0,4194304] 0 2024-09-13T23:06:13.224 INFO:tasks.workunit.client.0.smithi115.stdout:2/658: chown da/d21/d2d/d78/fa1 477277 1 2024-09-13T23:06:13.224 INFO:tasks.workunit.client.0.smithi115.stdout:4/644: rename db/d19/d1d/c26 to db/d16/d3f/d66/da6/cb6 0 2024-09-13T23:06:13.228 INFO:tasks.workunit.client.0.smithi115.stdout:6/682: truncate d4/df/f28 463014 0 2024-09-13T23:06:13.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/8: link f0 f3 0 2024-09-13T23:06:13.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/9: creat f4 x:0 0 0 2024-09-13T23:06:13.230 INFO:tasks.workunit.client.0.smithi115.stdout:5/620: dread d8/dd/d6a/d82/d63/f65 [0,4194304] 0 2024-09-13T23:06:13.230 INFO:tasks.workunit.client.0.smithi115.stdout:5/621: fsync d8/dd/f5f 0 2024-09-13T23:06:13.231 INFO:tasks.workunit.client.1.smithi152.stdout:2/18: mkdir d0/d4 0 2024-09-13T23:06:13.233 INFO:tasks.workunit.client.1.smithi152.stdout:2/19: mknod d0/d4/c5 0 2024-09-13T23:06:13.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/20: fdatasync d0/f1 0 2024-09-13T23:06:13.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/21: read d0/f1 [2449409,41130] 0 2024-09-13T23:06:13.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/22: write d0/f1 [4095678,108342] 0 2024-09-13T23:06:13.237 INFO:tasks.workunit.client.1.smithi152.stdout:2/23: mknod d0/d3/c6 0 2024-09-13T23:06:13.237 INFO:tasks.workunit.client.1.smithi152.stdout:2/24: write d0/f1 [1841814,43626] 0 2024-09-13T23:06:13.241 INFO:tasks.workunit.client.0.smithi115.stdout:4/645: mknod db/d16/d3f/d66/cb7 0 2024-09-13T23:06:13.242 INFO:tasks.workunit.client.0.smithi115.stdout:5/622: dread d8/dd/d14/fa5 [0,4194304] 0 2024-09-13T23:06:13.244 INFO:tasks.workunit.client.1.smithi152.stdout:7/10: dread f3 [0,4194304] 0 2024-09-13T23:06:13.244 INFO:tasks.workunit.client.1.smithi152.stdout:7/11: creat f5 x:0 0 0 2024-09-13T23:06:13.244 INFO:tasks.workunit.client.1.smithi152.stdout:7/12: creat f6 x:0 0 0 2024-09-13T23:06:13.245 INFO:tasks.workunit.client.1.smithi152.stdout:7/13: readlink l1 0 2024-09-13T23:06:13.245 INFO:tasks.workunit.client.0.smithi115.stdout:4/646: truncate db/f43 980831 0 2024-09-13T23:06:13.246 INFO:tasks.workunit.client.0.smithi115.stdout:5/623: rename d8/dd/d20/dbb/db5 to d8/dd/d20/d23/dc2 0 2024-09-13T23:06:13.247 INFO:tasks.workunit.client.0.smithi115.stdout:6/683: dread d4/df/d14/d38/d2a/d31/d5b/d88/d9f/faa [0,4194304] 0 2024-09-13T23:06:13.251 INFO:tasks.workunit.client.0.smithi115.stdout:4/647: getdents db/d16/d3f/d66/d68/d71/d84 0 2024-09-13T23:06:13.251 INFO:tasks.workunit.client.1.smithi152.stdout:7/14: write f3 [3058708,106143] 0 2024-09-13T23:06:13.252 INFO:tasks.workunit.client.1.smithi152.stdout:7/15: chown f4 11256 1 2024-09-13T23:06:13.252 INFO:tasks.workunit.client.1.smithi152.stdout:7/16: dread - f6 zero size 2024-09-13T23:06:13.252 INFO:tasks.workunit.client.0.smithi115.stdout:4/648: fdatasync db/d16/d3f/dae/f6f 0 2024-09-13T23:06:13.252 INFO:tasks.workunit.client.0.smithi115.stdout:4/649: write db/d11/f70 [988808,48755] 0 2024-09-13T23:06:13.253 INFO:tasks.workunit.client.1.smithi152.stdout:7/17: symlink l7 0 2024-09-13T23:06:13.253 INFO:tasks.workunit.client.1.smithi152.stdout:7/18: fdatasync f4 0 2024-09-13T23:06:13.253 INFO:tasks.workunit.client.1.smithi152.stdout:7/19: read f3 [110840,33235] 0 2024-09-13T23:06:13.253 INFO:tasks.workunit.client.0.smithi115.stdout:4/650: symlink db/d19/daa/lb8 0 2024-09-13T23:06:13.254 INFO:tasks.workunit.client.0.smithi115.stdout:4/651: mknod db/d16/d3f/d66/da6/cb9 0 2024-09-13T23:06:13.266 INFO:tasks.workunit.client.0.smithi115.stdout:2/659: dwrite da/d23/dd5/fd9 [0,4194304] 0 2024-09-13T23:06:13.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/25: fsync d0/f1 0 2024-09-13T23:06:13.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/26: truncate d0/f1 5209290 0 2024-09-13T23:06:13.267 INFO:tasks.workunit.client.0.smithi115.stdout:8/658: dwrite d3/d5/dc/d16/d1f/d27/d79/f7c [0,4194304] 0 2024-09-13T23:06:13.267 INFO:tasks.workunit.client.0.smithi115.stdout:6/684: dwrite d4/d57/d5a/fde [0,4194304] 0 2024-09-13T23:06:13.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/106: dwrite d3/d4/d6/d8/f19 [0,4194304] 0 2024-09-13T23:06:13.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/107: creat d3/d4/d6/d8/f1b x:0 0 0 2024-09-13T23:06:13.268 INFO:tasks.workunit.client.1.smithi152.stdout:2/27: symlink d0/d4/l7 0 2024-09-13T23:06:13.268 INFO:tasks.workunit.client.1.smithi152.stdout:2/28: write d0/f1 [3142434,101393] 0 2024-09-13T23:06:13.268 INFO:tasks.workunit.client.1.smithi152.stdout:2/29: chown d0/d4 3877587 1 2024-09-13T23:06:13.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/660: creat da/d21/d2d/d78/d56/dda/fdf x:0 0 0 2024-09-13T23:06:13.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/661: write da/d21/d8c/d41/d95/fc3 [178866,68897] 0 2024-09-13T23:06:13.270 INFO:tasks.workunit.client.0.smithi115.stdout:2/662: fsync da/d21/d2d/d78/d56/d1a/d7f/fb1 0 2024-09-13T23:06:13.270 INFO:tasks.workunit.client.1.smithi152.stdout:2/30: mkdir d0/d8 0 2024-09-13T23:06:13.272 INFO:tasks.workunit.client.1.smithi152.stdout:2/31: mkdir d0/d4/d9 0 2024-09-13T23:06:13.274 INFO:tasks.workunit.client.1.smithi152.stdout:2/32: link d0/f1 d0/fa 0 2024-09-13T23:06:13.274 INFO:tasks.workunit.client.1.smithi152.stdout:2/33: creat d0/fb x:0 0 0 2024-09-13T23:06:13.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/20: dread f3 [0,4194304] 0 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/21: read - f6 zero size 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/22: chown f4 4070 1 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/23: rmdir - no directory 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/24: creat f8 x:0 0 0 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/25: chown l7 3 1 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/26: dread - f8 zero size 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/27: creat f9 x:0 0 0 2024-09-13T23:06:13.276 INFO:tasks.workunit.client.1.smithi152.stdout:7/28: write f4 [671423,66162] 0 2024-09-13T23:06:13.277 INFO:tasks.workunit.client.0.smithi115.stdout:8/659: rename d3/d5/dc/d16/d1f/d28/d3e/l8b to d3/le5 0 2024-09-13T23:06:13.277 INFO:tasks.workunit.client.0.smithi115.stdout:8/660: creat d3/d5/dc/d23/d4e/fe6 x:0 0 0 2024-09-13T23:06:13.277 INFO:tasks.workunit.client.1.smithi152.stdout:2/34: link d0/d4/l7 d0/d4/d9/lc 0 2024-09-13T23:06:13.279 INFO:tasks.workunit.client.0.smithi115.stdout:8/661: dread d3/d5/fb [0,4194304] 0 2024-09-13T23:06:13.285 INFO:tasks.workunit.client.0.smithi115.stdout:8/662: creat d3/d5/dc/d16/d1f/d27/d79/da0/dbc/fe7 x:0 0 0 2024-09-13T23:06:13.285 INFO:tasks.workunit.client.0.smithi115.stdout:8/663: chown d3/d5/dc/d16/d1f/d27/d68/d98 148 1 2024-09-13T23:06:13.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/685: symlink d4/df/d14/d38/d2a/d31/d5b/le7 0 2024-09-13T23:06:13.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/686: fdatasync d4/df/d14/d38/d2a/d3e/f4c 0 2024-09-13T23:06:13.286 INFO:tasks.workunit.client.0.smithi115.stdout:6/687: chown d4/d57/dab/fb6 814507038 1 2024-09-13T23:06:13.288 INFO:tasks.workunit.client.0.smithi115.stdout:8/664: dread d3/d5/dc/d16/d1f/d28/d3e/f43 [0,4194304] 0 2024-09-13T23:06:13.290 INFO:tasks.workunit.client.0.smithi115.stdout:8/665: creat d3/d5/d1d/d63/fe8 x:0 0 0 2024-09-13T23:06:13.293 INFO:tasks.workunit.client.0.smithi115.stdout:8/666: rename d3/d5/d1c/d41/d42 to d3/d5/dc/d23/d4e/d54/d7f/de9 0 2024-09-13T23:06:13.293 INFO:tasks.workunit.client.0.smithi115.stdout:8/667: chown d3/d5/dc/d16/d1f/d28/d62/f7b 5055999 1 2024-09-13T23:06:13.294 INFO:tasks.workunit.client.1.smithi152.stdout:2/35: getdents d0/d4 0 2024-09-13T23:06:13.294 INFO:tasks.workunit.client.1.smithi152.stdout:4/108: dwrite d3/d4/d6/d8/f19 [0,4194304] 0 2024-09-13T23:06:13.295 INFO:tasks.workunit.client.1.smithi152.stdout:2/36: link d0/d3/c6 d0/d4/d9/cd 0 2024-09-13T23:06:13.295 INFO:tasks.workunit.client.1.smithi152.stdout:2/37: creat d0/fe x:0 0 0 2024-09-13T23:06:13.296 INFO:tasks.workunit.client.1.smithi152.stdout:4/109: mkdir d3/d4/d5/d1c 0 2024-09-13T23:06:13.296 INFO:tasks.workunit.client.1.smithi152.stdout:4/110: truncate d3/f13 715328 0 2024-09-13T23:06:13.297 INFO:tasks.workunit.client.0.smithi115.stdout:2/663: dwrite da/d23/d2c/fae [0,4194304] 0 2024-09-13T23:06:13.301 INFO:tasks.workunit.client.1.smithi152.stdout:2/38: creat d0/d4/d9/ff x:0 0 0 2024-09-13T23:06:13.301 INFO:tasks.workunit.client.1.smithi152.stdout:2/39: chown d0/d3/c6 4087828 1 2024-09-13T23:06:13.301 INFO:tasks.workunit.client.1.smithi152.stdout:2/40: chown d0/d4/d9 1168 1 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/41: creat d0/d4/d9/f10 x:0 0 0 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/42: dread - d0/fe zero size 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/29: getdents . 0 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/30: chown l1 204050686 1 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.0.smithi115.stdout:2/664: symlink da/d21/da8/dbc/le0 0 2024-09-13T23:06:13.302 INFO:tasks.workunit.client.0.smithi115.stdout:2/665: chown da/d21/d2d/d78/d48/lba 4743873 1 2024-09-13T23:06:13.303 INFO:tasks.workunit.client.0.smithi115.stdout:2/666: write da/d21/d8c/f4d [2788609,39687] 0 2024-09-13T23:06:13.304 INFO:tasks.workunit.client.0.smithi115.stdout:6/688: dwrite d4/df/d14/d38/f5e [0,4194304] 0 2024-09-13T23:06:13.308 INFO:tasks.workunit.client.0.smithi115.stdout:2/667: rename da/d21/d2d/d78 to da/d23/d2c/dc2/de1 0 2024-09-13T23:06:13.308 INFO:tasks.workunit.client.0.smithi115.stdout:2/668: dread - da/d23/d2c/dc2/de1/fa1 zero size 2024-09-13T23:06:13.308 INFO:tasks.workunit.client.0.smithi115.stdout:2/669: readlink da/d21/d8c/d41/d69/lcd 0 2024-09-13T23:06:13.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/668: write d3/d5/dc/d23/d4e/d54/d7f/de9/f15 [800025,59010] 0 2024-09-13T23:06:13.310 INFO:tasks.workunit.client.0.smithi115.stdout:8/669: truncate d3/d5/dc/d23/d4e/d54/d7f/fb5 349242 0 2024-09-13T23:06:13.315 INFO:tasks.workunit.client.0.smithi115.stdout:6/689: dread d4/df/d14/d38/d2a/d3e/f4c [4194304,4194304] 0 2024-09-13T23:06:13.315 INFO:tasks.workunit.client.1.smithi152.stdout:7/31: dwrite f9 [0,4194304] 0 2024-09-13T23:06:13.321 INFO:tasks.workunit.client.0.smithi115.stdout:8/670: dread d3/d5/dc/d16/f83 [0,4194304] 0 2024-09-13T23:06:13.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/43: dwrite d0/f1 [0,4194304] 0 2024-09-13T23:06:13.323 INFO:tasks.workunit.client.0.smithi115.stdout:8/671: mkdir d3/d5/d1d/dea 0 2024-09-13T23:06:13.324 INFO:tasks.workunit.client.1.smithi152.stdout:2/44: symlink d0/d4/l11 0 2024-09-13T23:06:13.324 INFO:tasks.workunit.client.0.smithi115.stdout:8/672: write d3/d5/dc/d23/f2d [71987,7876] 0 2024-09-13T23:06:13.326 INFO:tasks.workunit.client.1.smithi152.stdout:2/45: mknod d0/d8/c12 0 2024-09-13T23:06:13.329 INFO:tasks.workunit.client.0.smithi115.stdout:6/690: read d4/df/d14/d38/f5e [968688,82350] 0 2024-09-13T23:06:13.329 INFO:tasks.workunit.client.0.smithi115.stdout:6/691: chown d4/d57/d5a/c8d 263379 1 2024-09-13T23:06:13.338 INFO:tasks.workunit.client.0.smithi115.stdout:8/673: dread d3/d5/dc/d16/f38 [0,4194304] 0 2024-09-13T23:06:13.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/674: link d3/d5/d1d/d63/lb7 d3/d5/d1d/d63/leb 0 2024-09-13T23:06:13.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/675: creat d3/d5/dc/d23/fec x:0 0 0 2024-09-13T23:06:13.340 INFO:tasks.workunit.client.0.smithi115.stdout:8/676: creat d3/d5/d1c/fed x:0 0 0 2024-09-13T23:06:13.343 INFO:tasks.workunit.client.0.smithi115.stdout:8/677: symlink d3/d5/dc/d23/d4e/d54/d8c/lee 0 2024-09-13T23:06:13.353 INFO:tasks.workunit.client.1.smithi152.stdout:7/32: dwrite f5 [0,4194304] 0 2024-09-13T23:06:13.353 INFO:tasks.workunit.client.0.smithi115.stdout:2/670: dwrite da/d21/d8c/f4d [0,4194304] 0 2024-09-13T23:06:13.353 INFO:tasks.workunit.client.0.smithi115.stdout:2/671: chown da/d77/d83/fb8 119848 1 2024-09-13T23:06:13.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/672: creat da/d23/fe2 x:0 0 0 2024-09-13T23:06:13.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/673: chown da/d21/d8c/d41 57919 1 2024-09-13T23:06:13.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/674: readlink da/d23/l84 0 2024-09-13T23:06:13.354 INFO:tasks.workunit.client.0.smithi115.stdout:2/675: dread - da/d21/da8/fb7 zero size 2024-09-13T23:06:13.355 INFO:tasks.workunit.client.1.smithi152.stdout:7/33: rename f8 to fa 0 2024-09-13T23:06:13.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/676: link da/d23/d2c/dc2/de1/d56/d74/dc7/cd6 da/d23/ce3 0 2024-09-13T23:06:13.359 INFO:tasks.workunit.client.0.smithi115.stdout:2/677: creat da/d21/d8c/d41/fe4 x:0 0 0 2024-09-13T23:06:13.364 INFO:tasks.workunit.client.0.smithi115.stdout:2/678: write da/d21/d8c/d41/d62/f91 [537889,33106] 0 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:2/679: rename da/d21/c37 to da/d21/d2d/dac/ce5 0 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:3/685: sync 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:9/596: sync 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:1/601: sync 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:7/585: sync 2024-09-13T23:06:13.366 INFO:tasks.workunit.client.0.smithi115.stdout:2/680: fdatasync da/fa9 0 2024-09-13T23:06:13.367 INFO:tasks.workunit.client.0.smithi115.stdout:3/686: write d3/d5/d65/da8/fc6 [4498834,51472] 0 2024-09-13T23:06:13.367 INFO:tasks.workunit.client.0.smithi115.stdout:3/687: write d3/dcd/fdc [306507,12088] 0 2024-09-13T23:06:13.367 INFO:tasks.workunit.client.0.smithi115.stdout:9/597: stat d0/l2c 0 2024-09-13T23:06:13.367 INFO:tasks.workunit.client.0.smithi115.stdout:3/688: dread d3/d5/d2c/f90 [0,4194304] 0 2024-09-13T23:06:13.367 INFO:tasks.workunit.client.0.smithi115.stdout:3/689: write d3/d5/d35/d71/d3b/d47/f39 [904783,41392] 0 2024-09-13T23:06:13.368 INFO:tasks.workunit.client.0.smithi115.stdout:8/678: dwrite d3/d5/dc/d16/d1f/d28/d62/f7b [0,4194304] 0 2024-09-13T23:06:13.368 INFO:tasks.workunit.client.0.smithi115.stdout:8/679: truncate d3/d5/dc/d16/d1f/d28/d3e/fad 264938 0 2024-09-13T23:06:13.368 INFO:tasks.workunit.client.0.smithi115.stdout:8/680: creat d3/d5/dc/d23/fef x:0 0 0 2024-09-13T23:06:13.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/602: mkdir d0/de/d1b/d25/d67/dc4 0 2024-09-13T23:06:13.369 INFO:tasks.workunit.client.0.smithi115.stdout:2/681: rename da/d23/f38 to da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/fe6 0 2024-09-13T23:06:13.369 INFO:tasks.workunit.client.1.smithi152.stdout:7/34: write f5 [2876938,16713] 0 2024-09-13T23:06:13.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/586: dread da/dd/d13/d24/f6c [0,4194304] 0 2024-09-13T23:06:13.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/587: fsync da/dd/d1c/f1f 0 2024-09-13T23:06:13.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/588: getdents da/dd/d13/d7e 0 2024-09-13T23:06:13.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/589: fdatasync da/f10 0 2024-09-13T23:06:13.371 INFO:tasks.workunit.client.0.smithi115.stdout:7/590: read da/df/fa6 [979027,100394] 0 2024-09-13T23:06:13.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/35: rename fa to fb 0 2024-09-13T23:06:13.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/36: write f4 [1390731,44352] 0 2024-09-13T23:06:13.378 INFO:tasks.workunit.client.1.smithi152.stdout:7/37: mkdir dc 0 2024-09-13T23:06:13.379 INFO:tasks.workunit.client.1.smithi152.stdout:7/38: write fb [611865,64783] 0 2024-09-13T23:06:13.379 INFO:tasks.workunit.client.0.smithi115.stdout:1/603: rename d0/de/d66/d8f/d29/f2d to d0/de/d1b/d25/d4d/d51/d23/fc5 0 2024-09-13T23:06:13.380 INFO:tasks.workunit.client.0.smithi115.stdout:8/681: symlink d3/d5/dc/d16/d1f/d28/dc0/dcd/lf0 0 2024-09-13T23:06:13.380 INFO:tasks.workunit.client.0.smithi115.stdout:8/682: write d3/d5/f96 [2513149,868] 0 2024-09-13T23:06:13.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/690: dread d3/d5/d65/da8/fc6 [0,4194304] 0 2024-09-13T23:06:13.381 INFO:tasks.workunit.client.0.smithi115.stdout:3/691: write d3/d16/d1a/d1e/d76/fac [536473,126618] 0 2024-09-13T23:06:13.382 INFO:tasks.workunit.client.0.smithi115.stdout:2/682: dread da/d21/d8c/f4d [0,4194304] 0 2024-09-13T23:06:13.382 INFO:tasks.workunit.client.1.smithi152.stdout:7/39: rmdir dc 0 2024-09-13T23:06:13.382 INFO:tasks.workunit.client.1.smithi152.stdout:7/40: write f5 [3873699,18210] 0 2024-09-13T23:06:13.383 INFO:tasks.workunit.client.1.smithi152.stdout:7/41: dread - f6 zero size 2024-09-13T23:06:13.383 INFO:tasks.workunit.client.1.smithi152.stdout:7/42: truncate f0 4746631 0 2024-09-13T23:06:13.383 INFO:tasks.workunit.client.1.smithi152.stdout:7/43: rename f3 to fd 0 2024-09-13T23:06:13.395 INFO:tasks.workunit.client.0.smithi115.stdout:7/591: getdents da/dd/d1c/d2d/d60 0 2024-09-13T23:06:13.395 INFO:tasks.workunit.client.0.smithi115.stdout:9/598: getdents d0/d13/d17/d1f/d35 0 2024-09-13T23:06:13.395 INFO:tasks.workunit.client.0.smithi115.stdout:1/604: link d0/de/d62/l93 d0/de/d66/d8f/d29/d47/d74/d9d/da3/lc6 0 2024-09-13T23:06:13.396 INFO:tasks.workunit.client.0.smithi115.stdout:8/683: mkdir d3/d5/dc/d16/d1f/d28/dc0/dcd/df1 0 2024-09-13T23:06:13.396 INFO:tasks.workunit.client.0.smithi115.stdout:3/692: rmdir d3/d16/dab 39 2024-09-13T23:06:13.396 INFO:tasks.workunit.client.0.smithi115.stdout:3/693: dread - d3/d5/d35/d71/d45/fc4 zero size 2024-09-13T23:06:13.397 INFO:tasks.workunit.client.0.smithi115.stdout:2/683: mkdir da/d21/da6/de7 0 2024-09-13T23:06:13.397 INFO:tasks.workunit.client.0.smithi115.stdout:7/592: getdents da/dd/d1c/d84 0 2024-09-13T23:06:13.397 INFO:tasks.workunit.client.0.smithi115.stdout:7/593: dread - da/dd/d1c/fad zero size 2024-09-13T23:06:13.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/599: unlink d0/d13/d17/d1f/d4e/d61/d7d/d98/la8 0 2024-09-13T23:06:13.398 INFO:tasks.workunit.client.0.smithi115.stdout:9/600: truncate d0/d13/d17/d36/d80/f87 108064 0 2024-09-13T23:06:13.399 INFO:tasks.workunit.client.0.smithi115.stdout:1/605: mkdir d0/de/d66/d8f/d29/d47/d63/dac/dc7 0 2024-09-13T23:06:13.399 INFO:tasks.workunit.client.0.smithi115.stdout:1/606: write d0/de/d62/fa6 [595510,65733] 0 2024-09-13T23:06:13.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/44: dwrite f4 [0,4194304] 0 2024-09-13T23:06:13.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/45: fdatasync f9 0 2024-09-13T23:06:13.401 INFO:tasks.workunit.client.0.smithi115.stdout:8/684: mkdir d3/d5/d1c/df2 0 2024-09-13T23:06:13.402 INFO:tasks.workunit.client.0.smithi115.stdout:2/684: rename da/d21/d8c/d41/d62/f91 to da/d21/d2d/fe8 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/694: creat d3/d5/d35/d71/d3b/d4d/fee x:0 0 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/695: dread - d3/d5/d5b/dd2/fed zero size 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/696: creat d3/d5/d5b/fef x:0 0 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/697: fsync d3/d5/d65/da8/fe6 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/698: fsync d3/d5/d65/da8/da4/f62 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:3/699: chown d3/d16/d1a/dd8 3 1 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:7/594: creat da/dd/d1c/d2d/d60/fc8 x:0 0 0 2024-09-13T23:06:13.403 INFO:tasks.workunit.client.0.smithi115.stdout:7/595: write da/df/f26 [4119458,99795] 0 2024-09-13T23:06:13.407 INFO:tasks.workunit.client.0.smithi115.stdout:8/685: unlink d3/d5/d1d/c70 0 2024-09-13T23:06:13.410 INFO:tasks.workunit.client.0.smithi115.stdout:7/596: mknod da/dd/d13/d24/d52/cc9 0 2024-09-13T23:06:13.410 INFO:tasks.workunit.client.0.smithi115.stdout:8/686: rmdir d3/d5/dc/d16/d1f/d27/d68 39 2024-09-13T23:06:13.414 INFO:tasks.workunit.client.0.smithi115.stdout:2/685: dread da/d23/d2c/dc2/de1/f54 [0,4194304] 0 2024-09-13T23:06:13.415 INFO:tasks.workunit.client.0.smithi115.stdout:8/687: rmdir d3/d5/dc/d16/d1f/d27/d79 39 2024-09-13T23:06:13.418 INFO:tasks.workunit.client.0.smithi115.stdout:8/688: creat d3/d5/d1c/df2/ff3 x:0 0 0 2024-09-13T23:06:13.420 INFO:tasks.workunit.client.0.smithi115.stdout:8/689: mkdir d3/d5/dc/d23/d4e/d54/d7f/de9/df4 0 2024-09-13T23:06:13.421 INFO:tasks.workunit.client.0.smithi115.stdout:7/597: write da/dd/d1c/f90 [536725,67117] 0 2024-09-13T23:06:13.422 INFO:tasks.workunit.client.0.smithi115.stdout:7/598: chown da/dd/d13/d24/d67/d81 235690 1 2024-09-13T23:06:13.422 INFO:tasks.workunit.client.0.smithi115.stdout:8/690: mknod d3/d5/dc/d16/d1f/d27/d79/cf5 0 2024-09-13T23:06:13.424 INFO:tasks.workunit.client.0.smithi115.stdout:7/599: rename da/dd/d13/d36/d85/fb2 to da/dd/d13/d7e/d92/db1/fca 0 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:2/686: write f7 [1245610,13632] 0 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/691: rename d3/d5/dc/d23/d4e/f67 to d3/d5/dc/d23/d4e/d54/ff6 0 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/692: chown d3/d5/dc/d23/d4e/d54/d8c/f97 13609297 1 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/693: readlink d3/d5/dc/d16/d1f/d27/l30 0 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/694: creat d3/d5/dc/d16/d1f/d28/d3e/ff7 x:0 0 0 2024-09-13T23:06:13.426 INFO:tasks.workunit.client.0.smithi115.stdout:8/695: chown d3/d5/dc/d23/d4e/d54/d7f/f9d 12064500 1 2024-09-13T23:06:13.427 INFO:tasks.workunit.client.0.smithi115.stdout:8/696: chown d3/d5/dc/d16/d1f/d27/d79 86739 1 2024-09-13T23:06:13.427 INFO:tasks.workunit.client.0.smithi115.stdout:7/600: mknod da/dd/d13/d36/d5a/d6d/d8f/ccb 0 2024-09-13T23:06:13.436 INFO:tasks.workunit.client.0.smithi115.stdout:9/601: dwrite d0/d13/f2d [0,4194304] 0 2024-09-13T23:06:13.436 INFO:tasks.workunit.client.1.smithi152.stdout:7/46: dread f0 [0,4194304] 0 2024-09-13T23:06:13.438 INFO:tasks.workunit.client.0.smithi115.stdout:1/607: dwrite d0/de/d1b/d25/f77 [0,4194304] 0 2024-09-13T23:06:13.438 INFO:tasks.workunit.client.0.smithi115.stdout:3/700: dwrite d3/d16/d1a/f57 [0,4194304] 0 2024-09-13T23:06:13.439 INFO:tasks.workunit.client.0.smithi115.stdout:9/602: dread d0/d13/d17/d1f/d28/d76/d81/fab [0,4194304] 0 2024-09-13T23:06:13.440 INFO:tasks.workunit.client.0.smithi115.stdout:7/601: mkdir da/df/dcc 0 2024-09-13T23:06:13.443 INFO:tasks.workunit.client.0.smithi115.stdout:2/687: link c8 da/d23/d2c/dc2/de1/d56/d4b/ce9 0 2024-09-13T23:06:13.443 INFO:tasks.workunit.client.0.smithi115.stdout:2/688: truncate da/d23/d2c/dc2/de1/d56/dda/fdf 325787 0 2024-09-13T23:06:13.446 INFO:tasks.workunit.client.0.smithi115.stdout:8/697: getdents d3/d5/d1d 0 2024-09-13T23:06:13.450 INFO:tasks.workunit.client.0.smithi115.stdout:3/701: write d3/d5/d35/d71/f44 [2207630,1653] 0 2024-09-13T23:06:13.451 INFO:tasks.workunit.client.0.smithi115.stdout:1/608: mkdir d0/de/d1b/d25/d4d/d51/d31/d37/dc8 0 2024-09-13T23:06:13.451 INFO:tasks.workunit.client.0.smithi115.stdout:1/609: truncate d0/de/d66/d8f/d29/f4e 8427116 0 2024-09-13T23:06:13.452 INFO:tasks.workunit.client.0.smithi115.stdout:3/702: dread d3/d5/d2c/f90 [0,4194304] 0 2024-09-13T23:06:13.454 INFO:tasks.workunit.client.1.smithi152.stdout:7/47: dwrite f6 [0,4194304] 0 2024-09-13T23:06:13.461 INFO:tasks.workunit.client.0.smithi115.stdout:9/603: rename d0/d13/d17/d1f/d28/d76/d81/f89 to d0/d13/d17/d1f/d28/fbf 0 2024-09-13T23:06:13.463 INFO:tasks.workunit.client.0.smithi115.stdout:7/602: creat da/dd/d13/d36/d5a/d6d/d8f/fcd x:0 0 0 2024-09-13T23:06:13.463 INFO:tasks.workunit.client.0.smithi115.stdout:7/603: write da/dd/d13/d36/fc4 [1452847,93854] 0 2024-09-13T23:06:13.463 INFO:tasks.workunit.client.0.smithi115.stdout:7/604: read - da/df/f96 zero size 2024-09-13T23:06:13.464 INFO:tasks.workunit.client.0.smithi115.stdout:8/698: truncate d3/d5/dc/d23/d4e/d54/ff6 2542354 0 2024-09-13T23:06:13.464 INFO:tasks.workunit.client.0.smithi115.stdout:8/699: chown d3/d5/d1c/d41/ccf 156655404 1 2024-09-13T23:06:13.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/610: getdents d0/de/d66/d8f/d29/d47/d63 0 2024-09-13T23:06:13.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/611: truncate d0/f3 5177139 0 2024-09-13T23:06:13.466 INFO:tasks.workunit.client.1.smithi152.stdout:7/48: dread f5 [0,4194304] 0 2024-09-13T23:06:13.466 INFO:tasks.workunit.client.1.smithi152.stdout:7/49: fdatasync f5 0 2024-09-13T23:06:13.467 INFO:tasks.workunit.client.1.smithi152.stdout:7/50: mknod ce 0 2024-09-13T23:06:13.467 INFO:tasks.workunit.client.1.smithi152.stdout:7/51: chown l1 509 1 2024-09-13T23:06:13.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/703: creat d3/d5/d35/d71/d45/d59/ff0 x:0 0 0 2024-09-13T23:06:13.470 INFO:tasks.workunit.client.0.smithi115.stdout:3/704: chown d3/d5/d35/d71/d45/fc4 106 1 2024-09-13T23:06:13.471 INFO:tasks.workunit.client.0.smithi115.stdout:2/689: rename da/d23/d2c/dc2/de1/d56/d1a/l68 to da/d21/d8c/d41/d69/lea 0 2024-09-13T23:06:13.471 INFO:tasks.workunit.client.0.smithi115.stdout:2/690: write da/d23/d2c/dc2/de1/d53/f6f [757705,41126] 0 2024-09-13T23:06:13.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/604: getdents d0/d13/d17 0 2024-09-13T23:06:13.475 INFO:tasks.workunit.client.0.smithi115.stdout:8/700: symlink d3/d5/dc/d16/d1f/lf8 0 2024-09-13T23:06:13.475 INFO:tasks.workunit.client.0.smithi115.stdout:1/612: mkdir d0/de/d1b/d25/d4d/d51/d31/dc9 0 2024-09-13T23:06:13.475 INFO:tasks.workunit.client.0.smithi115.stdout:1/613: chown d0/de/d1b/d25/d4d/d51/d31/dc9 70 1 2024-09-13T23:06:13.475 INFO:tasks.workunit.client.0.smithi115.stdout:1/614: write d0/de/d62/f84 [918653,84203] 0 2024-09-13T23:06:13.476 INFO:tasks.workunit.client.0.smithi115.stdout:0/576: sync 2024-09-13T23:06:13.478 INFO:tasks.workunit.client.0.smithi115.stdout:0/577: write d6/d24/d25/d2b/d82/d44/fb7 [196121,94840] 0 2024-09-13T23:06:13.479 INFO:tasks.workunit.client.0.smithi115.stdout:3/705: symlink d3/dcd/lf1 0 2024-09-13T23:06:13.479 INFO:tasks.workunit.client.0.smithi115.stdout:3/706: truncate d3/d16/fdf 935903 0 2024-09-13T23:06:13.480 INFO:tasks.workunit.client.0.smithi115.stdout:3/707: write d3/d5/d65/da8/da4/f8c [560756,2266] 0 2024-09-13T23:06:13.481 INFO:tasks.workunit.client.0.smithi115.stdout:5/624: sync 2024-09-13T23:06:13.481 INFO:tasks.workunit.client.0.smithi115.stdout:4/652: sync 2024-09-13T23:06:13.481 INFO:tasks.workunit.client.0.smithi115.stdout:8/701: truncate d3/d5/dc/d23/d4e/fd7 2369874 0 2024-09-13T23:06:13.481 INFO:tasks.workunit.client.0.smithi115.stdout:8/702: fdatasync d3/d5/dc/d16/d1f/d27/d79/da0/dbc/fe7 0 2024-09-13T23:06:13.481 INFO:tasks.workunit.client.0.smithi115.stdout:8/703: creat d3/ff9 x:0 0 0 2024-09-13T23:06:13.482 INFO:tasks.workunit.client.0.smithi115.stdout:9/605: dread d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:13.482 INFO:tasks.workunit.client.0.smithi115.stdout:9/606: chown d0/d13/d3b/d42 129589451 1 2024-09-13T23:06:13.484 INFO:tasks.workunit.client.0.smithi115.stdout:0/578: creat d6/d24/d25/d2b/fcf x:0 0 0 2024-09-13T23:06:13.486 INFO:tasks.workunit.client.0.smithi115.stdout:3/708: dread d3/d5/d65/da8/da4/f62 [0,4194304] 0 2024-09-13T23:06:13.486 INFO:tasks.workunit.client.0.smithi115.stdout:5/625: mkdir d8/dd/d6a/d82/d63/d5a/dc3 0 2024-09-13T23:06:13.486 INFO:tasks.workunit.client.0.smithi115.stdout:5/626: stat d8/dd/d74 0 2024-09-13T23:06:13.486 INFO:tasks.workunit.client.0.smithi115.stdout:4/653: symlink db/d16/lba 0 2024-09-13T23:06:13.490 INFO:tasks.workunit.client.0.smithi115.stdout:0/579: dread d6/d24/fc6 [0,4194304] 0 2024-09-13T23:06:13.490 INFO:tasks.workunit.client.0.smithi115.stdout:9/607: link d0/d13/d17/c27 d0/d13/d3b/d42/cc0 0 2024-09-13T23:06:13.490 INFO:tasks.workunit.client.0.smithi115.stdout:9/608: chown d0/d13/c4a 1404891 1 2024-09-13T23:06:13.493 INFO:tasks.workunit.client.0.smithi115.stdout:5/627: rmdir d8/dd/d20/d23/dc2 0 2024-09-13T23:06:13.495 INFO:tasks.workunit.client.0.smithi115.stdout:4/654: rename db/d16/d3f/d66/d68/d6a/cb2 to db/d11/d2e/cbb 0 2024-09-13T23:06:13.495 INFO:tasks.workunit.client.0.smithi115.stdout:4/655: chown db/d16/d3f/d66/l78 508453342 1 2024-09-13T23:06:13.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/609: link d0/d13/d17/d1f/f70 d0/d13/d17/d36/d80/fc1 0 2024-09-13T23:06:13.497 INFO:tasks.workunit.client.0.smithi115.stdout:9/610: dread - d0/fb8 zero size 2024-09-13T23:06:13.498 INFO:tasks.workunit.client.0.smithi115.stdout:4/656: creat db/d11/d2e/d33/d36/d51/fbc x:0 0 0 2024-09-13T23:06:13.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/611: symlink d0/d13/d17/d1f/d35/lc2 0 2024-09-13T23:06:13.500 INFO:tasks.workunit.client.0.smithi115.stdout:9/612: truncate d0/d13/d17/d1f/d4e/f5d 4933371 0 2024-09-13T23:06:13.503 INFO:tasks.workunit.client.0.smithi115.stdout:4/657: rename db/d16/d3f/d66/d68/d71/fa4 to db/d11/d2e/d33/d36/fbd 0 2024-09-13T23:06:13.503 INFO:tasks.workunit.client.0.smithi115.stdout:4/658: creat db/d16/d3f/d66/d68/d71/d84/d96/fbe x:0 0 0 2024-09-13T23:06:13.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/605: dwrite da/dd/d1c/f20 [4194304,4194304] 0 2024-09-13T23:06:13.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/606: truncate da/dd/d16/d29/f55 665891 0 2024-09-13T23:06:13.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/607: chown da/dd/d1c/d2d 60569 1 2024-09-13T23:06:13.505 INFO:tasks.workunit.client.0.smithi115.stdout:9/613: mkdir d0/d13/d17/d1f/d4e/dc3 0 2024-09-13T23:06:13.506 INFO:tasks.workunit.client.0.smithi115.stdout:6/692: sync 2024-09-13T23:06:13.506 INFO:tasks.workunit.client.0.smithi115.stdout:0/580: read d6/d24/d25/d2b/d82/d44/f56 [3285200,62468] 0 2024-09-13T23:06:13.507 INFO:tasks.workunit.client.0.smithi115.stdout:7/608: symlink da/dd/d13/d7e/lce 0 2024-09-13T23:06:13.509 INFO:tasks.workunit.client.0.smithi115.stdout:0/581: symlink d6/ld0 0 2024-09-13T23:06:13.509 INFO:tasks.workunit.client.0.smithi115.stdout:4/659: dread db/f56 [0,4194304] 0 2024-09-13T23:06:13.510 INFO:tasks.workunit.client.0.smithi115.stdout:4/660: chown db/d11/d2e/d33/d36/d51/d57/f8f 332768212 1 2024-09-13T23:06:13.510 INFO:tasks.workunit.client.0.smithi115.stdout:0/582: mkdir d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/dd1 0 2024-09-13T23:06:13.510 INFO:tasks.workunit.client.0.smithi115.stdout:0/583: chown d6/d24/d25/d2b/d82/d44/d5c/d87 0 1 2024-09-13T23:06:13.510 INFO:tasks.workunit.client.0.smithi115.stdout:4/661: link db/d19/d34/f74 db/d11/d54/d17/fbf 0 2024-09-13T23:06:13.511 INFO:tasks.workunit.client.0.smithi115.stdout:4/662: dread - db/d19/d34/f55 zero size 2024-09-13T23:06:13.512 INFO:tasks.workunit.client.0.smithi115.stdout:4/663: link db/d19/d4e/f65 db/d19/daa/fc0 0 2024-09-13T23:06:13.513 INFO:tasks.workunit.client.0.smithi115.stdout:4/664: creat db/d11/d54/fc1 x:0 0 0 2024-09-13T23:06:13.515 INFO:tasks.workunit.client.0.smithi115.stdout:1/615: dwrite d0/de/d1b/d25/d4d/d51/d23/d65/f7d [0,4194304] 0 2024-09-13T23:06:13.518 INFO:tasks.workunit.client.0.smithi115.stdout:4/665: getdents db/d16/d3f/d66/d68/d71/d75 0 2024-09-13T23:06:13.518 INFO:tasks.workunit.client.0.smithi115.stdout:4/666: write db/d16/d3f/d66/d68/d71/d84/d96/fbe [243451,3501] 0 2024-09-13T23:06:13.518 INFO:tasks.workunit.client.0.smithi115.stdout:8/704: dwrite d3/d5/dc/d23/f2d [0,4194304] 0 2024-09-13T23:06:13.518 INFO:tasks.workunit.client.0.smithi115.stdout:8/705: chown d3/d5/dc/d16/d1f 9012247 1 2024-09-13T23:06:13.521 INFO:tasks.workunit.client.0.smithi115.stdout:4/667: creat db/d19/fc2 x:0 0 0 2024-09-13T23:06:13.522 INFO:tasks.workunit.client.0.smithi115.stdout:3/709: dwrite d3/dcd/fdc [0,4194304] 0 2024-09-13T23:06:13.522 INFO:tasks.workunit.client.0.smithi115.stdout:7/609: dread da/dd/d13/d24/f6c [0,4194304] 0 2024-09-13T23:06:13.524 INFO:tasks.workunit.client.0.smithi115.stdout:8/706: rename d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/f74 to d3/d5/dc/d23/d4e/d54/d8c/ffa 0 2024-09-13T23:06:13.526 INFO:tasks.workunit.client.0.smithi115.stdout:4/668: truncate db/d16/d3f/f45 240994 0 2024-09-13T23:06:13.526 INFO:tasks.workunit.client.0.smithi115.stdout:4/669: chown db/d11/d54/d17/lb1 63 1 2024-09-13T23:06:13.527 INFO:tasks.workunit.client.0.smithi115.stdout:8/707: dread d3/d5/dc/d23/d4e/fb9 [0,4194304] 0 2024-09-13T23:06:13.528 INFO:tasks.workunit.client.0.smithi115.stdout:3/710: truncate d3/d16/d1a/f57 891357 0 2024-09-13T23:06:13.532 INFO:tasks.workunit.client.0.smithi115.stdout:7/610: rename da/d53/c5e to da/dd/d1c/d2d/d60/d82/ccf 0 2024-09-13T23:06:13.534 INFO:tasks.workunit.client.0.smithi115.stdout:8/708: creat d3/d5/dc/d16/d1f/d27/d79/da0/dbc/ffb x:0 0 0 2024-09-13T23:06:13.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/711: symlink d3/d16/dab/lf2 0 2024-09-13T23:06:13.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/712: readlink d3/d5/d65/da8/da4/d49/ld1 0 2024-09-13T23:06:13.535 INFO:tasks.workunit.client.0.smithi115.stdout:3/713: chown d3/d16/d1a/d1e/d8e/faa 5752 1 2024-09-13T23:06:13.535 INFO:tasks.workunit.client.0.smithi115.stdout:9/614: dwrite d0/d13/d17/d1f/d28/d76/fa9 [0,4194304] 0 2024-09-13T23:06:13.536 INFO:tasks.workunit.client.0.smithi115.stdout:4/670: rename db/d19/d1d/c4a to db/d16/d3f/d66/da6/cc3 0 2024-09-13T23:06:13.537 INFO:tasks.workunit.client.0.smithi115.stdout:7/611: mknod da/dd/d13/d7e/d92/cd0 0 2024-09-13T23:06:13.537 INFO:tasks.workunit.client.0.smithi115.stdout:8/709: mkdir d3/d5/dc/d16/d1f/d27/d68/dfc 0 2024-09-13T23:06:13.539 INFO:tasks.workunit.client.0.smithi115.stdout:9/615: rmdir d0/d13/d17/d1f/d35 39 2024-09-13T23:06:13.539 INFO:tasks.workunit.client.0.smithi115.stdout:9/616: rename d0/d13 to d0/d13/d17/d36/d80/dc4 22 2024-09-13T23:06:13.540 INFO:tasks.workunit.client.0.smithi115.stdout:9/617: truncate d0/d13/d17/d1f/d28/f91 2335706 0 2024-09-13T23:06:13.544 INFO:tasks.workunit.client.0.smithi115.stdout:6/693: dwrite d4/df/f74 [0,4194304] 0 2024-09-13T23:06:13.549 INFO:tasks.workunit.client.0.smithi115.stdout:6/694: mkdir d4/df/d14/d67/d77/dcf/de8 0 2024-09-13T23:06:13.549 INFO:tasks.workunit.client.0.smithi115.stdout:3/714: write d3/d5/d35/d71/d3b/d47/d28/fe0 [922375,32353] 0 2024-09-13T23:06:13.551 INFO:tasks.workunit.client.0.smithi115.stdout:0/584: dwrite d6/d24/d25/da3/dad/f8a [0,4194304] 0 2024-09-13T23:06:13.551 INFO:tasks.workunit.client.0.smithi115.stdout:1/616: dwrite d0/de/d1b/d25/d67/f6e [0,4194304] 0 2024-09-13T23:06:13.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/695: symlink d4/d57/dce/le9 0 2024-09-13T23:06:13.552 INFO:tasks.workunit.client.0.smithi115.stdout:8/710: write d3/d5/fa7 [4131207,49097] 0 2024-09-13T23:06:13.553 INFO:tasks.workunit.client.0.smithi115.stdout:4/671: unlink db/d11/d2e/d33/d36/fbd 0 2024-09-13T23:06:13.555 INFO:tasks.workunit.client.0.smithi115.stdout:8/711: write d3/d5/dc/d16/d1f/d28/d3e/fad [192485,58942] 0 2024-09-13T23:06:13.557 INFO:tasks.workunit.client.0.smithi115.stdout:8/712: write d3/d5/dc/d23/d4e/f86 [101820,74759] 0 2024-09-13T23:06:13.557 INFO:tasks.workunit.client.0.smithi115.stdout:9/618: dwrite d0/d13/f72 [0,4194304] 0 2024-09-13T23:06:13.558 INFO:tasks.workunit.client.0.smithi115.stdout:9/619: write d0/d13/d17/d1f/d28/fbf [5220057,75189] 0 2024-09-13T23:06:13.559 INFO:tasks.workunit.client.0.smithi115.stdout:6/696: creat d4/d57/d5a/d79/d85/dbf/fea x:0 0 0 2024-09-13T23:06:13.562 INFO:tasks.workunit.client.0.smithi115.stdout:6/697: dread d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fc5 [0,4194304] 0 2024-09-13T23:06:13.563 INFO:tasks.workunit.client.0.smithi115.stdout:4/672: creat db/d16/d3f/d66/da6/fc4 x:0 0 0 2024-09-13T23:06:13.563 INFO:tasks.workunit.client.0.smithi115.stdout:4/673: chown db/d19/d34/f74 25 1 2024-09-13T23:06:13.565 INFO:tasks.workunit.client.0.smithi115.stdout:8/713: mkdir d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/dfd 0 2024-09-13T23:06:13.565 INFO:tasks.workunit.client.0.smithi115.stdout:8/714: readlink d3/d5/d1c/d41/l6d 0 2024-09-13T23:06:13.566 INFO:tasks.workunit.client.0.smithi115.stdout:8/715: write d3/d5/dc/d23/d4e/fe6 [371165,5684] 0 2024-09-13T23:06:13.567 INFO:tasks.workunit.client.0.smithi115.stdout:0/585: getdents d6 0 2024-09-13T23:06:13.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/586: stat d6/d24/d25/d58/f92 0 2024-09-13T23:06:13.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/587: getdents d6/d24/d25/d2b/d82/d6b/d9f/dab/dca 0 2024-09-13T23:06:13.571 INFO:tasks.workunit.client.0.smithi115.stdout:9/620: mkdir d0/d13/d17/dc5 0 2024-09-13T23:06:13.573 INFO:tasks.workunit.client.0.smithi115.stdout:6/698: rename d4/df/d14/d38/d2a/d3e/c61 to d4/d57/ceb 0 2024-09-13T23:06:13.573 INFO:tasks.workunit.client.0.smithi115.stdout:6/699: chown d4/df/d14/d35/l95 3355 1 2024-09-13T23:06:13.574 INFO:tasks.workunit.client.0.smithi115.stdout:4/674: creat db/d16/fc5 x:0 0 0 2024-09-13T23:06:13.574 INFO:tasks.workunit.client.0.smithi115.stdout:1/617: dwrite d0/fb0 [0,4194304] 0 2024-09-13T23:06:13.574 INFO:tasks.workunit.client.0.smithi115.stdout:3/715: dwrite d3/d5/d35/d71/d3b/d47/d28/f32 [0,4194304] 0 2024-09-13T23:06:13.576 INFO:tasks.workunit.client.0.smithi115.stdout:8/716: creat d3/d5/dc/d16/d1f/d27/d68/ffe x:0 0 0 2024-09-13T23:06:13.578 INFO:tasks.workunit.client.0.smithi115.stdout:9/621: rmdir d0/d13/d17/d1f/d4e/dc3 0 2024-09-13T23:06:13.579 INFO:tasks.workunit.client.0.smithi115.stdout:9/622: dread - d0/d13/d17/d1f/d4e/d61/d7d/fa6 zero size 2024-09-13T23:06:13.581 INFO:tasks.workunit.client.0.smithi115.stdout:0/588: rename d6/d24/d25/d2b/d82/d6b/d9f/f99 to d6/d24/d25/d2b/d82/d44/fd2 0 2024-09-13T23:06:13.583 INFO:tasks.workunit.client.0.smithi115.stdout:6/700: mkdir d4/df/d14/d67/d77/dcf/de8/dec 0 2024-09-13T23:06:13.586 INFO:tasks.workunit.client.0.smithi115.stdout:4/675: unlink db/d16/d3f/d66/d68/l9d 0 2024-09-13T23:06:13.587 INFO:tasks.workunit.client.0.smithi115.stdout:4/676: stat db/d16/d3f/d66/d68/d6a/f7a 0 2024-09-13T23:06:13.587 INFO:tasks.workunit.client.0.smithi115.stdout:4/677: stat db/d16/d3f/d66/d68/d71/d75/f80 0 2024-09-13T23:06:13.587 INFO:tasks.workunit.client.0.smithi115.stdout:1/618: rmdir d0/de/d1b/d25/d4d/d51/d23/d65 39 2024-09-13T23:06:13.591 INFO:tasks.workunit.client.0.smithi115.stdout:6/701: link d4/df/d14/d76/c8a d4/df/d14/ced 0 2024-09-13T23:06:13.595 INFO:tasks.workunit.client.0.smithi115.stdout:0/589: dread d6/d24/d25/d2b/d82/d44/f55 [0,4194304] 0 2024-09-13T23:06:13.611 INFO:tasks.workunit.client.0.smithi115.stdout:8/717: dwrite d3/d5/dc/d16/d1f/f52 [0,4194304] 0 2024-09-13T23:06:13.611 INFO:tasks.workunit.client.0.smithi115.stdout:8/718: dread - d3/d5/dc/d23/fec zero size 2024-09-13T23:06:13.612 INFO:tasks.workunit.client.0.smithi115.stdout:3/716: dwrite d3/d5/d65/da8/da4/d49/f7d [0,4194304] 0 2024-09-13T23:06:13.612 INFO:tasks.workunit.client.0.smithi115.stdout:6/702: dread d4/df/d14/d38/d44/d66/fac [0,4194304] 0 2024-09-13T23:06:13.614 INFO:tasks.workunit.client.0.smithi115.stdout:8/719: creat d3/d5/d1c/d41/fff x:0 0 0 2024-09-13T23:06:13.617 INFO:tasks.workunit.client.0.smithi115.stdout:8/720: rename d3/d5/d1d/d72/f9e to d3/d5/dc/d16/d1f/d28/d3e/f100 0 2024-09-13T23:06:13.617 INFO:tasks.workunit.client.0.smithi115.stdout:3/717: getdents d3/d5/d5b 0 2024-09-13T23:06:13.617 INFO:tasks.workunit.client.0.smithi115.stdout:3/718: chown d3/d16/d1a/d1e/d8e/fb5 64205 1 2024-09-13T23:06:13.619 INFO:tasks.workunit.client.0.smithi115.stdout:3/719: rename d3/d5/d35/d71/d3b/lbe to d3/d5/d35/d71/d3b/d47/de1/dcc/dd4/lf3 0 2024-09-13T23:06:13.619 INFO:tasks.workunit.client.0.smithi115.stdout:3/720: write d3/d5/d35/d71/d45/d59/f5a [625881,37453] 0 2024-09-13T23:06:13.622 INFO:tasks.workunit.client.0.smithi115.stdout:9/623: dwrite d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:13.622 INFO:tasks.workunit.client.0.smithi115.stdout:9/624: dread - d0/d13/d17/d1f/d77/f93 zero size 2024-09-13T23:06:13.622 INFO:tasks.workunit.client.0.smithi115.stdout:1/619: dwrite d0/de/d1b/f2f [0,4194304] 0 2024-09-13T23:06:13.625 INFO:tasks.workunit.client.0.smithi115.stdout:3/721: write d3/d16/d1a/f57 [830363,28274] 0 2024-09-13T23:06:13.629 INFO:tasks.workunit.client.0.smithi115.stdout:0/590: dwrite d6/d24/d25/d58/f92 [0,4194304] 0 2024-09-13T23:06:13.630 INFO:tasks.workunit.client.0.smithi115.stdout:4/678: dwrite db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:13.630 INFO:tasks.workunit.client.0.smithi115.stdout:4/679: truncate db/d16/d3f/d66/d68/d71/d84/d96/f98 200162 0 2024-09-13T23:06:13.637 INFO:tasks.workunit.client.0.smithi115.stdout:3/722: rename d3/d16/d1c/ld0 to d3/d16/d1a/d1e/lf4 0 2024-09-13T23:06:13.640 INFO:tasks.workunit.client.0.smithi115.stdout:3/723: dread d3/d16/d1a/d1e/d94/fb6 [0,4194304] 0 2024-09-13T23:06:13.646 INFO:tasks.workunit.client.0.smithi115.stdout:4/680: rename db/d11/l18 to db/d11/d54/d17/lc6 0 2024-09-13T23:06:13.646 INFO:tasks.workunit.client.0.smithi115.stdout:4/681: chown db/d11/d2e/d33/d36/d51/c99 11 1 2024-09-13T23:06:13.648 INFO:tasks.workunit.client.0.smithi115.stdout:3/724: link d3/d5/d35/d71/d45/f58 d3/d5/d35/d71/d3b/d47/de1/dcc/ff5 0 2024-09-13T23:06:13.648 INFO:tasks.workunit.client.0.smithi115.stdout:3/725: creat d3/d5/db/ff6 x:0 0 0 2024-09-13T23:06:13.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/726: read d3/d5/d35/f53 [668900,63590] 0 2024-09-13T23:06:13.651 INFO:tasks.workunit.client.0.smithi115.stdout:3/727: chown d3/d16/fdf 26 1 2024-09-13T23:06:13.653 INFO:tasks.workunit.client.0.smithi115.stdout:3/728: dread d3/d5/d5b/f72 [0,4194304] 0 2024-09-13T23:06:13.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/721: dwrite d3/d5/dc/d16/d1f/d28/d62/f7b [0,4194304] 0 2024-09-13T23:06:13.655 INFO:tasks.workunit.client.0.smithi115.stdout:1/620: dwrite d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:13.655 INFO:tasks.workunit.client.0.smithi115.stdout:1/621: truncate d0/de/d66/d8f/f61 5438156 0 2024-09-13T23:06:13.656 INFO:tasks.workunit.client.0.smithi115.stdout:1/622: fdatasync d0/de/d1b/d25/d4d/d51/d31/d79/fc2 0 2024-09-13T23:06:13.656 INFO:tasks.workunit.client.0.smithi115.stdout:1/623: write d0/de/d1b/f4a [5013533,37606] 0 2024-09-13T23:06:13.656 INFO:tasks.workunit.client.0.smithi115.stdout:0/591: dwrite d6/d24/d25/d2b/d82/d44/f5d [0,4194304] 0 2024-09-13T23:06:13.656 INFO:tasks.workunit.client.0.smithi115.stdout:3/729: mkdir d3/d5/d35/d71/d45/d98/dbc/df7 0 2024-09-13T23:06:13.657 INFO:tasks.workunit.client.0.smithi115.stdout:3/730: write d3/d5/f9a [229405,19638] 0 2024-09-13T23:06:13.657 INFO:tasks.workunit.client.0.smithi115.stdout:8/722: creat d3/d5/dc/d16/d1f/d28/dc0/f101 x:0 0 0 2024-09-13T23:06:13.658 INFO:tasks.workunit.client.0.smithi115.stdout:0/592: dread d6/d24/d25/d2b/d82/f48 [0,4194304] 0 2024-09-13T23:06:13.659 INFO:tasks.workunit.client.0.smithi115.stdout:3/731: mknod d3/d5/d5b/cf8 0 2024-09-13T23:06:13.659 INFO:tasks.workunit.client.0.smithi115.stdout:3/732: dread - d3/d5/d35/d71/d3b/d4d/d8d/fc0 zero size 2024-09-13T23:06:13.661 INFO:tasks.workunit.client.0.smithi115.stdout:0/593: read d6/f81 [23288,82102] 0 2024-09-13T23:06:13.661 INFO:tasks.workunit.client.0.smithi115.stdout:8/723: mkdir d3/d87/dc8/d102 0 2024-09-13T23:06:13.661 INFO:tasks.workunit.client.0.smithi115.stdout:9/625: truncate d0/d13/d17/d1f/d4e/f5d 1885366 0 2024-09-13T23:06:13.663 INFO:tasks.workunit.client.0.smithi115.stdout:3/733: link d3/d16/d1a/f57 d3/d16/d1a/d1e/ff9 0 2024-09-13T23:06:13.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/724: creat d3/d5/d1d/d72/f103 x:0 0 0 2024-09-13T23:06:13.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/725: write d3/d5/dc/d16/d1f/d27/d68/d98/fc2 [5206502,127140] 0 2024-09-13T23:06:13.665 INFO:tasks.workunit.client.0.smithi115.stdout:9/626: creat d0/d13/d17/d19/fc6 x:0 0 0 2024-09-13T23:06:13.666 INFO:tasks.workunit.client.0.smithi115.stdout:9/627: write d0/d13/d17/d36/f8d [426924,98457] 0 2024-09-13T23:06:13.667 INFO:tasks.workunit.client.0.smithi115.stdout:8/726: unlink d3/d5/dc/d16/d1f/d28/d62/f65 0 2024-09-13T23:06:13.667 INFO:tasks.workunit.client.0.smithi115.stdout:8/727: creat d3/d5/d1d/d72/f104 x:0 0 0 2024-09-13T23:06:13.671 INFO:tasks.workunit.client.0.smithi115.stdout:0/594: write d6/d24/d25/da3/dad/f8a [3953635,130695] 0 2024-09-13T23:06:13.673 INFO:tasks.workunit.client.0.smithi115.stdout:0/595: mknod d6/d24/d25/d2b/d82/d6b/d9f/dab/cd3 0 2024-09-13T23:06:13.676 INFO:tasks.workunit.client.0.smithi115.stdout:9/628: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:13.680 INFO:tasks.workunit.client.0.smithi115.stdout:8/728: dread d3/d5/dc/d16/d1f/d27/d79/da0/fa4 [0,4194304] 0 2024-09-13T23:06:13.680 INFO:tasks.workunit.client.0.smithi115.stdout:4/682: dwrite db/d11/d2e/d33/d36/f9c [0,4194304] 0 2024-09-13T23:06:13.683 INFO:tasks.workunit.client.0.smithi115.stdout:8/729: read d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/f5f [114661,96847] 0 2024-09-13T23:06:13.684 INFO:tasks.workunit.client.0.smithi115.stdout:4/683: mkdir db/d11/d2e/dc7 0 2024-09-13T23:06:13.685 INFO:tasks.workunit.client.0.smithi115.stdout:0/596: write d6/fd [4405574,116247] 0 2024-09-13T23:06:13.685 INFO:tasks.workunit.client.0.smithi115.stdout:1/624: dwrite d0/de/d66/d8f/d29/d47/d6a/f7a [0,4194304] 0 2024-09-13T23:06:13.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/684: symlink db/d19/d1d/db5/lc8 0 2024-09-13T23:06:13.686 INFO:tasks.workunit.client.0.smithi115.stdout:4/685: chown db/d11/d2e/d33/d36/d7f/l8a 4459 1 2024-09-13T23:06:13.688 INFO:tasks.workunit.client.0.smithi115.stdout:8/730: dread d3/d5/dc/d16/d1f/f22 [0,4194304] 0 2024-09-13T23:06:13.689 INFO:tasks.workunit.client.0.smithi115.stdout:8/731: creat d3/d87/dc8/f105 x:0 0 0 2024-09-13T23:06:13.691 INFO:tasks.workunit.client.0.smithi115.stdout:8/732: getdents d3/d5/dc/d16/d1f/d28/d3e 0 2024-09-13T23:06:13.693 INFO:tasks.workunit.client.0.smithi115.stdout:0/597: dread d6/d24/d25/d2b/d82/d44/f55 [0,4194304] 0 2024-09-13T23:06:13.693 INFO:tasks.workunit.client.0.smithi115.stdout:0/598: readlink d6/d24/d25/d2b/d82/d44/l47 0 2024-09-13T23:06:13.693 INFO:tasks.workunit.client.0.smithi115.stdout:0/599: chown d6/d24/d25/d2b/d82/l68 4227 1 2024-09-13T23:06:13.696 INFO:tasks.workunit.client.0.smithi115.stdout:0/600: unlink d6/d24/d25/d2b/d61/la6 0 2024-09-13T23:06:13.696 INFO:tasks.workunit.client.0.smithi115.stdout:0/601: dread - d6/d24/d25/da3/dad/fb6 zero size 2024-09-13T23:06:13.705 INFO:tasks.workunit.client.0.smithi115.stdout:4/686: write db/d11/d2e/d33/d36/d51/f7d [3388199,120689] 0 2024-09-13T23:06:13.705 INFO:tasks.workunit.client.0.smithi115.stdout:9/629: dwrite d0/d13/d17/d1f/d35/fb4 [0,4194304] 0 2024-09-13T23:06:13.717 INFO:tasks.workunit.client.0.smithi115.stdout:1/625: dwrite d0/de/d66/faa [0,4194304] 0 2024-09-13T23:06:13.718 INFO:tasks.workunit.client.0.smithi115.stdout:0/602: dwrite d6/d24/d25/d2b/d82/d44/fd2 [0,4194304] 0 2024-09-13T23:06:13.770 INFO:tasks.workunit.client.0.smithi115.stdout:9/630: link d0/d13/fbc d0/d13/d17/d1f/d4e/d61/d7d/fc7 0 2024-09-13T23:06:13.773 INFO:tasks.workunit.client.0.smithi115.stdout:4/687: rename db/d11/d2e/d33/d36/d51/d57/f63 to db/d11/d2e/d33/fc9 0 2024-09-13T23:06:13.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/626: rmdir d0/de/d1b/d25/d4d/d51/d31/dc9 0 2024-09-13T23:06:13.781 INFO:tasks.workunit.client.0.smithi115.stdout:1/627: dread d0/de/d1b/d25/d4d/d51/d23/fc5 [0,4194304] 0 2024-09-13T23:06:13.786 INFO:tasks.workunit.client.0.smithi115.stdout:0/603: mkdir d6/da5/dd4 0 2024-09-13T23:06:13.786 INFO:tasks.workunit.client.0.smithi115.stdout:0/604: readlink d6/l3c 0 2024-09-13T23:06:13.788 INFO:tasks.workunit.client.0.smithi115.stdout:9/631: mkdir d0/d13/d17/d19/dc8 0 2024-09-13T23:06:13.789 INFO:tasks.workunit.client.0.smithi115.stdout:4/688: creat db/d16/d3f/dae/fca x:0 0 0 2024-09-13T23:06:13.789 INFO:tasks.workunit.client.0.smithi115.stdout:4/689: chown db/d16/fc5 759224094 1 2024-09-13T23:06:13.789 INFO:tasks.workunit.client.0.smithi115.stdout:4/690: creat db/d16/d3f/dae/fcb x:0 0 0 2024-09-13T23:06:13.789 INFO:tasks.workunit.client.0.smithi115.stdout:4/691: chown db/d16/fc5 8 1 2024-09-13T23:06:13.791 INFO:tasks.workunit.client.0.smithi115.stdout:9/632: creat d0/d43/d53/fc9 x:0 0 0 2024-09-13T23:06:13.793 INFO:tasks.workunit.client.0.smithi115.stdout:9/633: rename d0/f2 to d0/d43/fca 0 2024-09-13T23:06:13.805 INFO:tasks.workunit.client.0.smithi115.stdout:9/634: dread d0/d43/d53/f69 [0,4194304] 0 2024-09-13T23:06:13.805 INFO:tasks.workunit.client.0.smithi115.stdout:9/635: write d0/d13/f2d [8603430,87738] 0 2024-09-13T23:06:13.805 INFO:tasks.workunit.client.0.smithi115.stdout:9/636: truncate d0/d43/d53/f59 5082327 0 2024-09-13T23:06:13.806 INFO:tasks.workunit.client.0.smithi115.stdout:9/637: mknod d0/d13/d17/d36/ccb 0 2024-09-13T23:06:13.806 INFO:tasks.workunit.client.0.smithi115.stdout:9/638: write d0/d13/d17/d1f/d77/fa3 [444432,110023] 0 2024-09-13T23:06:13.807 INFO:tasks.workunit.client.0.smithi115.stdout:9/639: rename d0/d13/d3b/d42/fbd to d0/d13/d17/d1f/d4e/d61/d7d/d98/fcc 0 2024-09-13T23:06:13.808 INFO:tasks.workunit.client.0.smithi115.stdout:9/640: creat d0/d13/d17/d1f/d28/fcd x:0 0 0 2024-09-13T23:06:13.856 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: pgmap v245: 65 pgs: 65 active+clean; 1018 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 115 MiB/s rd, 141 MiB/s wr, 821 op/s 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr fail", "who": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: Activating manager daemon smithi152.ntylos 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T23:06:13.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "mgr fail", "who": "smithi115.eqesbc"}]': finished 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: mgrmap e21: smithi152.ntylos(active, starting, since 0.0171884s) 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:06:13.858 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: Manager daemon smithi152.ntylos is now available 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:13.859 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:13 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:5/628: sync 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:2/691: sync 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:7/612: sync 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:6/703: sync 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:3/734: sync 2024-09-13T23:06:13.860 INFO:tasks.workunit.client.0.smithi115.stdout:6/704: dread - d4/df/d14/d38/d2a/d31/fbd zero size 2024-09-13T23:06:13.862 INFO:tasks.workunit.client.0.smithi115.stdout:5/629: symlink d8/dd/d20/dbb/lc4 0 2024-09-13T23:06:13.862 INFO:tasks.workunit.client.0.smithi115.stdout:3/735: dread d3/d16/d1a/d1e/d94/fb6 [0,4194304] 0 2024-09-13T23:06:13.864 INFO:tasks.workunit.client.0.smithi115.stdout:7/613: rename da/dd/d1c/f1f to da/dd/d13/d24/d52/fd1 0 2024-09-13T23:06:13.864 INFO:tasks.workunit.client.0.smithi115.stdout:7/614: chown da/l79 252 1 2024-09-13T23:06:13.864 INFO:tasks.workunit.client.0.smithi115.stdout:7/615: truncate da/df/f96 62460 0 2024-09-13T23:06:13.864 INFO:tasks.workunit.client.0.smithi115.stdout:4/692: dwrite db/d11/d2e/faf [0,4194304] 0 2024-09-13T23:06:13.865 INFO:tasks.workunit.client.0.smithi115.stdout:2/692: symlink da/d23/d2c/leb 0 2024-09-13T23:06:13.865 INFO:tasks.workunit.client.0.smithi115.stdout:7/616: read da/dd/d13/d36/fc4 [460195,101736] 0 2024-09-13T23:06:13.865 INFO:tasks.workunit.client.0.smithi115.stdout:6/705: getdents d4 0 2024-09-13T23:06:13.867 INFO:tasks.workunit.client.0.smithi115.stdout:5/630: mkdir d8/dd/d64/dc5 0 2024-09-13T23:06:13.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/693: read db/d11/d2e/d33/d36/d7f/f53 [836,94530] 0 2024-09-13T23:06:13.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/694: write db/d11/d54/d17/fbf [216671,109978] 0 2024-09-13T23:06:13.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/695: read db/d11/d54/d17/fbf [325269,96160] 0 2024-09-13T23:06:13.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/696: read db/f43 [890031,125975] 0 2024-09-13T23:06:13.869 INFO:tasks.workunit.client.0.smithi115.stdout:4/697: dread - db/d11/d2e/d33/d36/d51/d57/f8f zero size 2024-09-13T23:06:13.870 INFO:tasks.workunit.client.0.smithi115.stdout:4/698: read db/d11/d54/f38 [604913,9406] 0 2024-09-13T23:06:13.870 INFO:tasks.workunit.client.0.smithi115.stdout:3/736: symlink d3/d5/d35/d71/d3b/d47/de1/dcc/lfa 0 2024-09-13T23:06:13.871 INFO:tasks.workunit.client.0.smithi115.stdout:7/617: creat da/dd/d1c/d84/fd2 x:0 0 0 2024-09-13T23:06:13.873 INFO:tasks.workunit.client.0.smithi115.stdout:5/631: mknod d8/dd/d5d/d5e/d9a/cc6 0 2024-09-13T23:06:13.873 INFO:tasks.workunit.client.0.smithi115.stdout:5/632: chown d8/dd/d6a/d8a/fae 16143919 1 2024-09-13T23:06:13.873 INFO:tasks.workunit.client.0.smithi115.stdout:1/628: dwrite d0/de/d66/d8f/d29/f87 [0,4194304] 0 2024-09-13T23:06:13.873 INFO:tasks.workunit.client.0.smithi115.stdout:1/629: write d0/de/d1b/d25/d4d/d51/d31/d79/fc2 [500229,5974] 0 2024-09-13T23:06:13.876 INFO:tasks.workunit.client.0.smithi115.stdout:5/633: rmdir d8/dd/d20/dba 0 2024-09-13T23:06:13.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/641: dwrite d0/d13/d17/f1e [4194304,4194304] 0 2024-09-13T23:06:13.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/642: write d0/d13/d17/d1f/d35/d62/fa4 [665153,74789] 0 2024-09-13T23:06:13.880 INFO:tasks.workunit.client.0.smithi115.stdout:5/634: link d8/dd/d64/cbd d8/d9e/cc7 0 2024-09-13T23:06:13.880 INFO:tasks.workunit.client.0.smithi115.stdout:6/706: dread d4/df/d14/d38/d2a/f90 [0,4194304] 0 2024-09-13T23:06:13.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/605: dwrite d6/fa9 [0,4194304] 0 2024-09-13T23:06:13.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/606: creat d6/da0/fd5 x:0 0 0 2024-09-13T23:06:13.880 INFO:tasks.workunit.client.0.smithi115.stdout:0/607: getdents d6/d24/d25/dc7 0 2024-09-13T23:06:13.881 INFO:tasks.workunit.client.0.smithi115.stdout:4/699: fsync db/d11/d54/d17/fbf 0 2024-09-13T23:06:13.881 INFO:tasks.workunit.client.0.smithi115.stdout:7/618: read da/dd/d1c/f9c [225418,60589] 0 2024-09-13T23:06:13.881 INFO:tasks.workunit.client.0.smithi115.stdout:7/619: truncate da/dd/f59 5220322 0 2024-09-13T23:06:13.884 INFO:tasks.workunit.client.0.smithi115.stdout:9/643: dread d0/f5b [0,4194304] 0 2024-09-13T23:06:13.891 INFO:tasks.workunit.client.0.smithi115.stdout:0/608: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/cd6 0 2024-09-13T23:06:13.892 INFO:tasks.workunit.client.0.smithi115.stdout:5/635: dread d8/dd/d20/d23/f59 [0,4194304] 0 2024-09-13T23:06:13.892 INFO:tasks.workunit.client.0.smithi115.stdout:5/636: stat d8/dd/d20/d4a/c5b 0 2024-09-13T23:06:13.898 INFO:tasks.workunit.client.0.smithi115.stdout:2/693: dwrite da/d23/d2c/fb0 [0,4194304] 0 2024-09-13T23:06:13.905 INFO:tasks.workunit.client.0.smithi115.stdout:4/700: creat db/d16/d3f/d66/d68/d71/d84/fcc x:0 0 0 2024-09-13T23:06:13.907 INFO:tasks.workunit.client.0.smithi115.stdout:3/737: dwrite d3/d5/d35/d71/d3b/d4d/f74 [0,4194304] 0 2024-09-13T23:06:13.908 INFO:tasks.workunit.client.0.smithi115.stdout:7/620: rmdir da/df 39 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/738: dread d3/d5/d5b/fcb [0,4194304] 0 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/739: chown d3/d16/d1a/d1e/d76/f83 12591132 1 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/740: stat d3/d16/d1a/d1e/d8e/fb5 0 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/741: chown d3/d5/d35/d71/d45/d98 42888133 1 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/742: write d3/d16/d1a/d1e/d76/fac [612681,22652] 0 2024-09-13T23:06:13.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/743: fdatasync d3/d16/d1a/d1e/d8e/f8f 0 2024-09-13T23:06:13.911 INFO:tasks.workunit.client.0.smithi115.stdout:5/637: dwrite d8/dd/f46 [0,4194304] 0 2024-09-13T23:06:13.913 INFO:tasks.workunit.client.0.smithi115.stdout:1/630: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:13.913 INFO:tasks.workunit.client.0.smithi115.stdout:1/631: write d0/f3 [6042064,68703] 0 2024-09-13T23:06:13.913 INFO:tasks.workunit.client.0.smithi115.stdout:1/632: dread - d0/de/f9e zero size 2024-09-13T23:06:13.916 INFO:tasks.workunit.client.0.smithi115.stdout:0/609: unlink d6/d24/d25/d2b/d82/d6b/d9f/dab/cd3 0 2024-09-13T23:06:13.921 INFO:tasks.workunit.client.0.smithi115.stdout:6/707: dwrite d4/df/d51/fca [0,4194304] 0 2024-09-13T23:06:13.926 INFO:tasks.workunit.client.0.smithi115.stdout:4/701: unlink db/d16/d3f/d66/da6/cc3 0 2024-09-13T23:06:13.926 INFO:tasks.workunit.client.0.smithi115.stdout:4/702: chown db/d16/d3f/dae/f40 85328 1 2024-09-13T23:06:13.927 INFO:tasks.workunit.client.0.smithi115.stdout:4/703: fdatasync db/d19/d4e/f5b 0 2024-09-13T23:06:13.927 INFO:tasks.workunit.client.0.smithi115.stdout:4/704: chown db/d16/f7e 109108 1 2024-09-13T23:06:13.934 INFO:tasks.workunit.client.0.smithi115.stdout:7/621: creat da/dd/d13/d24/fd3 x:0 0 0 2024-09-13T23:06:13.935 INFO:tasks.workunit.client.0.smithi115.stdout:7/622: chown da/df/f2c 0 1 2024-09-13T23:06:13.937 INFO:tasks.workunit.client.0.smithi115.stdout:3/744: mkdir d3/d5/d35/d71/d45/dfb 0 2024-09-13T23:06:13.937 INFO:tasks.workunit.client.0.smithi115.stdout:3/745: write d3/d5/d65/da8/fe6 [1061106,93655] 0 2024-09-13T23:06:13.937 INFO:tasks.workunit.client.0.smithi115.stdout:3/746: write d3/d5/d65/da8/fc1 [394205,48336] 0 2024-09-13T23:06:13.938 INFO:tasks.workunit.client.0.smithi115.stdout:8/733: sync 2024-09-13T23:06:14.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: pgmap v245: 65 pgs: 65 active+clean; 1018 MiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 115 MiB/s rd, 141 MiB/s wr, 821 op/s 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr fail", "who": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: Activating manager daemon smithi152.ntylos 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T23:06:14.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.14206 172.21.15.115:0/2061016621' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "mgr fail", "who": "smithi115.eqesbc"}]': finished 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: mgrmap e21: smithi152.ntylos(active, starting, since 0.0171884s) 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:06:14.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: Manager daemon smithi152.ntylos is now available 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:14.039 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:13 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/83: sync 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/84: creat d3/d1e/f1f x:0 0 0 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/85: dread - d3/d1e/f1f zero size 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/86: creat d3/d5/f20 x:0 0 0 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/87: link d3/d1e/f1f d3/d1e/f21 0 2024-09-13T23:06:14.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/88: mknod d3/d5/c22 0 2024-09-13T23:06:14.051 INFO:tasks.workunit.client.0.smithi115.stdout:1/633: rename d0/de/d1b/d25/d4d/lc0 to d0/dd/lca 0 2024-09-13T23:06:14.055 INFO:tasks.workunit.client.0.smithi115.stdout:6/708: mknod d4/df/d14/cee 0 2024-09-13T23:06:14.059 INFO:tasks.workunit.client.0.smithi115.stdout:2/694: rmdir da/d21/d8c/d41 39 2024-09-13T23:06:14.059 INFO:tasks.workunit.client.0.smithi115.stdout:2/695: readlink da/d21/l2a 0 2024-09-13T23:06:14.060 INFO:tasks.workunit.client.0.smithi115.stdout:4/705: rmdir db/d16/d3f/db0 0 2024-09-13T23:06:14.061 INFO:tasks.workunit.client.0.smithi115.stdout:7/623: getdents da/dd 0 2024-09-13T23:06:14.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/89: dwrite d3/ff [0,4194304] 0 2024-09-13T23:06:14.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/90: chown d3/l14 14833 1 2024-09-13T23:06:14.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/91: fsync d3/f15 0 2024-09-13T23:06:14.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/92: chown d3/d1e/f1f 162589 1 2024-09-13T23:06:14.063 INFO:tasks.workunit.client.1.smithi152.stdout:9/93: creat d3/f23 x:0 0 0 2024-09-13T23:06:14.063 INFO:tasks.workunit.client.1.smithi152.stdout:9/94: chown d3/c7 523 1 2024-09-13T23:06:14.065 INFO:tasks.workunit.client.0.smithi115.stdout:3/747: symlink d3/d5/d35/d71/d42/lfc 0 2024-09-13T23:06:14.065 INFO:tasks.workunit.client.0.smithi115.stdout:3/748: dread - d3/d5/d5b/fb3 zero size 2024-09-13T23:06:14.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/734: link d3/d5/dc/d16/d1f/d27/d68/d98/fc2 d3/d5/dc/d23/d4e/d54/d7f/de9/f106 0 2024-09-13T23:06:14.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/735: readlink d3/d5/dc/d23/d4e/l71 0 2024-09-13T23:06:14.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/736: fdatasync d3/d5/f3d 0 2024-09-13T23:06:14.071 INFO:tasks.workunit.client.0.smithi115.stdout:3/749: dread d3/d5/d35/d71/d3b/d47/d28/fe0 [0,4194304] 0 2024-09-13T23:06:14.071 INFO:tasks.workunit.client.0.smithi115.stdout:3/750: chown d3/d5/d65/da8/da4/d49/f67 5144 1 2024-09-13T23:06:14.071 INFO:tasks.workunit.client.1.smithi152.stdout:9/95: rename d3/d5 to d3/d24 0 2024-09-13T23:06:14.072 INFO:tasks.workunit.client.1.smithi152.stdout:9/96: stat d3/c16 0 2024-09-13T23:06:14.073 INFO:tasks.workunit.client.0.smithi115.stdout:0/610: rename d6/d24/d25/d2b/d82/d6b/d9f/cb5 to d6/da5/dd4/cd7 0 2024-09-13T23:06:14.074 INFO:tasks.workunit.client.0.smithi115.stdout:1/634: mkdir d0/de/d66/d8f/d29/d47/d74/dcb 0 2024-09-13T23:06:14.075 INFO:tasks.workunit.client.0.smithi115.stdout:6/709: mkdir d4/df/d14/d38/d44/d99/def 0 2024-09-13T23:06:14.076 INFO:tasks.workunit.client.0.smithi115.stdout:2/696: mkdir da/d21/dec 0 2024-09-13T23:06:14.076 INFO:tasks.workunit.client.0.smithi115.stdout:2/697: readlink da/d23/d2c/dc2/de1/l4f 0 2024-09-13T23:06:14.078 INFO:tasks.workunit.client.0.smithi115.stdout:1/635: creat d0/de/d66/d8f/d29/d47/d74/fcc x:0 0 0 2024-09-13T23:06:14.080 INFO:tasks.workunit.client.0.smithi115.stdout:3/751: read d3/d5/d35/d71/d3b/f7e [641642,93308] 0 2024-09-13T23:06:14.080 INFO:tasks.workunit.client.0.smithi115.stdout:6/710: link d4/df/d14/d38/d2a/d3e/d56/d7b/f53 d4/df/d14/d38/d44/ff0 0 2024-09-13T23:06:14.081 INFO:tasks.workunit.client.0.smithi115.stdout:8/737: getdents d3/d5/dc/d23/d4e/d54/d7f 0 2024-09-13T23:06:14.083 INFO:tasks.workunit.client.0.smithi115.stdout:1/636: creat d0/de/d66/d8f/d29/d47/d74/d9d/da3/fcd x:0 0 0 2024-09-13T23:06:14.083 INFO:tasks.workunit.client.0.smithi115.stdout:1/637: chown d0/de/d1b/d25/d4d/d51/d31/d37/dc8 6 1 2024-09-13T23:06:14.086 INFO:tasks.workunit.client.0.smithi115.stdout:3/752: dread d3/d16/d1a/d1e/ff9 [0,4194304] 0 2024-09-13T23:06:14.087 INFO:tasks.workunit.client.0.smithi115.stdout:8/738: creat d3/d5/dc/d16/f107 x:0 0 0 2024-09-13T23:06:14.089 INFO:tasks.workunit.client.0.smithi115.stdout:8/739: symlink d3/d5/dc/d16/l108 0 2024-09-13T23:06:14.089 INFO:tasks.workunit.client.0.smithi115.stdout:2/698: dread da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:14.090 INFO:tasks.workunit.client.0.smithi115.stdout:1/638: rmdir d0/de/d62 39 2024-09-13T23:06:14.092 INFO:tasks.workunit.client.0.smithi115.stdout:6/711: write d4/f1d [1928775,84810] 0 2024-09-13T23:06:14.092 INFO:tasks.workunit.client.0.smithi115.stdout:6/712: write d4/d57/d5a/d79/d85/dbf/fea [637578,11122] 0 2024-09-13T23:06:14.093 INFO:tasks.workunit.client.0.smithi115.stdout:1/639: creat d0/de/d66/d8f/d29/d47/d74/dcb/fce x:0 0 0 2024-09-13T23:06:14.095 INFO:tasks.workunit.client.0.smithi115.stdout:5/638: sync 2024-09-13T23:06:14.096 INFO:tasks.workunit.client.0.smithi115.stdout:9/644: sync 2024-09-13T23:06:14.096 INFO:tasks.workunit.client.0.smithi115.stdout:9/645: stat d0/d13/d17/d19/lb0 0 2024-09-13T23:06:14.096 INFO:tasks.workunit.client.0.smithi115.stdout:9/646: chown d0/d13/d3b/d42/d95 662289 1 2024-09-13T23:06:14.097 INFO:tasks.workunit.client.0.smithi115.stdout:9/647: mknod d0/d13/d17/dc5/cce 0 2024-09-13T23:06:14.097 INFO:tasks.workunit.client.0.smithi115.stdout:9/648: truncate d0/d13/d17/d1f/d4e/d61/d7d/fa6 277716 0 2024-09-13T23:06:14.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/97: rmdir d3 39 2024-09-13T23:06:14.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/98: chown d3/d24/fb 16 1 2024-09-13T23:06:14.100 INFO:tasks.workunit.client.0.smithi115.stdout:9/649: symlink d0/d13/d17/d1f/d4e/d61/d7d/d98/lcf 0 2024-09-13T23:06:14.100 INFO:tasks.workunit.client.0.smithi115.stdout:8/740: dread d3/d5/f96 [0,4194304] 0 2024-09-13T23:06:14.100 INFO:tasks.workunit.client.0.smithi115.stdout:8/741: readlink d3/d5/dc/laf 0 2024-09-13T23:06:14.100 INFO:tasks.workunit.client.1.smithi152.stdout:9/99: creat d3/d1e/f25 x:0 0 0 2024-09-13T23:06:14.101 INFO:tasks.workunit.client.0.smithi115.stdout:8/742: dread d3/d5/dc/d16/d1f/d27/d79/fb4 [0,4194304] 0 2024-09-13T23:06:14.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/100: getdents d3 0 2024-09-13T23:06:14.103 INFO:tasks.workunit.client.1.smithi152.stdout:9/101: symlink d3/d24/l26 0 2024-09-13T23:06:14.103 INFO:tasks.workunit.client.1.smithi152.stdout:9/102: write d3/d1e/f21 [467816,31958] 0 2024-09-13T23:06:14.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/743: link d3/c18 d3/d5/dc/d16/d1f/d28/c109 0 2024-09-13T23:06:14.105 INFO:tasks.workunit.client.0.smithi115.stdout:8/744: write d3/d5/dc/d16/d1f/d27/d79/da0/fd0 [61138,2190] 0 2024-09-13T23:06:14.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/103: symlink d3/d24/l27 0 2024-09-13T23:06:14.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/104: chown d3/d24/cc 38065328 1 2024-09-13T23:06:14.109 INFO:tasks.workunit.client.0.smithi115.stdout:6/713: dread d4/df/d14/d38/d2a/f33 [4194304,4194304] 0 2024-09-13T23:06:14.112 INFO:tasks.workunit.client.0.smithi115.stdout:6/714: unlink d4/df/d14/d38/d2a/l71 0 2024-09-13T23:06:14.118 INFO:tasks.workunit.client.0.smithi115.stdout:5/639: write d8/dd/d6a/d82/d63/f44 [3940969,47554] 0 2024-09-13T23:06:14.118 INFO:tasks.workunit.client.0.smithi115.stdout:0/611: dwrite d6/d24/d25/d58/f7e [0,4194304] 0 2024-09-13T23:06:14.128 INFO:tasks.workunit.client.0.smithi115.stdout:2/699: dwrite f4 [0,4194304] 0 2024-09-13T23:06:14.129 INFO:tasks.workunit.client.0.smithi115.stdout:2/700: chown da/d21/l2a 15409354 1 2024-09-13T23:06:14.129 INFO:tasks.workunit.client.0.smithi115.stdout:2/701: chown da/d23/d2c/dc2/de1/d56/d1a/f44 36505831 1 2024-09-13T23:06:14.129 INFO:tasks.workunit.client.0.smithi115.stdout:6/715: dread d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:14.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/716: mknod d4/df/d14/d38/d44/d99/def/cf1 0 2024-09-13T23:06:14.132 INFO:tasks.workunit.client.0.smithi115.stdout:6/717: symlink d4/d57/d5a/lf2 0 2024-09-13T23:06:14.134 INFO:tasks.workunit.client.0.smithi115.stdout:5/640: dread d8/dd/d14/f94 [0,4194304] 0 2024-09-13T23:06:14.135 INFO:tasks.workunit.client.0.smithi115.stdout:6/718: mknod d4/d57/d5a/d79/d85/dbf/cf3 0 2024-09-13T23:06:14.135 INFO:tasks.workunit.client.0.smithi115.stdout:6/719: fsync d4/df/d14/d38/d44/d66/fac 0 2024-09-13T23:06:14.137 INFO:tasks.workunit.client.0.smithi115.stdout:5/641: unlink d8/cad 0 2024-09-13T23:06:14.137 INFO:tasks.workunit.client.0.smithi115.stdout:5/642: dread - d8/dd/d6a/d8a/f9f zero size 2024-09-13T23:06:14.138 INFO:tasks.workunit.client.0.smithi115.stdout:6/720: creat d4/df/d14/d38/d2a/d3e/d56/ff4 x:0 0 0 2024-09-13T23:06:14.139 INFO:tasks.workunit.client.0.smithi115.stdout:6/721: dread d4/df/d14/d38/d2a/d31/d5b/d88/fb8 [0,4194304] 0 2024-09-13T23:06:14.139 INFO:tasks.workunit.client.0.smithi115.stdout:6/722: write d4/df/d14/d38/d2a/d31/f34 [3287452,100507] 0 2024-09-13T23:06:14.140 INFO:tasks.workunit.client.0.smithi115.stdout:5/643: rmdir d8/dd/d5d/d5e/da8 0 2024-09-13T23:06:14.140 INFO:tasks.workunit.client.0.smithi115.stdout:5/644: chown d8/dd/d20/d27/f72 18 1 2024-09-13T23:06:14.140 INFO:tasks.workunit.client.0.smithi115.stdout:5/645: chown d8/dd/l22 6 1 2024-09-13T23:06:14.148 INFO:tasks.workunit.client.0.smithi115.stdout:2/702: write da/d23/d2c/dc2/de1/d56/f45 [2768588,31653] 0 2024-09-13T23:06:14.149 INFO:tasks.workunit.client.0.smithi115.stdout:1/640: dwrite d0/de/d66/d8f/d29/d47/d6a/f7a [0,4194304] 0 2024-09-13T23:06:14.150 INFO:tasks.workunit.client.0.smithi115.stdout:9/650: dwrite d0/d13/d17/d1f/f70 [8388608,4194304] 0 2024-09-13T23:06:14.151 INFO:tasks.workunit.client.0.smithi115.stdout:1/641: getdents d0/de/d71 0 2024-09-13T23:06:14.152 INFO:tasks.workunit.client.0.smithi115.stdout:9/651: unlink d0/d13/f79 0 2024-09-13T23:06:14.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/753: dwrite d3/d5/d5b/dd2/fed [0,4194304] 0 2024-09-13T23:06:14.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/754: fsync d3/d5/d65/da8/da4/f62 0 2024-09-13T23:06:14.154 INFO:tasks.workunit.client.0.smithi115.stdout:3/755: readlink d3/d5/d35/d4c/l75 0 2024-09-13T23:06:14.154 INFO:tasks.workunit.client.0.smithi115.stdout:1/642: link d0/de/d1b/d25/d4d/d51/d31/f53 d0/de/d66/d8f/d29/d47/d63/dac/dc7/fcf 0 2024-09-13T23:06:14.156 INFO:tasks.workunit.client.0.smithi115.stdout:3/756: write d3/d5/d65/da8/fa2 [1321978,84333] 0 2024-09-13T23:06:14.163 INFO:tasks.workunit.client.0.smithi115.stdout:2/703: dread da/d21/f5f [0,4194304] 0 2024-09-13T23:06:14.169 INFO:tasks.workunit.client.0.smithi115.stdout:9/652: dread d0/d13/d17/d1f/f70 [4194304,4194304] 0 2024-09-13T23:06:14.172 INFO:tasks.workunit.client.0.smithi115.stdout:3/757: dread d3/d5/d35/d71/d3b/d4d/f74 [0,4194304] 0 2024-09-13T23:06:14.172 INFO:tasks.workunit.client.0.smithi115.stdout:3/758: chown d3/d5 3024 1 2024-09-13T23:06:14.174 INFO:tasks.workunit.client.0.smithi115.stdout:2/704: write da/d21/f5f [7830170,51549] 0 2024-09-13T23:06:14.176 INFO:tasks.workunit.client.0.smithi115.stdout:2/705: mkdir da/d23/d2c/dc2/de1/d48/ded 0 2024-09-13T23:06:14.177 INFO:tasks.workunit.client.0.smithi115.stdout:2/706: chown da/l3e 0 1 2024-09-13T23:06:14.177 INFO:tasks.workunit.client.0.smithi115.stdout:2/707: write da/d21/f5b [1107501,130197] 0 2024-09-13T23:06:14.177 INFO:tasks.workunit.client.0.smithi115.stdout:9/653: dread d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:14.178 INFO:tasks.workunit.client.0.smithi115.stdout:8/745: dwrite d3/d5/f44 [0,4194304] 0 2024-09-13T23:06:14.178 INFO:tasks.workunit.client.0.smithi115.stdout:8/746: chown d3/d5/dc/d23/d4e/d54/d7f/de9/f15 49145628 1 2024-09-13T23:06:14.178 INFO:tasks.workunit.client.0.smithi115.stdout:8/747: write d3/d5/d1c/d41/f80 [444168,58823] 0 2024-09-13T23:06:14.178 INFO:tasks.workunit.client.0.smithi115.stdout:8/748: chown d3/d5/dc/d23/f2d 19022297 1 2024-09-13T23:06:14.178 INFO:tasks.workunit.client.0.smithi115.stdout:2/708: truncate da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/fe6 963550 0 2024-09-13T23:06:14.182 INFO:tasks.workunit.client.0.smithi115.stdout:9/654: mkdir d0/d13/d17/d1f/d28/d76/d81/dd0 0 2024-09-13T23:06:14.182 INFO:tasks.workunit.client.0.smithi115.stdout:9/655: write d0/d13/d17/d36/d80/f87 [1063283,114015] 0 2024-09-13T23:06:14.183 INFO:tasks.workunit.client.1.smithi152.stdout:9/105: dwrite d3/f15 [0,4194304] 0 2024-09-13T23:06:14.183 INFO:tasks.workunit.client.1.smithi152.stdout:9/106: stat d3/c16 0 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:8/749: symlink d3/l10a 0 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/723: dwrite d4/df/d14/d38/d44/d99/fc6 [0,4194304] 0 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:6/724: dread - d4/d57/fbe zero size 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/646: dwrite d8/dd/d14/f95 [0,4194304] 0 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/647: read - d8/dd/d6a/d82/d63/f8b zero size 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/648: read - d8/fbc zero size 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/649: fsync d8/dd/d6a/d82/d63/f8b 0 2024-09-13T23:06:14.184 INFO:tasks.workunit.client.0.smithi115.stdout:5/650: fsync d8/d7a/fc1 0 2024-09-13T23:06:14.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/709: mknod da/d23/d2c/dc2/de1/cee 0 2024-09-13T23:06:14.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/710: dread - da/d21/da8/fb7 zero size 2024-09-13T23:06:14.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/711: fsync da/d21/da8/fb6 0 2024-09-13T23:06:14.187 INFO:tasks.workunit.client.0.smithi115.stdout:2/712: write da/d23/d2c/f96 [1077342,12021] 0 2024-09-13T23:06:14.189 INFO:tasks.workunit.client.1.smithi152.stdout:3/8: sync 2024-09-13T23:06:14.189 INFO:tasks.workunit.client.1.smithi152.stdout:3/9: write - no filename 2024-09-13T23:06:14.189 INFO:tasks.workunit.client.1.smithi152.stdout:3/10: dwrite - no filename 2024-09-13T23:06:14.189 INFO:tasks.workunit.client.0.smithi115.stdout:6/725: mknod d4/df/d14/d38/d2a/d31/d5b/d88/d9f/cf5 0 2024-09-13T23:06:14.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/11: mknod c0 0 2024-09-13T23:06:14.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/12: truncate - no filename 2024-09-13T23:06:14.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/13: truncate - no filename 2024-09-13T23:06:14.194 INFO:tasks.workunit.client.1.smithi152.stdout:3/14: stat c0 0 2024-09-13T23:06:14.195 INFO:tasks.workunit.client.0.smithi115.stdout:2/713: creat da/d23/d2c/dc2/fef x:0 0 0 2024-09-13T23:06:14.195 INFO:tasks.workunit.client.0.smithi115.stdout:2/714: readlink da/d21/da8/dbc/le0 0 2024-09-13T23:06:14.195 INFO:tasks.workunit.client.0.smithi115.stdout:2/715: chown da/d21/d8c/d41/d62/fce 61 1 2024-09-13T23:06:14.195 INFO:tasks.workunit.client.0.smithi115.stdout:2/716: chown da/d23/d2c/dc2/de1/d56/d4b/l92 196439847 1 2024-09-13T23:06:14.195 INFO:tasks.workunit.client.0.smithi115.stdout:6/726: symlink d4/d57/dab/lf6 0 2024-09-13T23:06:14.197 INFO:tasks.workunit.client.0.smithi115.stdout:2/717: mkdir da/d23/d2c/dc2/de1/d56/df0 0 2024-09-13T23:06:14.197 INFO:tasks.workunit.client.0.smithi115.stdout:2/718: write da/fde [351497,102619] 0 2024-09-13T23:06:14.197 INFO:tasks.workunit.client.0.smithi115.stdout:2/719: chown da/d23/d2c/dc2/de1/d56/d4b/ca5 1755268 1 2024-09-13T23:06:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/15: rename c0 to c1 0 2024-09-13T23:06:14.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/16: fdatasync - no filename 2024-09-13T23:06:14.199 INFO:tasks.workunit.client.0.smithi115.stdout:6/727: mkdir d4/df/d14/d67/d77/dcf/de8/df7 0 2024-09-13T23:06:14.200 INFO:tasks.workunit.client.0.smithi115.stdout:0/612: dwrite d6/d24/d25/da7/fc3 [0,4194304] 0 2024-09-13T23:06:14.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/643: dwrite d0/de/d66/d8f/d29/d47/d63/dac/dc7/fcf [0,4194304] 0 2024-09-13T23:06:14.200 INFO:tasks.workunit.client.0.smithi115.stdout:1/644: chown d0/de/d1b/d25/d4d/d51/d23/d65/db6 29043653 1 2024-09-13T23:06:14.200 INFO:tasks.workunit.client.0.smithi115.stdout:3/759: dwrite d3/d5/d35/d71/f44 [4194304,4194304] 0 2024-09-13T23:06:14.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/17: creat f2 x:0 0 0 2024-09-13T23:06:14.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/18: chown c1 6 1 2024-09-13T23:06:14.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/19: truncate f2 17456 0 2024-09-13T23:06:14.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/20: creat f3 x:0 0 0 2024-09-13T23:06:14.202 INFO:tasks.workunit.client.0.smithi115.stdout:0/613: dread d6/d24/d25/d2b/d82/f48 [0,4194304] 0 2024-09-13T23:06:14.203 INFO:tasks.workunit.client.0.smithi115.stdout:6/728: mkdir d4/df/df8 0 2024-09-13T23:06:14.203 INFO:tasks.workunit.client.0.smithi115.stdout:6/729: write d4/df/d14/d38/d2a/fb2 [1064078,42546] 0 2024-09-13T23:06:14.203 INFO:tasks.workunit.client.1.smithi152.stdout:3/21: dread f2 [0,4194304] 0 2024-09-13T23:06:14.205 INFO:tasks.workunit.client.1.smithi152.stdout:3/22: mknod c4 0 2024-09-13T23:06:14.205 INFO:tasks.workunit.client.1.smithi152.stdout:3/23: chown c4 1 1 2024-09-13T23:06:14.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/645: mknod d0/de/d1b/cd0 0 2024-09-13T23:06:14.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/646: write d0/de/d62/f84 [1414824,84793] 0 2024-09-13T23:06:14.206 INFO:tasks.workunit.client.0.smithi115.stdout:1/647: stat d0/de/d66/d8f/d29/d47/d63/dac 0 2024-09-13T23:06:14.207 INFO:tasks.workunit.client.1.smithi152.stdout:3/24: link c4 c5 0 2024-09-13T23:06:14.207 INFO:tasks.workunit.client.1.smithi152.stdout:3/25: truncate f2 292345 0 2024-09-13T23:06:14.210 INFO:tasks.workunit.client.1.smithi152.stdout:3/26: symlink l6 0 2024-09-13T23:06:14.211 INFO:tasks.workunit.client.0.smithi115.stdout:0/614: rename d6/d24/d25/d2b/d82/d44/d5c/d87/cd6 to d6/d24/d25/d2b/d82/d44/cd8 0 2024-09-13T23:06:14.211 INFO:tasks.workunit.client.0.smithi115.stdout:0/615: write d6/d24/d25/d2b/d82/d44/f55 [1593216,4767] 0 2024-09-13T23:06:14.212 INFO:tasks.workunit.client.1.smithi152.stdout:3/27: mknod c7 0 2024-09-13T23:06:14.212 INFO:tasks.workunit.client.1.smithi152.stdout:3/28: write f2 [1144904,108725] 0 2024-09-13T23:06:14.213 INFO:tasks.workunit.client.0.smithi115.stdout:6/730: mknod d4/df/d14/d76/cf9 0 2024-09-13T23:06:14.213 INFO:tasks.workunit.client.0.smithi115.stdout:6/731: readlink d4/df/d14/d38/d2a/d31/d5b/le7 0 2024-09-13T23:06:14.213 INFO:tasks.workunit.client.0.smithi115.stdout:6/732: creat d4/df/d14/d35/ffa x:0 0 0 2024-09-13T23:06:14.217 INFO:tasks.workunit.client.0.smithi115.stdout:0/616: mkdir d6/da0/dd9 0 2024-09-13T23:06:14.217 INFO:tasks.workunit.client.0.smithi115.stdout:6/733: truncate d4/df/d14/d38/d44/d66/d8b/f98 2635303 0 2024-09-13T23:06:14.217 INFO:tasks.workunit.client.0.smithi115.stdout:0/617: chown d6/d24/d25/d58/f92 0 1 2024-09-13T23:06:14.217 INFO:tasks.workunit.client.0.smithi115.stdout:0/618: write d6/f20 [1383873,42192] 0 2024-09-13T23:06:14.217 INFO:tasks.workunit.client.0.smithi115.stdout:0/619: chown d6/d24/d25/d2b/d82/d6b/d9f/f83 1264 1 2024-09-13T23:06:14.218 INFO:tasks.workunit.client.0.smithi115.stdout:0/620: fsync d6/d24/d25/d2b/d82/d44/fd2 0 2024-09-13T23:06:14.219 INFO:tasks.workunit.client.0.smithi115.stdout:6/734: creat d4/df/d14/d38/d2a/dba/ffb x:0 0 0 2024-09-13T23:06:14.219 INFO:tasks.workunit.client.0.smithi115.stdout:6/735: creat d4/df/d14/d38/d44/ffc x:0 0 0 2024-09-13T23:06:14.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/29: write f2 [213295,29937] 0 2024-09-13T23:06:14.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/30: write f2 [214765,27036] 0 2024-09-13T23:06:14.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/31: creat f8 x:0 0 0 2024-09-13T23:06:14.221 INFO:tasks.workunit.client.0.smithi115.stdout:0/621: unlink d6/c23 0 2024-09-13T23:06:14.221 INFO:tasks.workunit.client.0.smithi115.stdout:0/622: creat d6/da0/fda x:0 0 0 2024-09-13T23:06:14.222 INFO:tasks.workunit.client.0.smithi115.stdout:1/648: dread d0/de/d66/d8f/d29/d47/d63/fb8 [0,4194304] 0 2024-09-13T23:06:14.223 INFO:tasks.workunit.client.0.smithi115.stdout:0/623: creat d6/da5/dd4/fdb x:0 0 0 2024-09-13T23:06:14.224 INFO:tasks.workunit.client.0.smithi115.stdout:0/624: creat d6/d24/fdc x:0 0 0 2024-09-13T23:06:14.224 INFO:tasks.workunit.client.0.smithi115.stdout:0/625: chown d6/f4d 48 1 2024-09-13T23:06:14.225 INFO:tasks.workunit.client.0.smithi115.stdout:0/626: stat d6/cc 0 2024-09-13T23:06:14.225 INFO:tasks.workunit.client.0.smithi115.stdout:0/627: mkdir d6/d24/d25/ddd 0 2024-09-13T23:06:14.231 INFO:tasks.workunit.client.0.smithi115.stdout:8/750: dwrite d3/d5/d1c/fd2 [0,4194304] 0 2024-09-13T23:06:14.233 INFO:tasks.workunit.client.0.smithi115.stdout:8/751: dread d3/d5/dc/d23/d4e/d54/d7f/f9d [0,4194304] 0 2024-09-13T23:06:14.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/656: dwrite d0/d43/f7e [0,4194304] 0 2024-09-13T23:06:14.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/657: read - d0/d13/d17/d1f/d77/f93 zero size 2024-09-13T23:06:14.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/658: write d0/d13/d17/d1f/d67/fbb [3581482,108441] 0 2024-09-13T23:06:14.235 INFO:tasks.workunit.client.0.smithi115.stdout:9/659: write d0/d13/d17/d1f/d4e/d61/d7d/fa6 [423737,107824] 0 2024-09-13T23:06:14.235 INFO:tasks.workunit.client.1.smithi152.stdout:9/107: dwrite d3/d24/fb [0,4194304] 0 2024-09-13T23:06:14.236 INFO:tasks.workunit.client.1.smithi152.stdout:9/108: fdatasync d3/f1c 0 2024-09-13T23:06:14.236 INFO:tasks.workunit.client.1.smithi152.stdout:9/109: dread - d3/d1e/f25 zero size 2024-09-13T23:06:14.236 INFO:tasks.workunit.client.0.smithi115.stdout:8/752: creat d3/d5/dc/d23/d4e/d54/d7f/de9/df4/f10b x:0 0 0 2024-09-13T23:06:14.236 INFO:tasks.workunit.client.0.smithi115.stdout:3/760: dwrite d3/d16/d1a/f26 [0,4194304] 0 2024-09-13T23:06:14.236 INFO:tasks.workunit.client.0.smithi115.stdout:1/649: dread d0/de/d1b/d25/d4d/d51/d31/d37/f3b [0,4194304] 0 2024-09-13T23:06:14.239 INFO:tasks.workunit.client.0.smithi115.stdout:5/651: dwrite d8/dd/f5f [0,4194304] 0 2024-09-13T23:06:14.240 INFO:tasks.workunit.client.0.smithi115.stdout:0/628: read d6/d24/d25/da7/fc3 [1245792,58210] 0 2024-09-13T23:06:14.244 INFO:tasks.workunit.client.0.smithi115.stdout:1/650: symlink d0/de/d66/ld1 0 2024-09-13T23:06:14.244 INFO:tasks.workunit.client.0.smithi115.stdout:3/761: rmdir d3/d5/d35/d71/d42 39 2024-09-13T23:06:14.249 INFO:tasks.workunit.client.0.smithi115.stdout:6/736: dread d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/fd2 [0,4194304] 0 2024-09-13T23:06:14.249 INFO:tasks.workunit.client.0.smithi115.stdout:6/737: chown d4/df/d14/d38/d2a/d3e/d56/d7b 0 1 2024-09-13T23:06:14.249 INFO:tasks.workunit.client.0.smithi115.stdout:5/652: link d8/dd/d14/c53 d8/dd/d20/d27/cc8 0 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/651: creat d0/de/fd2 x:0 0 0 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/652: write d0/de/d66/d8f/d29/d47/d6a/d80/f9a [1195489,49476] 0 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/653: rename d0/de/d66/d8f/d29/d47 to d0/de/d66/d8f/d29/d47/d74/d9d/dd3 22 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/654: fsync d0/de/d1b/f99 0 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:2/720: dwrite da/d21/f72 [0,4194304] 0 2024-09-13T23:06:14.250 INFO:tasks.workunit.client.0.smithi115.stdout:1/655: creat d0/de/d66/d8f/d29/d9c/fd4 x:0 0 0 2024-09-13T23:06:14.252 INFO:tasks.workunit.client.0.smithi115.stdout:6/738: creat d4/df/d14/d67/ffd x:0 0 0 2024-09-13T23:06:14.253 INFO:tasks.workunit.client.1.smithi152.stdout:3/32: dread f2 [0,4194304] 0 2024-09-13T23:06:14.253 INFO:tasks.workunit.client.1.smithi152.stdout:3/33: readlink l6 0 2024-09-13T23:06:14.253 INFO:tasks.workunit.client.1.smithi152.stdout:3/34: write f3 [109774,85308] 0 2024-09-13T23:06:14.253 INFO:tasks.workunit.client.1.smithi152.stdout:3/35: chown c4 8984556 1 2024-09-13T23:06:14.258 INFO:tasks.workunit.client.0.smithi115.stdout:5/653: creat d8/dd/d64/dc5/fc9 x:0 0 0 2024-09-13T23:06:14.267 INFO:tasks.workunit.client.0.smithi115.stdout:2/721: unlink da/d23/d2c/f9a 0 2024-09-13T23:06:14.268 INFO:tasks.workunit.client.0.smithi115.stdout:2/722: read da/d23/d2c/dc2/de1/d56/d1a/f44 [30091,15670] 0 2024-09-13T23:06:14.276 INFO:tasks.workunit.client.0.smithi115.stdout:5/654: unlink d8/dd/d20/d23/f3e 0 2024-09-13T23:06:14.276 INFO:tasks.workunit.client.0.smithi115.stdout:2/723: mkdir da/d23/d2c/dc2/de1/d56/d1a/d7f/df1 0 2024-09-13T23:06:14.278 INFO:tasks.workunit.client.0.smithi115.stdout:5/655: getdents d8/dd/d20/d4a 0 2024-09-13T23:06:14.279 INFO:tasks.workunit.client.0.smithi115.stdout:5/656: truncate d8/dd/f46 4597549 0 2024-09-13T23:06:14.279 INFO:tasks.workunit.client.0.smithi115.stdout:2/724: dread da/d23/d2c/dc2/de1/d56/d4b/f8f [0,4194304] 0 2024-09-13T23:06:14.279 INFO:tasks.workunit.client.0.smithi115.stdout:5/657: truncate d8/dd/f5c 676164 0 2024-09-13T23:06:14.280 INFO:tasks.workunit.client.0.smithi115.stdout:2/725: stat da/d23/d2c/dc2/de1/l4f 0 2024-09-13T23:06:14.281 INFO:tasks.workunit.client.0.smithi115.stdout:5/658: creat d8/dd/d74/fca x:0 0 0 2024-09-13T23:06:14.282 INFO:tasks.workunit.client.0.smithi115.stdout:2/726: creat da/d23/d2c/dc2/de1/d56/dda/ff2 x:0 0 0 2024-09-13T23:06:14.282 INFO:tasks.workunit.client.0.smithi115.stdout:5/659: rmdir d8/dd/d64 39 2024-09-13T23:06:14.283 INFO:tasks.workunit.client.0.smithi115.stdout:5/660: stat d8/dd/d20/dbb/c61 0 2024-09-13T23:06:14.285 INFO:tasks.workunit.client.0.smithi115.stdout:0/629: dwrite d6/da0/fa2 [0,4194304] 0 2024-09-13T23:06:14.286 INFO:tasks.workunit.client.0.smithi115.stdout:5/661: dread d8/fa2 [0,4194304] 0 2024-09-13T23:06:14.286 INFO:tasks.workunit.client.0.smithi115.stdout:0/630: write d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe [264588,99982] 0 2024-09-13T23:06:14.287 INFO:tasks.workunit.client.0.smithi115.stdout:2/727: write da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/fe6 [117017,88998] 0 2024-09-13T23:06:14.287 INFO:tasks.workunit.client.0.smithi115.stdout:2/728: read - da/d21/da8/fb7 zero size 2024-09-13T23:06:14.289 INFO:tasks.workunit.client.0.smithi115.stdout:5/662: getdents d8/dd/d6a/d8a 0 2024-09-13T23:06:14.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/631: rename d6/d24/d25/d2b/d82/d44/d5c/d87/da4/fcd to d6/d24/d25/d2b/d82/d44/d5c/d87/fde 0 2024-09-13T23:06:14.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/632: creat d6/d24/d25/d2b/fdf x:0 0 0 2024-09-13T23:06:14.292 INFO:tasks.workunit.client.0.smithi115.stdout:0/633: fsync d6/d24/d25/da3/dad/f9b 0 2024-09-13T23:06:14.296 INFO:tasks.workunit.client.0.smithi115.stdout:0/634: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/ce0 0 2024-09-13T23:06:14.298 INFO:tasks.workunit.client.0.smithi115.stdout:0/635: mknod d6/d24/d25/d2b/d82/d6b/d9f/dab/ce1 0 2024-09-13T23:06:14.298 INFO:tasks.workunit.client.0.smithi115.stdout:0/636: fsync d6/d24/d25/d7f/f89 0 2024-09-13T23:06:14.298 INFO:tasks.workunit.client.0.smithi115.stdout:0/637: rename d6/d24/d25/d2b to d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/de2 22 2024-09-13T23:06:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:3/762: dwrite d3/f1b [0,4194304] 0 2024-09-13T23:06:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:3/763: write d3/d5/d35/d71/d3b/d47/f86 [3874536,122524] 0 2024-09-13T23:06:14.304 INFO:tasks.workunit.client.0.smithi115.stdout:3/764: fsync d3/d5/d35/d71/d3b/fda 0 2024-09-13T23:06:14.305 INFO:tasks.workunit.client.0.smithi115.stdout:3/765: write d3/d5/d35/d71/f44 [1623754,22652] 0 2024-09-13T23:06:14.307 INFO:tasks.workunit.client.0.smithi115.stdout:3/766: chown d3/d5/d35/d71/d45/d59/l82 13570 1 2024-09-13T23:06:14.308 INFO:tasks.workunit.client.0.smithi115.stdout:3/767: getdents d3/d16/dab 0 2024-09-13T23:06:14.315 INFO:tasks.workunit.client.0.smithi115.stdout:1/656: dwrite d0/de/d66/d8f/d29/d47/d63/f6b [0,4194304] 0 2024-09-13T23:06:14.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/657: truncate d0/de/d1b/f26 3720817 0 2024-09-13T23:06:14.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/658: write d0/de/d62/f6c [192934,86187] 0 2024-09-13T23:06:14.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/659: write d0/de/d1b/f7b [661867,110772] 0 2024-09-13T23:06:14.317 INFO:tasks.workunit.client.0.smithi115.stdout:1/660: readlink d0/de/d62/l93 0 2024-09-13T23:06:14.318 INFO:tasks.workunit.client.0.smithi115.stdout:0/638: dwrite d6/d24/d25/d2b/d82/d6b/f7b [0,4194304] 0 2024-09-13T23:06:14.320 INFO:tasks.workunit.client.0.smithi115.stdout:0/639: link d6/d24/d25/d2b/d61/l74 d6/le3 0 2024-09-13T23:06:14.327 INFO:tasks.workunit.client.1.smithi152.stdout:9/110: dwrite d3/ff [4194304,4194304] 0 2024-09-13T23:06:14.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/36: dwrite f8 [0,4194304] 0 2024-09-13T23:06:14.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/37: chown f3 649118 1 2024-09-13T23:06:14.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/38: creat f9 x:0 0 0 2024-09-13T23:06:14.327 INFO:tasks.workunit.client.0.smithi115.stdout:5/663: dwrite d8/dd/d20/d27/fb2 [0,4194304] 0 2024-09-13T23:06:14.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/739: dwrite d4/df/d14/d38/d2a/d31/d5b/d88/fb8 [0,4194304] 0 2024-09-13T23:06:14.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/729: dwrite f7 [4194304,4194304] 0 2024-09-13T23:06:14.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/730: truncate da/d23/d2c/fae 4831431 0 2024-09-13T23:06:14.332 INFO:tasks.workunit.client.1.smithi152.stdout:9/111: creat d3/f28 x:0 0 0 2024-09-13T23:06:14.332 INFO:tasks.workunit.client.1.smithi152.stdout:9/112: fsync d3/d1e/f21 0 2024-09-13T23:06:14.333 INFO:tasks.workunit.client.0.smithi115.stdout:5/664: creat d8/dd/d64/fcb x:0 0 0 2024-09-13T23:06:14.340 INFO:tasks.workunit.client.0.smithi115.stdout:9/660: truncate d0/d13/d17/d36/d80/fc1 1347278 0 2024-09-13T23:06:14.343 INFO:tasks.workunit.client.1.smithi152.stdout:0/54: sync 2024-09-13T23:06:14.343 INFO:tasks.workunit.client.1.smithi152.stdout:4/111: sync 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/55: chown la 18682 1 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/56: creat f15 x:0 0 0 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/57: creat f16 x:0 0 0 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/58: chown fc 0 1 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/59: creat f17 x:0 0 0 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:6/14: sync 2024-09-13T23:06:14.344 INFO:tasks.workunit.client.1.smithi152.stdout:5/38: sync 2024-09-13T23:06:14.345 INFO:tasks.workunit.client.1.smithi152.stdout:1/55: sync 2024-09-13T23:06:14.346 INFO:tasks.workunit.client.1.smithi152.stdout:8/29: sync 2024-09-13T23:06:14.346 INFO:tasks.workunit.client.1.smithi152.stdout:3/39: write f8 [1157791,20655] 0 2024-09-13T23:06:14.347 INFO:tasks.workunit.client.1.smithi152.stdout:0/60: mkdir d18 0 2024-09-13T23:06:14.347 INFO:tasks.workunit.client.1.smithi152.stdout:0/61: truncate f14 450843 0 2024-09-13T23:06:14.348 INFO:tasks.workunit.client.1.smithi152.stdout:0/62: write ff [848885,47824] 0 2024-09-13T23:06:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:0/63: stat ff 0 2024-09-13T23:06:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/15: mkdir d4 0 2024-09-13T23:06:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:5/39: truncate d5/f7 1272846 0 2024-09-13T23:06:14.349 INFO:tasks.workunit.client.1.smithi152.stdout:8/30: symlink la 0 2024-09-13T23:06:14.350 INFO:tasks.workunit.client.1.smithi152.stdout:3/40: symlink la 0 2024-09-13T23:06:14.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/40: getdents d5 0 2024-09-13T23:06:14.356 INFO:tasks.workunit.client.0.smithi115.stdout:9/661: dread d0/d13/d3b/f97 [0,4194304] 0 2024-09-13T23:06:14.362 INFO:tasks.workunit.client.1.smithi152.stdout:1/56: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:14.368 INFO:tasks.workunit.client.0.smithi115.stdout:2/731: dwrite da/d77/d83/fa4 [0,4194304] 0 2024-09-13T23:06:14.374 INFO:tasks.workunit.client.0.smithi115.stdout:2/732: link da/d21/d8c/d41/d69/f50 da/d23/d2c/dc2/de1/d48/ff3 0 2024-09-13T23:06:14.376 INFO:tasks.workunit.client.0.smithi115.stdout:5/665: dwrite d8/dd/d20/f52 [0,4194304] 0 2024-09-13T23:06:14.376 INFO:tasks.workunit.client.0.smithi115.stdout:5/666: write d8/d7a/f7e [494132,43210] 0 2024-09-13T23:06:14.381 INFO:tasks.workunit.client.0.smithi115.stdout:2/733: dread da/d23/d2c/dc2/de1/f54 [0,4194304] 0 2024-09-13T23:06:14.381 INFO:tasks.workunit.client.0.smithi115.stdout:5/667: creat d8/dd/d6a/d8a/fcc x:0 0 0 2024-09-13T23:06:14.385 INFO:tasks.workunit.client.1.smithi152.stdout:9/113: dwrite d3/f28 [0,4194304] 0 2024-09-13T23:06:14.385 INFO:tasks.workunit.client.1.smithi152.stdout:9/114: chown d3/d24/l18 24542845 1 2024-09-13T23:06:14.386 INFO:tasks.workunit.client.0.smithi115.stdout:2/734: link da/d23/d2c/dc2/de1/d48/lc5 da/d23/d2c/dc2/de1/lf4 0 2024-09-13T23:06:14.386 INFO:tasks.workunit.client.0.smithi115.stdout:6/740: rmdir d4/df/d14 39 2024-09-13T23:06:14.387 INFO:tasks.workunit.client.1.smithi152.stdout:9/115: symlink d3/d1e/l29 0 2024-09-13T23:06:14.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/116: chown d3/d24/l27 1592 1 2024-09-13T23:06:14.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/117: truncate d3/f23 813486 0 2024-09-13T23:06:14.389 INFO:tasks.workunit.client.0.smithi115.stdout:2/735: mkdir da/d21/da8/df5 0 2024-09-13T23:06:14.390 INFO:tasks.workunit.client.1.smithi152.stdout:9/118: rename d3/fe to d3/d24/f2a 0 2024-09-13T23:06:14.390 INFO:tasks.workunit.client.1.smithi152.stdout:9/119: stat d3/d1e/l29 0 2024-09-13T23:06:14.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/120: rmdir d3/d24 39 2024-09-13T23:06:14.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/121: creat d3/d1e/f2b x:0 0 0 2024-09-13T23:06:14.392 INFO:tasks.workunit.client.0.smithi115.stdout:2/736: write da/d21/f5b [218493,57219] 0 2024-09-13T23:06:14.392 INFO:tasks.workunit.client.1.smithi152.stdout:4/112: dwrite d3/d4/d6/d8/f19 [4194304,4194304] 0 2024-09-13T23:06:14.395 INFO:tasks.workunit.client.0.smithi115.stdout:2/737: rename da/d23/d2c/dc2/de1/f42 to da/d23/d2c/dc2/de1/d56/dda/ff6 0 2024-09-13T23:06:14.395 INFO:tasks.workunit.client.1.smithi152.stdout:0/64: dwrite f0 [0,4194304] 0 2024-09-13T23:06:14.396 INFO:tasks.workunit.client.1.smithi152.stdout:9/122: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:14.396 INFO:tasks.workunit.client.0.smithi115.stdout:9/662: dwrite d0/d13/d17/d1f/d4e/d61/d7d/d98/fcc [0,4194304] 0 2024-09-13T23:06:14.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/41: dwrite f3 [0,4194304] 0 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/113: dread d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/114: truncate d3/d4/d6/f14 604022 0 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/115: dread - d3/d4/d6/d8/f1b zero size 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/116: chown d3/d4/c18 542 1 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:0/65: unlink f15 0 2024-09-13T23:06:14.400 INFO:tasks.workunit.client.1.smithi152.stdout:0/66: getdents d18 0 2024-09-13T23:06:14.402 INFO:tasks.workunit.client.1.smithi152.stdout:4/117: rename d3/d4/d5/cd to d3/d4/d5/c1d 0 2024-09-13T23:06:14.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/42: getdents . 0 2024-09-13T23:06:14.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/43: dread - f9 zero size 2024-09-13T23:06:14.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/67: mkdir d18/d19 0 2024-09-13T23:06:14.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/68: write ff [993710,19768] 0 2024-09-13T23:06:14.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/69: dread - f17 zero size 2024-09-13T23:06:14.405 INFO:tasks.workunit.client.1.smithi152.stdout:1/57: dwrite f0 [0,4194304] 0 2024-09-13T23:06:14.405 INFO:tasks.workunit.client.1.smithi152.stdout:1/58: creat d4/d9/f13 x:0 0 0 2024-09-13T23:06:14.407 INFO:tasks.workunit.client.1.smithi152.stdout:4/118: creat d3/d4/d5/d1c/f1e x:0 0 0 2024-09-13T23:06:14.407 INFO:tasks.workunit.client.1.smithi152.stdout:3/44: rename c4 to cb 0 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.0.smithi115.stdout:2/738: dread da/d23/d2c/dc2/de1/d48/ff3 [0,4194304] 0 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.0.smithi115.stdout:5/668: dwrite d8/dd/d20/d23/f70 [0,4194304] 0 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.0.smithi115.stdout:5/669: truncate d8/dd/d20/d23/f59 1536166 0 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.0.smithi115.stdout:5/670: readlink d8/dd/d20/d4a/la6 0 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/46: sync 2024-09-13T23:06:14.408 INFO:tasks.workunit.client.1.smithi152.stdout:7/52: sync 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/59: unlink f0 0 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/60: truncate d4/d9/f12 528390 0 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/61: readlink l3 0 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/62: creat d4/d9/f14 x:0 0 0 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/63: dread - d4/d9/f13 zero size 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/64: dread - d4/d9/fb zero size 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/65: chown d4/d9 18067 1 2024-09-13T23:06:14.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/66: read - d4/d9/fd zero size 2024-09-13T23:06:14.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/123: dread d3/d24/f2a [0,4194304] 0 2024-09-13T23:06:14.414 INFO:tasks.workunit.client.1.smithi152.stdout:2/47: mknod d0/d8/c13 0 2024-09-13T23:06:14.414 INFO:tasks.workunit.client.1.smithi152.stdout:2/48: truncate d0/fe 559700 0 2024-09-13T23:06:14.414 INFO:tasks.workunit.client.1.smithi152.stdout:1/67: read d4/f7 [1491629,87209] 0 2024-09-13T23:06:14.415 INFO:tasks.workunit.client.1.smithi152.stdout:2/49: mkdir d0/d4/d9/d14 0 2024-09-13T23:06:14.416 INFO:tasks.workunit.client.1.smithi152.stdout:5/41: dread d5/f7 [0,4194304] 0 2024-09-13T23:06:14.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/68: symlink d4/d9/l15 0 2024-09-13T23:06:14.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/69: chown d4/d9/f13 13 1 2024-09-13T23:06:14.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/70: chown d4/cf 0 1 2024-09-13T23:06:14.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/71: truncate d4/d9/f13 988089 0 2024-09-13T23:06:14.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/72: getdents d4/d9/d11 0 2024-09-13T23:06:14.417 INFO:tasks.workunit.client.1.smithi152.stdout:9/124: rmdir d3/d1e 39 2024-09-13T23:06:14.418 INFO:tasks.workunit.client.1.smithi152.stdout:2/50: rename d0/d4/c5 to d0/d4/d9/d14/c15 0 2024-09-13T23:06:14.419 INFO:tasks.workunit.client.1.smithi152.stdout:2/51: stat d0/fa 0 2024-09-13T23:06:14.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/42: creat d5/f8 x:0 0 0 2024-09-13T23:06:14.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/52: dread d0/fe [0,4194304] 0 2024-09-13T23:06:14.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/53: chown d0/f1 108617 1 2024-09-13T23:06:14.421 INFO:tasks.workunit.client.1.smithi152.stdout:9/125: mknod d3/c2c 0 2024-09-13T23:06:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:5/43: mkdir d5/d9 0 2024-09-13T23:06:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:1/73: mkdir d4/d16 0 2024-09-13T23:06:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/126: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/127: stat d3/d24/cc 0 2024-09-13T23:06:14.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/128: write d3/f28 [4723822,50346] 0 2024-09-13T23:06:14.425 INFO:tasks.workunit.client.1.smithi152.stdout:1/74: mknod d4/d9/c17 0 2024-09-13T23:06:14.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/45: write f3 [3525825,105916] 0 2024-09-13T23:06:14.426 INFO:tasks.workunit.client.1.smithi152.stdout:1/75: link d4/cf d4/d9/d11/c18 0 2024-09-13T23:06:14.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/46: truncate f9 504872 0 2024-09-13T23:06:14.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/70: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:14.428 INFO:tasks.workunit.client.1.smithi152.stdout:3/47: truncate f8 2075613 0 2024-09-13T23:06:14.429 INFO:tasks.workunit.client.1.smithi152.stdout:0/71: creat d18/f1a x:0 0 0 2024-09-13T23:06:14.429 INFO:tasks.workunit.client.1.smithi152.stdout:0/72: creat d18/f1b x:0 0 0 2024-09-13T23:06:14.429 INFO:tasks.workunit.client.1.smithi152.stdout:0/73: truncate f10 1162897 0 2024-09-13T23:06:14.430 INFO:tasks.workunit.client.1.smithi152.stdout:0/74: mknod d18/c1c 0 2024-09-13T23:06:14.430 INFO:tasks.workunit.client.1.smithi152.stdout:7/53: write f9 [25909,55437] 0 2024-09-13T23:06:14.431 INFO:tasks.workunit.client.1.smithi152.stdout:3/48: mknod cc 0 2024-09-13T23:06:14.431 INFO:tasks.workunit.client.1.smithi152.stdout:0/75: symlink d18/l1d 0 2024-09-13T23:06:14.432 INFO:tasks.workunit.client.0.smithi115.stdout:4/706: sync 2024-09-13T23:06:14.432 INFO:tasks.workunit.client.0.smithi115.stdout:7/624: sync 2024-09-13T23:06:14.434 INFO:tasks.workunit.client.1.smithi152.stdout:7/54: rename ce to cf 0 2024-09-13T23:06:14.434 INFO:tasks.workunit.client.1.smithi152.stdout:3/49: creat fd x:0 0 0 2024-09-13T23:06:14.434 INFO:tasks.workunit.client.1.smithi152.stdout:3/50: write fd [416474,54051] 0 2024-09-13T23:06:14.434 INFO:tasks.workunit.client.1.smithi152.stdout:7/55: rename l1 to l10 0 2024-09-13T23:06:14.435 INFO:tasks.workunit.client.1.smithi152.stdout:7/56: rmdir - no directory 2024-09-13T23:06:14.436 INFO:tasks.workunit.client.1.smithi152.stdout:7/57: creat f11 x:0 0 0 2024-09-13T23:06:14.437 INFO:tasks.workunit.client.0.smithi115.stdout:9/663: rmdir d0/d13 39 2024-09-13T23:06:14.437 INFO:tasks.workunit.client.1.smithi152.stdout:7/58: mknod c12 0 2024-09-13T23:06:14.437 INFO:tasks.workunit.client.1.smithi152.stdout:7/59: write f5 [1062480,76992] 0 2024-09-13T23:06:14.438 INFO:tasks.workunit.client.1.smithi152.stdout:5/44: write d5/f7 [785837,45557] 0 2024-09-13T23:06:14.438 INFO:tasks.workunit.client.0.smithi115.stdout:2/739: unlink da/d23/d2c/dc2/cd3 0 2024-09-13T23:06:14.439 INFO:tasks.workunit.client.1.smithi152.stdout:5/45: rename d5/d9 to d5/da 0 2024-09-13T23:06:14.443 INFO:tasks.workunit.client.0.smithi115.stdout:5/671: rmdir d8/dd/d20/dbb 39 2024-09-13T23:06:14.443 INFO:tasks.workunit.client.0.smithi115.stdout:5/672: write d8/dd/d6a/d82/d63/f44 [1722372,47183] 0 2024-09-13T23:06:14.445 INFO:tasks.workunit.client.0.smithi115.stdout:7/625: dread da/dd/f2e [0,4194304] 0 2024-09-13T23:06:14.445 INFO:tasks.workunit.client.0.smithi115.stdout:7/626: write da/dd/d1c/d84/fd2 [299398,41524] 0 2024-09-13T23:06:14.445 INFO:tasks.workunit.client.0.smithi115.stdout:4/707: truncate db/d11/fa3 3332186 0 2024-09-13T23:06:14.449 INFO:tasks.workunit.client.0.smithi115.stdout:7/627: symlink da/dd/d1c/db0/ld4 0 2024-09-13T23:06:14.449 INFO:tasks.workunit.client.0.smithi115.stdout:5/673: dread d8/dd/d14/f94 [0,4194304] 0 2024-09-13T23:06:14.453 INFO:tasks.workunit.client.0.smithi115.stdout:5/674: getdents d8/dd 0 2024-09-13T23:06:14.453 INFO:tasks.workunit.client.0.smithi115.stdout:5/675: truncate d8/dd/d14/f50 1640688 0 2024-09-13T23:06:14.454 INFO:tasks.workunit.client.1.smithi152.stdout:4/119: dwrite d3/d4/d6/d8/f19 [8388608,4194304] 0 2024-09-13T23:06:14.456 INFO:tasks.workunit.client.0.smithi115.stdout:4/708: getdents db/d11/d2e/d33/d36/d51 0 2024-09-13T23:06:14.465 INFO:tasks.workunit.client.1.smithi152.stdout:3/51: fdatasync f3 0 2024-09-13T23:06:14.469 INFO:tasks.workunit.client.0.smithi115.stdout:7/628: dread da/dd/f59 [0,4194304] 0 2024-09-13T23:06:14.469 INFO:tasks.workunit.client.0.smithi115.stdout:7/629: chown da/d53/c72 3554 1 2024-09-13T23:06:14.469 INFO:tasks.workunit.client.0.smithi115.stdout:7/630: stat da/df/f28 0 2024-09-13T23:06:14.474 INFO:tasks.workunit.client.0.smithi115.stdout:7/631: creat da/dd/d1c/d2d/d41/d98/fd5 x:0 0 0 2024-09-13T23:06:14.474 INFO:tasks.workunit.client.0.smithi115.stdout:7/632: readlink da/dd/d13/d36/l57 0 2024-09-13T23:06:14.475 INFO:tasks.workunit.client.1.smithi152.stdout:4/120: write d3/d4/d6/d8/f19 [5776295,36044] 0 2024-09-13T23:06:14.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/52: dread f2 [0,4194304] 0 2024-09-13T23:06:14.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/53: stat f9 0 2024-09-13T23:06:14.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/54: rmdir - no directory 2024-09-13T23:06:14.478 INFO:tasks.workunit.client.1.smithi152.stdout:4/121: rmdir d3/d4/d6 39 2024-09-13T23:06:14.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/55: mkdir de 0 2024-09-13T23:06:14.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/56: stat de 0 2024-09-13T23:06:14.480 INFO:tasks.workunit.client.1.smithi152.stdout:3/57: creat de/ff x:0 0 0 2024-09-13T23:06:14.492 INFO:tasks.workunit.client.0.smithi115.stdout:7/633: dread da/dd/d13/d36/d5a/d6d/f8b [0,4194304] 0 2024-09-13T23:06:14.493 INFO:tasks.workunit.client.0.smithi115.stdout:7/634: creat da/dd/d1c/d2d/d60/fd6 x:0 0 0 2024-09-13T23:06:14.495 INFO:tasks.workunit.client.0.smithi115.stdout:7/635: unlink da/dd/d13/d36/d5a/d6d/f8b 0 2024-09-13T23:06:14.496 INFO:tasks.workunit.client.0.smithi115.stdout:7/636: unlink da/dd/d16/d29/ca2 0 2024-09-13T23:06:14.497 INFO:tasks.workunit.client.0.smithi115.stdout:7/637: link da/dd/d1c/f90 da/dd/d1c/d2d/d60/d82/fd7 0 2024-09-13T23:06:14.499 INFO:tasks.workunit.client.0.smithi115.stdout:7/638: mkdir da/dd/d13/d7e/d92/db1/dd8 0 2024-09-13T23:06:14.500 INFO:tasks.workunit.client.0.smithi115.stdout:7/639: creat da/dd/d1c/d2d/fd9 x:0 0 0 2024-09-13T23:06:14.500 INFO:tasks.workunit.client.0.smithi115.stdout:7/640: dread - da/dd/d1c/d2d/d41/fbb zero size 2024-09-13T23:06:14.500 INFO:tasks.workunit.client.0.smithi115.stdout:7/641: chown da/df/d3b 12684 1 2024-09-13T23:06:14.500 INFO:tasks.workunit.client.0.smithi115.stdout:7/642: chown da/dd/d16/c47 41541 1 2024-09-13T23:06:14.502 INFO:tasks.workunit.client.0.smithi115.stdout:7/643: unlink da/dd/d1c/d2d/d41/c49 0 2024-09-13T23:06:14.504 INFO:tasks.workunit.client.0.smithi115.stdout:7/644: creat da/dd/d13/fda x:0 0 0 2024-09-13T23:06:14.505 INFO:tasks.workunit.client.0.smithi115.stdout:9/664: dwrite d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:14.505 INFO:tasks.workunit.client.0.smithi115.stdout:9/665: write d0/d13/d17/d1f/d28/d76/d81/fab [1381086,2128] 0 2024-09-13T23:06:14.506 INFO:tasks.workunit.client.0.smithi115.stdout:9/666: rmdir d0/d13/d17/dc5 39 2024-09-13T23:06:14.506 INFO:tasks.workunit.client.0.smithi115.stdout:9/667: fsync d0/d13/d17/d1f/d4e/d61/d7d/fc7 0 2024-09-13T23:06:14.510 INFO:tasks.workunit.client.1.smithi152.stdout:7/60: dwrite f6 [0,4194304] 0 2024-09-13T23:06:14.512 INFO:tasks.workunit.client.1.smithi152.stdout:0/76: dwrite f2 [0,4194304] 0 2024-09-13T23:06:14.512 INFO:tasks.workunit.client.1.smithi152.stdout:0/77: chown f8 16976 1 2024-09-13T23:06:14.512 INFO:tasks.workunit.client.1.smithi152.stdout:7/61: truncate f0 3135053 0 2024-09-13T23:06:14.513 INFO:tasks.workunit.client.0.smithi115.stdout:2/740: dwrite da/d21/d8c/d41/d95/fc3 [0,4194304] 0 2024-09-13T23:06:14.513 INFO:tasks.workunit.client.0.smithi115.stdout:2/741: write f7 [9300321,18471] 0 2024-09-13T23:06:14.513 INFO:tasks.workunit.client.0.smithi115.stdout:2/742: fdatasync da/d21/d8c/d41/f7a 0 2024-09-13T23:06:14.513 INFO:tasks.workunit.client.0.smithi115.stdout:9/668: write d0/d13/f72 [1467705,9120] 0 2024-09-13T23:06:14.513 INFO:tasks.workunit.client.0.smithi115.stdout:4/709: dwrite db/d19/fc2 [0,4194304] 0 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:0/78: creat d18/d19/f1e x:0 0 0 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:4/122: dwrite d3/d4/d5/f7 [0,4194304] 0 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:0/79: dread - fb zero size 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:4/123: write d3/d4/d6/d8/f19 [13484842,40349] 0 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:4/124: stat d3/d4/d6/d8/l15 0 2024-09-13T23:06:14.514 INFO:tasks.workunit.client.1.smithi152.stdout:5/46: dwrite f0 [0,4194304] 0 2024-09-13T23:06:14.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/129: dwrite d3/f28 [0,4194304] 0 2024-09-13T23:06:14.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/80: mkdir d18/d1f 0 2024-09-13T23:06:14.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/81: dread - d18/f1a zero size 2024-09-13T23:06:14.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/82: fsync fb 0 2024-09-13T23:06:14.518 INFO:tasks.workunit.client.1.smithi152.stdout:5/47: link c3 d5/da/cb 0 2024-09-13T23:06:14.520 INFO:tasks.workunit.client.1.smithi152.stdout:9/130: symlink d3/l2d 0 2024-09-13T23:06:14.521 INFO:tasks.workunit.client.1.smithi152.stdout:0/83: creat d18/d1f/f20 x:0 0 0 2024-09-13T23:06:14.521 INFO:tasks.workunit.client.0.smithi115.stdout:7/645: dread da/dd/d13/d24/d52/d7c/da7/fae [4194304,4194304] 0 2024-09-13T23:06:14.521 INFO:tasks.workunit.client.0.smithi115.stdout:5/676: truncate d8/dd/d14/f50 533087 0 2024-09-13T23:06:14.521 INFO:tasks.workunit.client.0.smithi115.stdout:2/743: creat da/d77/d83/ff7 x:0 0 0 2024-09-13T23:06:14.522 INFO:tasks.workunit.client.0.smithi115.stdout:5/677: dread - d8/dd/d20/d27/fbf zero size 2024-09-13T23:06:14.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/84: mkdir d18/d19/d21 0 2024-09-13T23:06:14.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/85: fsync f16 0 2024-09-13T23:06:14.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/86: write ff [2042873,106945] 0 2024-09-13T23:06:14.524 INFO:tasks.workunit.client.0.smithi115.stdout:9/669: rmdir d0/d13/d17/d1f/d28/d76 39 2024-09-13T23:06:14.524 INFO:tasks.workunit.client.0.smithi115.stdout:9/670: chown d0/d13/d17/d1f/d77/fa3 4 1 2024-09-13T23:06:14.527 INFO:tasks.workunit.client.1.smithi152.stdout:0/87: unlink fc 0 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.1.smithi152.stdout:3/58: write f8 [81590,129320] 0 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/54: dwrite d0/fa [0,4194304] 0 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/55: fsync d0/d4/d9/f10 0 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/56: read - d0/d4/d9/ff zero size 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/57: chown d0/d4/d9/f10 1655 1 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/671: truncate d0/d13/d17/f1e 5000025 0 2024-09-13T23:06:14.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/672: fsync d0/d13/d17/d1f/d77/f93 0 2024-09-13T23:06:14.529 INFO:tasks.workunit.client.1.smithi152.stdout:9/131: dread d3/d24/f2a [0,4194304] 0 2024-09-13T23:06:14.529 INFO:tasks.workunit.client.1.smithi152.stdout:9/132: fdatasync d3/f15 0 2024-09-13T23:06:14.529 INFO:tasks.workunit.client.1.smithi152.stdout:9/133: fdatasync d3/f28 0 2024-09-13T23:06:14.529 INFO:tasks.workunit.client.0.smithi115.stdout:9/673: unlink d0/d13/d17/l4b 0 2024-09-13T23:06:14.531 INFO:tasks.workunit.client.1.smithi152.stdout:2/58: unlink d0/f1 0 2024-09-13T23:06:14.531 INFO:tasks.workunit.client.1.smithi152.stdout:2/59: chown d0/d4/d9 58831 1 2024-09-13T23:06:14.531 INFO:tasks.workunit.client.1.smithi152.stdout:2/60: chown d0/d8 256737 1 2024-09-13T23:06:14.532 INFO:tasks.workunit.client.0.smithi115.stdout:9/674: mkdir d0/d13/d17/d36/dd1 0 2024-09-13T23:06:14.536 INFO:tasks.workunit.client.1.smithi152.stdout:9/134: truncate d3/d24/fb 253460 0 2024-09-13T23:06:14.537 INFO:tasks.workunit.client.0.smithi115.stdout:9/675: rename d0/d13/d17/d1f/d4e/d61/d7d/fa6 to d0/d13/d17/d1f/d28/d76/d81/dd0/fd2 0 2024-09-13T23:06:14.537 INFO:tasks.workunit.client.0.smithi115.stdout:9/676: fsync d0/d13/d17/d1f/d28/fcd 0 2024-09-13T23:06:14.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/62: dread f6 [0,4194304] 0 2024-09-13T23:06:14.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/63: creat f13 x:0 0 0 2024-09-13T23:06:14.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/64: read f9 [4005748,77453] 0 2024-09-13T23:06:14.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/65: rmdir - no directory 2024-09-13T23:06:14.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/66: readlink l7 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/67: write f9 [430703,72975] 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/68: creat f14 x:0 0 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/69: write f11 [363298,117329] 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/70: creat f15 x:0 0 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/71: truncate f13 421479 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/72: creat f16 x:0 0 0 2024-09-13T23:06:14.542 INFO:tasks.workunit.client.1.smithi152.stdout:7/73: fsync f4 0 2024-09-13T23:06:14.550 INFO:tasks.workunit.client.1.smithi152.stdout:7/74: mkdir d17 0 2024-09-13T23:06:14.555 INFO:tasks.workunit.client.1.smithi152.stdout:3/59: dread f3 [0,4194304] 0 2024-09-13T23:06:14.556 INFO:tasks.workunit.client.1.smithi152.stdout:3/60: mknod de/c10 0 2024-09-13T23:06:14.557 INFO:tasks.workunit.client.1.smithi152.stdout:3/61: mkdir de/d11 0 2024-09-13T23:06:14.557 INFO:tasks.workunit.client.1.smithi152.stdout:3/62: chown cc 31333845 1 2024-09-13T23:06:14.558 INFO:tasks.workunit.client.1.smithi152.stdout:3/63: rename f3 to de/d11/f12 0 2024-09-13T23:06:14.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/64: creat de/f13 x:0 0 0 2024-09-13T23:06:14.559 INFO:tasks.workunit.client.0.smithi115.stdout:8/753: sync 2024-09-13T23:06:14.559 INFO:tasks.workunit.client.0.smithi115.stdout:8/754: fsync d3/f2f 0 2024-09-13T23:06:14.561 INFO:tasks.workunit.client.1.smithi152.stdout:3/65: mkdir de/d14 0 2024-09-13T23:06:14.561 INFO:tasks.workunit.client.1.smithi152.stdout:3/66: write de/d11/f12 [248077,89145] 0 2024-09-13T23:06:14.561 INFO:tasks.workunit.client.1.smithi152.stdout:3/67: stat f2 0 2024-09-13T23:06:14.561 INFO:tasks.workunit.client.1.smithi152.stdout:3/68: write de/d11/f12 [3646121,87304] 0 2024-09-13T23:06:14.570 INFO:tasks.workunit.client.0.smithi115.stdout:8/755: dread d3/d5/f76 [0,4194304] 0 2024-09-13T23:06:14.570 INFO:tasks.workunit.client.0.smithi115.stdout:8/756: chown d3/d5/dc/d16/d1f/d28/f29 2 1 2024-09-13T23:06:14.570 INFO:tasks.workunit.client.0.smithi115.stdout:8/757: fsync d3/d87/fc6 0 2024-09-13T23:06:14.578 INFO:tasks.workunit.client.0.smithi115.stdout:4/710: dwrite db/d16/d3f/dae/fa5 [0,4194304] 0 2024-09-13T23:06:14.582 INFO:tasks.workunit.client.1.smithi152.stdout:2/61: dwrite d0/fe [0,4194304] 0 2024-09-13T23:06:14.583 INFO:tasks.workunit.client.1.smithi152.stdout:4/125: dwrite d3/d4/d5/d1c/f1e [0,4194304] 0 2024-09-13T23:06:14.583 INFO:tasks.workunit.client.1.smithi152.stdout:0/88: dwrite f14 [0,4194304] 0 2024-09-13T23:06:14.585 INFO:tasks.workunit.client.0.smithi115.stdout:4/711: mknod db/d11/ccd 0 2024-09-13T23:06:14.585 INFO:tasks.workunit.client.0.smithi115.stdout:5/678: dwrite d8/fbc [0,4194304] 0 2024-09-13T23:06:14.585 INFO:tasks.workunit.client.0.smithi115.stdout:2/744: dwrite da/d21/da8/fb6 [0,4194304] 0 2024-09-13T23:06:14.586 INFO:tasks.workunit.client.0.smithi115.stdout:8/758: dread d3/d87/fc6 [0,4194304] 0 2024-09-13T23:06:14.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/75: dread f11 [0,4194304] 0 2024-09-13T23:06:14.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/69: dwrite de/f13 [0,4194304] 0 2024-09-13T23:06:14.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/70: creat de/f15 x:0 0 0 2024-09-13T23:06:14.589 INFO:tasks.workunit.client.0.smithi115.stdout:4/712: symlink db/d11/d54/d17/lce 0 2024-09-13T23:06:14.589 INFO:tasks.workunit.client.0.smithi115.stdout:4/713: truncate db/d16/d3f/d66/d68/d71/d75/f80 1811116 0 2024-09-13T23:06:14.589 INFO:tasks.workunit.client.0.smithi115.stdout:4/714: chown db/d16/d3f/dae/fca 842 1 2024-09-13T23:06:14.590 INFO:tasks.workunit.client.1.smithi152.stdout:4/126: mknod d3/d4/d6/d8/d17/c1f 0 2024-09-13T23:06:14.590 INFO:tasks.workunit.client.0.smithi115.stdout:7/646: fsync da/dd/d13/fda 0 2024-09-13T23:06:14.591 INFO:tasks.workunit.client.0.smithi115.stdout:7/647: dread - da/dd/d13/d36/d85/fc6 zero size 2024-09-13T23:06:14.593 INFO:tasks.workunit.client.0.smithi115.stdout:2/745: creat da/d23/d2c/dc2/de1/d48/ded/ff8 x:0 0 0 2024-09-13T23:06:14.594 INFO:tasks.workunit.client.0.smithi115.stdout:8/759: rename d3/d5/d1d/dea to d3/d5/dc/d23/d4e/d54/d7f/d10c 0 2024-09-13T23:06:14.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/76: symlink d17/l18 0 2024-09-13T23:06:14.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/77: chown l7 218 1 2024-09-13T23:06:14.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/78: fdatasync f16 0 2024-09-13T23:06:14.598 INFO:tasks.workunit.client.0.smithi115.stdout:7/648: mknod da/dd/d13/d24/d67/cdb 0 2024-09-13T23:06:14.601 INFO:tasks.workunit.client.0.smithi115.stdout:8/760: mkdir d3/d10d 0 2024-09-13T23:06:14.601 INFO:tasks.workunit.client.0.smithi115.stdout:5/679: dread d8/dd/d6a/d82/f58 [0,4194304] 0 2024-09-13T23:06:14.601 INFO:tasks.workunit.client.0.smithi115.stdout:5/680: write d8/d7a/fc1 [533593,31923] 0 2024-09-13T23:06:14.606 INFO:tasks.workunit.client.0.smithi115.stdout:2/746: dread da/d23/dd5/fd9 [0,4194304] 0 2024-09-13T23:06:14.606 INFO:tasks.workunit.client.0.smithi115.stdout:2/747: write da/f73 [1518919,45824] 0 2024-09-13T23:06:14.606 INFO:tasks.workunit.client.0.smithi115.stdout:2/748: chown da/d77/d83/ff7 5 1 2024-09-13T23:06:14.606 INFO:tasks.workunit.client.0.smithi115.stdout:4/715: rename db/d16/d3f/d66/d68/d71/d84/d96/fbe to db/d16/d3f/fcf 0 2024-09-13T23:06:14.611 INFO:tasks.workunit.client.1.smithi152.stdout:0/89: dwrite d18/d19/f1e [0,4194304] 0 2024-09-13T23:06:14.611 INFO:tasks.workunit.client.0.smithi115.stdout:9/677: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:14.612 INFO:tasks.workunit.client.0.smithi115.stdout:9/678: fsync d0/d13/d17/d1f/d4e/d61/d7d/d98/fcc 0 2024-09-13T23:06:14.615 INFO:tasks.workunit.client.0.smithi115.stdout:7/649: dread da/df/f2c [0,4194304] 0 2024-09-13T23:06:14.616 INFO:tasks.workunit.client.0.smithi115.stdout:7/650: write da/dd/d1c/d2d/d41/fbc [4346577,887] 0 2024-09-13T23:06:14.617 INFO:tasks.workunit.client.1.smithi152.stdout:3/71: rename cc to de/d14/c16 0 2024-09-13T23:06:14.617 INFO:tasks.workunit.client.0.smithi115.stdout:8/761: mknod d3/d10d/c10e 0 2024-09-13T23:06:14.617 INFO:tasks.workunit.client.0.smithi115.stdout:5/681: mkdir d8/d9e/dcd 0 2024-09-13T23:06:14.618 INFO:tasks.workunit.client.0.smithi115.stdout:8/762: write d3/d5/dc/d16/d1f/d28/dc0/f101 [849667,95849] 0 2024-09-13T23:06:14.618 INFO:tasks.workunit.client.0.smithi115.stdout:2/749: creat da/d21/da6/de7/ff9 x:0 0 0 2024-09-13T23:06:14.619 INFO:tasks.workunit.client.1.smithi152.stdout:3/72: dread fd [0,4194304] 0 2024-09-13T23:06:14.619 INFO:tasks.workunit.client.1.smithi152.stdout:3/73: write fd [1336678,89497] 0 2024-09-13T23:06:14.619 INFO:tasks.workunit.client.1.smithi152.stdout:4/127: creat d3/d4/d6/f20 x:0 0 0 2024-09-13T23:06:14.620 INFO:tasks.workunit.client.0.smithi115.stdout:3/768: sync 2024-09-13T23:06:14.620 INFO:tasks.workunit.client.0.smithi115.stdout:3/769: stat d3/d5/d65/da8 0 2024-09-13T23:06:14.623 INFO:tasks.workunit.client.1.smithi152.stdout:7/79: link f9 d17/f19 0 2024-09-13T23:06:14.624 INFO:tasks.workunit.client.0.smithi115.stdout:3/770: dread d3/d5/d65/da8/fc6 [0,4194304] 0 2024-09-13T23:06:14.625 INFO:tasks.workunit.client.0.smithi115.stdout:9/679: rename d0/c37 to d0/d13/d17/d1f/d77/cd3 0 2024-09-13T23:06:14.629 INFO:tasks.workunit.client.0.smithi115.stdout:4/716: truncate db/d16/d3f/dae/fa5 1988392 0 2024-09-13T23:06:14.630 INFO:tasks.workunit.client.0.smithi115.stdout:4/717: dread - db/d11/d54/f85 zero size 2024-09-13T23:06:14.630 INFO:tasks.workunit.client.0.smithi115.stdout:4/718: readlink db/d19/d34/l58 0 2024-09-13T23:06:14.631 INFO:tasks.workunit.client.0.smithi115.stdout:2/750: dread da/d21/fb3 [0,4194304] 0 2024-09-13T23:06:14.631 INFO:tasks.workunit.client.1.smithi152.stdout:5/48: dwrite d5/f6 [0,4194304] 0 2024-09-13T23:06:14.631 INFO:tasks.workunit.client.1.smithi152.stdout:0/90: write fd [846013,63335] 0 2024-09-13T23:06:14.631 INFO:tasks.workunit.client.1.smithi152.stdout:5/49: chown d5 28 1 2024-09-13T23:06:14.631 INFO:tasks.workunit.client.1.smithi152.stdout:7/80: creat d17/f1a x:0 0 0 2024-09-13T23:06:14.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/91: write d18/f1a [12822,72269] 0 2024-09-13T23:06:14.635 INFO:tasks.workunit.client.1.smithi152.stdout:6/16: sync 2024-09-13T23:06:14.637 INFO:tasks.workunit.client.1.smithi152.stdout:7/81: link f16 d17/f1b 0 2024-09-13T23:06:14.639 INFO:tasks.workunit.client.0.smithi115.stdout:1/661: sync 2024-09-13T23:06:14.639 INFO:tasks.workunit.client.0.smithi115.stdout:0/640: sync 2024-09-13T23:06:14.639 INFO:tasks.workunit.client.0.smithi115.stdout:6/741: sync 2024-09-13T23:06:14.639 INFO:tasks.workunit.client.0.smithi115.stdout:6/742: fdatasync d4/df/d14/d35/ffa 0 2024-09-13T23:06:14.641 INFO:tasks.workunit.client.0.smithi115.stdout:5/682: rmdir d8/dd/d20/d4a 39 2024-09-13T23:06:14.641 INFO:tasks.workunit.client.0.smithi115.stdout:5/683: fdatasync d8/f2a 0 2024-09-13T23:06:14.641 INFO:tasks.workunit.client.0.smithi115.stdout:8/763: truncate d3/d5/dc/d23/f6f 1442681 0 2024-09-13T23:06:14.641 INFO:tasks.workunit.client.0.smithi115.stdout:8/764: stat d3/d5/dc/d16/d1f/fac 0 2024-09-13T23:06:14.641 INFO:tasks.workunit.client.0.smithi115.stdout:3/771: rmdir d3/d5/d35/d71/d3b/d47/de1 39 2024-09-13T23:06:14.642 INFO:tasks.workunit.client.0.smithi115.stdout:9/680: chown d0/d13/d17/d36/f8d 1704563 1 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/684: dread d8/d7a/f84 [0,4194304] 0 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/685: creat d8/dd/d64/dc5/fce x:0 0 0 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/686: creat d8/d7a/fcf x:0 0 0 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/687: chown d8/dd/d5d/d5e 13234 1 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.1.smithi152.stdout:9/135: dwrite d3/d24/fb [0,4194304] 0 2024-09-13T23:06:14.645 INFO:tasks.workunit.client.1.smithi152.stdout:9/136: chown d3/d1e/f21 38970146 1 2024-09-13T23:06:14.649 INFO:tasks.workunit.client.1.smithi152.stdout:0/92: dread f2 [4194304,4194304] 0 2024-09-13T23:06:14.649 INFO:tasks.workunit.client.1.smithi152.stdout:0/93: chown c12 262254495 1 2024-09-13T23:06:14.650 INFO:tasks.workunit.client.1.smithi152.stdout:9/137: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:14.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/719: rename db/d16/d3f/dae/f40 to db/d19/d4e/fd0 0 2024-09-13T23:06:14.653 INFO:tasks.workunit.client.0.smithi115.stdout:8/765: symlink d3/d5/dc/d23/d4e/l10f 0 2024-09-13T23:06:14.653 INFO:tasks.workunit.client.0.smithi115.stdout:8/766: readlink d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/le0 0 2024-09-13T23:06:14.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/767: chown d3/d5/dc/d23/c53 0 1 2024-09-13T23:06:14.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/768: rename d3/d5/dc/d16 to d3/d5/dc/d16/d1f/d28/d62/d110 22 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/138: creat d3/d24/f2e x:0 0 0 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/139: fsync d3/d24/f20 0 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.0.smithi115.stdout:1/662: link d0/de/d66/d8f/dad/cb3 d0/de/d66/d8f/d29/d47/d74/cd5 0 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.0.smithi115.stdout:3/772: symlink d3/d5/d65/da8/da4/d49/lfd 0 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.0.smithi115.stdout:3/773: stat d3/d5/c2a 0 2024-09-13T23:06:14.655 INFO:tasks.workunit.client.0.smithi115.stdout:3/774: truncate d3/d5/d35/d71/d3b/d47/fae 89827 0 2024-09-13T23:06:14.656 INFO:tasks.workunit.client.1.smithi152.stdout:7/82: dread f0 [0,4194304] 0 2024-09-13T23:06:14.656 INFO:tasks.workunit.client.1.smithi152.stdout:7/83: creat d17/f1c x:0 0 0 2024-09-13T23:06:14.656 INFO:tasks.workunit.client.1.smithi152.stdout:7/84: truncate f14 612009 0 2024-09-13T23:06:14.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/140: link d3/d1e/f1f d3/d24/f2f 0 2024-09-13T23:06:14.659 INFO:tasks.workunit.client.0.smithi115.stdout:4/720: mkdir db/d11/d54/d17/dd1 0 2024-09-13T23:06:14.659 INFO:tasks.workunit.client.0.smithi115.stdout:4/721: chown db/d16/d3f/d66/d68/d71/d84 15909904 1 2024-09-13T23:06:14.659 INFO:tasks.workunit.client.0.smithi115.stdout:4/722: fdatasync db/d16/d3f/f6c 0 2024-09-13T23:06:14.660 INFO:tasks.workunit.client.0.smithi115.stdout:8/769: mknod d3/d5/dc/d16/d1f/d28/d3e/c111 0 2024-09-13T23:06:14.661 INFO:tasks.workunit.client.0.smithi115.stdout:1/663: creat d0/de/d1b/d25/d4d/d51/d31/d37/fd6 x:0 0 0 2024-09-13T23:06:14.661 INFO:tasks.workunit.client.0.smithi115.stdout:1/664: readlink d0/l56 0 2024-09-13T23:06:14.662 INFO:tasks.workunit.client.0.smithi115.stdout:4/723: mknod db/d16/d3f/d66/d68/cd2 0 2024-09-13T23:06:14.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/665: mkdir d0/de/d66/d8f/d29/d47/d74/d9d/da3/dd7 0 2024-09-13T23:06:14.664 INFO:tasks.workunit.client.0.smithi115.stdout:1/666: dread - d0/de/d1b/d25/d4d/d51/d23/f9f zero size 2024-09-13T23:06:14.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/85: rename f9 to d17/f1d 0 2024-09-13T23:06:14.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/86: creat d17/f1e x:0 0 0 2024-09-13T23:06:14.665 INFO:tasks.workunit.client.1.smithi152.stdout:7/87: write d17/f1d [3125968,20934] 0 2024-09-13T23:06:14.672 INFO:tasks.workunit.client.0.smithi115.stdout:3/775: dread d3/d16/fdf [0,4194304] 0 2024-09-13T23:06:14.672 INFO:tasks.workunit.client.0.smithi115.stdout:3/776: creat d3/d5/d35/ffe x:0 0 0 2024-09-13T23:06:14.675 INFO:tasks.workunit.client.0.smithi115.stdout:3/777: rmdir d3/d5/d35/d71/d3b/d47/de1/dcc/dd4 39 2024-09-13T23:06:14.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/778: mknod d3/d5/d35/d71/d45/dfb/cff 0 2024-09-13T23:06:14.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/779: write d3/d5/f9a [1160583,10480] 0 2024-09-13T23:06:14.677 INFO:tasks.workunit.client.0.smithi115.stdout:3/780: dread - d3/d16/d1a/d1e/d8e/fb5 zero size 2024-09-13T23:06:14.677 INFO:tasks.workunit.client.0.smithi115.stdout:4/724: write db/d16/d3f/d66/d68/d71/d84/f88 [1142013,91082] 0 2024-09-13T23:06:14.678 INFO:tasks.workunit.client.0.smithi115.stdout:3/781: truncate d3/d16/d1a/d1e/dd3/fdb 1054914 0 2024-09-13T23:06:14.678 INFO:tasks.workunit.client.0.smithi115.stdout:3/782: chown d3/d5/d35/d4c/fd5 11 1 2024-09-13T23:06:14.680 INFO:tasks.workunit.client.0.smithi115.stdout:3/783: symlink d3/d5/db/dbd/l100 0 2024-09-13T23:06:14.680 INFO:tasks.workunit.client.0.smithi115.stdout:3/784: chown d3/d5/d2c 93 1 2024-09-13T23:06:14.681 INFO:tasks.workunit.client.1.smithi152.stdout:7/88: dread f4 [0,4194304] 0 2024-09-13T23:06:14.681 INFO:tasks.workunit.client.1.smithi152.stdout:7/89: write f16 [152074,85293] 0 2024-09-13T23:06:14.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/90: mknod d17/c1f 0 2024-09-13T23:06:14.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/91: chown f6 264214 1 2024-09-13T23:06:14.686 INFO:tasks.workunit.client.1.smithi152.stdout:7/92: dread fd [0,4194304] 0 2024-09-13T23:06:14.689 INFO:tasks.workunit.client.1.smithi152.stdout:4/128: dwrite d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:14.695 INFO:tasks.workunit.client.1.smithi152.stdout:4/129: mknod d3/d4/d6/d8/d17/c21 0 2024-09-13T23:06:14.695 INFO:tasks.workunit.client.1.smithi152.stdout:4/130: chown d3/d4/d6/d8/f19 1 1 2024-09-13T23:06:14.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/74: dread f8 [0,4194304] 0 2024-09-13T23:06:14.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/75: creat de/f17 x:0 0 0 2024-09-13T23:06:14.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/76: truncate de/ff 75580 0 2024-09-13T23:06:14.696 INFO:tasks.workunit.client.1.smithi152.stdout:5/50: truncate d5/f6 761829 0 2024-09-13T23:06:14.696 INFO:tasks.workunit.client.1.smithi152.stdout:4/131: creat d3/d4/f22 x:0 0 0 2024-09-13T23:06:14.698 INFO:tasks.workunit.client.1.smithi152.stdout:2/62: dwrite d0/fe [4194304,4194304] 0 2024-09-13T23:06:14.698 INFO:tasks.workunit.client.1.smithi152.stdout:5/51: mkdir d5/dc 0 2024-09-13T23:06:14.699 INFO:tasks.workunit.client.0.smithi115.stdout:2/751: dwrite da/d23/d2c/dc2/de1/d56/d1a/d7f/f97 [0,4194304] 0 2024-09-13T23:06:14.699 INFO:tasks.workunit.client.0.smithi115.stdout:7/651: dwrite da/dd/d1c/d2d/d45/d4d/f6f [0,4194304] 0 2024-09-13T23:06:14.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/31: sync 2024-09-13T23:06:14.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/32: truncate f3 1345670 0 2024-09-13T23:06:14.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/33: write f3 [2063248,81135] 0 2024-09-13T23:06:14.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/34: creat fb x:0 0 0 2024-09-13T23:06:14.700 INFO:tasks.workunit.client.1.smithi152.stdout:4/132: rename d3/d4/d5/c12 to d3/d4/d6/c23 0 2024-09-13T23:06:14.701 INFO:tasks.workunit.client.1.smithi152.stdout:5/52: symlink d5/ld 0 2024-09-13T23:06:14.701 INFO:tasks.workunit.client.0.smithi115.stdout:2/752: mkdir da/d23/d2c/dc2/de1/d56/d1a/dfa 0 2024-09-13T23:06:14.701 INFO:tasks.workunit.client.0.smithi115.stdout:2/753: chown da/f73 110 1 2024-09-13T23:06:14.703 INFO:tasks.workunit.client.1.smithi152.stdout:4/133: creat d3/d4/d6/d8/d17/f24 x:0 0 0 2024-09-13T23:06:14.703 INFO:tasks.workunit.client.1.smithi152.stdout:4/134: readlink d3/d4/d6/d8/l15 0 2024-09-13T23:06:14.703 INFO:tasks.workunit.client.1.smithi152.stdout:4/135: chown d3/d4/ce 554606 1 2024-09-13T23:06:14.703 INFO:tasks.workunit.client.1.smithi152.stdout:2/63: mkdir d0/d4/d9/d16 0 2024-09-13T23:06:14.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/64: write d0/d4/d9/ff [616604,30313] 0 2024-09-13T23:06:14.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/652: symlink da/dd/d1c/d2d/d60/ldc 0 2024-09-13T23:06:14.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/653: read da/dd/d1c/d2d/d60/d82/fd7 [470510,10718] 0 2024-09-13T23:06:14.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/65: creat d0/d4/d9/d16/f17 x:0 0 0 2024-09-13T23:06:14.705 INFO:tasks.workunit.client.0.smithi115.stdout:6/743: dwrite d4/df/d14/d38/d2a/d3e/fa5 [4194304,4194304] 0 2024-09-13T23:06:14.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/94: dwrite f2 [4194304,4194304] 0 2024-09-13T23:06:14.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/95: truncate fb 365869 0 2024-09-13T23:06:14.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/96: truncate f8 900894 0 2024-09-13T23:06:14.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/17: dwrite f3 [0,4194304] 0 2024-09-13T23:06:14.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/18: chown d4 47726436 1 2024-09-13T23:06:14.708 INFO:tasks.workunit.client.1.smithi152.stdout:2/66: mkdir d0/d4/d9/d18 0 2024-09-13T23:06:14.708 INFO:tasks.workunit.client.0.smithi115.stdout:5/688: dwrite d8/dd/d64/fb0 [0,4194304] 0 2024-09-13T23:06:14.709 INFO:tasks.workunit.client.1.smithi152.stdout:9/141: dwrite d3/d1e/f2b [0,4194304] 0 2024-09-13T23:06:14.709 INFO:tasks.workunit.client.1.smithi152.stdout:9/142: truncate d3/d24/f2e 544412 0 2024-09-13T23:06:14.713 INFO:tasks.workunit.client.0.smithi115.stdout:5/689: getdents d8/d9e 0 2024-09-13T23:06:14.717 INFO:tasks.workunit.client.0.smithi115.stdout:5/690: creat d8/dd/d20/dbb/fd0 x:0 0 0 2024-09-13T23:06:14.717 INFO:tasks.workunit.client.0.smithi115.stdout:5/691: readlink d8/dd/d20/d23/lbe 0 2024-09-13T23:06:14.717 INFO:tasks.workunit.client.0.smithi115.stdout:5/692: getdents d8/dd/d6a/d82 0 2024-09-13T23:06:14.724 INFO:tasks.workunit.client.0.smithi115.stdout:3/785: rename d3/d5/d35/d71/d45 to d3/d16/d1c/d101 0 2024-09-13T23:06:14.724 INFO:tasks.workunit.client.1.smithi152.stdout:2/67: mknod d0/d8/c19 0 2024-09-13T23:06:14.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/53: write f0 [524244,63335] 0 2024-09-13T23:06:14.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/786: mkdir d3/d5/d35/d71/d3b/d47/de1/dcc/dd4/de2/d102 0 2024-09-13T23:06:14.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/787: creat d3/d5/d2c/f103 x:0 0 0 2024-09-13T23:06:14.729 INFO:tasks.workunit.client.0.smithi115.stdout:3/788: creat d3/d5/d65/da8/da4/f104 x:0 0 0 2024-09-13T23:06:14.732 INFO:tasks.workunit.client.0.smithi115.stdout:2/754: dread da/d21/fb3 [0,4194304] 0 2024-09-13T23:06:14.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/143: write d3/d24/fb [3993724,16019] 0 2024-09-13T23:06:14.734 INFO:tasks.workunit.client.0.smithi115.stdout:2/755: getdents da/d77 0 2024-09-13T23:06:14.735 INFO:tasks.workunit.client.0.smithi115.stdout:5/693: dread d8/dd/d6a/d82/d63/f65 [0,4194304] 0 2024-09-13T23:06:14.735 INFO:tasks.workunit.client.0.smithi115.stdout:5/694: getdents d8/dd/d20/d4a 0 2024-09-13T23:06:14.736 INFO:tasks.workunit.client.0.smithi115.stdout:2/756: rmdir da/d21/da8/dbc 39 2024-09-13T23:06:14.736 INFO:tasks.workunit.client.0.smithi115.stdout:5/695: creat d8/d9e/dcd/fd1 x:0 0 0 2024-09-13T23:06:14.737 INFO:tasks.workunit.client.1.smithi152.stdout:9/144: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:14.738 INFO:tasks.workunit.client.0.smithi115.stdout:5/696: creat d8/dd/d4c/fd2 x:0 0 0 2024-09-13T23:06:14.738 INFO:tasks.workunit.client.0.smithi115.stdout:5/697: readlink d8/dd/d14/l39 0 2024-09-13T23:06:14.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/145: mkdir d3/d1e/d30 0 2024-09-13T23:06:14.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/146: chown d3/c7 73769 1 2024-09-13T23:06:14.740 INFO:tasks.workunit.client.0.smithi115.stdout:5/698: symlink d8/ld3 0 2024-09-13T23:06:14.741 INFO:tasks.workunit.client.0.smithi115.stdout:9/681: dwrite d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:14.744 INFO:tasks.workunit.client.1.smithi152.stdout:1/76: sync 2024-09-13T23:06:14.744 INFO:tasks.workunit.client.0.smithi115.stdout:5/699: mknod d8/dd/d20/d23/cd4 0 2024-09-13T23:06:14.747 INFO:tasks.workunit.client.1.smithi152.stdout:1/77: link d4/d9/fd d4/d9/d11/f19 0 2024-09-13T23:06:14.749 INFO:tasks.workunit.client.0.smithi115.stdout:5/700: mknod d8/d9e/cd5 0 2024-09-13T23:06:14.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/136: getdents d3/d4/d6 0 2024-09-13T23:06:14.752 INFO:tasks.workunit.client.0.smithi115.stdout:7/654: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:14.752 INFO:tasks.workunit.client.0.smithi115.stdout:7/655: chown da/dd/d13/d36/d5a/l9b 9 1 2024-09-13T23:06:14.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/137: mknod d3/d4/d5/c25 0 2024-09-13T23:06:14.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/138: chown d3/d4/c18 1 1 2024-09-13T23:06:14.753 INFO:tasks.workunit.client.0.smithi115.stdout:2/757: write da/d23/d2c/dc2/de1/d56/d1a/d7f/f97 [21396,9195] 0 2024-09-13T23:06:14.754 INFO:tasks.workunit.client.1.smithi152.stdout:5/54: write f0 [7842192,64938] 0 2024-09-13T23:06:14.756 INFO:tasks.workunit.client.0.smithi115.stdout:2/758: rename da/d21/da6/de7/ff9 to da/d23/d2c/dc2/de1/d48/ded/ffb 0 2024-09-13T23:06:14.756 INFO:tasks.workunit.client.1.smithi152.stdout:4/139: creat d3/f26 x:0 0 0 2024-09-13T23:06:14.757 INFO:tasks.workunit.client.1.smithi152.stdout:4/140: creat d3/d4/d5/d1c/f27 x:0 0 0 2024-09-13T23:06:14.757 INFO:tasks.workunit.client.1.smithi152.stdout:4/141: readlink d3/lf 0 2024-09-13T23:06:14.757 INFO:tasks.workunit.client.1.smithi152.stdout:4/142: creat d3/d4/d5/d1c/f28 x:0 0 0 2024-09-13T23:06:14.760 INFO:tasks.workunit.client.0.smithi115.stdout:2/759: creat da/d23/d2c/dc2/de1/d56/d4b/ffc x:0 0 0 2024-09-13T23:06:14.761 INFO:tasks.workunit.client.0.smithi115.stdout:2/760: chown da/d77/d83/fd0 60839 1 2024-09-13T23:06:14.762 INFO:tasks.workunit.client.0.smithi115.stdout:2/761: mknod da/d21/da6/de7/cfd 0 2024-09-13T23:06:14.764 INFO:tasks.workunit.client.0.smithi115.stdout:5/701: read d8/dd/d64/fb0 [2813234,115200] 0 2024-09-13T23:06:14.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/147: dread d3/f4 [0,4194304] 0 2024-09-13T23:06:14.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/148: truncate d3/d24/f20 733169 0 2024-09-13T23:06:14.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/35: dwrite fb [0,4194304] 0 2024-09-13T23:06:14.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/770: write d3/d5/dc/d16/d1f/d28/d62/f7b [1352847,121889] 0 2024-09-13T23:06:14.771 INFO:tasks.workunit.client.0.smithi115.stdout:2/762: dread da/d23/d2c/dc2/de1/d56/f24 [0,4194304] 0 2024-09-13T23:06:14.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/36: mknod cc 0 2024-09-13T23:06:14.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/37: write f3 [688426,7319] 0 2024-09-13T23:06:14.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/93: dwrite d17/f19 [0,4194304] 0 2024-09-13T23:06:14.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/94: readlink d17/l18 0 2024-09-13T23:06:14.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/95: fsync d17/f1d 0 2024-09-13T23:06:14.781 INFO:tasks.workunit.client.1.smithi152.stdout:7/96: write f16 [375207,78032] 0 2024-09-13T23:06:14.783 INFO:tasks.workunit.client.1.smithi152.stdout:7/97: rename f15 to d17/f20 0 2024-09-13T23:06:14.785 INFO:tasks.workunit.client.1.smithi152.stdout:7/98: symlink d17/l21 0 2024-09-13T23:06:14.794 INFO:tasks.workunit.client.1.smithi152.stdout:9/149: dread d3/d1e/f2b [0,4194304] 0 2024-09-13T23:06:14.794 INFO:tasks.workunit.client.1.smithi152.stdout:9/150: chown d3/c2c 34123782 1 2024-09-13T23:06:14.820 INFO:tasks.workunit.client.0.smithi115.stdout:3/789: dwrite d3/d5/d35/d71/d3b/f7e [0,4194304] 0 2024-09-13T23:06:14.820 INFO:tasks.workunit.client.0.smithi115.stdout:3/790: chown d3/d16/d1a/d1e/d94/fb6 1411832879 1 2024-09-13T23:06:14.820 INFO:tasks.workunit.client.0.smithi115.stdout:3/791: readlink d3/d16/dab/lb9 0 2024-09-13T23:06:14.821 INFO:tasks.workunit.client.1.smithi152.stdout:2/68: dwrite d0/fe [0,4194304] 0 2024-09-13T23:06:14.821 INFO:tasks.workunit.client.0.smithi115.stdout:3/792: creat d3/d5/d35/d71/d42/f105 x:0 0 0 2024-09-13T23:06:14.821 INFO:tasks.workunit.client.0.smithi115.stdout:3/793: readlink d3/d16/d1a/d1e/l99 0 2024-09-13T23:06:14.822 INFO:tasks.workunit.client.1.smithi152.stdout:2/69: read d0/d4/d9/ff [165073,51769] 0 2024-09-13T23:06:14.822 INFO:tasks.workunit.client.1.smithi152.stdout:2/70: write d0/d4/d9/f10 [631453,81671] 0 2024-09-13T23:06:14.822 INFO:tasks.workunit.client.1.smithi152.stdout:2/71: write d0/d4/d9/d16/f17 [367213,63648] 0 2024-09-13T23:06:14.823 INFO:tasks.workunit.client.0.smithi115.stdout:3/794: symlink d3/d16/d1a/dd8/l106 0 2024-09-13T23:06:14.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/55: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:14.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/72: creat d0/d4/f1a x:0 0 0 2024-09-13T23:06:14.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/73: creat d0/d4/d9/f1b x:0 0 0 2024-09-13T23:06:14.825 INFO:tasks.workunit.client.1.smithi152.stdout:5/56: link d5/f6 d5/dc/fe 0 2024-09-13T23:06:14.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/57: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:14.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/58: chown c4 162640 1 2024-09-13T23:06:14.827 INFO:tasks.workunit.client.0.smithi115.stdout:6/744: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:14.827 INFO:tasks.workunit.client.0.smithi115.stdout:6/745: fdatasync d4/df/d14/d38/d2a/d31/fb5 0 2024-09-13T23:06:14.827 INFO:tasks.workunit.client.0.smithi115.stdout:7/656: dwrite da/df/f2c [0,4194304] 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/77: dwrite fd [0,4194304] 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/78: fdatasync de/f17 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/74: creat d0/d3/f1c x:0 0 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/79: read de/ff [14466,75390] 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/75: creat d0/d4/f1d x:0 0 0 2024-09-13T23:06:14.828 INFO:tasks.workunit.client.1.smithi152.stdout:2/76: dread - d0/d3/f1c zero size 2024-09-13T23:06:14.829 INFO:tasks.workunit.client.0.smithi115.stdout:9/682: dwrite d0/d13/d17/d36/f46 [0,4194304] 0 2024-09-13T23:06:14.830 INFO:tasks.workunit.client.0.smithi115.stdout:8/771: dwrite d3/d5/d1c/df2/ff3 [0,4194304] 0 2024-09-13T23:06:14.831 INFO:tasks.workunit.client.0.smithi115.stdout:6/746: rename d4/df/d14/d38/d2a/d3e/d56/ff4 to d4/df/d14/d38/d44/ffe 0 2024-09-13T23:06:14.831 INFO:tasks.workunit.client.1.smithi152.stdout:5/59: mkdir d5/da/df 0 2024-09-13T23:06:14.831 INFO:tasks.workunit.client.1.smithi152.stdout:4/143: dwrite d3/d4/d6/f20 [0,4194304] 0 2024-09-13T23:06:14.832 INFO:tasks.workunit.client.1.smithi152.stdout:4/144: chown d3/d4/d6/d8 331703 1 2024-09-13T23:06:14.832 INFO:tasks.workunit.client.1.smithi152.stdout:4/145: write d3/d4/d5/d1c/f27 [1046227,80089] 0 2024-09-13T23:06:14.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/19: dwrite f3 [4194304,4194304] 0 2024-09-13T23:06:14.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/20: chown l2 1617 1 2024-09-13T23:06:14.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/21: chown f3 0 1 2024-09-13T23:06:14.834 INFO:tasks.workunit.client.0.smithi115.stdout:5/702: dwrite d8/fa2 [0,4194304] 0 2024-09-13T23:06:14.835 INFO:tasks.workunit.client.0.smithi115.stdout:9/683: creat d0/d13/d17/d1f/d4e/fd4 x:0 0 0 2024-09-13T23:06:14.835 INFO:tasks.workunit.client.1.smithi152.stdout:3/80: symlink de/d11/l18 0 2024-09-13T23:06:14.835 INFO:tasks.workunit.client.1.smithi152.stdout:3/81: stat de/d14 0 2024-09-13T23:06:14.842 INFO:tasks.workunit.client.0.smithi115.stdout:7/657: rename da/dd/d13/d7e to da/dd/d13/d36/d5a/d99/ddd 0 2024-09-13T23:06:14.845 INFO:tasks.workunit.client.0.smithi115.stdout:6/747: write d4/df/d14/d38/d44/d66/d8b/f98 [3962151,78471] 0 2024-09-13T23:06:14.849 INFO:tasks.workunit.client.1.smithi152.stdout:6/22: read f3 [1648738,10727] 0 2024-09-13T23:06:14.849 INFO:tasks.workunit.client.0.smithi115.stdout:8/772: dread d3/d5/d1c/df2/ff3 [0,4194304] 0 2024-09-13T23:06:14.854 INFO:tasks.workunit.client.0.smithi115.stdout:7/658: mkdir da/dd/d1c/d84/dde 0 2024-09-13T23:06:14.863 INFO:tasks.workunit.client.0.smithi115.stdout:6/748: dread d4/df/d14/d38/d2a/d3e/f4c [4194304,4194304] 0 2024-09-13T23:06:14.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/82: creat de/d11/f19 x:0 0 0 2024-09-13T23:06:14.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/83: creat de/d11/f1a x:0 0 0 2024-09-13T23:06:14.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/84: fdatasync f8 0 2024-09-13T23:06:14.864 INFO:tasks.workunit.client.1.smithi152.stdout:6/23: symlink d4/l5 0 2024-09-13T23:06:14.865 INFO:tasks.workunit.client.0.smithi115.stdout:6/749: mkdir d4/df/d14/d38/d2a/d3e/d56/dff 0 2024-09-13T23:06:14.865 INFO:tasks.workunit.client.1.smithi152.stdout:5/60: getdents d5/da 0 2024-09-13T23:06:14.866 INFO:tasks.workunit.client.0.smithi115.stdout:6/750: getdents d4/df/d14/d38/d44/d66 0 2024-09-13T23:06:14.868 INFO:tasks.workunit.client.0.smithi115.stdout:7/659: dread da/dd/d13/d36/d5a/d99/ddd/d92/db1/fca [0,4194304] 0 2024-09-13T23:06:14.868 INFO:tasks.workunit.client.0.smithi115.stdout:7/660: chown da/dd/d1c/d2d/d45 120063769 1 2024-09-13T23:06:14.868 INFO:tasks.workunit.client.0.smithi115.stdout:5/703: dwrite d8/dd/d5d/f8e [4194304,4194304] 0 2024-09-13T23:06:14.868 INFO:tasks.workunit.client.0.smithi115.stdout:5/704: readlink d8/dd/lb8 0 2024-09-13T23:06:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/24: creat d4/f6 x:0 0 0 2024-09-13T23:06:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/25: read f3 [651211,79886] 0 2024-09-13T23:06:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/26: readlink l2 0 2024-09-13T23:06:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:2/77: rename d0/d3 to d0/d4/d9/d18/d1e 0 2024-09-13T23:06:14.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/61: symlink d5/dc/l10 0 2024-09-13T23:06:14.870 INFO:tasks.workunit.client.1.smithi152.stdout:2/78: read d0/d4/d9/f10 [168649,48734] 0 2024-09-13T23:06:14.870 INFO:tasks.workunit.client.1.smithi152.stdout:2/79: fdatasync d0/d4/d9/f1b 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.0.smithi115.stdout:7/661: mkdir da/dd/d1c/d2d/d41/d98/ddf 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.0.smithi115.stdout:7/662: readlink da/dd/d1c/d2d/d60/lc7 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.1.smithi152.stdout:6/27: link f3 d4/f7 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.1.smithi152.stdout:5/62: symlink d5/l11 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/80: symlink d0/d4/d9/d14/l1f 0 2024-09-13T23:06:14.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/81: chown d0/d8 436578 1 2024-09-13T23:06:14.872 INFO:tasks.workunit.client.0.smithi115.stdout:6/751: read d4/df/d14/d38/d44/d66/fac [1844072,88173] 0 2024-09-13T23:06:14.872 INFO:tasks.workunit.client.0.smithi115.stdout:5/705: rename d8/dd/d14 to d8/dd/d6a/d82/d63/dd6 0 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:6/28: mknod d4/c8 0 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:6/29: creat d4/f9 x:0 0 0 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:6/30: creat d4/fa x:0 0 0 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:6/31: dread - d4/fa zero size 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/82: creat d0/d4/d9/d14/f20 x:0 0 0 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/83: dread - d0/d4/d9/f1b zero size 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/84: chown d0/d4/d9/lc 34941 1 2024-09-13T23:06:14.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/85: creat d0/d4/d9/d16/f21 x:0 0 0 2024-09-13T23:06:14.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/99: dwrite d17/f1b [0,4194304] 0 2024-09-13T23:06:14.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/86: dread d0/d4/d9/ff [0,4194304] 0 2024-09-13T23:06:14.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/87: fdatasync d0/fe 0 2024-09-13T23:06:14.876 INFO:tasks.workunit.client.0.smithi115.stdout:7/663: unlink da/dd/d13/d24/d67/cdb 0 2024-09-13T23:06:14.876 INFO:tasks.workunit.client.1.smithi152.stdout:8/38: dwrite f3 [0,4194304] 0 2024-09-13T23:06:14.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/146: dwrite d3/d4/f22 [0,4194304] 0 2024-09-13T23:06:14.878 INFO:tasks.workunit.client.1.smithi152.stdout:4/147: fsync d3/f13 0 2024-09-13T23:06:14.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/78: dwrite d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:14.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/79: dread - d4/d9/d11/f19 zero size 2024-09-13T23:06:14.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/100: getdents d17 0 2024-09-13T23:06:14.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/101: write d17/f1e [892328,121904] 0 2024-09-13T23:06:14.879 INFO:tasks.workunit.client.0.smithi115.stdout:6/752: creat d4/df/d14/d38/d2a/d3e/d56/dc4/f100 x:0 0 0 2024-09-13T23:06:14.881 INFO:tasks.workunit.client.1.smithi152.stdout:3/85: dread de/d11/f12 [0,4194304] 0 2024-09-13T23:06:14.882 INFO:tasks.workunit.client.0.smithi115.stdout:5/706: mknod d8/dd/d74/cd7 0 2024-09-13T23:06:14.885 INFO:tasks.workunit.client.0.smithi115.stdout:7/664: link da/dd/d13/d24/f6c da/dd/d1c/d2d/d41/d98/fe0 0 2024-09-13T23:06:14.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/102: creat d17/f22 x:0 0 0 2024-09-13T23:06:14.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/103: creat d17/f23 x:0 0 0 2024-09-13T23:06:14.886 INFO:tasks.workunit.client.1.smithi152.stdout:3/86: readlink l6 0 2024-09-13T23:06:14.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/88: rename d0/fb to d0/d8/f22 0 2024-09-13T23:06:14.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/89: read - d0/d4/d9/d16/f21 zero size 2024-09-13T23:06:14.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/753: rename d4/df/d14/d67/d77/dc1/ce6 to d4/d57/c101 0 2024-09-13T23:06:14.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/754: stat d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb 0 2024-09-13T23:06:14.890 INFO:tasks.workunit.client.0.smithi115.stdout:5/707: mkdir d8/d9e/dd8 0 2024-09-13T23:06:14.890 INFO:tasks.workunit.client.1.smithi152.stdout:3/87: mknod de/d11/c1b 0 2024-09-13T23:06:14.890 INFO:tasks.workunit.client.1.smithi152.stdout:3/88: creat de/f1c x:0 0 0 2024-09-13T23:06:14.891 INFO:tasks.workunit.client.1.smithi152.stdout:2/90: rmdir d0 39 2024-09-13T23:06:14.891 INFO:tasks.workunit.client.1.smithi152.stdout:2/91: chown d0/d4/d9/d18/d1e/c6 9812147 1 2024-09-13T23:06:14.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/39: write f3 [2961998,5566] 0 2024-09-13T23:06:14.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/40: creat fd x:0 0 0 2024-09-13T23:06:14.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/41: write f3 [420192,21102] 0 2024-09-13T23:06:14.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/755: unlink d4/df/d14/d67/ca2 0 2024-09-13T23:06:14.895 INFO:tasks.workunit.client.0.smithi115.stdout:6/756: fdatasync d4/d57/dab/fb6 0 2024-09-13T23:06:14.898 INFO:tasks.workunit.client.0.smithi115.stdout:5/708: dread d8/dd/d20/f17 [0,4194304] 0 2024-09-13T23:06:14.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/42: unlink fb 0 2024-09-13T23:06:14.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/43: chown f3 51520599 1 2024-09-13T23:06:14.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/44: creat fe x:0 0 0 2024-09-13T23:06:14.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/45: mknod cf 0 2024-09-13T23:06:14.907 INFO:tasks.workunit.client.1.smithi152.stdout:8/46: rename fe to f10 0 2024-09-13T23:06:14.907 INFO:tasks.workunit.client.1.smithi152.stdout:8/47: write fd [937561,4730] 0 2024-09-13T23:06:14.907 INFO:tasks.workunit.client.1.smithi152.stdout:8/48: rmdir - no directory 2024-09-13T23:06:14.907 INFO:tasks.workunit.client.0.smithi115.stdout:6/757: dread d4/df/f1c [0,4194304] 0 2024-09-13T23:06:14.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/63: dwrite d5/dc/fe [0,4194304] 0 2024-09-13T23:06:14.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/64: chown c3 122730258 1 2024-09-13T23:06:14.908 INFO:tasks.workunit.client.0.smithi115.stdout:6/758: mknod d4/df/d14/d38/d2a/d31/d5b/da8/c102 0 2024-09-13T23:06:14.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/65: symlink d5/da/df/l12 0 2024-09-13T23:06:14.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/66: write d5/f8 [808474,12240] 0 2024-09-13T23:06:14.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/67: chown d5 11039 1 2024-09-13T23:06:14.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/68: chown d5 224 1 2024-09-13T23:06:14.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/759: symlink d4/df/d14/d38/d2a/d3e/l103 0 2024-09-13T23:06:14.910 INFO:tasks.workunit.client.0.smithi115.stdout:6/760: fsync d4/df/d14/d35/f39 0 2024-09-13T23:06:14.912 INFO:tasks.workunit.client.0.smithi115.stdout:6/761: creat d4/df/d14/d67/d77/dcf/de8/f104 x:0 0 0 2024-09-13T23:06:14.912 INFO:tasks.workunit.client.0.smithi115.stdout:6/762: dread - d4/df/d14/d38/d44/d66/fc9 zero size 2024-09-13T23:06:14.913 INFO:tasks.workunit.client.0.smithi115.stdout:6/763: rmdir d4/d57/d5a/d79/d85/dbf 39 2024-09-13T23:06:14.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/709: write d8/fbc [3456268,93767] 0 2024-09-13T23:06:14.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/710: stat d8/dd/d5d/c86 0 2024-09-13T23:06:14.915 INFO:tasks.workunit.client.0.smithi115.stdout:5/711: chown d8/dd/d6a/d82/d63/dd6/f94 1277 1 2024-09-13T23:06:14.916 INFO:tasks.workunit.client.0.smithi115.stdout:5/712: creat d8/d9e/dd8/fd9 x:0 0 0 2024-09-13T23:06:14.918 INFO:tasks.workunit.client.0.smithi115.stdout:6/764: write d4/df/f1c [4041430,71162] 0 2024-09-13T23:06:14.918 INFO:tasks.workunit.client.0.smithi115.stdout:6/765: fdatasync d4/df/d14/d35/f39 0 2024-09-13T23:06:14.919 INFO:tasks.workunit.client.0.smithi115.stdout:6/766: mknod d4/d57/d5a/d79/d85/dbf/c105 0 2024-09-13T23:06:14.921 INFO:tasks.workunit.client.0.smithi115.stdout:6/767: link d4/df/d14/c19 d4/df/d14/d38/d44/d66/d8b/c106 0 2024-09-13T23:06:14.921 INFO:tasks.workunit.client.0.smithi115.stdout:6/768: chown d4/df/d14/d38/d2a/d3e/d56/dc4/f100 16362105 1 2024-09-13T23:06:14.922 INFO:tasks.workunit.client.0.smithi115.stdout:6/769: rename d4/df/d14/d38/d44/ff0 to d4/df/d14/d38/d44/d99/f107 0 2024-09-13T23:06:14.923 INFO:tasks.workunit.client.1.smithi152.stdout:6/32: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:14.923 INFO:tasks.workunit.client.0.smithi115.stdout:6/770: rename d4/df/d14/d38/d44/d99/def/cf1 to d4/df/d14/d38/d44/d99/dc0/c108 0 2024-09-13T23:06:14.929 INFO:tasks.workunit.client.0.smithi115.stdout:7/665: dwrite da/dd/d13/d36/f42 [0,4194304] 0 2024-09-13T23:06:14.929 INFO:tasks.workunit.client.1.smithi152.stdout:1/80: dwrite d4/d9/fb [0,4194304] 0 2024-09-13T23:06:14.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/81: stat d4/d9/c17 0 2024-09-13T23:06:14.932 INFO:tasks.workunit.client.0.smithi115.stdout:7/666: mkdir da/dd/d1c/d2d/d41/de1 0 2024-09-13T23:06:14.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/148: dwrite d3/d4/d6/f20 [4194304,4194304] 0 2024-09-13T23:06:14.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/149: write d3/d4/d6/f14 [830822,20502] 0 2024-09-13T23:06:14.935 INFO:tasks.workunit.client.0.smithi115.stdout:5/713: dwrite d8/dd/d20/d23/f2f [0,4194304] 0 2024-09-13T23:06:14.937 INFO:tasks.workunit.client.1.smithi152.stdout:4/150: rename d3/d4/ce to d3/d4/d6/d8/c29 0 2024-09-13T23:06:14.937 INFO:tasks.workunit.client.0.smithi115.stdout:5/714: mkdir d8/dd/d20/d27/dda 0 2024-09-13T23:06:14.938 INFO:tasks.workunit.client.0.smithi115.stdout:7/667: dread da/dd/f59 [4194304,4194304] 0 2024-09-13T23:06:14.938 INFO:tasks.workunit.client.1.smithi152.stdout:4/151: mknod d3/d4/d6/d8/d17/c2a 0 2024-09-13T23:06:14.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/152: mkdir d3/d4/d5/d2b 0 2024-09-13T23:06:14.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/153: truncate d3/d4/d6/d8/f1b 688025 0 2024-09-13T23:06:14.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/154: creat d3/d4/d5/d1c/f2c x:0 0 0 2024-09-13T23:06:14.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/155: fsync d3/d4/d6/f20 0 2024-09-13T23:06:14.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/89: rmdir de/d11 39 2024-09-13T23:06:14.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/90: dread - de/d11/f1a zero size 2024-09-13T23:06:14.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/91: readlink de/d11/l18 0 2024-09-13T23:06:14.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/92: chown de/f17 40585 1 2024-09-13T23:06:14.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/93: creat de/f1d x:0 0 0 2024-09-13T23:06:14.945 INFO:tasks.workunit.client.0.smithi115.stdout:6/771: dwrite d4/df/d14/d38/d2a/d3e/fa5 [0,4194304] 0 2024-09-13T23:06:14.945 INFO:tasks.workunit.client.1.smithi152.stdout:2/92: dwrite d0/fa [0,4194304] 0 2024-09-13T23:06:14.948 INFO:tasks.workunit.client.0.smithi115.stdout:5/715: dread d8/dd/d6a/d8a/fae [0,4194304] 0 2024-09-13T23:06:14.948 INFO:tasks.workunit.client.1.smithi152.stdout:2/93: symlink d0/d4/d9/l23 0 2024-09-13T23:06:14.951 INFO:tasks.workunit.client.0.smithi115.stdout:5/716: symlink d8/dd/d5d/d5e/ldb 0 2024-09-13T23:06:14.951 INFO:tasks.workunit.client.0.smithi115.stdout:5/717: dread - d8/dd/d74/fca zero size 2024-09-13T23:06:14.951 INFO:tasks.workunit.client.0.smithi115.stdout:5/718: write d8/dd/d6a/d8a/fae [1885353,96018] 0 2024-09-13T23:06:14.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/33: truncate d4/f6 3430692 0 2024-09-13T23:06:14.955 INFO:tasks.workunit.client.0.smithi115.stdout:7/668: dread da/dd/d1c/d2d/d45/d4d/f6f [0,4194304] 0 2024-09-13T23:06:14.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/94: dread f8 [0,4194304] 0 2024-09-13T23:06:14.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/95: creat de/f1e x:0 0 0 2024-09-13T23:06:14.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/34: dread f3 [0,4194304] 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/669: creat da/dd/d13/d24/d67/fe2 x:0 0 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/670: stat da/dd/d16 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/671: chown da/dd/d13/d24/d52/d7c/da7/fae 36 1 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/672: truncate da/dd/d1c/d2d/d60/d82/fd7 930597 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.0.smithi115.stdout:7/673: write da/dd/d1c/d2d/d41/d98/fbd [25126,73831] 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.1.smithi152.stdout:3/96: mkdir de/d1f 0 2024-09-13T23:06:14.958 INFO:tasks.workunit.client.1.smithi152.stdout:6/35: symlink d4/lb 0 2024-09-13T23:06:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/36: creat d4/fc x:0 0 0 2024-09-13T23:06:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/37: chown d4/c8 429065 1 2024-09-13T23:06:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/38: readlink d4/lb 0 2024-09-13T23:06:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:3/97: creat de/d1f/f20 x:0 0 0 2024-09-13T23:06:14.959 INFO:tasks.workunit.client.1.smithi152.stdout:3/98: fdatasync de/ff 0 2024-09-13T23:06:14.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/49: dwrite fd [0,4194304] 0 2024-09-13T23:06:14.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/50: fdatasync fd 0 2024-09-13T23:06:14.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/674: rmdir da/dd/d13/d36/d85 39 2024-09-13T23:06:14.960 INFO:tasks.workunit.client.0.smithi115.stdout:7/675: symlink da/dd/d1c/db0/le3 0 2024-09-13T23:06:14.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/99: link de/f1e de/d14/f21 0 2024-09-13T23:06:14.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/100: creat de/f22 x:0 0 0 2024-09-13T23:06:14.962 INFO:tasks.workunit.client.0.smithi115.stdout:7/676: rename da/dd/f59 to da/df/d3b/fe4 0 2024-09-13T23:06:14.964 INFO:tasks.workunit.client.1.smithi152.stdout:8/51: rename c4 to c11 0 2024-09-13T23:06:14.964 INFO:tasks.workunit.client.1.smithi152.stdout:8/52: fdatasync fd 0 2024-09-13T23:06:14.966 INFO:tasks.workunit.client.0.smithi115.stdout:6/772: dwrite d4/df/d14/d38/d2a/d3e/d56/dc4/f100 [0,4194304] 0 2024-09-13T23:06:14.967 INFO:tasks.workunit.client.1.smithi152.stdout:3/101: link de/d11/l18 de/d1f/l23 0 2024-09-13T23:06:14.967 INFO:tasks.workunit.client.1.smithi152.stdout:3/102: stat f2 0 2024-09-13T23:06:14.967 INFO:tasks.workunit.client.1.smithi152.stdout:8/53: symlink l12 0 2024-09-13T23:06:14.968 INFO:tasks.workunit.client.1.smithi152.stdout:8/54: symlink l13 0 2024-09-13T23:06:14.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/103: mknod de/c24 0 2024-09-13T23:06:14.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/104: fdatasync fd 0 2024-09-13T23:06:14.969 INFO:tasks.workunit.client.1.smithi152.stdout:3/105: creat de/d11/f25 x:0 0 0 2024-09-13T23:06:14.970 INFO:tasks.workunit.client.0.smithi115.stdout:6/773: creat d4/df/d14/d38/f109 x:0 0 0 2024-09-13T23:06:14.971 INFO:tasks.workunit.client.1.smithi152.stdout:5/69: dwrite d5/f8 [0,4194304] 0 2024-09-13T23:06:14.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/774: truncate d4/df/d14/d38/d2a/d3e/d56/d7b/f53 322899 0 2024-09-13T23:06:14.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/775: truncate d4/df/d14/d35/f8c 681578 0 2024-09-13T23:06:14.974 INFO:tasks.workunit.client.0.smithi115.stdout:6/776: read - d4/d57/fbe zero size 2024-09-13T23:06:14.976 INFO:tasks.workunit.client.0.smithi115.stdout:6/777: symlink d4/df/d14/d67/d77/l10a 0 2024-09-13T23:06:14.976 INFO:tasks.workunit.client.0.smithi115.stdout:6/778: fdatasync d4/d57/d75/fb1 0 2024-09-13T23:06:14.976 INFO:tasks.workunit.client.0.smithi115.stdout:6/779: chown d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/c9a 5990 1 2024-09-13T23:06:14.976 INFO:tasks.workunit.client.0.smithi115.stdout:6/780: chown d4/d57/d5a/d79/d85 27628038 1 2024-09-13T23:06:14.977 INFO:tasks.workunit.client.1.smithi152.stdout:1/82: dwrite f1 [0,4194304] 0 2024-09-13T23:06:14.978 INFO:tasks.workunit.client.0.smithi115.stdout:6/781: mkdir d4/df/d14/d38/d44/d99/d10b 0 2024-09-13T23:06:14.980 INFO:tasks.workunit.client.0.smithi115.stdout:5/719: dread d8/dd/d6a/d8a/fae [0,4194304] 0 2024-09-13T23:06:14.983 INFO:tasks.workunit.client.1.smithi152.stdout:1/83: rename d4/d9/d11 to d4/d9/d1a 0 2024-09-13T23:06:14.983 INFO:tasks.workunit.client.1.smithi152.stdout:1/84: write d4/d9/fd [944188,39337] 0 2024-09-13T23:06:14.987 INFO:tasks.workunit.client.1.smithi152.stdout:6/39: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:14.988 INFO:tasks.workunit.client.1.smithi152.stdout:6/40: creat d4/fd x:0 0 0 2024-09-13T23:06:14.988 INFO:tasks.workunit.client.1.smithi152.stdout:6/41: dread - d4/fc zero size 2024-09-13T23:06:14.988 INFO:tasks.workunit.client.1.smithi152.stdout:5/70: dread f0 [4194304,4194304] 0 2024-09-13T23:06:14.991 INFO:tasks.workunit.client.0.smithi115.stdout:5/720: read d8/dd/d5d/f6e [717985,56005] 0 2024-09-13T23:06:14.991 INFO:tasks.workunit.client.0.smithi115.stdout:5/721: dread - d8/dd/d6a/d8a/f98 zero size 2024-09-13T23:06:14.991 INFO:tasks.workunit.client.0.smithi115.stdout:5/722: creat d8/d7a/fdc x:0 0 0 2024-09-13T23:06:14.992 INFO:tasks.workunit.client.1.smithi152.stdout:5/71: creat d5/da/df/f13 x:0 0 0 2024-09-13T23:06:14.992 INFO:tasks.workunit.client.1.smithi152.stdout:4/156: dwrite d3/d4/d6/f14 [0,4194304] 0 2024-09-13T23:06:14.995 INFO:tasks.workunit.client.1.smithi152.stdout:4/157: mknod d3/d4/d6/d8/d17/c2d 0 2024-09-13T23:06:14.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/85: rmdir d4/d9 39 2024-09-13T23:06:14.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/86: write d4/d9/d1a/f19 [1905316,127958] 0 2024-09-13T23:06:14.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/158: link d3/d4/d6/f20 d3/d4/d5/d2b/f2e 0 2024-09-13T23:06:15.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/723: dread d8/dd/d20/dbb/f41 [0,4194304] 0 2024-09-13T23:06:15.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/724: write d8/d9e/dcd/fd1 [965097,118652] 0 2024-09-13T23:06:15.004 INFO:tasks.workunit.client.1.smithi152.stdout:5/72: write d5/dc/fe [1113590,63356] 0 2024-09-13T23:06:15.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/55: dwrite f10 [0,4194304] 0 2024-09-13T23:06:15.004 INFO:tasks.workunit.client.1.smithi152.stdout:5/73: write f0 [4885572,49961] 0 2024-09-13T23:06:15.004 INFO:tasks.workunit.client.1.smithi152.stdout:5/74: read d5/dc/fe [3483341,46959] 0 2024-09-13T23:06:15.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/75: truncate d5/f7 1272629 0 2024-09-13T23:06:15.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/76: creat d5/f14 x:0 0 0 2024-09-13T23:06:15.008 INFO:tasks.workunit.client.1.smithi152.stdout:5/77: mknod d5/da/c15 0 2024-09-13T23:06:15.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/87: read d4/d9/fb [2531532,20065] 0 2024-09-13T23:06:15.016 INFO:tasks.workunit.client.0.smithi115.stdout:5/725: dread d8/dd/d6a/d82/d63/dd6/f37 [0,4194304] 0 2024-09-13T23:06:15.016 INFO:tasks.workunit.client.0.smithi115.stdout:6/782: dwrite d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fc5 [0,4194304] 0 2024-09-13T23:06:15.016 INFO:tasks.workunit.client.0.smithi115.stdout:6/783: fdatasync d4/df/d14/d67/d77/dcf/de8/f104 0 2024-09-13T23:06:15.017 INFO:tasks.workunit.client.0.smithi115.stdout:6/784: fdatasync d4/df/d14/d38/d44/d66/fac 0 2024-09-13T23:06:15.019 INFO:tasks.workunit.client.1.smithi152.stdout:8/56: write fd [3262007,101072] 0 2024-09-13T23:06:15.019 INFO:tasks.workunit.client.1.smithi152.stdout:6/42: dwrite f3 [4194304,4194304] 0 2024-09-13T23:06:15.020 INFO:tasks.workunit.client.0.smithi115.stdout:5/726: mkdir d8/dd/d5d/d9b/ddd 0 2024-09-13T23:06:15.023 INFO:tasks.workunit.client.0.smithi115.stdout:5/727: write d8/d9e/dcd/fd1 [764301,74216] 0 2024-09-13T23:06:15.023 INFO:tasks.workunit.client.1.smithi152.stdout:5/78: read d5/f7 [957879,13964] 0 2024-09-13T23:06:15.023 INFO:tasks.workunit.client.1.smithi152.stdout:5/79: write d5/da/df/f13 [415935,118505] 0 2024-09-13T23:06:15.024 INFO:tasks.workunit.client.1.smithi152.stdout:8/57: mknod c14 0 2024-09-13T23:06:15.024 INFO:tasks.workunit.client.1.smithi152.stdout:8/58: creat f15 x:0 0 0 2024-09-13T23:06:15.025 INFO:tasks.workunit.client.0.smithi115.stdout:5/728: mkdir d8/dd/d6a/d82/d63/dd6/dde 0 2024-09-13T23:06:15.025 INFO:tasks.workunit.client.0.smithi115.stdout:5/729: creat d8/dd/d5d/d5e/fdf x:0 0 0 2024-09-13T23:06:15.026 INFO:tasks.workunit.client.1.smithi152.stdout:6/43: mkdir d4/de 0 2024-09-13T23:06:15.027 INFO:tasks.workunit.client.1.smithi152.stdout:8/59: mknod c16 0 2024-09-13T23:06:15.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/44: creat d4/de/ff x:0 0 0 2024-09-13T23:06:15.028 INFO:tasks.workunit.client.1.smithi152.stdout:6/45: write d4/fa [17526,36585] 0 2024-09-13T23:06:15.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/60: mkdir d17 0 2024-09-13T23:06:15.029 INFO:tasks.workunit.client.1.smithi152.stdout:8/61: mknod d17/c18 0 2024-09-13T23:06:15.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/88: dwrite d4/d9/f13 [0,4194304] 0 2024-09-13T23:06:15.038 INFO:tasks.workunit.client.1.smithi152.stdout:1/89: symlink d4/d16/l1b 0 2024-09-13T23:06:15.038 INFO:tasks.workunit.client.0.smithi115.stdout:5/730: write d8/dd/d5d/f8e [4960458,33601] 0 2024-09-13T23:06:15.040 INFO:tasks.workunit.client.1.smithi152.stdout:1/90: unlink d4/ce 0 2024-09-13T23:06:15.041 INFO:tasks.workunit.client.1.smithi152.stdout:8/62: dread f10 [0,4194304] 0 2024-09-13T23:06:15.042 INFO:tasks.workunit.client.1.smithi152.stdout:8/63: fdatasync f15 0 2024-09-13T23:06:15.045 INFO:tasks.workunit.client.1.smithi152.stdout:1/91: write d4/d9/fd [625103,127900] 0 2024-09-13T23:06:15.045 INFO:tasks.workunit.client.1.smithi152.stdout:1/92: write d4/d9/fd [107290,35008] 0 2024-09-13T23:06:15.045 INFO:tasks.workunit.client.1.smithi152.stdout:1/93: write d4/d9/fb [4773016,11418] 0 2024-09-13T23:06:15.051 INFO:tasks.workunit.client.0.smithi115.stdout:5/731: write d8/dd/d20/f52 [3556172,24174] 0 2024-09-13T23:06:15.051 INFO:tasks.workunit.client.0.smithi115.stdout:5/732: write d8/dd/d5d/d5e/fdf [564804,104705] 0 2024-09-13T23:06:15.051 INFO:tasks.workunit.client.0.smithi115.stdout:5/733: readlink d8/dd/d6a/d82/d63/dd6/l71 0 2024-09-13T23:06:15.053 INFO:tasks.workunit.client.0.smithi115.stdout:5/734: mknod d8/dd/d20/ce0 0 2024-09-13T23:06:15.053 INFO:tasks.workunit.client.0.smithi115.stdout:5/735: fdatasync d8/dd/d20/d4a/f57 0 2024-09-13T23:06:15.054 INFO:tasks.workunit.client.1.smithi152.stdout:6/46: dwrite d4/f9 [0,4194304] 0 2024-09-13T23:06:15.054 INFO:tasks.workunit.client.1.smithi152.stdout:6/47: write d4/de/ff [667645,12140] 0 2024-09-13T23:06:15.055 INFO:tasks.workunit.client.0.smithi115.stdout:5/736: unlink d8/l11 0 2024-09-13T23:06:15.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/80: dwrite d5/da/df/f13 [0,4194304] 0 2024-09-13T23:06:15.071 INFO:tasks.workunit.client.1.smithi152.stdout:5/81: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:15.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/82: symlink d5/l16 0 2024-09-13T23:06:15.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/83: read f0 [3103064,69438] 0 2024-09-13T23:06:15.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/84: chown d5/f8 1267 1 2024-09-13T23:06:15.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/85: symlink d5/da/df/l17 0 2024-09-13T23:06:15.073 INFO:tasks.workunit.client.1.smithi152.stdout:5/86: link d5/da/cb d5/da/df/c18 0 2024-09-13T23:06:15.073 INFO:tasks.workunit.client.1.smithi152.stdout:5/87: read f0 [2916706,12015] 0 2024-09-13T23:06:15.087 INFO:tasks.workunit.client.1.smithi152.stdout:1/94: dwrite d4/d9/fb [4194304,4194304] 0 2024-09-13T23:06:15.087 INFO:tasks.workunit.client.1.smithi152.stdout:1/95: fdatasync d4/d9/fb 0 2024-09-13T23:06:15.088 INFO:tasks.workunit.client.0.smithi115.stdout:5/737: dwrite d8/dd/f2b [0,4194304] 0 2024-09-13T23:06:15.089 INFO:tasks.workunit.client.1.smithi152.stdout:1/96: read d4/d9/d1a/f19 [1760132,34339] 0 2024-09-13T23:06:15.089 INFO:tasks.workunit.client.1.smithi152.stdout:1/97: fsync d4/d9/fb 0 2024-09-13T23:06:15.090 INFO:tasks.workunit.client.1.smithi152.stdout:1/98: creat d4/f1c x:0 0 0 2024-09-13T23:06:15.092 INFO:tasks.workunit.client.1.smithi152.stdout:1/99: symlink d4/d16/l1d 0 2024-09-13T23:06:15.093 INFO:tasks.workunit.client.1.smithi152.stdout:5/88: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:15.093 INFO:tasks.workunit.client.1.smithi152.stdout:5/89: chown d5/f7 1467541 1 2024-09-13T23:06:15.097 INFO:tasks.workunit.client.1.smithi152.stdout:5/90: rename d5/da/df to d5/dc/d19 0 2024-09-13T23:06:15.097 INFO:tasks.workunit.client.1.smithi152.stdout:1/100: dread d4/d9/fd [0,4194304] 0 2024-09-13T23:06:15.098 INFO:tasks.workunit.client.1.smithi152.stdout:5/91: creat d5/dc/d19/f1a x:0 0 0 2024-09-13T23:06:15.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/101: truncate d4/d9/fd 485884 0 2024-09-13T23:06:15.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/102: stat d4/f1c 0 2024-09-13T23:06:15.099 INFO:tasks.workunit.client.1.smithi152.stdout:5/92: creat d5/da/f1b x:0 0 0 2024-09-13T23:06:15.100 INFO:tasks.workunit.client.1.smithi152.stdout:5/93: write d5/da/f1b [204951,130753] 0 2024-09-13T23:06:15.100 INFO:tasks.workunit.client.1.smithi152.stdout:1/103: getdents d4/d9/d1a 0 2024-09-13T23:06:15.108 INFO:tasks.workunit.client.0.smithi115.stdout:5/738: dwrite d8/dd/d20/d4a/f4f [4194304,4194304] 0 2024-09-13T23:06:15.110 INFO:tasks.workunit.client.0.smithi115.stdout:5/739: mkdir d8/dd/d5d/d9b/de1 0 2024-09-13T23:06:15.111 INFO:tasks.workunit.client.0.smithi115.stdout:5/740: write d8/dd/d5d/d5e/f73 [201444,108893] 0 2024-09-13T23:06:15.111 INFO:tasks.workunit.client.0.smithi115.stdout:5/741: readlink d8/dd/d6a/d82/d63/dd6/l71 0 2024-09-13T23:06:15.113 INFO:tasks.workunit.client.1.smithi152.stdout:9/151: sync 2024-09-13T23:06:15.113 INFO:tasks.workunit.client.1.smithi152.stdout:9/152: readlink d3/l2d 0 2024-09-13T23:06:15.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/97: sync 2024-09-13T23:06:15.114 INFO:tasks.workunit.client.1.smithi152.stdout:5/94: dread d5/dc/d19/f13 [0,4194304] 0 2024-09-13T23:06:15.123 INFO:tasks.workunit.client.0.smithi115.stdout:5/742: write d8/f26 [3738594,11588] 0 2024-09-13T23:06:15.123 INFO:tasks.workunit.client.0.smithi115.stdout:5/743: fsync d8/dd/d6a/d82/d63/dd6/fa5 0 2024-09-13T23:06:15.123 INFO:tasks.workunit.client.0.smithi115.stdout:5/744: fsync d8/dd/d20/d4a/f8f 0 2024-09-13T23:06:15.124 INFO:tasks.workunit.client.1.smithi152.stdout:1/104: dwrite f1 [0,4194304] 0 2024-09-13T23:06:15.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/98: dwrite f0 [0,4194304] 0 2024-09-13T23:06:15.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/99: fsync fd 0 2024-09-13T23:06:15.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/100: chown f10 12607 1 2024-09-13T23:06:15.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/101: chown f8 29761447 1 2024-09-13T23:06:15.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/102: mknod d18/c22 0 2024-09-13T23:06:15.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/103: chown d18/l1d 3 1 2024-09-13T23:06:15.146 INFO:tasks.workunit.client.0.smithi115.stdout:4/725: sync 2024-09-13T23:06:15.146 INFO:tasks.workunit.client.0.smithi115.stdout:1/667: sync 2024-09-13T23:06:15.146 INFO:tasks.workunit.client.0.smithi115.stdout:0/641: sync 2024-09-13T23:06:15.148 INFO:tasks.workunit.client.0.smithi115.stdout:1/668: rmdir d0/de/d1b/d25/d67/dc4 0 2024-09-13T23:06:15.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/153: dread d3/f15 [0,4194304] 0 2024-09-13T23:06:15.153 INFO:tasks.workunit.client.0.smithi115.stdout:0/642: mkdir d6/d24/d25/da3/dad/de4 0 2024-09-13T23:06:15.153 INFO:tasks.workunit.client.0.smithi115.stdout:0/643: mknod d6/d24/d25/ce5 0 2024-09-13T23:06:15.153 INFO:tasks.workunit.client.0.smithi115.stdout:0/644: chown d6/d24/d25/d2b/d82/d6b/d9f/dab/dca 0 1 2024-09-13T23:06:15.153 INFO:tasks.workunit.client.1.smithi152.stdout:9/154: rename d3/d24/c1b to d3/d24/c31 0 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/155: dread - d3/f1c zero size 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/156: creat d3/d1e/d30/f32 x:0 0 0 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/157: chown d3/d1e 2 1 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.0.smithi115.stdout:0/645: mknod d6/d24/d25/d2b/ce6 0 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.0.smithi115.stdout:0/646: fdatasync d6/d24/d25/d2b/f42 0 2024-09-13T23:06:15.154 INFO:tasks.workunit.client.0.smithi115.stdout:0/647: readlink d6/ld0 0 2024-09-13T23:06:15.158 INFO:tasks.workunit.client.0.smithi115.stdout:0/648: creat d6/fe7 x:0 0 0 2024-09-13T23:06:15.158 INFO:tasks.workunit.client.0.smithi115.stdout:5/745: dwrite d8/dd/d6a/fa1 [0,4194304] 0 2024-09-13T23:06:15.158 INFO:tasks.workunit.client.0.smithi115.stdout:5/746: write d8/dd/d74/fca [989567,116274] 0 2024-09-13T23:06:15.158 INFO:tasks.workunit.client.0.smithi115.stdout:5/747: readlink d8/dd/d20/dbb/l62 0 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/748: readlink d8/dd/l22 0 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/749: read - d8/dd/d6a/d8a/f98 zero size 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/750: chown d8/dd/d64/lac 61803218 1 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/751: creat d8/d9e/dd8/fe2 x:0 0 0 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.0.smithi115.stdout:5/752: write d8/f26 [834144,14853] 0 2024-09-13T23:06:15.159 INFO:tasks.workunit.client.1.smithi152.stdout:1/105: dwrite d4/f1c [0,4194304] 0 2024-09-13T23:06:15.162 INFO:tasks.workunit.client.0.smithi115.stdout:5/753: rename d8/dd/d20/dbb/f92 to d8/d9e/dd8/fe3 0 2024-09-13T23:06:15.162 INFO:tasks.workunit.client.0.smithi115.stdout:5/754: dread - d8/dd/d20/d4a/f8f zero size 2024-09-13T23:06:15.163 INFO:tasks.workunit.client.1.smithi152.stdout:9/158: write d3/f15 [1167366,117614] 0 2024-09-13T23:06:15.163 INFO:tasks.workunit.client.0.smithi115.stdout:5/755: link d8/dd/d5d/d5e/f7c d8/dd/d20/d27/da9/fe4 0 2024-09-13T23:06:15.164 INFO:tasks.workunit.client.0.smithi115.stdout:5/756: stat d8/dd/d20/d4a/caf 0 2024-09-13T23:06:15.164 INFO:tasks.workunit.client.0.smithi115.stdout:5/757: chown d8/d9e/dd8/fe3 467013 1 2024-09-13T23:06:15.164 INFO:tasks.workunit.client.0.smithi115.stdout:5/758: write d8/d7a/fdc [476620,45390] 0 2024-09-13T23:06:15.166 INFO:tasks.workunit.client.0.smithi115.stdout:0/649: dread d6/f72 [0,4194304] 0 2024-09-13T23:06:15.167 INFO:tasks.workunit.client.1.smithi152.stdout:1/106: link d4/c5 d4/c1e 0 2024-09-13T23:06:15.173 INFO:tasks.workunit.client.0.smithi115.stdout:5/759: write d8/dd/d6a/d82/d63/dd6/f94 [1893577,5031] 0 2024-09-13T23:06:15.181 INFO:tasks.workunit.client.0.smithi115.stdout:0/650: dread d6/d24/d25/d58/f7e [0,4194304] 0 2024-09-13T23:06:15.183 INFO:tasks.workunit.client.1.smithi152.stdout:5/95: dwrite f0 [0,4194304] 0 2024-09-13T23:06:15.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/96: symlink d5/l1c 0 2024-09-13T23:06:15.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/97: chown d5/f8 80 1 2024-09-13T23:06:15.186 INFO:tasks.workunit.client.0.smithi115.stdout:5/760: write d8/dd/d6a/d82/d63/dd6/f77 [718590,93294] 0 2024-09-13T23:06:15.186 INFO:tasks.workunit.client.1.smithi152.stdout:5/98: truncate d5/da/f1b 272351 0 2024-09-13T23:06:15.186 INFO:tasks.workunit.client.1.smithi152.stdout:5/99: chown d5/da/cb 41646094 1 2024-09-13T23:06:15.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/651: dread d6/f20 [0,4194304] 0 2024-09-13T23:06:15.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/652: fsync d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe 0 2024-09-13T23:06:15.188 INFO:tasks.workunit.client.0.smithi115.stdout:0/653: chown d6/d24/d25/d58/f7e 6570 1 2024-09-13T23:06:15.190 INFO:tasks.workunit.client.0.smithi115.stdout:0/654: rmdir d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf/dd1 0 2024-09-13T23:06:15.190 INFO:tasks.workunit.client.0.smithi115.stdout:0/655: getdents d6/d24/d25/d2b/d82/d44/d5c/d87/dc2 0 2024-09-13T23:06:15.196 INFO:tasks.workunit.client.0.smithi115.stdout:5/761: write d8/dd/d64/fa7 [3334866,60542] 0 2024-09-13T23:06:15.198 INFO:tasks.workunit.client.0.smithi115.stdout:5/762: rename d8/dd/d20/c68 to d8/dd/d6a/d82/d63/dd6/ce5 0 2024-09-13T23:06:15.200 INFO:tasks.workunit.client.1.smithi152.stdout:5/100: read d5/f8 [2184359,126514] 0 2024-09-13T23:06:15.202 INFO:tasks.workunit.client.0.smithi115.stdout:4/726: dwrite db/d16/d3f/f67 [0,4194304] 0 2024-09-13T23:06:15.203 INFO:tasks.workunit.client.0.smithi115.stdout:1/669: dwrite d0/fb0 [0,4194304] 0 2024-09-13T23:06:15.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/159: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:15.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/727: symlink db/d16/d3f/dae/ld3 0 2024-09-13T23:06:15.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/728: readlink db/d19/d34/l58 0 2024-09-13T23:06:15.208 INFO:tasks.workunit.client.1.smithi152.stdout:1/107: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:15.209 INFO:tasks.workunit.client.0.smithi115.stdout:0/656: dwrite d6/d24/f38 [0,4194304] 0 2024-09-13T23:06:15.210 INFO:tasks.workunit.client.1.smithi152.stdout:5/101: read d5/da/f1b [22557,52449] 0 2024-09-13T23:06:15.210 INFO:tasks.workunit.client.1.smithi152.stdout:5/102: fdatasync f0 0 2024-09-13T23:06:15.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/103: creat d5/dc/d19/f1d x:0 0 0 2024-09-13T23:06:15.212 INFO:tasks.workunit.client.0.smithi115.stdout:0/657: symlink d6/d24/d25/d58/db4/le8 0 2024-09-13T23:06:15.213 INFO:tasks.workunit.client.0.smithi115.stdout:0/658: mknod d6/da0/ce9 0 2024-09-13T23:06:15.213 INFO:tasks.workunit.client.0.smithi115.stdout:0/659: creat d6/da5/fea x:0 0 0 2024-09-13T23:06:15.213 INFO:tasks.workunit.client.1.smithi152.stdout:5/104: getdents d5 0 2024-09-13T23:06:15.214 INFO:tasks.workunit.client.1.smithi152.stdout:5/105: mknod d5/c1e 0 2024-09-13T23:06:15.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/660: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/ceb 0 2024-09-13T23:06:15.214 INFO:tasks.workunit.client.0.smithi115.stdout:0/661: chown d6/da5/fea 235878 1 2024-09-13T23:06:15.215 INFO:tasks.workunit.client.0.smithi115.stdout:4/729: dread db/d19/fc2 [0,4194304] 0 2024-09-13T23:06:15.216 INFO:tasks.workunit.client.0.smithi115.stdout:4/730: symlink db/d16/d3f/dae/ld4 0 2024-09-13T23:06:15.217 INFO:tasks.workunit.client.0.smithi115.stdout:4/731: fdatasync db/d11/d2e/d33/d36/d7f/f53 0 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: Checking for cert/key for grafana.smithi115 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: Migrating grafana.smithi115 cert to cert store 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: Migrating grafana.smithi115 key to cert store 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/trash_purge_schedule"}]: dispatch 2024-09-13T23:06:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/trash_purge_schedule"}]: dispatch 2024-09-13T23:06:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: mgrmap e22: smithi152.ntylos(active, since 1.04027s) 2024-09-13T23:06:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: Deploying cephadm binary to smithi115 2024-09-13T23:06:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:14 smithi152 ceph-mon[34465]: Deploying cephadm binary to smithi152 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.1.smithi152.stdout:2/94: sync 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.1.smithi152.stdout:7/104: sync 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.1.smithi152.stdout:7/105: write d17/f1c [701258,83961] 0 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/732: symlink db/d16/d3f/d66/d68/d71/d84/ld5 0 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/733: symlink db/d16/d3f/dae/ld6 0 2024-09-13T23:06:15.220 INFO:tasks.workunit.client.0.smithi115.stdout:4/734: write db/d11/d54/d17/f9a [212723,26169] 0 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.0.smithi115.stdout:4/735: mknod db/d11/d54/cd7 0 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/95: mknod d0/d4/d9/d18/d1e/c24 0 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/96: creat d0/d4/d9/f25 x:0 0 0 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/108: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/109: dread - d4/d9/f14 zero size 2024-09-13T23:06:15.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/110: truncate d4/d9/f14 848229 0 2024-09-13T23:06:15.222 INFO:tasks.workunit.client.0.smithi115.stdout:0/662: read d6/d24/f38 [664799,33388] 0 2024-09-13T23:06:15.222 INFO:tasks.workunit.client.0.smithi115.stdout:0/663: creat d6/d24/d25/d58/fec x:0 0 0 2024-09-13T23:06:15.222 INFO:tasks.workunit.client.1.smithi152.stdout:1/111: creat d4/d9/f1f x:0 0 0 2024-09-13T23:06:15.227 INFO:tasks.workunit.client.1.smithi152.stdout:1/112: write d4/f6 [1972873,77629] 0 2024-09-13T23:06:15.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/106: read d17/f19 [1654194,64272] 0 2024-09-13T23:06:15.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/107: fsync f11 0 2024-09-13T23:06:15.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/108: chown d17/f1d 3952 1 2024-09-13T23:06:15.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/109: chown c12 93 1 2024-09-13T23:06:15.232 INFO:tasks.workunit.client.1.smithi152.stdout:1/113: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:15.232 INFO:tasks.workunit.client.1.smithi152.stdout:1/114: chown d4/d9/fb 102320687 1 2024-09-13T23:06:15.232 INFO:tasks.workunit.client.1.smithi152.stdout:1/115: write d4/f6 [3344603,68838] 0 2024-09-13T23:06:15.232 INFO:tasks.workunit.client.1.smithi152.stdout:7/110: write d17/f1c [633921,1387] 0 2024-09-13T23:06:15.232 INFO:tasks.workunit.client.1.smithi152.stdout:1/116: rename d4/d16/l1d to d4/d9/d1a/l20 0 2024-09-13T23:06:15.233 INFO:tasks.workunit.client.1.smithi152.stdout:7/111: mkdir d17/d24 0 2024-09-13T23:06:15.233 INFO:tasks.workunit.client.0.smithi115.stdout:4/736: getdents db/d16/d3f/dae 0 2024-09-13T23:06:15.235 INFO:tasks.workunit.client.0.smithi115.stdout:4/737: mkdir db/d11/d54/d17/dd1/dd8 0 2024-09-13T23:06:15.235 INFO:tasks.workunit.client.0.smithi115.stdout:4/738: chown db/d19/f27 98174098 1 2024-09-13T23:06:15.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/97: dwrite d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:15.236 INFO:tasks.workunit.client.0.smithi115.stdout:4/739: mknod db/d19/cd9 0 2024-09-13T23:06:15.239 INFO:tasks.workunit.client.1.smithi152.stdout:2/98: rename d0/d8/c12 to d0/d4/d9/d16/c26 0 2024-09-13T23:06:15.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/99: rename d0/l2 to d0/d4/d9/l27 0 2024-09-13T23:06:15.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/100: creat d0/d4/d9/d14/f28 x:0 0 0 2024-09-13T23:06:15.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/101: write d0/d4/f1d [295257,89126] 0 2024-09-13T23:06:15.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/102: dread - d0/d8/f22 zero size 2024-09-13T23:06:15.244 INFO:tasks.workunit.client.1.smithi152.stdout:2/103: creat d0/d4/d9/d18/f29 x:0 0 0 2024-09-13T23:06:15.246 INFO:tasks.workunit.client.1.smithi152.stdout:2/104: creat d0/d8/f2a x:0 0 0 2024-09-13T23:06:15.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/105: dread d0/d4/d9/ff [0,4194304] 0 2024-09-13T23:06:15.249 INFO:tasks.workunit.client.1.smithi152.stdout:2/106: mkdir d0/d4/d9/d16/d2b 0 2024-09-13T23:06:15.249 INFO:tasks.workunit.client.1.smithi152.stdout:2/107: read - d0/d4/d9/d14/f28 zero size 2024-09-13T23:06:15.249 INFO:tasks.workunit.client.1.smithi152.stdout:2/108: stat d0/d8/f2a 0 2024-09-13T23:06:15.250 INFO:tasks.workunit.client.1.smithi152.stdout:2/109: symlink d0/l2c 0 2024-09-13T23:06:15.250 INFO:tasks.workunit.client.1.smithi152.stdout:2/110: fdatasync d0/d4/d9/d16/f17 0 2024-09-13T23:06:15.250 INFO:tasks.workunit.client.1.smithi152.stdout:2/111: chown d0/fe 29153 1 2024-09-13T23:06:15.251 INFO:tasks.workunit.client.1.smithi152.stdout:7/112: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:15.255 INFO:tasks.workunit.client.1.smithi152.stdout:7/113: write f4 [2979030,98452] 0 2024-09-13T23:06:15.255 INFO:tasks.workunit.client.1.smithi152.stdout:7/114: fdatasync d17/f1e 0 2024-09-13T23:06:15.256 INFO:tasks.workunit.client.1.smithi152.stdout:7/115: rename f11 to d17/f25 0 2024-09-13T23:06:15.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/116: link d17/f1c d17/f26 0 2024-09-13T23:06:15.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/117: creat d17/f27 x:0 0 0 2024-09-13T23:06:15.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/118: readlink l10 0 2024-09-13T23:06:15.257 INFO:tasks.workunit.client.1.smithi152.stdout:7/119: write d17/f22 [705012,20022] 0 2024-09-13T23:06:15.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/120: write d17/f22 [13999,59468] 0 2024-09-13T23:06:15.258 INFO:tasks.workunit.client.0.smithi115.stdout:4/740: dwrite db/d11/fa3 [0,4194304] 0 2024-09-13T23:06:15.258 INFO:tasks.workunit.client.0.smithi115.stdout:4/741: fsync db/d11/d2e/faf 0 2024-09-13T23:06:15.260 INFO:tasks.workunit.client.0.smithi115.stdout:4/742: rmdir db/d11/d2e/d33 39 2024-09-13T23:06:15.260 INFO:tasks.workunit.client.0.smithi115.stdout:4/743: write db/d16/d3f/d66/d68/d71/d84/fcc [849488,16043] 0 2024-09-13T23:06:15.261 INFO:tasks.workunit.client.0.smithi115.stdout:4/744: mknod db/cda 0 2024-09-13T23:06:15.263 INFO:tasks.workunit.client.0.smithi115.stdout:4/745: mkdir db/d16/d3f/d66/da6/ddb 0 2024-09-13T23:06:15.263 INFO:tasks.workunit.client.0.smithi115.stdout:4/746: creat db/d11/fdc x:0 0 0 2024-09-13T23:06:15.263 INFO:tasks.workunit.client.1.smithi152.stdout:2/112: dread d0/fa [0,4194304] 0 2024-09-13T23:06:15.265 INFO:tasks.workunit.client.0.smithi115.stdout:4/747: unlink db/d16/d3f/d66/l92 0 2024-09-13T23:06:15.265 INFO:tasks.workunit.client.0.smithi115.stdout:4/748: dread - db/d11/d2e/d33/d36/d51/d57/f8f zero size 2024-09-13T23:06:15.265 INFO:tasks.workunit.client.0.smithi115.stdout:4/749: dread - db/d11/d54/f85 zero size 2024-09-13T23:06:15.266 INFO:tasks.workunit.client.0.smithi115.stdout:4/750: stat db/l3d 0 2024-09-13T23:06:15.266 INFO:tasks.workunit.client.0.smithi115.stdout:4/751: write db/d11/d2e/d33/d36/d7f/f3e [4898759,118920] 0 2024-09-13T23:06:15.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/752: rmdir db/d11/d2e/d33/d36 39 2024-09-13T23:06:15.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/753: chown db/d11/l8b 14057396 1 2024-09-13T23:06:15.269 INFO:tasks.workunit.client.0.smithi115.stdout:4/754: chown db/d19/d1d/f59 1 1 2024-09-13T23:06:15.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/121: dwrite d17/f26 [0,4194304] 0 2024-09-13T23:06:15.277 INFO:tasks.workunit.client.1.smithi152.stdout:7/122: mknod d17/d24/c28 0 2024-09-13T23:06:15.277 INFO:tasks.workunit.client.1.smithi152.stdout:2/113: dread d0/fe [0,4194304] 0 2024-09-13T23:06:15.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/123: rename fb to d17/d24/f29 0 2024-09-13T23:06:15.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/124: chown fd 856 1 2024-09-13T23:06:15.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/125: chown fd 20 1 2024-09-13T23:06:15.280 INFO:tasks.workunit.client.1.smithi152.stdout:2/114: mknod d0/d4/d9/d14/c2d 0 2024-09-13T23:06:15.281 INFO:tasks.workunit.client.1.smithi152.stdout:2/115: dread d0/d4/d9/ff [0,4194304] 0 2024-09-13T23:06:15.281 INFO:tasks.workunit.client.1.smithi152.stdout:2/116: dread - d0/d4/d9/f1b zero size 2024-09-13T23:06:15.284 INFO:tasks.workunit.client.1.smithi152.stdout:2/117: rename d0/d4/d9/f1b to d0/f2e 0 2024-09-13T23:06:15.284 INFO:tasks.workunit.client.1.smithi152.stdout:2/118: creat d0/d4/d9/d14/f2f x:0 0 0 2024-09-13T23:06:15.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/119: mkdir d0/d4/d9/d16/d30 0 2024-09-13T23:06:15.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/120: truncate d0/d4/f1a 560407 0 2024-09-13T23:06:15.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/121: chown d0 0 1 2024-09-13T23:06:15.289 INFO:tasks.workunit.client.0.smithi115.stdout:2/763: sync 2024-09-13T23:06:15.291 INFO:tasks.workunit.client.0.smithi115.stdout:2/764: link f4 da/d23/d2c/dc2/de1/d48/ffe 0 2024-09-13T23:06:15.291 INFO:tasks.workunit.client.0.smithi115.stdout:2/765: readlink da/d23/d2c/dc2/de1/l4f 0 2024-09-13T23:06:15.291 INFO:tasks.workunit.client.0.smithi115.stdout:2/766: dread - da/d23/d2c/dc2/de1/d56/d4b/ffc zero size 2024-09-13T23:06:15.291 INFO:tasks.workunit.client.0.smithi115.stdout:2/767: chown da/d21/l79 26007618 1 2024-09-13T23:06:15.294 INFO:tasks.workunit.client.0.smithi115.stdout:4/755: dwrite db/d16/d3f/d66/d68/d6a/f7a [0,4194304] 0 2024-09-13T23:06:15.296 INFO:tasks.workunit.client.1.smithi152.stdout:7/126: dwrite f6 [0,4194304] 0 2024-09-13T23:06:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:4/756: mknod db/d16/d3f/d66/d68/d71/cdd 0 2024-09-13T23:06:15.297 INFO:tasks.workunit.client.0.smithi115.stdout:4/757: readlink db/d16/d3f/d66/d68/d71/l7b 0 2024-09-13T23:06:15.297 INFO:tasks.workunit.client.1.smithi152.stdout:7/127: mkdir d17/d24/d2a 0 2024-09-13T23:06:15.299 INFO:tasks.workunit.client.0.smithi115.stdout:4/758: creat db/d11/d2e/dc7/fde x:0 0 0 2024-09-13T23:06:15.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/128: truncate d17/d24/f29 469806 0 2024-09-13T23:06:15.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: Checking for cert/key for grafana.smithi115 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: Migrating grafana.smithi115 cert to cert store 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: Migrating grafana.smithi115 key to cert store 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/trash_purge_schedule"}]: dispatch 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.ntylos/trash_purge_schedule"}]: dispatch 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: mgrmap e22: smithi152.ntylos(active, since 1.04027s) 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: Deploying cephadm binary to smithi115 2024-09-13T23:06:15.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:14 smithi115 ceph-mon[27601]: Deploying cephadm binary to smithi152 2024-09-13T23:06:15.301 INFO:tasks.workunit.client.1.smithi152.stdout:7/129: mkdir d17/d24/d2a/d2b 0 2024-09-13T23:06:15.311 INFO:tasks.workunit.client.0.smithi115.stdout:4/759: dread db/d19/d1d/f8d [0,4194304] 0 2024-09-13T23:06:15.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/760: creat db/d16/d3f/d66/fdf x:0 0 0 2024-09-13T23:06:15.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/122: dwrite d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:15.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/123: read d0/d4/d9/ff [88399,29168] 0 2024-09-13T23:06:15.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/124: fsync d0/d4/d9/d16/f21 0 2024-09-13T23:06:15.315 INFO:tasks.workunit.client.0.smithi115.stdout:2/768: dwrite da/d23/d2c/dc2/de1/d56/dda/ff2 [0,4194304] 0 2024-09-13T23:06:15.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/130: dread d17/f1b [0,4194304] 0 2024-09-13T23:06:15.317 INFO:tasks.workunit.client.0.smithi115.stdout:4/761: rename db/d16/d3f/l61 to db/d11/d2e/d33/d36/dad/le0 0 2024-09-13T23:06:15.318 INFO:tasks.workunit.client.1.smithi152.stdout:7/131: symlink d17/d24/d2a/d2b/l2c 0 2024-09-13T23:06:15.318 INFO:tasks.workunit.client.1.smithi152.stdout:7/132: write f5 [4046434,98470] 0 2024-09-13T23:06:15.320 INFO:tasks.workunit.client.1.smithi152.stdout:7/133: mkdir d17/d24/d2d 0 2024-09-13T23:06:15.320 INFO:tasks.workunit.client.0.smithi115.stdout:2/769: creat da/d21/d8c/d41/fff x:0 0 0 2024-09-13T23:06:15.321 INFO:tasks.workunit.client.0.smithi115.stdout:2/770: truncate da/d77/d83/fa4 5036406 0 2024-09-13T23:06:15.322 INFO:tasks.workunit.client.1.smithi152.stdout:7/134: mkdir d17/d24/d2a/d2e 0 2024-09-13T23:06:15.322 INFO:tasks.workunit.client.1.smithi152.stdout:7/135: chown d17/d24 976 1 2024-09-13T23:06:15.323 INFO:tasks.workunit.client.0.smithi115.stdout:2/771: mknod da/d21/da6/de7/c100 0 2024-09-13T23:06:15.324 INFO:tasks.workunit.client.1.smithi152.stdout:7/136: mknod d17/d24/d2a/d2e/c2f 0 2024-09-13T23:06:15.329 INFO:tasks.workunit.client.1.smithi152.stdout:7/137: write f14 [613774,94576] 0 2024-09-13T23:06:15.329 INFO:tasks.workunit.client.1.smithi152.stdout:7/138: truncate d17/f27 70725 0 2024-09-13T23:06:15.329 INFO:tasks.workunit.client.1.smithi152.stdout:7/139: write f14 [1007589,32230] 0 2024-09-13T23:06:15.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/772: mknod da/d23/d2c/dc2/de1/d56/d74/dc7/c101 0 2024-09-13T23:06:15.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/773: fsync da/d23/d2c/fae 0 2024-09-13T23:06:15.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/774: chown da/d21/d8c/d41/f8b 2879203 1 2024-09-13T23:06:15.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/775: creat da/d21/da8/df5/f102 x:0 0 0 2024-09-13T23:06:15.330 INFO:tasks.workunit.client.0.smithi115.stdout:2/776: truncate da/d21/d8c/d41/d95/fc3 2426564 0 2024-09-13T23:06:15.331 INFO:tasks.workunit.client.0.smithi115.stdout:2/777: mkdir da/d23/d2c/dc2/d103 0 2024-09-13T23:06:15.336 INFO:tasks.workunit.client.1.smithi152.stdout:7/140: write d17/f1b [206864,111273] 0 2024-09-13T23:06:15.336 INFO:tasks.workunit.client.1.smithi152.stdout:7/141: write d17/f23 [369778,9252] 0 2024-09-13T23:06:15.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/142: read d17/d24/f29 [8843,28052] 0 2024-09-13T23:06:15.337 INFO:tasks.workunit.client.0.smithi115.stdout:2/778: rename da/d21/d2d to da/d23/d2c/dc2/d104 0 2024-09-13T23:06:15.338 INFO:tasks.workunit.client.1.smithi152.stdout:7/143: mkdir d17/d24/d2a/d2e/d30 0 2024-09-13T23:06:15.338 INFO:tasks.workunit.client.1.smithi152.stdout:2/125: dwrite d0/d4/d9/f10 [0,4194304] 0 2024-09-13T23:06:15.338 INFO:tasks.workunit.client.1.smithi152.stdout:2/126: fdatasync d0/d4/d9/d14/f28 0 2024-09-13T23:06:15.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/779: truncate da/f73 1215989 0 2024-09-13T23:06:15.339 INFO:tasks.workunit.client.0.smithi115.stdout:2/780: chown da/d21/d8c/d41/d95 114001 1 2024-09-13T23:06:15.339 INFO:tasks.workunit.client.1.smithi152.stdout:7/144: unlink f4 0 2024-09-13T23:06:15.339 INFO:tasks.workunit.client.1.smithi152.stdout:7/145: chown d17/d24/d2d 1533137 1 2024-09-13T23:06:15.339 INFO:tasks.workunit.client.1.smithi152.stdout:7/146: chown d17/f1e 2041404 1 2024-09-13T23:06:15.340 INFO:tasks.workunit.client.0.smithi115.stdout:2/781: unlink da/d23/d2c/f96 0 2024-09-13T23:06:15.342 INFO:tasks.workunit.client.0.smithi115.stdout:2/782: mknod da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/c105 0 2024-09-13T23:06:15.347 INFO:tasks.workunit.client.1.smithi152.stdout:2/127: truncate d0/d4/f1d 2317491 0 2024-09-13T23:06:15.347 INFO:tasks.workunit.client.0.smithi115.stdout:4/762: dwrite db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:15.350 INFO:tasks.workunit.client.1.smithi152.stdout:2/128: symlink d0/d4/d9/d16/d2b/l31 0 2024-09-13T23:06:15.350 INFO:tasks.workunit.client.0.smithi115.stdout:4/763: creat db/d11/d2e/d33/d36/d51/d57/fe1 x:0 0 0 2024-09-13T23:06:15.350 INFO:tasks.workunit.client.0.smithi115.stdout:4/764: chown db/d11/d54/fc1 21 1 2024-09-13T23:06:15.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/765: chown db/d11/ca7 40 1 2024-09-13T23:06:15.352 INFO:tasks.workunit.client.0.smithi115.stdout:4/766: symlink db/d16/d3f/dae/le2 0 2024-09-13T23:06:15.353 INFO:tasks.workunit.client.0.smithi115.stdout:4/767: readlink db/d19/d1d/l37 0 2024-09-13T23:06:15.353 INFO:tasks.workunit.client.1.smithi152.stdout:7/147: dread f16 [0,4194304] 0 2024-09-13T23:06:15.353 INFO:tasks.workunit.client.1.smithi152.stdout:7/148: fdatasync f16 0 2024-09-13T23:06:15.353 INFO:tasks.workunit.client.1.smithi152.stdout:7/149: write f5 [4856404,100118] 0 2024-09-13T23:06:15.353 INFO:tasks.workunit.client.1.smithi152.stdout:7/150: write f5 [378129,22060] 0 2024-09-13T23:06:15.354 INFO:tasks.workunit.client.0.smithi115.stdout:4/768: link db/d11/l31 db/d16/le3 0 2024-09-13T23:06:15.354 INFO:tasks.workunit.client.1.smithi152.stdout:2/129: write d0/fa [98418,77930] 0 2024-09-13T23:06:15.356 INFO:tasks.workunit.client.1.smithi152.stdout:2/130: mkdir d0/d4/d9/d18/d32 0 2024-09-13T23:06:15.357 INFO:tasks.workunit.client.1.smithi152.stdout:2/131: symlink d0/d4/d9/d18/l33 0 2024-09-13T23:06:15.357 INFO:tasks.workunit.client.1.smithi152.stdout:2/132: creat d0/d4/d9/d14/f34 x:0 0 0 2024-09-13T23:06:15.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/133: write d0/d4/d9/d14/f20 [543152,84139] 0 2024-09-13T23:06:15.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/134: read - d0/d8/f2a zero size 2024-09-13T23:06:15.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/135: readlink d0/d4/d9/l23 0 2024-09-13T23:06:15.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/783: dwrite da/d23/d2c/dc2/de1/d56/d1a/f1d [0,4194304] 0 2024-09-13T23:06:15.360 INFO:tasks.workunit.client.1.smithi152.stdout:2/136: creat d0/d4/d9/d18/d32/f35 x:0 0 0 2024-09-13T23:06:15.360 INFO:tasks.workunit.client.1.smithi152.stdout:2/137: readlink d0/d4/l11 0 2024-09-13T23:06:15.360 INFO:tasks.workunit.client.1.smithi152.stdout:2/138: write d0/fa [532780,67123] 0 2024-09-13T23:06:15.365 INFO:tasks.workunit.client.0.smithi115.stdout:4/769: rmdir db/d16 39 2024-09-13T23:06:15.368 INFO:tasks.workunit.client.0.smithi115.stdout:4/770: creat db/d16/d3f/d66/da6/fe4 x:0 0 0 2024-09-13T23:06:15.370 INFO:tasks.workunit.client.0.smithi115.stdout:4/771: unlink db/d11/d2e/d33/d36/dad/le0 0 2024-09-13T23:06:15.370 INFO:tasks.workunit.client.0.smithi115.stdout:4/772: fsync db/d16/d3f/dae/fcb 0 2024-09-13T23:06:15.371 INFO:tasks.workunit.client.0.smithi115.stdout:4/773: creat db/d16/fe5 x:0 0 0 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:6/48: sync 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/106: sync 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:4/159: sync 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:8/64: sync 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:4/160: fdatasync d3/d4/d5/d1c/f2c 0 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:4/161: truncate d3/d4/d6/d8/d17/f24 615091 0 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:4/162: dread - d3/d4/d5/d1c/f2c zero size 2024-09-13T23:06:15.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/107: unlink f8 0 2024-09-13T23:06:15.373 INFO:tasks.workunit.client.1.smithi152.stdout:3/108: creat de/d11/f26 x:0 0 0 2024-09-13T23:06:15.373 INFO:tasks.workunit.client.0.smithi115.stdout:4/774: mkdir db/d16/d3f/d66/d68/d71/d84/d96/de6 0 2024-09-13T23:06:15.374 INFO:tasks.workunit.client.1.smithi152.stdout:3/109: mkdir de/d11/d27 0 2024-09-13T23:06:15.374 INFO:tasks.workunit.client.0.smithi115.stdout:7/677: sync 2024-09-13T23:06:15.374 INFO:tasks.workunit.client.0.smithi115.stdout:3/795: sync 2024-09-13T23:06:15.375 INFO:tasks.workunit.client.0.smithi115.stdout:6/785: sync 2024-09-13T23:06:15.375 INFO:tasks.workunit.client.0.smithi115.stdout:9/684: sync 2024-09-13T23:06:15.375 INFO:tasks.workunit.client.0.smithi115.stdout:6/786: write d4/df/f1c [2640741,38698] 0 2024-09-13T23:06:15.375 INFO:tasks.workunit.client.0.smithi115.stdout:8/773: sync 2024-09-13T23:06:15.377 INFO:tasks.workunit.client.0.smithi115.stdout:4/775: creat db/d11/d2e/d33/d36/fe7 x:0 0 0 2024-09-13T23:06:15.377 INFO:tasks.workunit.client.1.smithi152.stdout:3/110: rename de/f15 to de/d11/f28 0 2024-09-13T23:06:15.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/111: mknod de/d1f/c29 0 2024-09-13T23:06:15.380 INFO:tasks.workunit.client.1.smithi152.stdout:3/112: fdatasync de/d11/f12 0 2024-09-13T23:06:15.380 INFO:tasks.workunit.client.0.smithi115.stdout:3/796: rename d3/d16/d1c/d101/d59/l82 to d3/d16/d1c/d101/d98/l107 0 2024-09-13T23:06:15.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/113: symlink de/l2a 0 2024-09-13T23:06:15.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/114: readlink de/l2a 0 2024-09-13T23:06:15.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/115: stat de/c24 0 2024-09-13T23:06:15.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/685: dread d0/d13/d17/d1f/d35/d62/fa4 [0,4194304] 0 2024-09-13T23:06:15.382 INFO:tasks.workunit.client.0.smithi115.stdout:7/678: truncate da/dd/d13/d36/d5a/d99/ddd/d92/db1/fca 3915129 0 2024-09-13T23:06:15.383 INFO:tasks.workunit.client.1.smithi152.stdout:3/116: creat de/d11/d27/f2b x:0 0 0 2024-09-13T23:06:15.384 INFO:tasks.workunit.client.1.smithi152.stdout:3/117: mknod de/d1f/c2c 0 2024-09-13T23:06:15.384 INFO:tasks.workunit.client.1.smithi152.stdout:3/118: creat de/d11/f2d x:0 0 0 2024-09-13T23:06:15.385 INFO:tasks.workunit.client.0.smithi115.stdout:4/776: mkdir db/d11/d54/d17/dd1/de8 0 2024-09-13T23:06:15.385 INFO:tasks.workunit.client.0.smithi115.stdout:9/686: readlink d0/l2f 0 2024-09-13T23:06:15.385 INFO:tasks.workunit.client.0.smithi115.stdout:9/687: stat d0/d13/d17/d1f/d28/d76/d81/fab 0 2024-09-13T23:06:15.386 INFO:tasks.workunit.client.0.smithi115.stdout:7/679: creat da/dd/fe5 x:0 0 0 2024-09-13T23:06:15.387 INFO:tasks.workunit.client.0.smithi115.stdout:4/777: rename db/d11/d54/f44 to db/d16/d3f/fe9 0 2024-09-13T23:06:15.388 INFO:tasks.workunit.client.0.smithi115.stdout:4/778: fdatasync db/d16/fe5 0 2024-09-13T23:06:15.388 INFO:tasks.workunit.client.0.smithi115.stdout:9/688: readlink d0/l26 0 2024-09-13T23:06:15.390 INFO:tasks.workunit.client.0.smithi115.stdout:7/680: mkdir da/dd/d1c/d2d/d60/d82/de6 0 2024-09-13T23:06:15.392 INFO:tasks.workunit.client.1.smithi152.stdout:6/49: write f3 [7617388,121191] 0 2024-09-13T23:06:15.392 INFO:tasks.workunit.client.1.smithi152.stdout:6/50: write d4/fc [911059,69696] 0 2024-09-13T23:06:15.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/681: symlink da/dd/d1c/le7 0 2024-09-13T23:06:15.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/682: creat da/dd/d13/d24/d52/fe8 x:0 0 0 2024-09-13T23:06:15.393 INFO:tasks.workunit.client.0.smithi115.stdout:7/683: dread - da/dd/d1c/d2d/d60/fc8 zero size 2024-09-13T23:06:15.394 INFO:tasks.workunit.client.0.smithi115.stdout:6/787: write d4/df/d14/d38/d2a/d31/d5b/da8/fb9 [1475093,100881] 0 2024-09-13T23:06:15.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/139: dwrite d0/d4/d9/ff [0,4194304] 0 2024-09-13T23:06:15.397 INFO:tasks.workunit.client.0.smithi115.stdout:6/788: creat d4/d57/dcb/f10c x:0 0 0 2024-09-13T23:06:15.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/789: getdents d4/df/d14/d38/d44/d99/def 0 2024-09-13T23:06:15.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/790: truncate d4/df/d14/d38/d2a/d31/d5b/da8/fcc 283552 0 2024-09-13T23:06:15.398 INFO:tasks.workunit.client.0.smithi115.stdout:6/791: stat d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb 0 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/797: dread d3/d5/db/faf [0,4194304] 0 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/798: chown d3/d5/d35/l54 1264057 1 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/799: write d3/d5/d65/da8/da4/d49/f7d [4604854,115854] 0 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:3/800: fsync d3/d5/d35/f91 0 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:6/792: creat d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/f10d x:0 0 0 2024-09-13T23:06:15.399 INFO:tasks.workunit.client.0.smithi115.stdout:6/793: write d4/df/d14/d35/ffa [660949,110064] 0 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.0.smithi115.stdout:6/794: readlink d4/d57/d5a/l78 0 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/140: mknod d0/c36 0 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/141: creat d0/d4/f37 x:0 0 0 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/142: dread - d0/d4/d9/f25 zero size 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/143: truncate d0/d4/d9/d16/f21 360291 0 2024-09-13T23:06:15.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/144: chown d0/d4/l7 49072141 1 2024-09-13T23:06:15.401 INFO:tasks.workunit.client.0.smithi115.stdout:3/801: link d3/d5/d65/da8/fc1 d3/d16/d1a/d1e/d94/f108 0 2024-09-13T23:06:15.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/145: dread d0/d4/f1a [0,4194304] 0 2024-09-13T23:06:15.409 INFO:tasks.workunit.client.1.smithi152.stdout:2/146: link d0/d4/d9/d14/f28 d0/d4/d9/d16/d30/f38 0 2024-09-13T23:06:15.409 INFO:tasks.workunit.client.0.smithi115.stdout:7/684: dread da/dd/d1c/f20 [4194304,4194304] 0 2024-09-13T23:06:15.409 INFO:tasks.workunit.client.0.smithi115.stdout:7/685: stat da/dd/d1c/d2d/d45/cc2 0 2024-09-13T23:06:15.410 INFO:tasks.workunit.client.1.smithi152.stdout:4/163: dwrite d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:15.410 INFO:tasks.workunit.client.1.smithi152.stdout:2/147: stat d0/d4/l7 0 2024-09-13T23:06:15.410 INFO:tasks.workunit.client.1.smithi152.stdout:4/164: chown d3/d4/d6 23 1 2024-09-13T23:06:15.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/65: dwrite fd [0,4194304] 0 2024-09-13T23:06:15.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/165: symlink d3/d4/d5/d1c/l2f 0 2024-09-13T23:06:15.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/166: dread - d3/d4/d5/d1c/f2c zero size 2024-09-13T23:06:15.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/167: getdents d3/d4/d6 0 2024-09-13T23:06:15.411 INFO:tasks.workunit.client.0.smithi115.stdout:7/686: symlink da/dd/d1c/d2d/d60/d82/le9 0 2024-09-13T23:06:15.411 INFO:tasks.workunit.client.0.smithi115.stdout:3/802: dread d3/dcd/fdc [0,4194304] 0 2024-09-13T23:06:15.412 INFO:tasks.workunit.client.0.smithi115.stdout:8/774: dwrite d3/d5/dc/d16/f107 [0,4194304] 0 2024-09-13T23:06:15.412 INFO:tasks.workunit.client.0.smithi115.stdout:8/775: readlink d3/d5/dc/d16/d1f/lbb 0 2024-09-13T23:06:15.412 INFO:tasks.workunit.client.1.smithi152.stdout:4/168: symlink d3/d4/l30 0 2024-09-13T23:06:15.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/169: unlink d3/d4/d6/d8/d17/c21 0 2024-09-13T23:06:15.415 INFO:tasks.workunit.client.0.smithi115.stdout:3/803: symlink d3/d16/l109 0 2024-09-13T23:06:15.418 INFO:tasks.workunit.client.1.smithi152.stdout:3/119: getdents de/d11/d27 0 2024-09-13T23:06:15.418 INFO:tasks.workunit.client.1.smithi152.stdout:6/51: dread f3 [4194304,4194304] 0 2024-09-13T23:06:15.418 INFO:tasks.workunit.client.0.smithi115.stdout:7/687: mkdir da/dd/d13/d24/d52/d7c/da7/dea 0 2024-09-13T23:06:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/52: write d4/fc [663888,113069] 0 2024-09-13T23:06:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/53: readlink d4/lb 0 2024-09-13T23:06:15.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/54: write f3 [2783925,117800] 0 2024-09-13T23:06:15.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/148: write d0/d4/d9/f10 [1110466,72597] 0 2024-09-13T23:06:15.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/149: stat d0/d4/d9/d18/d1e/c24 0 2024-09-13T23:06:15.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/66: write fd [3631307,96124] 0 2024-09-13T23:06:15.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/150: mknod d0/d8/c39 0 2024-09-13T23:06:15.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/151: creat d0/d4/d9/f3a x:0 0 0 2024-09-13T23:06:15.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/152: dread - d0/d4/f37 zero size 2024-09-13T23:06:15.426 INFO:tasks.workunit.client.1.smithi152.stdout:4/170: write d3/d4/d6/f1a [2853943,95555] 0 2024-09-13T23:06:15.426 INFO:tasks.workunit.client.1.smithi152.stdout:4/171: readlink d3/d4/d6/d8/l15 0 2024-09-13T23:06:15.426 INFO:tasks.workunit.client.1.smithi152.stdout:4/172: dread - d3/d4/d5/d1c/f2c zero size 2024-09-13T23:06:15.427 INFO:tasks.workunit.client.1.smithi152.stdout:4/173: symlink d3/l31 0 2024-09-13T23:06:15.428 INFO:tasks.workunit.client.1.smithi152.stdout:4/174: mkdir d3/d4/d32 0 2024-09-13T23:06:15.430 INFO:tasks.workunit.client.0.smithi115.stdout:8/776: creat d3/d87/dc8/d102/f112 x:0 0 0 2024-09-13T23:06:15.433 INFO:tasks.workunit.client.0.smithi115.stdout:7/688: symlink da/df/dcc/leb 0 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/777: creat d3/d87/f113 x:0 0 0 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/689: symlink da/dd/d13/d36/lec 0 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/690: fsync da/dd/d13/d36/fc4 0 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/691: read - da/fc3 zero size 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:7/692: dread - da/dd/d1c/d2d/d60/fd6 zero size 2024-09-13T23:06:15.437 INFO:tasks.workunit.client.0.smithi115.stdout:8/778: creat d3/d5/dc/d23/d4e/d54/d8c/f114 x:0 0 0 2024-09-13T23:06:15.438 INFO:tasks.workunit.client.1.smithi152.stdout:2/153: dread d0/d4/d9/d16/f17 [0,4194304] 0 2024-09-13T23:06:15.439 INFO:tasks.workunit.client.0.smithi115.stdout:7/693: truncate da/dd/d1c/d2d/d45/f5f 3926253 0 2024-09-13T23:06:15.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/779: creat d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/f115 x:0 0 0 2024-09-13T23:06:15.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/780: write d3/d5/dc/d16/d1f/d27/d68/fbf [431182,103206] 0 2024-09-13T23:06:15.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/781: chown d3/d5/d1d/f20 78004 1 2024-09-13T23:06:15.441 INFO:tasks.workunit.client.0.smithi115.stdout:8/782: stat d3/d5/dc/d16/d1f/lf8 0 2024-09-13T23:06:15.445 INFO:tasks.workunit.client.0.smithi115.stdout:8/783: getdents d3/d5/d1c/d41 0 2024-09-13T23:06:15.446 INFO:tasks.workunit.client.0.smithi115.stdout:8/784: mknod d3/d5/dc/d23/d4e/d54/d7f/de9/df4/c116 0 2024-09-13T23:06:15.446 INFO:tasks.workunit.client.0.smithi115.stdout:8/785: write d3/d5/d1c/fd2 [4527024,10992] 0 2024-09-13T23:06:15.451 INFO:tasks.workunit.client.1.smithi152.stdout:8/67: dwrite f10 [4194304,4194304] 0 2024-09-13T23:06:15.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/55: fsync f3 0 2024-09-13T23:06:15.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/56: chown l1 63320216 1 2024-09-13T23:06:15.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/57: chown d4 673 1 2024-09-13T23:06:15.479 INFO:tasks.workunit.client.1.smithi152.stdout:6/58: write d4/f9 [1802833,129021] 0 2024-09-13T23:06:15.479 INFO:tasks.workunit.client.0.smithi115.stdout:3/804: dwrite d3/d16/d1a/d1e/d94/fb6 [0,4194304] 0 2024-09-13T23:06:15.480 INFO:tasks.workunit.client.0.smithi115.stdout:3/805: truncate d3/d16/d1c/f38 916188 0 2024-09-13T23:06:15.482 INFO:tasks.workunit.client.1.smithi152.stdout:6/59: rmdir d4 39 2024-09-13T23:06:15.482 INFO:tasks.workunit.client.1.smithi152.stdout:6/60: chown d4/lb 3 1 2024-09-13T23:06:15.482 INFO:tasks.workunit.client.1.smithi152.stdout:6/61: write d4/f7 [3643855,6534] 0 2024-09-13T23:06:15.483 INFO:tasks.workunit.client.1.smithi152.stdout:6/62: mknod d4/de/c10 0 2024-09-13T23:06:15.483 INFO:tasks.workunit.client.1.smithi152.stdout:3/120: dwrite fd [0,4194304] 0 2024-09-13T23:06:15.484 INFO:tasks.workunit.client.1.smithi152.stdout:8/68: dwrite f15 [0,4194304] 0 2024-09-13T23:06:15.484 INFO:tasks.workunit.client.0.smithi115.stdout:7/694: dwrite da/dd/d1c/f7d [4194304,4194304] 0 2024-09-13T23:06:15.485 INFO:tasks.workunit.client.1.smithi152.stdout:4/175: dwrite d3/f26 [0,4194304] 0 2024-09-13T23:06:15.487 INFO:tasks.workunit.client.1.smithi152.stdout:6/63: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:15.487 INFO:tasks.workunit.client.0.smithi115.stdout:8/786: dwrite d3/d5/dc/d23/fc5 [0,4194304] 0 2024-09-13T23:06:15.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/121: mkdir de/d14/d2e 0 2024-09-13T23:06:15.491 INFO:tasks.workunit.client.1.smithi152.stdout:8/69: mkdir d17/d19 0 2024-09-13T23:06:15.491 INFO:tasks.workunit.client.1.smithi152.stdout:8/70: chown d17/d19 1 1 2024-09-13T23:06:15.493 INFO:tasks.workunit.client.1.smithi152.stdout:4/176: mkdir d3/d4/d33 0 2024-09-13T23:06:15.493 INFO:tasks.workunit.client.1.smithi152.stdout:4/177: dread - d3/d4/d5/d1c/f2c zero size 2024-09-13T23:06:15.493 INFO:tasks.workunit.client.1.smithi152.stdout:4/178: readlink d3/d4/l30 0 2024-09-13T23:06:15.493 INFO:tasks.workunit.client.1.smithi152.stdout:4/179: fsync d3/d4/d6/d8/f1b 0 2024-09-13T23:06:15.494 INFO:tasks.workunit.client.1.smithi152.stdout:6/64: rmdir d4 39 2024-09-13T23:06:15.495 INFO:tasks.workunit.client.1.smithi152.stdout:3/122: symlink de/d11/l2f 0 2024-09-13T23:06:15.495 INFO:tasks.workunit.client.1.smithi152.stdout:3/123: dread - de/d14/f21 zero size 2024-09-13T23:06:15.495 INFO:tasks.workunit.client.1.smithi152.stdout:8/71: rmdir d17 39 2024-09-13T23:06:15.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/180: mkdir d3/d34 0 2024-09-13T23:06:15.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/181: write d3/d4/f22 [4718886,113509] 0 2024-09-13T23:06:15.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/124: mknod de/d1f/c30 0 2024-09-13T23:06:15.500 INFO:tasks.workunit.client.0.smithi115.stdout:8/787: dread d3/d5/f3d [0,4194304] 0 2024-09-13T23:06:15.501 INFO:tasks.workunit.client.1.smithi152.stdout:3/125: unlink de/d11/f2d 0 2024-09-13T23:06:15.501 INFO:tasks.workunit.client.1.smithi152.stdout:3/126: dread - de/d11/f25 zero size 2024-09-13T23:06:15.501 INFO:tasks.workunit.client.1.smithi152.stdout:3/127: fsync de/f17 0 2024-09-13T23:06:15.502 INFO:tasks.workunit.client.1.smithi152.stdout:3/128: mknod de/d14/d2e/c31 0 2024-09-13T23:06:15.504 INFO:tasks.workunit.client.1.smithi152.stdout:3/129: symlink de/d11/l32 0 2024-09-13T23:06:15.504 INFO:tasks.workunit.client.1.smithi152.stdout:3/130: chown de/f1c 39 1 2024-09-13T23:06:15.504 INFO:tasks.workunit.client.1.smithi152.stdout:3/131: dread - de/f17 zero size 2024-09-13T23:06:15.506 INFO:tasks.workunit.client.1.smithi152.stdout:3/132: symlink de/d11/l33 0 2024-09-13T23:06:15.507 INFO:tasks.workunit.client.1.smithi152.stdout:0/104: sync 2024-09-13T23:06:15.507 INFO:tasks.workunit.client.1.smithi152.stdout:9/160: sync 2024-09-13T23:06:15.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/133: rename de/d14/d2e/c31 to de/c34 0 2024-09-13T23:06:15.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/134: write de/d14/f21 [1002142,79704] 0 2024-09-13T23:06:15.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/135: write de/d11/f26 [544286,104416] 0 2024-09-13T23:06:15.510 INFO:tasks.workunit.client.1.smithi152.stdout:9/161: creat d3/d1e/f33 x:0 0 0 2024-09-13T23:06:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:9/162: mkdir d3/d24/d34 0 2024-09-13T23:06:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:9/163: truncate d3/d1e/d30/f32 293407 0 2024-09-13T23:06:15.511 INFO:tasks.workunit.client.1.smithi152.stdout:9/164: read - d3/d1e/f25 zero size 2024-09-13T23:06:15.521 INFO:tasks.workunit.client.1.smithi152.stdout:0/105: write f1 [3116906,52583] 0 2024-09-13T23:06:15.521 INFO:tasks.workunit.client.1.smithi152.stdout:4/182: write d3/d4/d5/d2b/f2e [5913520,20063] 0 2024-09-13T23:06:15.523 INFO:tasks.workunit.client.1.smithi152.stdout:8/72: dwrite f3 [4194304,4194304] 0 2024-09-13T23:06:15.523 INFO:tasks.workunit.client.1.smithi152.stdout:8/73: fdatasync f10 0 2024-09-13T23:06:15.524 INFO:tasks.workunit.client.0.smithi115.stdout:8/788: write d3/d5/d1d/d72/fa8 [2745423,89658] 0 2024-09-13T23:06:15.524 INFO:tasks.workunit.client.0.smithi115.stdout:8/789: readlink d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/le0 0 2024-09-13T23:06:15.524 INFO:tasks.workunit.client.0.smithi115.stdout:8/790: fdatasync d3/d87/fc6 0 2024-09-13T23:06:15.524 INFO:tasks.workunit.client.1.smithi152.stdout:4/183: creat d3/d4/d6/f35 x:0 0 0 2024-09-13T23:06:15.524 INFO:tasks.workunit.client.1.smithi152.stdout:4/184: chown d3/d4/d6/d8 8705883 1 2024-09-13T23:06:15.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/74: mknod d17/d19/c1a 0 2024-09-13T23:06:15.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/75: fsync fd 0 2024-09-13T23:06:15.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/76: chown cf 1855 1 2024-09-13T23:06:15.526 INFO:tasks.workunit.client.1.smithi152.stdout:4/185: link d3/l31 d3/d34/l36 0 2024-09-13T23:06:15.538 INFO:tasks.workunit.client.1.smithi152.stdout:8/77: dread f15 [0,4194304] 0 2024-09-13T23:06:15.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/78: link la d17/l1b 0 2024-09-13T23:06:15.540 INFO:tasks.workunit.client.1.smithi152.stdout:8/79: write fd [3576166,112047] 0 2024-09-13T23:06:15.548 INFO:tasks.workunit.client.1.smithi152.stdout:0/106: dwrite fb [0,4194304] 0 2024-09-13T23:06:15.549 INFO:tasks.workunit.client.1.smithi152.stdout:3/136: rmdir de/d14/d2e 0 2024-09-13T23:06:15.550 INFO:tasks.workunit.client.1.smithi152.stdout:4/186: read d3/f26 [2315135,88057] 0 2024-09-13T23:06:15.550 INFO:tasks.workunit.client.1.smithi152.stdout:4/187: write d3/d4/d6/f1a [874559,25348] 0 2024-09-13T23:06:15.551 INFO:tasks.workunit.client.1.smithi152.stdout:0/107: symlink d18/l23 0 2024-09-13T23:06:15.552 INFO:tasks.workunit.client.1.smithi152.stdout:3/137: read de/f1e [917569,5838] 0 2024-09-13T23:06:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:4/188: mkdir d3/d4/d6/d37 0 2024-09-13T23:06:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/138: mknod de/c35 0 2024-09-13T23:06:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/139: creat de/d1f/f36 x:0 0 0 2024-09-13T23:06:15.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/140: creat de/d11/f37 x:0 0 0 2024-09-13T23:06:15.560 INFO:tasks.workunit.client.1.smithi152.stdout:8/80: dwrite f3 [4194304,4194304] 0 2024-09-13T23:06:15.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/108: write f2 [5633612,75619] 0 2024-09-13T23:06:15.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/109: getdents d18/d19/d21 0 2024-09-13T23:06:15.568 INFO:tasks.workunit.client.1.smithi152.stdout:0/110: unlink d18/l23 0 2024-09-13T23:06:15.568 INFO:tasks.workunit.client.1.smithi152.stdout:0/111: write f8 [1668879,65803] 0 2024-09-13T23:06:15.569 INFO:tasks.workunit.client.1.smithi152.stdout:0/112: truncate f0 1793596 0 2024-09-13T23:06:15.569 INFO:tasks.workunit.client.1.smithi152.stdout:0/113: stat d18/d1f/f20 0 2024-09-13T23:06:15.571 INFO:tasks.workunit.client.1.smithi152.stdout:0/114: symlink d18/d19/l24 0 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/189: dwrite d3/d4/d6/f20 [4194304,4194304] 0 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:8/81: dwrite f15 [4194304,4194304] 0 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:8/82: chown l7 61 1 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/190: fsync d3/d4/d6/d8/f19 0 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/191: fdatasync d3/d4/d5/d1c/f28 0 2024-09-13T23:06:15.588 INFO:tasks.workunit.client.1.smithi152.stdout:4/192: fsync d3/d4/d5/d1c/f1e 0 2024-09-13T23:06:15.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/141: rename de/d11 to de/d14/d38 0 2024-09-13T23:06:15.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/83: creat d17/f1c x:0 0 0 2024-09-13T23:06:15.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/84: truncate f15 488413 0 2024-09-13T23:06:15.599 INFO:tasks.workunit.client.1.smithi152.stdout:4/193: write d3/d4/d5/f7 [218766,34601] 0 2024-09-13T23:06:15.599 INFO:tasks.workunit.client.1.smithi152.stdout:4/194: write d3/d4/d6/d8/f1b [1129125,50385] 0 2024-09-13T23:06:15.601 INFO:tasks.workunit.client.1.smithi152.stdout:3/142: read de/f13 [3754350,2083] 0 2024-09-13T23:06:15.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/143: rename f2 to de/f39 0 2024-09-13T23:06:15.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/144: fdatasync de/ff 0 2024-09-13T23:06:15.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/145: write de/d14/d38/f25 [872050,91288] 0 2024-09-13T23:06:15.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/146: chown de/d1f 62397906 1 2024-09-13T23:06:15.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/147: fsync de/d14/d38/f19 0 2024-09-13T23:06:15.604 INFO:tasks.workunit.client.1.smithi152.stdout:3/148: rename de/f22 to de/d14/d38/d27/f3a 0 2024-09-13T23:06:15.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/149: link de/d14/c16 de/d14/d38/c3b 0 2024-09-13T23:06:15.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/150: chown de/d1f/f36 3 1 2024-09-13T23:06:15.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/151: chown de/c35 433 1 2024-09-13T23:06:15.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/152: chown de/d14/d38/l33 4083752 1 2024-09-13T23:06:15.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/153: symlink de/d14/l3c 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/154: creat de/d1f/f3d x:0 0 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/155: truncate de/d14/d38/d27/f2b 669535 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/156: read - de/d14/d38/f1a zero size 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/157: write de/d1f/f20 [960536,35732] 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/158: creat de/f3e x:0 0 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/159: read de/f1e [774040,17432] 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/160: fdatasync de/f13 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/161: write de/d14/d38/f28 [97785,57728] 0 2024-09-13T23:06:15.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/162: write de/d14/d38/f37 [175359,60752] 0 2024-09-13T23:06:15.609 INFO:tasks.workunit.client.1.smithi152.stdout:4/195: truncate d3/d4/d5/f7 1987679 0 2024-09-13T23:06:15.609 INFO:tasks.workunit.client.1.smithi152.stdout:4/196: write d3/d4/d6/f14 [4848232,87608] 0 2024-09-13T23:06:15.609 INFO:tasks.workunit.client.1.smithi152.stdout:4/197: write d3/d4/d5/d1c/f27 [2133650,80150] 0 2024-09-13T23:06:15.611 INFO:tasks.workunit.client.1.smithi152.stdout:5/106: sync 2024-09-13T23:06:15.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/117: sync 2024-09-13T23:06:15.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/118: chown d4/d9 59950 1 2024-09-13T23:06:15.612 INFO:tasks.workunit.client.1.smithi152.stdout:5/107: symlink d5/dc/d19/l1f 0 2024-09-13T23:06:15.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/119: unlink d4/d16/l1b 0 2024-09-13T23:06:15.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/120: chown d4/d9/d1a/l20 1515546 1 2024-09-13T23:06:15.627 INFO:tasks.workunit.client.1.smithi152.stdout:1/121: dread d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:15.629 INFO:tasks.workunit.client.1.smithi152.stdout:1/122: dread d4/d9/d1a/f19 [0,4194304] 0 2024-09-13T23:06:15.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/695: creat da/dd/d13/d36/d5a/d99/ddd/fed x:0 0 0 2024-09-13T23:06:15.641 INFO:tasks.workunit.client.1.smithi152.stdout:1/123: write f1 [3923547,79069] 0 2024-09-13T23:06:15.643 INFO:tasks.workunit.client.1.smithi152.stdout:5/108: dwrite f0 [4194304,4194304] 0 2024-09-13T23:06:15.643 INFO:tasks.workunit.client.1.smithi152.stdout:8/85: dwrite f15 [0,4194304] 0 2024-09-13T23:06:15.644 INFO:tasks.workunit.client.1.smithi152.stdout:4/198: dwrite d3/d4/d5/d2b/f2e [0,4194304] 0 2024-09-13T23:06:15.644 INFO:tasks.workunit.client.1.smithi152.stdout:1/124: getdents d4/d9 0 2024-09-13T23:06:15.644 INFO:tasks.workunit.client.1.smithi152.stdout:4/199: write d3/d4/d5/d2b/f2e [9064266,129542] 0 2024-09-13T23:06:15.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/791: getdents d3/d87 0 2024-09-13T23:06:15.645 INFO:tasks.workunit.client.0.smithi115.stdout:8/792: dread - d3/d5/d1d/d72/f103 zero size 2024-09-13T23:06:15.648 INFO:tasks.workunit.client.0.smithi115.stdout:8/793: creat d3/d5/dc/d16/d1f/f117 x:0 0 0 2024-09-13T23:06:15.650 INFO:tasks.workunit.client.0.smithi115.stdout:8/794: dread d3/d5/d1c/f2e [0,4194304] 0 2024-09-13T23:06:15.651 INFO:tasks.workunit.client.0.smithi115.stdout:8/795: stat d3/d5/dc/d23/f6f 0 2024-09-13T23:06:15.651 INFO:tasks.workunit.client.1.smithi152.stdout:1/125: truncate d4/f7 91459 0 2024-09-13T23:06:15.653 INFO:tasks.workunit.client.1.smithi152.stdout:4/200: link d3/d4/d5/d1c/l2f d3/d4/d5/d1c/l38 0 2024-09-13T23:06:15.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/109: rmdir d5/da 39 2024-09-13T23:06:15.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/110: fsync d5/f14 0 2024-09-13T23:06:15.654 INFO:tasks.workunit.client.0.smithi115.stdout:8/796: dread d3/d5/dc/d16/d1f/d28/dc0/f101 [0,4194304] 0 2024-09-13T23:06:15.655 INFO:tasks.workunit.client.1.smithi152.stdout:1/126: symlink d4/d9/d1a/l21 0 2024-09-13T23:06:15.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/127: fsync d4/f7 0 2024-09-13T23:06:15.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/128: fdatasync d4/d9/f13 0 2024-09-13T23:06:15.661 INFO:tasks.workunit.client.1.smithi152.stdout:1/129: mkdir d4/d9/d1a/d22 0 2024-09-13T23:06:15.663 INFO:tasks.workunit.client.0.smithi115.stdout:8/797: write d3/d5/dc/d16/d1f/d27/d79/f7c [2547157,124135] 0 2024-09-13T23:06:15.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/798: mknod d3/d5/dc/d23/d4e/d54/d7f/d10c/c118 0 2024-09-13T23:06:15.666 INFO:tasks.workunit.client.0.smithi115.stdout:8/799: mkdir d3/d5/dc/d23/d4e/d54/d8c/dd9/d119 0 2024-09-13T23:06:15.667 INFO:tasks.workunit.client.1.smithi152.stdout:5/111: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:15.668 INFO:tasks.workunit.client.1.smithi152.stdout:5/112: mkdir d5/dc/d19/d20 0 2024-09-13T23:06:15.668 INFO:tasks.workunit.client.0.smithi115.stdout:8/800: unlink d3/d5/d1d/d63/f99 0 2024-09-13T23:06:15.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/113: mknod d5/da/c21 0 2024-09-13T23:06:15.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/201: dread d3/d4/d5/d2b/f2e [4194304,4194304] 0 2024-09-13T23:06:15.671 INFO:tasks.workunit.client.1.smithi152.stdout:5/114: getdents d5/dc 0 2024-09-13T23:06:15.671 INFO:tasks.workunit.client.1.smithi152.stdout:5/115: fdatasync d5/f8 0 2024-09-13T23:06:15.672 INFO:tasks.workunit.client.1.smithi152.stdout:4/202: mkdir d3/d4/d6/d8/d17/d39 0 2024-09-13T23:06:15.673 INFO:tasks.workunit.client.0.smithi115.stdout:8/801: mknod d3/d5/dc/d23/d4e/c11a 0 2024-09-13T23:06:15.674 INFO:tasks.workunit.client.1.smithi152.stdout:5/116: link d5/f14 d5/f22 0 2024-09-13T23:06:15.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/802: symlink d3/d5/dc/d23/d4e/d54/d8c/dd9/l11b 0 2024-09-13T23:06:15.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/803: chown d3/d5/dc/d16/d1f/d27/d68/cb6 0 1 2024-09-13T23:06:15.675 INFO:tasks.workunit.client.1.smithi152.stdout:4/203: mkdir d3/d4/d6/d8/d17/d3a 0 2024-09-13T23:06:15.675 INFO:tasks.workunit.client.1.smithi152.stdout:4/204: read - d3/d4/d6/f35 zero size 2024-09-13T23:06:15.675 INFO:tasks.workunit.client.1.smithi152.stdout:5/117: stat c3 0 2024-09-13T23:06:15.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/804: symlink d3/d5/d1d/l11c 0 2024-09-13T23:06:15.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/805: creat d3/d5/d1d/d63/f11d x:0 0 0 2024-09-13T23:06:15.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/806: readlink d3/d5/dc/d23/d4e/l71 0 2024-09-13T23:06:15.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/807: write d3/d5/dc/d23/d4e/d54/d7f/de9/f61 [1042968,88964] 0 2024-09-13T23:06:15.677 INFO:tasks.workunit.client.1.smithi152.stdout:4/205: truncate d3/d4/d6/f14 2320732 0 2024-09-13T23:06:15.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/118: mknod d5/dc/d19/c23 0 2024-09-13T23:06:15.677 INFO:tasks.workunit.client.1.smithi152.stdout:4/206: rename d3/d4/d6/c23 to d3/d4/d6/c3b 0 2024-09-13T23:06:15.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/119: mknod d5/dc/c24 0 2024-09-13T23:06:15.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/207: rename d3/d34/l36 to d3/l3c 0 2024-09-13T23:06:15.680 INFO:tasks.workunit.client.1.smithi152.stdout:5/120: mkdir d5/dc/d19/d20/d25 0 2024-09-13T23:06:15.681 INFO:tasks.workunit.client.0.smithi115.stdout:8/808: mknod d3/d5/d1c/c11e 0 2024-09-13T23:06:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/208: creat d3/d4/d5/f3d x:0 0 0 2024-09-13T23:06:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/121: mkdir d5/d26 0 2024-09-13T23:06:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/122: read - d5/dc/d19/f1d zero size 2024-09-13T23:06:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:1/130: dwrite d4/d9/f13 [0,4194304] 0 2024-09-13T23:06:15.682 INFO:tasks.workunit.client.1.smithi152.stdout:1/131: fsync d4/f6 0 2024-09-13T23:06:15.683 INFO:tasks.workunit.client.1.smithi152.stdout:1/132: chown d4/l8 245242 1 2024-09-13T23:06:15.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/123: mkdir d5/dc/d19/d20/d25/d27 0 2024-09-13T23:06:15.685 INFO:tasks.workunit.client.1.smithi152.stdout:1/133: creat d4/d9/d1a/f23 x:0 0 0 2024-09-13T23:06:15.685 INFO:tasks.workunit.client.0.smithi115.stdout:7/696: mknod da/dd/d13/d24/cee 0 2024-09-13T23:06:15.685 INFO:tasks.workunit.client.0.smithi115.stdout:7/697: creat da/dd/d13/d24/d52/d7c/da7/fef x:0 0 0 2024-09-13T23:06:15.686 INFO:tasks.workunit.client.1.smithi152.stdout:1/134: mkdir d4/d9/d1a/d22/d24 0 2024-09-13T23:06:15.688 INFO:tasks.workunit.client.1.smithi152.stdout:1/135: unlink d4/l10 0 2024-09-13T23:06:15.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/124: dread d5/f7 [0,4194304] 0 2024-09-13T23:06:15.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/125: read - d5/dc/d19/f1d zero size 2024-09-13T23:06:15.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/809: write d3/d5/d1d/d63/f7d [140564,23582] 0 2024-09-13T23:06:15.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/810: fdatasync d3/d5/d1d/d63/fe8 0 2024-09-13T23:06:15.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/811: dread - d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/f115 zero size 2024-09-13T23:06:15.690 INFO:tasks.workunit.client.0.smithi115.stdout:8/812: readlink d3/d5/l9b 0 2024-09-13T23:06:15.691 INFO:tasks.workunit.client.0.smithi115.stdout:8/813: symlink d3/d5/dc/d16/d1f/d28/dc0/dcd/df1/l11f 0 2024-09-13T23:06:15.691 INFO:tasks.workunit.client.0.smithi115.stdout:8/814: rmdir d3/d5/d1c/d41 39 2024-09-13T23:06:15.692 INFO:tasks.workunit.client.0.smithi115.stdout:8/815: chown d3/d5/dc/d23/fc5 1 1 2024-09-13T23:06:15.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/126: dwrite d5/f7 [0,4194304] 0 2024-09-13T23:06:15.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/127: fdatasync d5/f22 0 2024-09-13T23:06:15.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/209: dwrite d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:15.730 INFO:tasks.workunit.client.0.smithi115.stdout:8/816: dwrite d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/fc3 [0,4194304] 0 2024-09-13T23:06:15.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/817: mkdir d3/d5/d1c/df2/d120 0 2024-09-13T23:06:15.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/818: stat d3/d5/d1c/f2e 0 2024-09-13T23:06:15.734 INFO:tasks.workunit.client.0.smithi115.stdout:8/819: write d3/d5/dc/d23/fef [187680,79081] 0 2024-09-13T23:06:15.734 INFO:tasks.workunit.client.0.smithi115.stdout:5/763: sync 2024-09-13T23:06:15.735 INFO:tasks.workunit.client.0.smithi115.stdout:8/820: mkdir d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/d121 0 2024-09-13T23:06:15.735 INFO:tasks.workunit.client.0.smithi115.stdout:8/821: stat d3/d5/dc/d23/d4e/d54/l5e 0 2024-09-13T23:06:15.736 INFO:tasks.workunit.client.1.smithi152.stdout:4/210: symlink d3/d4/d6/d8/d17/d39/l3e 0 2024-09-13T23:06:15.737 INFO:tasks.workunit.client.1.smithi152.stdout:4/211: chown d3/d4/d5/d1c/f27 419209259 1 2024-09-13T23:06:15.737 INFO:tasks.workunit.client.1.smithi152.stdout:4/212: read d3/f26 [3476720,71448] 0 2024-09-13T23:06:15.737 INFO:tasks.workunit.client.0.smithi115.stdout:8/822: mkdir d3/d5/dc/d16/d1f/d27/d79/da0/d122 0 2024-09-13T23:06:15.737 INFO:tasks.workunit.client.0.smithi115.stdout:5/764: dread d8/dd/d5d/d5e/f73 [0,4194304] 0 2024-09-13T23:06:15.738 INFO:tasks.workunit.client.1.smithi152.stdout:4/213: mknod d3/d4/d6/c3f 0 2024-09-13T23:06:15.738 INFO:tasks.workunit.client.1.smithi152.stdout:4/214: creat d3/f40 x:0 0 0 2024-09-13T23:06:15.739 INFO:tasks.workunit.client.0.smithi115.stdout:8/823: rename d3/d5/dc/d16/l108 to d3/d5/dc/d23/d4e/d54/d7f/d10c/l123 0 2024-09-13T23:06:15.739 INFO:tasks.workunit.client.0.smithi115.stdout:8/824: chown d3/d5/dc/d16/d1f/d28/d3e/c88 1 1 2024-09-13T23:06:15.740 INFO:tasks.workunit.client.0.smithi115.stdout:5/765: mkdir d8/dd/d6a/d82/d63/dd6/dde/de6 0 2024-09-13T23:06:15.741 INFO:tasks.workunit.client.1.smithi152.stdout:4/215: getdents d3/d34 0 2024-09-13T23:06:15.741 INFO:tasks.workunit.client.1.smithi152.stdout:4/216: creat d3/d4/d5/d1c/f41 x:0 0 0 2024-09-13T23:06:15.741 INFO:tasks.workunit.client.1.smithi152.stdout:4/217: write d3/d4/d6/d8/f1b [1724877,91460] 0 2024-09-13T23:06:15.741 INFO:tasks.workunit.client.1.smithi152.stdout:4/218: write d3/d4/d6/f35 [65718,43106] 0 2024-09-13T23:06:15.741 INFO:tasks.workunit.client.1.smithi152.stdout:4/219: dread - d3/d4/d5/d1c/f41 zero size 2024-09-13T23:06:15.742 INFO:tasks.workunit.client.0.smithi115.stdout:8/825: symlink d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/l124 0 2024-09-13T23:06:15.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/220: truncate d3/d4/d6/d8/f19 4084427 0 2024-09-13T23:06:15.743 INFO:tasks.workunit.client.1.smithi152.stdout:7/151: sync 2024-09-13T23:06:15.743 INFO:tasks.workunit.client.1.smithi152.stdout:2/154: sync 2024-09-13T23:06:15.744 INFO:tasks.workunit.client.1.smithi152.stdout:4/221: stat d3/l31 0 2024-09-13T23:06:15.744 INFO:tasks.workunit.client.1.smithi152.stdout:4/222: chown d3/d4/d6/f1a 922584452 1 2024-09-13T23:06:15.744 INFO:tasks.workunit.client.1.smithi152.stdout:4/223: creat d3/d4/d5/f42 x:0 0 0 2024-09-13T23:06:15.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/152: rmdir d17/d24/d2a/d2e 39 2024-09-13T23:06:15.746 INFO:tasks.workunit.client.1.smithi152.stdout:2/155: truncate d0/d4/d9/d18/d1e/f1c 2334335 0 2024-09-13T23:06:15.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/128: dwrite d5/f6 [0,4194304] 0 2024-09-13T23:06:15.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/129: chown d5/da/c21 195 1 2024-09-13T23:06:15.749 INFO:tasks.workunit.client.0.smithi115.stdout:7/698: symlink da/dd/d1c/d2d/d45/lf0 0 2024-09-13T23:06:15.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/224: mknod d3/d4/d5/d1c/c43 0 2024-09-13T23:06:15.749 INFO:tasks.workunit.client.1.smithi152.stdout:7/153: mknod d17/d24/d2a/d2b/c31 0 2024-09-13T23:06:15.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/225: read - d3/d4/d5/d1c/f28 zero size 2024-09-13T23:06:15.749 INFO:tasks.workunit.client.1.smithi152.stdout:2/156: stat d0/d4/d9/l27 0 2024-09-13T23:06:15.750 INFO:tasks.workunit.client.1.smithi152.stdout:2/157: readlink d0/d4/d9/l23 0 2024-09-13T23:06:15.750 INFO:tasks.workunit.client.0.smithi115.stdout:1/670: sync 2024-09-13T23:06:15.750 INFO:tasks.workunit.client.0.smithi115.stdout:2/784: sync 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.0.smithi115.stdout:0/664: sync 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.0.smithi115.stdout:0/665: chown d6/d24/d25/d2b/f31 33267227 1 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.0.smithi115.stdout:1/671: getdents d0/de/d71 0 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.0.smithi115.stdout:1/672: chown d0/dd/f20 252657486 1 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.0.smithi115.stdout:0/666: truncate d6/d24/d25/d7f/f9d 8933960 0 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.1.smithi152.stdout:5/130: mkdir d5/dc/d19/d20/d25/d28 0 2024-09-13T23:06:15.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/154: rmdir d17/d24/d2a/d2e 39 2024-09-13T23:06:15.752 INFO:tasks.workunit.client.0.smithi115.stdout:4/779: sync 2024-09-13T23:06:15.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/131: mknod d5/dc/d19/d20/d25/d28/c29 0 2024-09-13T23:06:15.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/132: dread - d5/f22 zero size 2024-09-13T23:06:15.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/133: chown d5/da/c21 86842971 1 2024-09-13T23:06:15.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/134: chown d5/dc/c24 63727 1 2024-09-13T23:06:15.755 INFO:tasks.workunit.client.1.smithi152.stdout:7/155: creat d17/d24/d2a/d2e/f32 x:0 0 0 2024-09-13T23:06:15.755 INFO:tasks.workunit.client.1.smithi152.stdout:7/156: chown d17/d24/d2a/d2e/c2f 249 1 2024-09-13T23:06:15.756 INFO:tasks.workunit.client.1.smithi152.stdout:5/135: rmdir d5/dc/d19/d20 39 2024-09-13T23:06:15.757 INFO:tasks.workunit.client.0.smithi115.stdout:2/785: dread da/d23/d2c/dc2/d104/f6e [0,4194304] 0 2024-09-13T23:06:15.758 INFO:tasks.workunit.client.0.smithi115.stdout:1/673: rename d0/de/d1b/d25/l5b to d0/de/d66/d8f/d29/d47/d63/dac/dc7/ld8 0 2024-09-13T23:06:15.759 INFO:tasks.workunit.client.0.smithi115.stdout:2/786: rmdir da/d23/d2c/dc2/de1/d53 39 2024-09-13T23:06:15.761 INFO:tasks.workunit.client.1.smithi152.stdout:7/157: creat d17/d24/d2a/f33 x:0 0 0 2024-09-13T23:06:15.764 INFO:tasks.workunit.client.1.smithi152.stdout:7/158: dread - d17/f1a zero size 2024-09-13T23:06:15.765 INFO:tasks.workunit.client.0.smithi115.stdout:1/674: creat d0/de/d66/d8f/d29/d47/d63/dac/fd9 x:0 0 0 2024-09-13T23:06:15.765 INFO:tasks.workunit.client.1.smithi152.stdout:7/159: truncate d17/f1e 898618 0 2024-09-13T23:06:15.767 INFO:tasks.workunit.client.0.smithi115.stdout:2/787: rename da/d23/f7b to da/d23/d2c/dc2/d104/dac/f106 0 2024-09-13T23:06:15.767 INFO:tasks.workunit.client.0.smithi115.stdout:2/788: fdatasync da/d23/dd5/fd9 0 2024-09-13T23:06:15.767 INFO:tasks.workunit.client.0.smithi115.stdout:5/766: dwrite d8/d7a/fcf [0,4194304] 0 2024-09-13T23:06:15.768 INFO:tasks.workunit.client.1.smithi152.stdout:7/160: link c12 d17/d24/d2a/d2e/c34 0 2024-09-13T23:06:15.768 INFO:tasks.workunit.client.1.smithi152.stdout:7/161: write d17/f25 [962901,105800] 0 2024-09-13T23:06:15.768 INFO:tasks.workunit.client.1.smithi152.stdout:7/162: chown d17/l21 7524006 1 2024-09-13T23:06:15.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/163: truncate f16 1230230 0 2024-09-13T23:06:15.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/164: fsync f13 0 2024-09-13T23:06:15.773 INFO:tasks.workunit.client.0.smithi115.stdout:1/675: dread d0/de/d62/f6c [0,4194304] 0 2024-09-13T23:06:15.775 INFO:tasks.workunit.client.0.smithi115.stdout:1/676: link d0/de/d62/f6c d0/de/d1b/d25/d4d/d51/d23/d65/db6/fda 0 2024-09-13T23:06:15.776 INFO:tasks.workunit.client.0.smithi115.stdout:1/677: chown d0/f7 538 1 2024-09-13T23:06:15.777 INFO:tasks.workunit.client.0.smithi115.stdout:1/678: mkdir d0/de/d66/d8f/dad/ddb 0 2024-09-13T23:06:15.780 INFO:tasks.workunit.client.0.smithi115.stdout:1/679: symlink d0/de/d1b/d25/ldc 0 2024-09-13T23:06:15.780 INFO:tasks.workunit.client.0.smithi115.stdout:5/767: dread d8/dd/d64/fa7 [0,4194304] 0 2024-09-13T23:06:15.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/136: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:15.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/165: dread f13 [0,4194304] 0 2024-09-13T23:06:15.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/137: write d5/da/f1b [792829,47993] 0 2024-09-13T23:06:15.788 INFO:tasks.workunit.client.1.smithi152.stdout:5/138: chown d5/dc/d19/f1a 126 1 2024-09-13T23:06:15.788 INFO:tasks.workunit.client.1.smithi152.stdout:7/166: symlink d17/d24/l35 0 2024-09-13T23:06:15.788 INFO:tasks.workunit.client.1.smithi152.stdout:7/167: dread - d17/f20 zero size 2024-09-13T23:06:15.790 INFO:tasks.workunit.client.1.smithi152.stdout:5/139: link d5/dc/d19/f1a d5/da/f2a 0 2024-09-13T23:06:15.791 INFO:tasks.workunit.client.1.smithi152.stdout:7/168: symlink d17/d24/d2d/l36 0 2024-09-13T23:06:15.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/140: symlink d5/dc/d19/l2b 0 2024-09-13T23:06:15.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/141: dread - d5/f14 zero size 2024-09-13T23:06:15.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/142: write d5/da/f1b [1096063,32882] 0 2024-09-13T23:06:15.797 INFO:tasks.workunit.client.0.smithi115.stdout:1/680: dread d0/f3 [0,4194304] 0 2024-09-13T23:06:15.801 INFO:tasks.workunit.client.1.smithi152.stdout:7/169: dread d17/f23 [0,4194304] 0 2024-09-13T23:06:15.801 INFO:tasks.workunit.client.1.smithi152.stdout:7/170: fdatasync d17/f26 0 2024-09-13T23:06:15.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/171: mknod d17/d24/d2a/c37 0 2024-09-13T23:06:15.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/172: dread - d17/d24/d2a/f33 zero size 2024-09-13T23:06:15.804 INFO:tasks.workunit.client.1.smithi152.stdout:7/173: unlink d17/d24/c28 0 2024-09-13T23:06:15.817 INFO:tasks.workunit.client.0.smithi115.stdout:0/667: dwrite d6/d24/d25/fb3 [4194304,4194304] 0 2024-09-13T23:06:15.817 INFO:tasks.workunit.client.0.smithi115.stdout:0/668: write d6/d24/d25/d2b/d82/d6b/f7b [5129850,56598] 0 2024-09-13T23:06:15.817 INFO:tasks.workunit.client.0.smithi115.stdout:4/780: dwrite db/d11/d2e/d33/fc9 [0,4194304] 0 2024-09-13T23:06:15.818 INFO:tasks.workunit.client.0.smithi115.stdout:0/669: write d6/d24/d25/d2b/d82/d6b/fbf [254557,45058] 0 2024-09-13T23:06:15.818 INFO:tasks.workunit.client.0.smithi115.stdout:4/781: creat db/d11/d2e/dc7/fea x:0 0 0 2024-09-13T23:06:15.818 INFO:tasks.workunit.client.0.smithi115.stdout:4/782: chown db/d11/d2e/d33/d36/fe7 369 1 2024-09-13T23:06:15.818 INFO:tasks.workunit.client.0.smithi115.stdout:4/783: chown db/d11/d54/fc1 2 1 2024-09-13T23:06:15.819 INFO:tasks.workunit.client.1.smithi152.stdout:2/158: dwrite d0/d4/d9/d14/f34 [0,4194304] 0 2024-09-13T23:06:15.819 INFO:tasks.workunit.client.1.smithi152.stdout:4/226: dwrite d3/d4/d5/f3d [0,4194304] 0 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/227: chown d3/d4/d6 14756 1 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/228: chown d3/d4 2058 1 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.1.smithi152.stdout:5/143: write f0 [7597710,79076] 0 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.0.smithi115.stdout:7/699: dwrite da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.0.smithi115.stdout:8/826: dwrite d3/d5/f96 [0,4194304] 0 2024-09-13T23:06:15.820 INFO:tasks.workunit.client.0.smithi115.stdout:2/789: dwrite da/d23/d2c/dc2/de1/d56/d4b/f8f [0,4194304] 0 2024-09-13T23:06:15.823 INFO:tasks.workunit.client.0.smithi115.stdout:1/681: dwrite d0/de/d66/d8f/d29/d47/d74/fcc [0,4194304] 0 2024-09-13T23:06:15.824 INFO:tasks.workunit.client.0.smithi115.stdout:5/768: dwrite d8/d7a/fdc [0,4194304] 0 2024-09-13T23:06:15.825 INFO:tasks.workunit.client.0.smithi115.stdout:4/784: unlink db/d19/d1d/db5/lc8 0 2024-09-13T23:06:15.825 INFO:tasks.workunit.client.1.smithi152.stdout:4/229: truncate d3/f13 650760 0 2024-09-13T23:06:15.827 INFO:tasks.workunit.client.0.smithi115.stdout:7/700: creat da/dd/d13/d36/d5a/d99/ddd/d92/db1/ff1 x:0 0 0 2024-09-13T23:06:15.833 INFO:tasks.workunit.client.1.smithi152.stdout:5/144: link d5/f6 d5/dc/d19/d20/f2c 0 2024-09-13T23:06:15.834 INFO:tasks.workunit.client.0.smithi115.stdout:9/689: sync 2024-09-13T23:06:15.834 INFO:tasks.workunit.client.0.smithi115.stdout:6/795: sync 2024-09-13T23:06:15.835 INFO:tasks.workunit.client.0.smithi115.stdout:3/806: sync 2024-09-13T23:06:15.836 INFO:tasks.workunit.client.1.smithi152.stdout:4/230: creat d3/d4/d6/d37/f44 x:0 0 0 2024-09-13T23:06:15.837 INFO:tasks.workunit.client.1.smithi152.stdout:4/231: dread - d3/d4/d5/f42 zero size 2024-09-13T23:06:15.838 INFO:tasks.workunit.client.1.smithi152.stdout:7/174: truncate d17/f1b 2185493 0 2024-09-13T23:06:15.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/159: dread d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:15.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/160: fsync d0/d4/d9/f10 0 2024-09-13T23:06:15.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/161: write d0/d4/d9/f10 [1721076,24212] 0 2024-09-13T23:06:15.841 INFO:tasks.workunit.client.1.smithi152.stdout:7/175: symlink d17/d24/d2d/l38 0 2024-09-13T23:06:15.841 INFO:tasks.workunit.client.1.smithi152.stdout:7/176: rename d17 to d17/d24/d2a/d2e/d30/d39 22 2024-09-13T23:06:15.841 INFO:tasks.workunit.client.0.smithi115.stdout:4/785: write db/d16/f47 [568273,126077] 0 2024-09-13T23:06:15.844 INFO:tasks.workunit.client.1.smithi152.stdout:7/177: creat d17/d24/d2a/d2b/f3a x:0 0 0 2024-09-13T23:06:15.844 INFO:tasks.workunit.client.1.smithi152.stdout:7/178: write d17/f22 [874450,91943] 0 2024-09-13T23:06:15.845 INFO:tasks.workunit.client.1.smithi152.stdout:7/179: creat d17/d24/d2a/d2b/f3b x:0 0 0 2024-09-13T23:06:15.846 INFO:tasks.workunit.client.1.smithi152.stdout:2/162: dread d0/d4/d9/d14/f20 [0,4194304] 0 2024-09-13T23:06:15.846 INFO:tasks.workunit.client.1.smithi152.stdout:2/163: chown d0/d4/l7 62525474 1 2024-09-13T23:06:15.846 INFO:tasks.workunit.client.0.smithi115.stdout:7/701: dread da/f10 [4194304,4194304] 0 2024-09-13T23:06:15.847 INFO:tasks.workunit.client.0.smithi115.stdout:7/702: chown da/df/fa6 159 1 2024-09-13T23:06:15.847 INFO:tasks.workunit.client.0.smithi115.stdout:7/703: readlink da/l79 0 2024-09-13T23:06:15.849 INFO:tasks.workunit.client.0.smithi115.stdout:5/769: creat d8/dd/d20/d4a/fe7 x:0 0 0 2024-09-13T23:06:15.849 INFO:tasks.workunit.client.0.smithi115.stdout:5/770: dread - d8/dd/d20/dbb/faa zero size 2024-09-13T23:06:15.849 INFO:tasks.workunit.client.0.smithi115.stdout:9/690: creat d0/d13/d17/d1f/d4e/fd5 x:0 0 0 2024-09-13T23:06:15.849 INFO:tasks.workunit.client.0.smithi115.stdout:9/691: readlink d0/d13/d17/d1f/d28/l5f 0 2024-09-13T23:06:15.851 INFO:tasks.workunit.client.1.smithi152.stdout:7/180: rename d17/f26 to d17/d24/f3c 0 2024-09-13T23:06:15.853 INFO:tasks.workunit.client.0.smithi115.stdout:5/771: mkdir d8/dd/d6a/d82/d63/de8 0 2024-09-13T23:06:15.855 INFO:tasks.workunit.client.0.smithi115.stdout:9/692: truncate d0/d43/d53/f59 2655800 0 2024-09-13T23:06:15.855 INFO:tasks.workunit.client.1.smithi152.stdout:7/181: symlink d17/d24/d2d/l3d 0 2024-09-13T23:06:15.857 INFO:tasks.workunit.client.0.smithi115.stdout:5/772: link d8/dd/d5d/lb4 d8/dd/d20/d27/da9/le9 0 2024-09-13T23:06:15.861 INFO:tasks.workunit.client.0.smithi115.stdout:9/693: truncate d0/d13/d17/d1f/f45 2979504 0 2024-09-13T23:06:15.862 INFO:tasks.workunit.client.0.smithi115.stdout:1/682: dwrite d0/de/d1b/d25/d4d/d51/d23/d65/db6/fda [0,4194304] 0 2024-09-13T23:06:15.862 INFO:tasks.workunit.client.0.smithi115.stdout:1/683: write d0/de/d66/d8f/f6d [4434460,8622] 0 2024-09-13T23:06:15.862 INFO:tasks.workunit.client.0.smithi115.stdout:1/684: write d0/f3 [3096096,43038] 0 2024-09-13T23:06:15.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/232: dread d3/d4/d5/d1c/f27 [0,4194304] 0 2024-09-13T23:06:15.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/233: write d3/f13 [1229071,32053] 0 2024-09-13T23:06:15.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/234: dread - d3/d4/d5/d1c/f41 zero size 2024-09-13T23:06:15.864 INFO:tasks.workunit.client.0.smithi115.stdout:9/694: dread d0/d13/d17/d1f/d28/d76/d81/dd0/fd2 [0,4194304] 0 2024-09-13T23:06:15.865 INFO:tasks.workunit.client.1.smithi152.stdout:4/235: creat d3/d4/d32/f45 x:0 0 0 2024-09-13T23:06:15.865 INFO:tasks.workunit.client.1.smithi152.stdout:4/236: chown d3/d4/d5/f42 49387 1 2024-09-13T23:06:15.865 INFO:tasks.workunit.client.1.smithi152.stdout:4/237: fsync d3/f40 0 2024-09-13T23:06:15.865 INFO:tasks.workunit.client.0.smithi115.stdout:0/670: dwrite d6/d24/d25/d2b/d61/f69 [0,4194304] 0 2024-09-13T23:06:15.866 INFO:tasks.workunit.client.1.smithi152.stdout:4/238: symlink d3/d34/l46 0 2024-09-13T23:06:15.870 INFO:tasks.workunit.client.0.smithi115.stdout:9/695: creat d0/d13/d17/d1f/d67/fd6 x:0 0 0 2024-09-13T23:06:15.872 INFO:tasks.workunit.client.0.smithi115.stdout:0/671: rename d6/d24/f38 to d6/d24/d25/da3/fed 0 2024-09-13T23:06:15.874 INFO:tasks.workunit.client.0.smithi115.stdout:2/790: dwrite da/d21/d8c/d41/f7a [0,4194304] 0 2024-09-13T23:06:15.878 INFO:tasks.workunit.client.0.smithi115.stdout:0/672: rmdir d6/d24/d25/ddd 0 2024-09-13T23:06:15.878 INFO:tasks.workunit.client.0.smithi115.stdout:6/796: dwrite d4/df/d14/d38/d44/d99/fc6 [0,4194304] 0 2024-09-13T23:06:15.885 INFO:tasks.workunit.client.0.smithi115.stdout:0/673: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dee 0 2024-09-13T23:06:15.885 INFO:tasks.workunit.client.0.smithi115.stdout:0/674: readlink d6/d24/d25/d2b/d82/d44/d5c/l79 0 2024-09-13T23:06:15.887 INFO:tasks.workunit.client.0.smithi115.stdout:6/797: rename d4/df/d14/d35 to d4/df/d14/d67/d10e 0 2024-09-13T23:06:15.890 INFO:tasks.workunit.client.0.smithi115.stdout:6/798: rename d4/df/d14/d38/d2a/d31/f34 to d4/d57/d5a/f10f 0 2024-09-13T23:06:15.893 INFO:tasks.workunit.client.0.smithi115.stdout:6/799: link d4/df/c40 d4/df/d14/d38/d2a/d3e/c110 0 2024-09-13T23:06:15.895 INFO:tasks.workunit.client.0.smithi115.stdout:8/827: dwrite d3/d5/dc/d16/d1f/d28/f55 [0,4194304] 0 2024-09-13T23:06:15.895 INFO:tasks.workunit.client.0.smithi115.stdout:8/828: fdatasync d3/d5/d1c/fed 0 2024-09-13T23:06:15.895 INFO:tasks.workunit.client.0.smithi115.stdout:1/685: read d0/de/d1b/f2f [4027230,84707] 0 2024-09-13T23:06:15.898 INFO:tasks.workunit.client.0.smithi115.stdout:8/829: creat d3/d5/dc/d16/d1f/d27/f125 x:0 0 0 2024-09-13T23:06:15.899 INFO:tasks.workunit.client.0.smithi115.stdout:1/686: creat d0/de/d1b/d25/d4d/fdd x:0 0 0 2024-09-13T23:06:15.900 INFO:tasks.workunit.client.0.smithi115.stdout:8/830: dread d3/d5/dc/d23/d4e/d54/d8c/f97 [0,4194304] 0 2024-09-13T23:06:15.901 INFO:tasks.workunit.client.0.smithi115.stdout:1/687: symlink d0/de/d62/lde 0 2024-09-13T23:06:15.902 INFO:tasks.workunit.client.0.smithi115.stdout:8/831: mkdir d3/d5/dc/d16/d1f/d27/d79/da0/d122/d126 0 2024-09-13T23:06:15.902 INFO:tasks.workunit.client.0.smithi115.stdout:8/832: chown d3/d5/dc/d16/d1f/d27/d79/da0/dc9 2997 1 2024-09-13T23:06:15.903 INFO:tasks.workunit.client.0.smithi115.stdout:8/833: fsync d3/d5/dc/d16/f38 0 2024-09-13T23:06:15.903 INFO:tasks.workunit.client.0.smithi115.stdout:1/688: symlink d0/de/d1b/d25/d4d/d51/d31/d37/dc8/ldf 0 2024-09-13T23:06:15.903 INFO:tasks.workunit.client.0.smithi115.stdout:1/689: fdatasync d0/de/d1b/d25/d4d/d51/d23/f2c 0 2024-09-13T23:06:15.904 INFO:tasks.workunit.client.0.smithi115.stdout:8/834: creat d3/d5/d1d/f127 x:0 0 0 2024-09-13T23:06:15.904 INFO:tasks.workunit.client.0.smithi115.stdout:8/835: truncate d3/d5/d1c/d41/fff 613320 0 2024-09-13T23:06:15.906 INFO:tasks.workunit.client.0.smithi115.stdout:8/836: mkdir d3/d5/dc/d16/d1f/d28/d3e/d128 0 2024-09-13T23:06:15.906 INFO:tasks.workunit.client.0.smithi115.stdout:8/837: dread - d3/d5/dc/d23/d4e/d54/d7f/fda zero size 2024-09-13T23:06:15.906 INFO:tasks.workunit.client.0.smithi115.stdout:8/838: write d3/d5/dc/d16/d1f/d28/f29 [5077494,7831] 0 2024-09-13T23:06:15.907 INFO:tasks.workunit.client.0.smithi115.stdout:8/839: creat d3/d5/dc/d16/d1f/d27/d79/f129 x:0 0 0 2024-09-13T23:06:15.910 INFO:tasks.workunit.client.0.smithi115.stdout:8/840: unlink d3/d5/dc/d16/d1f/d28/d3e/fad 0 2024-09-13T23:06:15.910 INFO:tasks.workunit.client.0.smithi115.stdout:8/841: read d3/fd [3554903,72978] 0 2024-09-13T23:06:15.910 INFO:tasks.workunit.client.0.smithi115.stdout:8/842: fdatasync d3/d5/dc/d23/d4e/d54/d7f/de9/fd5 0 2024-09-13T23:06:15.910 INFO:tasks.workunit.client.0.smithi115.stdout:8/843: truncate d3/d5/dc/d16/f38 437041 0 2024-09-13T23:06:15.912 INFO:tasks.workunit.client.0.smithi115.stdout:8/844: symlink d3/d5/dc/d16/d1f/l12a 0 2024-09-13T23:06:15.913 INFO:tasks.workunit.client.0.smithi115.stdout:8/845: mknod d3/d5/dc/d16/d1f/d28/dc0/dcd/c12b 0 2024-09-13T23:06:15.914 INFO:tasks.workunit.client.0.smithi115.stdout:5/773: getdents d8/dd/d6a/d82/d63 0 2024-09-13T23:06:15.915 INFO:tasks.workunit.client.0.smithi115.stdout:8/846: rmdir d3/d5/dc/d16/d1f/d28/dc0/dcd 39 2024-09-13T23:06:15.917 INFO:tasks.workunit.client.0.smithi115.stdout:8/847: creat d3/d5/dc/d23/d4e/d54/d7f/de9/f12c x:0 0 0 2024-09-13T23:06:15.917 INFO:tasks.workunit.client.0.smithi115.stdout:8/848: fdatasync d3/d5/dc/f35 0 2024-09-13T23:06:15.919 INFO:tasks.workunit.client.0.smithi115.stdout:8/849: link d3/c47 d3/d87/c12d 0 2024-09-13T23:06:15.920 INFO:tasks.workunit.client.0.smithi115.stdout:8/850: write d3/d5/dc/d16/d1f/f117 [773570,32737] 0 2024-09-13T23:06:15.920 INFO:tasks.workunit.client.0.smithi115.stdout:8/851: creat d3/d10d/f12e x:0 0 0 2024-09-13T23:06:15.922 INFO:tasks.workunit.client.0.smithi115.stdout:8/852: link d3/d5/d1d/d63/fe8 d3/d5/f12f 0 2024-09-13T23:06:15.923 INFO:tasks.workunit.client.0.smithi115.stdout:8/853: mknod d3/d87/dc8/c130 0 2024-09-13T23:06:15.923 INFO:tasks.workunit.client.0.smithi115.stdout:8/854: truncate d3/d5/dc/d16/d1f/d27/d79/f7c 4553573 0 2024-09-13T23:06:15.925 INFO:tasks.workunit.client.0.smithi115.stdout:8/855: creat d3/d5/dc/d23/d4e/d54/d7f/d10c/f131 x:0 0 0 2024-09-13T23:06:15.926 INFO:tasks.workunit.client.0.smithi115.stdout:8/856: symlink d3/d5/dc/d23/d4e/d54/d7f/de9/l132 0 2024-09-13T23:06:15.926 INFO:tasks.workunit.client.0.smithi115.stdout:8/857: creat d3/d5/dc/d23/d4e/d54/d7f/d10c/f133 x:0 0 0 2024-09-13T23:06:15.927 INFO:tasks.workunit.client.1.smithi152.stdout:5/145: dwrite d5/f6 [0,4194304] 0 2024-09-13T23:06:15.929 INFO:tasks.workunit.client.1.smithi152.stdout:5/146: getdents d5 0 2024-09-13T23:06:15.933 INFO:tasks.workunit.client.0.smithi115.stdout:7/704: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:15.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/791: dwrite da/d23/d2c/dc2/de1/d56/dda/ff2 [4194304,4194304] 0 2024-09-13T23:06:15.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/792: readlink da/d21/d8c/d41/l70 0 2024-09-13T23:06:15.934 INFO:tasks.workunit.client.0.smithi115.stdout:7/705: creat da/dd/d13/d36/d5a/d6d/ff2 x:0 0 0 2024-09-13T23:06:15.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/690: truncate d0/f3 5046168 0 2024-09-13T23:06:15.937 INFO:tasks.workunit.client.0.smithi115.stdout:1/691: fsync d0/de/d1b/d25/d4d/d51/d23/f2c 0 2024-09-13T23:06:15.941 INFO:tasks.workunit.client.0.smithi115.stdout:8/858: dread d3/d5/d1d/f26 [4194304,4194304] 0 2024-09-13T23:06:15.941 INFO:tasks.workunit.client.0.smithi115.stdout:8/859: fdatasync f2 0 2024-09-13T23:06:15.941 INFO:tasks.workunit.client.0.smithi115.stdout:3/807: dwrite d3/d5/d35/d71/d42/f105 [0,4194304] 0 2024-09-13T23:06:15.941 INFO:tasks.workunit.client.0.smithi115.stdout:3/808: fdatasync d3/d16/d1a/f26 0 2024-09-13T23:06:15.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/164: dwrite d0/d4/d9/d14/f2f [0,4194304] 0 2024-09-13T23:06:15.942 INFO:tasks.workunit.client.1.smithi152.stdout:4/239: dwrite d3/d4/d6/d8/d17/f24 [0,4194304] 0 2024-09-13T23:06:15.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/800: dwrite d4/df/d14/d38/d2a/d31/fbd [0,4194304] 0 2024-09-13T23:06:15.942 INFO:tasks.workunit.client.0.smithi115.stdout:6/801: chown d4/df/d14/c19 380159 1 2024-09-13T23:06:15.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/696: dwrite d0/d13/d17/d1f/d35/d40/f52 [0,4194304] 0 2024-09-13T23:06:15.942 INFO:tasks.workunit.client.0.smithi115.stdout:9/697: truncate d0/d13/d3b/d42/d95/fb7 157897 0 2024-09-13T23:06:15.943 INFO:tasks.workunit.client.0.smithi115.stdout:9/698: fdatasync d0/d13/d17/d1f/d28/fcd 0 2024-09-13T23:06:15.943 INFO:tasks.workunit.client.0.smithi115.stdout:4/786: dwrite db/d11/d2e/d33/d36/d51/d57/fab [0,4194304] 0 2024-09-13T23:06:15.943 INFO:tasks.workunit.client.0.smithi115.stdout:5/774: dwrite d8/dd/d6a/d82/d63/f8b [0,4194304] 0 2024-09-13T23:06:15.943 INFO:tasks.workunit.client.0.smithi115.stdout:0/675: dwrite d6/d24/d25/d2b/fdf [0,4194304] 0 2024-09-13T23:06:15.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/182: dwrite d17/f25 [0,4194304] 0 2024-09-13T23:06:15.944 INFO:tasks.workunit.client.0.smithi115.stdout:2/793: write da/d21/fb3 [402848,93477] 0 2024-09-13T23:06:15.944 INFO:tasks.workunit.client.0.smithi115.stdout:2/794: write da/d21/f5f [4349139,129666] 0 2024-09-13T23:06:15.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/183: symlink d17/d24/d2d/l3e 0 2024-09-13T23:06:15.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/147: truncate d5/dc/fe 2737881 0 2024-09-13T23:06:15.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/148: chown d5/dc/d19 6804 1 2024-09-13T23:06:15.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/149: chown d5/l16 515 1 2024-09-13T23:06:15.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/150: fsync d5/dc/d19/f1d 0 2024-09-13T23:06:15.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/151: stat d5/da 0 2024-09-13T23:06:15.954 INFO:tasks.workunit.client.0.smithi115.stdout:6/802: mkdir d4/d57/d5a/d111 0 2024-09-13T23:06:15.955 INFO:tasks.workunit.client.1.smithi152.stdout:5/152: mknod d5/dc/c2d 0 2024-09-13T23:06:15.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/65: sync 2024-09-13T23:06:15.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/699: mkdir d0/d13/d17/d1f/d4e/da2/dd7 0 2024-09-13T23:06:15.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/700: readlink d0/d13/d3b/l6a 0 2024-09-13T23:06:15.960 INFO:tasks.workunit.client.1.smithi152.stdout:6/66: mkdir d4/d11 0 2024-09-13T23:06:15.960 INFO:tasks.workunit.client.1.smithi152.stdout:6/67: write d4/f6 [4157656,70343] 0 2024-09-13T23:06:15.961 INFO:tasks.workunit.client.1.smithi152.stdout:6/68: mkdir d4/de/d12 0 2024-09-13T23:06:15.964 INFO:tasks.workunit.client.1.smithi152.stdout:6/69: creat d4/de/f13 x:0 0 0 2024-09-13T23:06:15.971 INFO:tasks.workunit.client.0.smithi115.stdout:5/775: creat d8/dd/d5d/d5e/d9a/fea x:0 0 0 2024-09-13T23:06:15.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/165: write d0/d4/d9/d14/f2f [4837525,74992] 0 2024-09-13T23:06:15.973 INFO:tasks.workunit.client.0.smithi115.stdout:0/676: rename d6/d24/d25/d2b/d82/d44/d5c/d87/da4/fa8 to d6/d24/d25/d2b/d82/d6b/d9f/dab/fef 0 2024-09-13T23:06:15.974 INFO:tasks.workunit.client.0.smithi115.stdout:0/677: chown d6/d24/d25/d2b/d82/d44/cd8 44912 1 2024-09-13T23:06:15.974 INFO:tasks.workunit.client.0.smithi115.stdout:0/678: dread - d6/d24/fdc zero size 2024-09-13T23:06:15.974 INFO:tasks.workunit.client.1.smithi152.stdout:2/166: unlink d0/d4/d9/d18/d1e/c6 0 2024-09-13T23:06:15.975 INFO:tasks.workunit.client.0.smithi115.stdout:2/795: creat da/d21/d8c/f107 x:0 0 0 2024-09-13T23:06:15.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/167: link d0/d4/d9/d14/f28 d0/d4/d9/d16/d2b/f3b 0 2024-09-13T23:06:15.975 INFO:tasks.workunit.client.1.smithi152.stdout:2/168: read - d0/d8/f22 zero size 2024-09-13T23:06:15.988 INFO:tasks.workunit.client.0.smithi115.stdout:7/706: dwrite da/fc [0,4194304] 0 2024-09-13T23:06:15.988 INFO:tasks.workunit.client.0.smithi115.stdout:7/707: dread - da/dd/d13/d24/d67/fe2 zero size 2024-09-13T23:06:15.988 INFO:tasks.workunit.client.0.smithi115.stdout:8/860: dwrite d3/d5/dc/d16/d1f/d28/d3e/f100 [4194304,4194304] 0 2024-09-13T23:06:15.988 INFO:tasks.workunit.client.0.smithi115.stdout:1/692: dwrite d0/de/d1b/f85 [0,4194304] 0 2024-09-13T23:06:15.991 INFO:tasks.workunit.client.0.smithi115.stdout:3/809: rmdir d3 39 2024-09-13T23:06:15.992 INFO:tasks.workunit.client.0.smithi115.stdout:6/803: rmdir d4/df/df8 0 2024-09-13T23:06:15.993 INFO:tasks.workunit.client.0.smithi115.stdout:5/776: mkdir d8/dd/d20/dbb/deb 0 2024-09-13T23:06:15.995 INFO:tasks.workunit.client.0.smithi115.stdout:9/701: rename d0/d13/d17/d1f/d35/d62/fa4 to d0/d13/d3b/d42/d95/fd8 0 2024-09-13T23:06:15.997 INFO:tasks.workunit.client.0.smithi115.stdout:2/796: mkdir da/d23/d2c/dc2/d108 0 2024-09-13T23:06:15.998 INFO:tasks.workunit.client.0.smithi115.stdout:7/708: mknod da/dd/d13/d36/d85/cf3 0 2024-09-13T23:06:15.998 INFO:tasks.workunit.client.0.smithi115.stdout:7/709: fsync da/df/fa6 0 2024-09-13T23:06:16.001 INFO:tasks.workunit.client.0.smithi115.stdout:4/787: dwrite db/d19/d1d/f59 [0,4194304] 0 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.0.smithi115.stdout:6/804: dread d4/df/d51/f83 [0,4194304] 0 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.0.smithi115.stdout:1/693: mknod d0/de/d1b/d25/d4d/d51/d23/d65/db6/ce0 0 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.0.smithi115.stdout:3/810: symlink d3/d5/db/dbd/l10a 0 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.0.smithi115.stdout:3/811: chown d3/d16/d1c/d101/d98/dbc/fc7 38659226 1 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.0.smithi115.stdout:3/812: chown d3/d16/l109 4008 1 2024-09-13T23:06:16.005 INFO:tasks.workunit.client.1.smithi152.stdout:6/70: dwrite d4/fd [0,4194304] 0 2024-09-13T23:06:16.006 INFO:tasks.workunit.client.0.smithi115.stdout:9/702: mknod d0/d13/d17/d1f/d4e/cd9 0 2024-09-13T23:06:16.006 INFO:tasks.workunit.client.0.smithi115.stdout:9/703: fsync d0/d43/f9e 0 2024-09-13T23:06:16.006 INFO:tasks.workunit.client.0.smithi115.stdout:2/797: symlink da/d23/d2c/dc2/de1/d48/ded/l109 0 2024-09-13T23:06:16.006 INFO:tasks.workunit.client.0.smithi115.stdout:2/798: fdatasync da/d77/d83/ff7 0 2024-09-13T23:06:16.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/169: dwrite d0/d4/d9/d18/f29 [0,4194304] 0 2024-09-13T23:06:16.008 INFO:tasks.workunit.client.0.smithi115.stdout:5/777: dread d8/dd/d6a/fa1 [0,4194304] 0 2024-09-13T23:06:16.010 INFO:tasks.workunit.client.1.smithi152.stdout:6/71: rename d4/fa to d4/d11/f14 0 2024-09-13T23:06:16.010 INFO:tasks.workunit.client.1.smithi152.stdout:6/72: fdatasync d4/de/ff 0 2024-09-13T23:06:16.010 INFO:tasks.workunit.client.1.smithi152.stdout:6/73: fsync f3 0 2024-09-13T23:06:16.010 INFO:tasks.workunit.client.1.smithi152.stdout:6/74: fdatasync f3 0 2024-09-13T23:06:16.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/679: dwrite d6/d24/d25/d2b/d82/d6b/d9f/fbc [0,4194304] 0 2024-09-13T23:06:16.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/710: dread da/dd/d13/d24/d52/d7c/da7/fae [0,4194304] 0 2024-09-13T23:06:16.011 INFO:tasks.workunit.client.0.smithi115.stdout:7/711: fdatasync da/dd/d13/d36/f3a 0 2024-09-13T23:06:16.011 INFO:tasks.workunit.client.0.smithi115.stdout:0/680: write d6/d24/d25/d7f/f9a [840631,28197] 0 2024-09-13T23:06:16.011 INFO:tasks.workunit.client.1.smithi152.stdout:2/170: mkdir d0/d4/d9/d18/d1e/d3c 0 2024-09-13T23:06:16.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/75: rename f3 to d4/d11/f15 0 2024-09-13T23:06:16.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/76: truncate d4/de/ff 1086316 0 2024-09-13T23:06:16.015 INFO:tasks.workunit.client.1.smithi152.stdout:2/171: rename d0/d8/c39 to d0/d4/d9/d18/d1e/d3c/c3d 0 2024-09-13T23:06:16.015 INFO:tasks.workunit.client.1.smithi152.stdout:2/172: fdatasync d0/d4/d9/f25 0 2024-09-13T23:06:16.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/77: mkdir d4/de/d12/d16 0 2024-09-13T23:06:16.016 INFO:tasks.workunit.client.0.smithi115.stdout:6/805: rmdir d4/df/d14/d38/d2a/d3e/d56 39 2024-09-13T23:06:16.018 INFO:tasks.workunit.client.0.smithi115.stdout:2/799: write da/d23/d2c/dc2/de1/d48/ff3 [3398854,83126] 0 2024-09-13T23:06:16.019 INFO:tasks.workunit.client.1.smithi152.stdout:2/173: getdents d0/d4 0 2024-09-13T23:06:16.021 INFO:tasks.workunit.client.0.smithi115.stdout:3/813: creat d3/d16/d1a/d1e/f10b x:0 0 0 2024-09-13T23:06:16.022 INFO:tasks.workunit.client.0.smithi115.stdout:3/814: readlink d3/d5/db/dbd/lea 0 2024-09-13T23:06:16.022 INFO:tasks.workunit.client.1.smithi152.stdout:2/174: creat d0/d4/d9/d16/d30/f3e x:0 0 0 2024-09-13T23:06:16.023 INFO:tasks.workunit.client.1.smithi152.stdout:2/175: symlink d0/d8/l3f 0 2024-09-13T23:06:16.024 INFO:tasks.workunit.client.0.smithi115.stdout:9/704: mknod d0/d13/d17/d1f/d67/cda 0 2024-09-13T23:06:16.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/176: link d0/d8/f22 d0/d4/d9/f40 0 2024-09-13T23:06:16.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/177: fdatasync d0/d4/d9/f10 0 2024-09-13T23:06:16.026 INFO:tasks.workunit.client.0.smithi115.stdout:5/778: mknod d8/dd/d64/dc5/cec 0 2024-09-13T23:06:16.026 INFO:tasks.workunit.client.0.smithi115.stdout:5/779: fdatasync d8/dd/d20/d23/f70 0 2024-09-13T23:06:16.026 INFO:tasks.workunit.client.0.smithi115.stdout:5/780: truncate d8/dd/d5d/d5e/fc0 891289 0 2024-09-13T23:06:16.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/788: dwrite db/f56 [0,4194304] 0 2024-09-13T23:06:16.029 INFO:tasks.workunit.client.0.smithi115.stdout:4/789: chown db/d11/d2e/f5d 51 1 2024-09-13T23:06:16.036 INFO:tasks.workunit.client.0.smithi115.stdout:2/800: mkdir da/d21/d8c/d41/d62/d10a 0 2024-09-13T23:06:16.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/815: rename d3/d5/db/ff6 to d3/d5/d35/d4c/dc2/f10c 0 2024-09-13T23:06:16.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/816: truncate d3/d5/d35/ffe 350036 0 2024-09-13T23:06:16.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/817: fsync d3/d16/d1a/f57 0 2024-09-13T23:06:16.039 INFO:tasks.workunit.client.0.smithi115.stdout:3/818: fsync d3/d5/d35/f53 0 2024-09-13T23:06:16.040 INFO:tasks.workunit.client.0.smithi115.stdout:9/705: symlink d0/d13/d17/d1f/d28/d76/d81/ldb 0 2024-09-13T23:06:16.041 INFO:tasks.workunit.client.0.smithi115.stdout:5/781: mknod d8/dd/d20/ced 0 2024-09-13T23:06:16.042 INFO:tasks.workunit.client.0.smithi115.stdout:1/694: dwrite d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:16.042 INFO:tasks.workunit.client.0.smithi115.stdout:1/695: write d0/de/d66/d8f/d29/d47/fa7 [421075,98374] 0 2024-09-13T23:06:16.043 INFO:tasks.workunit.client.0.smithi115.stdout:4/790: unlink db/d19/f27 0 2024-09-13T23:06:16.046 INFO:tasks.workunit.client.0.smithi115.stdout:2/801: symlink da/d23/dbd/l10b 0 2024-09-13T23:06:16.046 INFO:tasks.workunit.client.0.smithi115.stdout:8/861: truncate d3/d5/dc/d23/fef 65119 0 2024-09-13T23:06:16.046 INFO:tasks.workunit.client.0.smithi115.stdout:8/862: getdents d3/d5/d1c/d41 0 2024-09-13T23:06:16.047 INFO:tasks.workunit.client.0.smithi115.stdout:3/819: creat d3/d16/d1a/d1e/dd3/f10d x:0 0 0 2024-09-13T23:06:16.048 INFO:tasks.workunit.client.0.smithi115.stdout:9/706: creat d0/d13/fdc x:0 0 0 2024-09-13T23:06:16.049 INFO:tasks.workunit.client.0.smithi115.stdout:4/791: mknod db/d19/d34/ceb 0 2024-09-13T23:06:16.049 INFO:tasks.workunit.client.0.smithi115.stdout:4/792: readlink db/d19/l20 0 2024-09-13T23:06:16.049 INFO:tasks.workunit.client.0.smithi115.stdout:8/863: mknod d3/d87/dc8/d102/c134 0 2024-09-13T23:06:16.051 INFO:tasks.workunit.client.0.smithi115.stdout:3/820: link d3/d5/d35/l54 d3/d16/d1a/d1e/dd3/l10e 0 2024-09-13T23:06:16.052 INFO:tasks.workunit.client.0.smithi115.stdout:5/782: write d8/dd/d6a/d82/d63/dd6/fa5 [1061633,127066] 0 2024-09-13T23:06:16.052 INFO:tasks.workunit.client.0.smithi115.stdout:9/707: symlink d0/d13/d17/d1f/d4e/da2/dd7/ldd 0 2024-09-13T23:06:16.052 INFO:tasks.workunit.client.0.smithi115.stdout:9/708: chown d0/d13/d17/d1f/d77/f93 3257 1 2024-09-13T23:06:16.053 INFO:tasks.workunit.client.0.smithi115.stdout:5/783: mknod d8/dd/d6a/d8a/cee 0 2024-09-13T23:06:16.053 INFO:tasks.workunit.client.0.smithi115.stdout:5/784: write d8/dd/d20/f25 [1519310,77954] 0 2024-09-13T23:06:16.054 INFO:tasks.workunit.client.0.smithi115.stdout:9/709: symlink d0/d13/d17/lde 0 2024-09-13T23:06:16.056 INFO:tasks.workunit.client.0.smithi115.stdout:9/710: rename d0/d13/d17/d1f/d77/cd3 to d0/d13/d17/d1f/d77/cdf 0 2024-09-13T23:06:16.057 INFO:tasks.workunit.client.0.smithi115.stdout:9/711: creat d0/fe0 x:0 0 0 2024-09-13T23:06:16.058 INFO:tasks.workunit.client.0.smithi115.stdout:9/712: link d0/d13/fdc d0/d13/d17/d19/dc8/fe1 0 2024-09-13T23:06:16.058 INFO:tasks.workunit.client.0.smithi115.stdout:9/713: readlink d0/d13/d17/d19/l25 0 2024-09-13T23:06:16.062 INFO:tasks.workunit.client.0.smithi115.stdout:8/864: dread d3/d5/f44 [0,4194304] 0 2024-09-13T23:06:16.062 INFO:tasks.workunit.client.0.smithi115.stdout:3/821: dread d3/d5/d65/da8/da4/d49/fa6 [0,4194304] 0 2024-09-13T23:06:16.064 INFO:tasks.workunit.client.0.smithi115.stdout:3/822: mkdir d3/d5/d65/da8/da4/d10f 0 2024-09-13T23:06:16.064 INFO:tasks.workunit.client.0.smithi115.stdout:8/865: getdents d3/d5/dc/d16/d1f/d27 0 2024-09-13T23:06:16.065 INFO:tasks.workunit.client.0.smithi115.stdout:4/793: dread db/d16/d3f/d66/d68/d6a/f7a [0,4194304] 0 2024-09-13T23:06:16.066 INFO:tasks.workunit.client.0.smithi115.stdout:8/866: link d3/d5/dc/d23/d4e/fb9 d3/d5/dc/f135 0 2024-09-13T23:06:16.066 INFO:tasks.workunit.client.0.smithi115.stdout:8/867: truncate d3/d5/dc/d23/fec 344295 0 2024-09-13T23:06:16.066 INFO:tasks.workunit.client.0.smithi115.stdout:4/794: mkdir db/d16/d3f/d66/da6/dec 0 2024-09-13T23:06:16.067 INFO:tasks.workunit.client.0.smithi115.stdout:9/714: dread d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:16.068 INFO:tasks.workunit.client.0.smithi115.stdout:8/868: rename d3/d5/d1d/l24 to d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/dfd/l136 0 2024-09-13T23:06:16.069 INFO:tasks.workunit.client.0.smithi115.stdout:8/869: readlink d3/d5/d1c/d41/l6d 0 2024-09-13T23:06:16.069 INFO:tasks.workunit.client.0.smithi115.stdout:8/870: truncate d3/d10d/f12e 641651 0 2024-09-13T23:06:16.071 INFO:tasks.workunit.client.0.smithi115.stdout:5/785: dread d8/dd/d20/d23/f70 [0,4194304] 0 2024-09-13T23:06:16.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/806: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:16.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/807: write d4/d57/dab/fb7 [229014,78903] 0 2024-09-13T23:06:16.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/808: write d4/df/d14/d38/d2a/d31/d5b/da8/fcc [390910,56589] 0 2024-09-13T23:06:16.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/809: chown d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb 759690234 1 2024-09-13T23:06:16.073 INFO:tasks.workunit.client.0.smithi115.stdout:6/810: creat d4/d57/d5a/db4/f112 x:0 0 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:6/811: truncate d4/df/d14/d67/d10e/ffa 1233682 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/823: dread d3/d5/d35/d71/d3b/d4d/f74 [0,4194304] 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/824: stat d3/d16/d1a/d1e/d76/l9c 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/825: chown d3/d16/d1c/d101/d98/dbc/df7 77667 1 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:3/826: write d3/d5/d35/d4c/dc2/f10c [858330,108425] 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.0.smithi115.stdout:7/712: dwrite da/dd/d1c/d2d/d41/d98/fbd [0,4194304] 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/78: dwrite d4/d11/f14 [0,4194304] 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/79: stat d4/f6 0 2024-09-13T23:06:16.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/80: truncate d4/f6 4817761 0 2024-09-13T23:06:16.077 INFO:tasks.workunit.client.0.smithi115.stdout:1/696: dwrite d0/de/d1b/d25/d4d/d51/d31/d37/fd6 [0,4194304] 0 2024-09-13T23:06:16.077 INFO:tasks.workunit.client.0.smithi115.stdout:6/812: mknod d4/c113 0 2024-09-13T23:06:16.077 INFO:tasks.workunit.client.0.smithi115.stdout:6/813: write d4/df/d14/d38/f109 [1026111,5639] 0 2024-09-13T23:06:16.078 INFO:tasks.workunit.client.0.smithi115.stdout:8/871: fsync d3/d5/dc/d23/d4e/d54/d7f/de9/f61 0 2024-09-13T23:06:16.078 INFO:tasks.workunit.client.0.smithi115.stdout:0/681: dwrite d6/d24/f95 [0,4194304] 0 2024-09-13T23:06:16.079 INFO:tasks.workunit.client.1.smithi152.stdout:2/178: rmdir d0/d4/d9/d18/d1e 39 2024-09-13T23:06:16.082 INFO:tasks.workunit.client.0.smithi115.stdout:3/827: link d3/d5/db/dbd/l10a d3/d16/d84/l110 0 2024-09-13T23:06:16.083 INFO:tasks.workunit.client.1.smithi152.stdout:2/179: write d0/d4/d9/d16/f17 [646080,71631] 0 2024-09-13T23:06:16.084 INFO:tasks.workunit.client.0.smithi115.stdout:1/697: dread d0/de/d62/fa6 [0,4194304] 0 2024-09-13T23:06:16.084 INFO:tasks.workunit.client.0.smithi115.stdout:1/698: readlink d0/de/d66/d8f/d29/d47/lbb 0 2024-09-13T23:06:16.085 INFO:tasks.workunit.client.0.smithi115.stdout:1/699: chown d0/de/d66/d8f/d29/f42 18 1 2024-09-13T23:06:16.085 INFO:tasks.workunit.client.0.smithi115.stdout:0/682: fdatasync d6/d24/d25/d2b/d82/d6b/f7b 0 2024-09-13T23:06:16.085 INFO:tasks.workunit.client.0.smithi115.stdout:1/700: creat d0/de/d1b/d25/d67/fe1 x:0 0 0 2024-09-13T23:06:16.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/81: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:16.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/82: fdatasync d4/de/f13 0 2024-09-13T23:06:16.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/83: fdatasync d4/fd 0 2024-09-13T23:06:16.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/180: write d0/d4/d9/d18/d32/f35 [630720,19671] 0 2024-09-13T23:06:16.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/181: creat d0/d4/d9/d18/d1e/f41 x:0 0 0 2024-09-13T23:06:16.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/182: fsync d0/d4/d9/d18/f29 0 2024-09-13T23:06:16.090 INFO:tasks.workunit.client.0.smithi115.stdout:9/715: dwrite d0/d13/d17/d1f/d28/d76/d81/fab [0,4194304] 0 2024-09-13T23:06:16.090 INFO:tasks.workunit.client.0.smithi115.stdout:7/713: rename da/dd/d13/d36/d5a/d99/ddd/lce to da/df/d3b/lf4 0 2024-09-13T23:06:16.095 INFO:tasks.workunit.client.0.smithi115.stdout:6/814: mknod d4/df/d14/d38/d44/d99/d10b/c114 0 2024-09-13T23:06:16.095 INFO:tasks.workunit.client.1.smithi152.stdout:2/183: creat d0/d4/d9/f42 x:0 0 0 2024-09-13T23:06:16.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/184: mkdir d0/d8/d43 0 2024-09-13T23:06:16.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/185: read - d0/d4/d9/d18/d1e/f41 zero size 2024-09-13T23:06:16.113 INFO:tasks.workunit.client.0.smithi115.stdout:0/683: mknod d6/d24/d25/cf0 0 2024-09-13T23:06:16.114 INFO:tasks.workunit.client.0.smithi115.stdout:1/701: mknod d0/ce2 0 2024-09-13T23:06:16.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/872: dwrite d3/d5/dc/d16/d1f/d28/f55 [0,4194304] 0 2024-09-13T23:06:16.117 INFO:tasks.workunit.client.1.smithi152.stdout:9/165: sync 2024-09-13T23:06:16.122 INFO:tasks.workunit.client.0.smithi115.stdout:9/716: chown d0/f5b 28575086 1 2024-09-13T23:06:16.122 INFO:tasks.workunit.client.0.smithi115.stdout:7/714: creat da/df/d3b/ff5 x:0 0 0 2024-09-13T23:06:16.122 INFO:tasks.workunit.client.0.smithi115.stdout:7/715: creat da/dd/d13/d24/d52/ff6 x:0 0 0 2024-09-13T23:06:16.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/166: unlink d3/c16 0 2024-09-13T23:06:16.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/167: link d3/l1d d3/l35 0 2024-09-13T23:06:16.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/168: rename d3/d24/f2f to d3/d24/f36 0 2024-09-13T23:06:16.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/169: chown d3/d1e/f2b 80640 1 2024-09-13T23:06:16.123 INFO:tasks.workunit.client.0.smithi115.stdout:0/684: mknod d6/d24/d25/da3/cf1 0 2024-09-13T23:06:16.124 INFO:tasks.workunit.client.1.smithi152.stdout:9/170: mkdir d3/d24/d34/d37 0 2024-09-13T23:06:16.124 INFO:tasks.workunit.client.1.smithi152.stdout:9/171: truncate d3/f1c 523624 0 2024-09-13T23:06:16.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/685: write d6/d24/d25/d7f/f9a [630638,20321] 0 2024-09-13T23:06:16.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/686: chown d6/l54 45351762 1 2024-09-13T23:06:16.124 INFO:tasks.workunit.client.0.smithi115.stdout:0/687: fdatasync d6/d24/d25/d2b/d82/d6b/fa1 0 2024-09-13T23:06:16.125 INFO:tasks.workunit.client.0.smithi115.stdout:7/716: creat da/ff7 x:0 0 0 2024-09-13T23:06:16.125 INFO:tasks.workunit.client.0.smithi115.stdout:7/717: write da/dd/d1c/f9c [508955,75104] 0 2024-09-13T23:06:16.126 INFO:tasks.workunit.client.0.smithi115.stdout:1/702: dread d0/de/d66/d8f/d29/d47/d6a/f7a [0,4194304] 0 2024-09-13T23:06:16.128 INFO:tasks.workunit.client.0.smithi115.stdout:7/718: mkdir da/dd/d1c/d2d/d41/de1/df8 0 2024-09-13T23:06:16.128 INFO:tasks.workunit.client.0.smithi115.stdout:7/719: truncate da/dd/fe5 72478 0 2024-09-13T23:06:16.129 INFO:tasks.workunit.client.0.smithi115.stdout:7/720: rmdir da/dd/d13/d36/d5a/d99 39 2024-09-13T23:06:16.129 INFO:tasks.workunit.client.0.smithi115.stdout:8/873: write d3/d5/d1c/fd2 [1357234,13499] 0 2024-09-13T23:06:16.129 INFO:tasks.workunit.client.0.smithi115.stdout:8/874: chown d3/ff9 333271603 1 2024-09-13T23:06:16.130 INFO:tasks.workunit.client.0.smithi115.stdout:7/721: rename da/dd/d1c/d2d/d60/l6a to da/dd/d13/d36/d5a/d99/ddd/d92/db1/dd8/lf9 0 2024-09-13T23:06:16.130 INFO:tasks.workunit.client.0.smithi115.stdout:7/722: chown da/dd/d13/d36/d5a/c69 49900395 1 2024-09-13T23:06:16.131 INFO:tasks.workunit.client.0.smithi115.stdout:8/875: mkdir d3/d5/dc/d16/d1f/d27/d68/dfc/d137 0 2024-09-13T23:06:16.132 INFO:tasks.workunit.client.0.smithi115.stdout:7/723: rename da/dd/d13/d36/cb4 to da/dd/d13/d36/d5a/d6d/cfa 0 2024-09-13T23:06:16.134 INFO:tasks.workunit.client.0.smithi115.stdout:8/876: creat d3/d5/dc/d23/d4e/d54/d7f/d10c/f138 x:0 0 0 2024-09-13T23:06:16.134 INFO:tasks.workunit.client.0.smithi115.stdout:8/877: fdatasync d3/d5/dc/d23/d4e/d54/d7f/d10c/f133 0 2024-09-13T23:06:16.134 INFO:tasks.workunit.client.0.smithi115.stdout:7/724: getdents da/dd/d13/d24/d52/d7c 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:6/84: dwrite d4/de/ff [0,4194304] 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:6/85: write d4/f9 [3820808,52269] 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/186: dwrite d0/d4/d9/d16/f21 [0,4194304] 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/187: dread - d0/d8/f2a zero size 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/188: readlink d0/d4/l11 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/189: write d0/d4/d9/d16/f17 [856956,32346] 0 2024-09-13T23:06:16.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/190: creat d0/d4/d9/d18/d1e/f44 x:0 0 0 2024-09-13T23:06:16.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/815: dwrite d4/df/f2e [0,4194304] 0 2024-09-13T23:06:16.136 INFO:tasks.workunit.client.0.smithi115.stdout:6/816: chown d4/df/d14/d38/d2a/d3e/d56 7752 1 2024-09-13T23:06:16.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/878: creat d3/d5/dc/d23/d4e/d54/d8c/dd9/d119/f139 x:0 0 0 2024-09-13T23:06:16.136 INFO:tasks.workunit.client.0.smithi115.stdout:8/879: fdatasync d3/d5/d1c/df2/ff3 0 2024-09-13T23:06:16.137 INFO:tasks.workunit.client.0.smithi115.stdout:2/802: dwrite da/d21/fb3 [0,4194304] 0 2024-09-13T23:06:16.137 INFO:tasks.workunit.client.0.smithi115.stdout:2/803: truncate da/d23/d2c/dc2/de1/d56/dda/ff6 737434 0 2024-09-13T23:06:16.137 INFO:tasks.workunit.client.0.smithi115.stdout:2/804: chown da/d23/d2c/dc2/de1/d56/d4b/ce9 69271 1 2024-09-13T23:06:16.138 INFO:tasks.workunit.client.0.smithi115.stdout:0/688: dread d6/d24/d25/da3/fed [0,4194304] 0 2024-09-13T23:06:16.138 INFO:tasks.workunit.client.0.smithi115.stdout:8/880: dread d3/d5/d1d/d72/fc1 [0,4194304] 0 2024-09-13T23:06:16.138 INFO:tasks.workunit.client.0.smithi115.stdout:6/817: getdents d4/d57/dce 0 2024-09-13T23:06:16.140 INFO:tasks.workunit.client.1.smithi152.stdout:2/191: rmdir d0/d4 39 2024-09-13T23:06:16.142 INFO:tasks.workunit.client.0.smithi115.stdout:3/828: dwrite d3/d16/d1c/d101/d59/ff0 [0,4194304] 0 2024-09-13T23:06:16.142 INFO:tasks.workunit.client.0.smithi115.stdout:3/829: write d3/d5/d5b/fe7 [620610,128666] 0 2024-09-13T23:06:16.142 INFO:tasks.workunit.client.0.smithi115.stdout:1/703: write d0/f7 [2660738,100862] 0 2024-09-13T23:06:16.142 INFO:tasks.workunit.client.0.smithi115.stdout:8/881: link d3/d5/dc/d23/d4e/d54/d7f/d10c/f138 d3/d5/dc/d23/d4e/d54/d7f/de9/df4/f13a 0 2024-09-13T23:06:16.143 INFO:tasks.workunit.client.0.smithi115.stdout:8/882: read d3/d5/dc/f31 [356564,51693] 0 2024-09-13T23:06:16.143 INFO:tasks.workunit.client.0.smithi115.stdout:8/883: write d3/d5/d6a/fdc [452668,83893] 0 2024-09-13T23:06:16.148 INFO:tasks.workunit.client.0.smithi115.stdout:1/704: creat d0/de/d66/d8f/d29/d47/d63/fe3 x:0 0 0 2024-09-13T23:06:16.148 INFO:tasks.workunit.client.0.smithi115.stdout:8/884: mknod d3/d5/dc/d16/d1f/d27/d68/dfc/d137/c13b 0 2024-09-13T23:06:16.151 INFO:tasks.workunit.client.0.smithi115.stdout:2/805: rename da/d23/d2c/dc2/de1/d48/ded to da/d21/d8c/d41/d62/d10a/d10c 0 2024-09-13T23:06:16.153 INFO:tasks.workunit.client.0.smithi115.stdout:3/830: symlink d3/d5/d65/da8/l111 0 2024-09-13T23:06:16.154 INFO:tasks.workunit.client.0.smithi115.stdout:8/885: link d3/c9 d3/d5/dc/d16/d1f/c13c 0 2024-09-13T23:06:16.155 INFO:tasks.workunit.client.0.smithi115.stdout:2/806: creat da/d23/d2c/dc2/d108/f10d x:0 0 0 2024-09-13T23:06:16.155 INFO:tasks.workunit.client.0.smithi115.stdout:8/886: dread d3/d5/dc/d16/d1f/d27/d79/fb4 [0,4194304] 0 2024-09-13T23:06:16.155 INFO:tasks.workunit.client.0.smithi115.stdout:3/831: symlink d3/d16/d1a/d1e/dd3/l112 0 2024-09-13T23:06:16.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/807: mknod da/d21/d8c/d41/d62/d10a/d10c/c10e 0 2024-09-13T23:06:16.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/808: write da/d23/d2c/dc2/de1/d48/faf [4248089,47653] 0 2024-09-13T23:06:16.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/809: readlink da/d21/d8c/l1b 0 2024-09-13T23:06:16.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/810: dread - da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/fc9 zero size 2024-09-13T23:06:16.157 INFO:tasks.workunit.client.0.smithi115.stdout:8/887: rmdir d3/d5/dc/d23/d4e 39 2024-09-13T23:06:16.159 INFO:tasks.workunit.client.0.smithi115.stdout:8/888: mknod d3/d5/dc/d16/d1f/d27/d79/c13d 0 2024-09-13T23:06:16.159 INFO:tasks.workunit.client.0.smithi115.stdout:8/889: fsync d3/d5/f96 0 2024-09-13T23:06:16.159 INFO:tasks.workunit.client.0.smithi115.stdout:1/705: dread d0/de/d1b/d25/f77 [0,4194304] 0 2024-09-13T23:06:16.159 INFO:tasks.workunit.client.0.smithi115.stdout:1/706: dread - d0/de/d66/d8f/d29/d47/d63/fe3 zero size 2024-09-13T23:06:16.160 INFO:tasks.workunit.client.0.smithi115.stdout:1/707: mknod d0/de/d66/d8f/d29/d47/ce4 0 2024-09-13T23:06:16.160 INFO:tasks.workunit.client.0.smithi115.stdout:1/708: fsync d0/de/d1b/d25/d4d/d51/d31/d79/fc2 0 2024-09-13T23:06:16.162 INFO:tasks.workunit.client.0.smithi115.stdout:1/709: rename d0/de/d66/d8f/d29/d47/d6a/d80 to d0/de/d66/d8f/dad/ddb/de5 0 2024-09-13T23:06:16.162 INFO:tasks.workunit.client.0.smithi115.stdout:1/710: symlink d0/de/d66/le6 0 2024-09-13T23:06:16.162 INFO:tasks.workunit.client.0.smithi115.stdout:1/711: chown d0/cf 8828 1 2024-09-13T23:06:16.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/712: write d0/f83 [247170,66212] 0 2024-09-13T23:06:16.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/713: readlink d0/dd/lca 0 2024-09-13T23:06:16.165 INFO:tasks.workunit.client.0.smithi115.stdout:7/725: dwrite da/dd/d1c/d2d/d41/d98/fbd [4194304,4194304] 0 2024-09-13T23:06:16.165 INFO:tasks.workunit.client.0.smithi115.stdout:1/714: link d0/de/d66/d8f/d29/f4c d0/de/d71/fe7 0 2024-09-13T23:06:16.165 INFO:tasks.workunit.client.0.smithi115.stdout:1/715: stat d0/de/d1b/f99 0 2024-09-13T23:06:16.166 INFO:tasks.workunit.client.0.smithi115.stdout:6/818: dwrite d4/df/d14/d38/f68 [4194304,4194304] 0 2024-09-13T23:06:16.167 INFO:tasks.workunit.client.0.smithi115.stdout:7/726: mknod da/dd/d13/d36/d5a/d6d/d8f/cfb 0 2024-09-13T23:06:16.168 INFO:tasks.workunit.client.0.smithi115.stdout:1/716: truncate d0/de/d66/d8f/f6d 1374941 0 2024-09-13T23:06:16.173 INFO:tasks.workunit.client.0.smithi115.stdout:2/811: dread da/d23/d2c/dc2/de1/d56/dda/ff2 [0,4194304] 0 2024-09-13T23:06:16.192 INFO:tasks.workunit.client.0.smithi115.stdout:7/727: dwrite da/df/d3b/ff5 [0,4194304] 0 2024-09-13T23:06:16.193 INFO:tasks.workunit.client.0.smithi115.stdout:7/728: truncate da/df/f28 1174990 0 2024-09-13T23:06:16.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/729: getdents da/dd/d1c/d2d/d41/de1 0 2024-09-13T23:06:16.195 INFO:tasks.workunit.client.0.smithi115.stdout:7/730: creat da/dd/d1c/d2d/d41/de1/df8/ffc x:0 0 0 2024-09-13T23:06:16.196 INFO:tasks.workunit.client.0.smithi115.stdout:7/731: creat da/dd/d1c/d2d/d41/ffd x:0 0 0 2024-09-13T23:06:16.196 INFO:tasks.workunit.client.0.smithi115.stdout:7/732: creat da/dd/d1c/d2d/d41/de1/df8/ffe x:0 0 0 2024-09-13T23:06:16.207 INFO:tasks.workunit.client.0.smithi115.stdout:8/890: dread d3/d5/d6a/f75 [0,4194304] 0 2024-09-13T23:06:16.207 INFO:tasks.workunit.client.0.smithi115.stdout:8/891: fsync d3/d5/d1c/fd2 0 2024-09-13T23:06:16.207 INFO:tasks.workunit.client.0.smithi115.stdout:8/892: dread - d3/d5/dc/d23/d4e/d54/d7f/fda zero size 2024-09-13T23:06:16.211 INFO:tasks.workunit.client.0.smithi115.stdout:8/893: link d3/d5/dc/d16/d1f/d28/d3e/ff7 d3/d5/dc/d16/d1f/d27/d68/d98/f13e 0 2024-09-13T23:06:16.213 INFO:tasks.workunit.client.0.smithi115.stdout:8/894: mkdir d3/d5/dc/d16/d1f/d27/d68/dfc/d13f 0 2024-09-13T23:06:16.214 INFO:tasks.workunit.client.1.smithi152.stdout:6/86: dwrite d4/de/f13 [0,4194304] 0 2024-09-13T23:06:16.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:15 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:16.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:15 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:16.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:15 smithi152 ceph-mon[34465]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:16.218 INFO:tasks.workunit.client.1.smithi152.stdout:6/87: getdents d4/de 0 2024-09-13T23:06:16.222 INFO:tasks.workunit.client.1.smithi152.stdout:6/88: rmdir d4/de/d12 39 2024-09-13T23:06:16.222 INFO:tasks.workunit.client.1.smithi152.stdout:6/89: write d4/fd [4331327,66997] 0 2024-09-13T23:06:16.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/90: fdatasync d4/de/f13 0 2024-09-13T23:06:16.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/91: mknod d4/c17 0 2024-09-13T23:06:16.224 INFO:tasks.workunit.client.1.smithi152.stdout:6/92: getdents d4/de/d12 0 2024-09-13T23:06:16.234 INFO:tasks.workunit.client.0.smithi115.stdout:6/819: dwrite d4/df/d14/d38/d2a/d3e/d56/f5c [0,4194304] 0 2024-09-13T23:06:16.234 INFO:tasks.workunit.client.0.smithi115.stdout:3/832: dwrite d3/d16/d1c/d101/fc4 [0,4194304] 0 2024-09-13T23:06:16.234 INFO:tasks.workunit.client.0.smithi115.stdout:7/733: dwrite da/dd/f2e [0,4194304] 0 2024-09-13T23:06:16.234 INFO:tasks.workunit.client.0.smithi115.stdout:2/812: dwrite da/d23/d2c/dc2/d104/dac/fcf [0,4194304] 0 2024-09-13T23:06:16.236 INFO:tasks.workunit.client.0.smithi115.stdout:8/895: dwrite d3/d5/dc/d23/d4e/d54/d7f/f9d [0,4194304] 0 2024-09-13T23:06:16.238 INFO:tasks.workunit.client.0.smithi115.stdout:6/820: mkdir d4/df/d14/d67/d77/dcf/d115 0 2024-09-13T23:06:16.241 INFO:tasks.workunit.client.1.smithi152.stdout:6/93: dread d4/de/f13 [0,4194304] 0 2024-09-13T23:06:16.252 INFO:tasks.workunit.client.0.smithi115.stdout:2/813: dwrite da/d23/d2c/dc2/de1/fc6 [0,4194304] 0 2024-09-13T23:06:16.252 INFO:tasks.workunit.client.0.smithi115.stdout:2/814: fsync da/d21/f5f 0 2024-09-13T23:06:16.253 INFO:tasks.workunit.client.0.smithi115.stdout:3/833: truncate d3/d16/d1c/d101/f6c 618623 0 2024-09-13T23:06:16.253 INFO:tasks.workunit.client.0.smithi115.stdout:3/834: chown d3/d5/d35/d71/d3b/f7e 3107 1 2024-09-13T23:06:16.256 INFO:tasks.workunit.client.0.smithi115.stdout:7/734: rename da/dd/d1c/d2d/cb9 to da/dd/d1c/d2d/d60/d82/de6/cff 0 2024-09-13T23:06:16.321 INFO:tasks.workunit.client.0.smithi115.stdout:7/735: write da/fc3 [434048,24911] 0 2024-09-13T23:06:16.325 INFO:tasks.workunit.client.1.smithi152.stdout:6/94: dwrite d4/de/f13 [0,4194304] 0 2024-09-13T23:06:16.325 INFO:tasks.workunit.client.1.smithi152.stdout:0/115: sync 2024-09-13T23:06:16.325 INFO:tasks.workunit.client.1.smithi152.stdout:0/116: dread - d18/f1b zero size 2024-09-13T23:06:16.325 INFO:tasks.workunit.client.1.smithi152.stdout:0/117: dread fd [0,4194304] 0 2024-09-13T23:06:16.326 INFO:tasks.workunit.client.1.smithi152.stdout:0/118: dwrite d18/d19/f1e [0,4194304] 0 2024-09-13T23:06:16.326 INFO:tasks.workunit.client.1.smithi152.stdout:0/119: write f16 [757471,124721] 0 2024-09-13T23:06:16.326 INFO:tasks.workunit.client.1.smithi152.stdout:0/120: truncate f16 1784330 0 2024-09-13T23:06:16.326 INFO:tasks.workunit.client.1.smithi152.stdout:0/121: fdatasync f10 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:8/896: mknod d3/d5/dc/d16/d1f/d28/d62/c140 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:6/821: creat d4/df/d14/d67/d77/dcf/f116 x:0 0 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:6/822: creat d4/ddd/f117 x:0 0 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/815: mkdir da/d23/d2c/dc2/de1/d56/d74/d10f 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/816: truncate da/d21/fb3 4306196 0 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:2/817: chown da/d21/d8c/d41/d69/lcd 165677 1 2024-09-13T23:06:16.327 INFO:tasks.workunit.client.0.smithi115.stdout:7/736: mkdir da/dd/d1c/d2d/d41/d100 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:7/737: truncate da/dd/d1c/d2d/d41/de1/df8/ffe 1025388 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:8/897: link d3/d5/dc/d16/d1f/d27/d79/c13d d3/d5/d1c/d41/c141 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/823: rmdir d4/df/d14 39 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/824: chown d4/df/d14/d38/d2a 12158 1 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/825: read - d4/ddd/fdf zero size 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:2/818: creat da/d21/d8c/d41/d62/d10a/f110 x:0 0 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:8/898: mknod d3/d5/dc/d23/c142 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/826: symlink d4/df/d14/d38/d44/d99/dc0/l118 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:8/899: link d3/d5/dc/d16/d1f/lbb d3/d5/dc/d16/d1f/l143 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:8/900: read d3/d5/dc/d16/f83 [3960108,81052] 0 2024-09-13T23:06:16.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/827: mknod d4/df/d14/d38/d2a/c119 0 2024-09-13T23:06:16.328 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:15 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:16.329 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:15 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:16.329 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:15 smithi115 ceph-mon[27601]: pgmap v4: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:16.329 INFO:tasks.workunit.client.1.smithi152.stdout:0/122: unlink f16 0 2024-09-13T23:06:16.332 INFO:tasks.workunit.client.0.smithi115.stdout:3/835: dwrite d3/d16/d84/fb0 [0,4194304] 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/836: creat d3/d5/d65/f113 x:0 0 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/837: getdents d3/d5/d35/d71/d3b/d47/de1/dcc/dd4/de2/d102 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/738: dread da/df/d3b/ff5 [0,4194304] 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/838: symlink d3/d16/d1c/d101/dfb/l114 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/739: mknod da/dd/d13/d36/d5a/d99/c101 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/828: dread d4/df/d51/fca [0,4194304] 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/829: chown d4/df/d14/d38/d2a/d31/d5b/d88 4 1 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/830: fsync d4/df/f74 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/740: creat da/dd/d13/d36/d5a/f102 x:0 0 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:7/741: creat da/f103 x:0 0 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/831: rename d4/df/d14/d38/d2a/dba/ce5 to d4/df/d14/d67/d77/c11a 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/839: dread d3/d16/d1a/d1e/d76/f83 [0,4194304] 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:6/832: symlink d4/d57/d5a/d111/l11b 0 2024-09-13T23:06:16.333 INFO:tasks.workunit.client.0.smithi115.stdout:3/840: creat d3/d5/d35/d71/d42/f115 x:0 0 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:3/841: rmdir d3/dcd 39 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/819: dwrite da/d23/d2c/dc2/de1/d56/d1a/f1f [0,4194304] 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:3/842: dread d3/d5/d35/f53 [0,4194304] 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:7/742: dread da/dd/d13/d24/f4f [0,4194304] 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:2/820: symlink da/d23/db4/l111 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:3/843: truncate d3/d5/d35/d4c/fd5 987045 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:3/844: truncate d3/d5/d5b/dd2/fed 5060162 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:7/743: getdents da/dd/d13/d24/d52 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:7/744: truncate da/df/f26 2982826 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:7/745: fsync da/dd/d13/d36/f3a 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:8/901: dwrite d3/d5/dc/d23/d4e/d54/d7f/de9/f8f [0,4194304] 0 2024-09-13T23:06:16.334 INFO:tasks.workunit.client.0.smithi115.stdout:8/902: read d3/d5/dc/d23/d4e/fe6 [32824,32237] 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:8/903: chown d3/d5/dc/d16/d1f/d28/d3e/d128 479853 1 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:2/821: read da/d21/d8c/d41/d62/f71 [301940,4281] 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:2/822: getdents da/d23/d2c/dc2/de1/d56/df0 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:2/823: creat da/d21/da6/de7/f112 x:0 0 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:8/904: rmdir d3/d5/dc/d16 39 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/746: dread da/dd/d1c/d2d/d41/d98/fbd [4194304,4194304] 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:8/905: mknod d3/d5/dc/d16/d1f/d28/dc0/c144 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:8/906: creat d3/d5/d1d/d72/f145 x:0 0 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:8/907: fsync d3/d5/d1d/d72/f103 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:6/833: dwrite d4/df/d14/d67/d77/dcf/f116 [0,4194304] 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:3/845: dwrite d3/d16/d1c/d101/f6c [0,4194304] 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:6/834: mknod d4/df/c11c 0 2024-09-13T23:06:16.335 INFO:tasks.workunit.client.0.smithi115.stdout:6/835: chown d4/df/d14/d38/d2a/d31/d5b/d88 573 1 2024-09-13T23:06:16.339 INFO:tasks.workunit.client.1.smithi152.stdout:0/123: write f14 [1129085,58807] 0 2024-09-13T23:06:16.339 INFO:tasks.workunit.client.1.smithi152.stdout:0/124: creat d18/f25 x:0 0 0 2024-09-13T23:06:16.345 INFO:tasks.workunit.client.0.smithi115.stdout:6/836: dread d4/df/d14/d38/d2a/d31/d5b/d88/fb8 [0,4194304] 0 2024-09-13T23:06:16.345 INFO:tasks.workunit.client.0.smithi115.stdout:6/837: truncate d4/df/d14/d38/d44/d99/f107 1014426 0 2024-09-13T23:06:16.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/747: dwrite da/f103 [0,4194304] 0 2024-09-13T23:06:16.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/748: stat da/dd/d13/d24/d52/d7c/da7 0 2024-09-13T23:06:16.347 INFO:tasks.workunit.client.0.smithi115.stdout:7/749: creat da/dd/d1c/d2d/d41/de1/df8/f104 x:0 0 0 2024-09-13T23:06:16.347 INFO:tasks.workunit.client.0.smithi115.stdout:8/908: dwrite d3/d5/dc/d16/d1f/d27/f125 [0,4194304] 0 2024-09-13T23:06:16.348 INFO:tasks.workunit.client.0.smithi115.stdout:6/838: symlink d4/df/d14/d38/d2a/d3e/d56/l11d 0 2024-09-13T23:06:16.349 INFO:tasks.workunit.client.0.smithi115.stdout:2/824: dwrite da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:16.355 INFO:tasks.workunit.client.0.smithi115.stdout:6/839: creat d4/df/d14/d38/d44/d99/def/f11e x:0 0 0 2024-09-13T23:06:16.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/825: mkdir da/d23/d2c/dc2/d108/d113 0 2024-09-13T23:06:16.358 INFO:tasks.workunit.client.0.smithi115.stdout:2/826: chown da/d21/da8/dc4 13050502 1 2024-09-13T23:06:16.359 INFO:tasks.workunit.client.0.smithi115.stdout:6/840: truncate d4/df/d14/d38/d2a/d31/fbd 3070893 0 2024-09-13T23:06:16.359 INFO:tasks.workunit.client.0.smithi115.stdout:6/841: fdatasync d4/d57/fbe 0 2024-09-13T23:06:16.360 INFO:tasks.workunit.client.1.smithi152.stdout:0/125: dwrite f10 [0,4194304] 0 2024-09-13T23:06:16.360 INFO:tasks.workunit.client.1.smithi152.stdout:3/163: sync 2024-09-13T23:06:16.362 INFO:tasks.workunit.client.0.smithi115.stdout:6/842: rename d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/c9a to d4/c11f 0 2024-09-13T23:06:16.364 INFO:tasks.workunit.client.0.smithi115.stdout:6/843: symlink d4/d57/d75/l120 0 2024-09-13T23:06:16.364 INFO:tasks.workunit.client.0.smithi115.stdout:8/909: dread d3/d87/fc6 [0,4194304] 0 2024-09-13T23:06:16.365 INFO:tasks.workunit.client.1.smithi152.stdout:0/126: rename f2 to d18/f26 0 2024-09-13T23:06:16.365 INFO:tasks.workunit.client.1.smithi152.stdout:0/127: creat d18/f27 x:0 0 0 2024-09-13T23:06:16.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/164: creat de/d14/d38/d27/f3f x:0 0 0 2024-09-13T23:06:16.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/165: stat de/d14/d38/d27 0 2024-09-13T23:06:16.366 INFO:tasks.workunit.client.0.smithi115.stdout:6/844: mknod d4/d57/d75/c121 0 2024-09-13T23:06:16.366 INFO:tasks.workunit.client.0.smithi115.stdout:6/845: readlink d4/df/d14/d38/d2a/l4e 0 2024-09-13T23:06:16.366 INFO:tasks.workunit.client.0.smithi115.stdout:6/846: chown d4/d57/c54 329229760 1 2024-09-13T23:06:16.366 INFO:tasks.workunit.client.0.smithi115.stdout:6/847: write d4/df/d14/d67/d10e/f8c [1044785,106271] 0 2024-09-13T23:06:16.367 INFO:tasks.workunit.client.1.smithi152.stdout:3/166: unlink de/d1f/c30 0 2024-09-13T23:06:16.368 INFO:tasks.workunit.client.0.smithi115.stdout:7/750: dwrite da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:16.368 INFO:tasks.workunit.client.0.smithi115.stdout:7/751: creat da/dd/d1c/d2d/d60/f105 x:0 0 0 2024-09-13T23:06:16.368 INFO:tasks.workunit.client.0.smithi115.stdout:8/910: creat d3/d5/dc/d16/f146 x:0 0 0 2024-09-13T23:06:16.369 INFO:tasks.workunit.client.0.smithi115.stdout:6/848: creat d4/df/d14/d67/d77/dcf/de8/dec/f122 x:0 0 0 2024-09-13T23:06:16.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/167: rename de/d14/d38/d27/f3f to de/f40 0 2024-09-13T23:06:16.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/168: write de/d14/d38/f25 [1919027,87543] 0 2024-09-13T23:06:16.370 INFO:tasks.workunit.client.0.smithi115.stdout:7/752: creat da/dd/d1c/d2d/d41/d100/f106 x:0 0 0 2024-09-13T23:06:16.371 INFO:tasks.workunit.client.1.smithi152.stdout:3/169: dread de/d14/d38/f28 [0,4194304] 0 2024-09-13T23:06:16.372 INFO:tasks.workunit.client.0.smithi115.stdout:6/849: unlink d4/df/d14/d38/d2a/d31/c4f 0 2024-09-13T23:06:16.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/753: rmdir da/dd/d16/d29 39 2024-09-13T23:06:16.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/754: truncate da/dd/d13/d24/d67/d81/fab 1388522 0 2024-09-13T23:06:16.377 INFO:tasks.workunit.client.0.smithi115.stdout:7/755: symlink da/dd/d1c/d2d/d60/d82/l107 0 2024-09-13T23:06:16.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/827: dwrite da/d21/da8/fb7 [4194304,4194304] 0 2024-09-13T23:06:16.377 INFO:tasks.workunit.client.0.smithi115.stdout:2/828: chown da/d23/d2c/dc2/de1/d56/d4b/l92 8750 1 2024-09-13T23:06:16.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/756: creat da/dd/d16/d29/f108 x:0 0 0 2024-09-13T23:06:16.379 INFO:tasks.workunit.client.0.smithi115.stdout:7/757: write da/dd/d13/d24/d67/d81/fab [2250220,57785] 0 2024-09-13T23:06:16.381 INFO:tasks.workunit.client.0.smithi115.stdout:7/758: mknod da/df/d3b/c109 0 2024-09-13T23:06:16.385 INFO:tasks.workunit.client.1.smithi152.stdout:3/170: getdents de/d14/d38/d27 0 2024-09-13T23:06:16.393 INFO:tasks.workunit.client.0.smithi115.stdout:0/689: sync 2024-09-13T23:06:16.394 INFO:tasks.workunit.client.0.smithi115.stdout:4/795: sync 2024-09-13T23:06:16.394 INFO:tasks.workunit.client.0.smithi115.stdout:9/717: sync 2024-09-13T23:06:16.394 INFO:tasks.workunit.client.0.smithi115.stdout:1/717: sync 2024-09-13T23:06:16.394 INFO:tasks.workunit.client.0.smithi115.stdout:5/786: sync 2024-09-13T23:06:16.394 INFO:tasks.workunit.client.0.smithi115.stdout:5/787: dread - d8/dd/d5d/d5e/f7c zero size 2024-09-13T23:06:16.397 INFO:tasks.workunit.client.0.smithi115.stdout:0/690: link d6/d24/d25/d58/db4/le8 d6/d24/d25/d58/lf2 0 2024-09-13T23:06:16.398 INFO:tasks.workunit.client.0.smithi115.stdout:4/796: rename db/d19/d34/f89 to db/d11/d2e/fed 0 2024-09-13T23:06:16.399 INFO:tasks.workunit.client.0.smithi115.stdout:5/788: creat d8/dd/d20/dbb/deb/fef x:0 0 0 2024-09-13T23:06:16.400 INFO:tasks.workunit.client.0.smithi115.stdout:0/691: getdents d6 0 2024-09-13T23:06:16.401 INFO:tasks.workunit.client.0.smithi115.stdout:2/829: dread da/d23/d2c/f47 [0,4194304] 0 2024-09-13T23:06:16.401 INFO:tasks.workunit.client.0.smithi115.stdout:0/692: symlink d6/d24/d25/d58/lf3 0 2024-09-13T23:06:16.403 INFO:tasks.workunit.client.1.smithi152.stdout:3/171: dread de/f13 [0,4194304] 0 2024-09-13T23:06:16.404 INFO:tasks.workunit.client.0.smithi115.stdout:4/797: symlink db/d16/d3f/d66/d68/d71/d84/d96/lee 0 2024-09-13T23:06:16.404 INFO:tasks.workunit.client.0.smithi115.stdout:4/798: dread - db/d11/d2e/dc7/fea zero size 2024-09-13T23:06:16.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/172: creat de/d14/d38/d27/f41 x:0 0 0 2024-09-13T23:06:16.406 INFO:tasks.workunit.client.0.smithi115.stdout:0/693: creat d6/d24/d25/dc7/ff4 x:0 0 0 2024-09-13T23:06:16.407 INFO:tasks.workunit.client.1.smithi152.stdout:3/173: rename de/d14/l3c to de/d14/d38/d27/l42 0 2024-09-13T23:06:16.408 INFO:tasks.workunit.client.0.smithi115.stdout:4/799: mkdir db/d11/d2e/d33/d36/d7f/def 0 2024-09-13T23:06:16.408 INFO:tasks.workunit.client.0.smithi115.stdout:8/911: dwrite d3/d5/dc/d16/d1f/d27/d79/da0/dbc/ffb [0,4194304] 0 2024-09-13T23:06:16.408 INFO:tasks.workunit.client.0.smithi115.stdout:8/912: readlink d3/d5/dc/d23/d4e/d54/d8c/dd9/l11b 0 2024-09-13T23:06:16.408 INFO:tasks.workunit.client.0.smithi115.stdout:8/913: readlink d3/d5/dc/d16/d1f/d28/dc0/dcd/lf0 0 2024-09-13T23:06:16.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/174: link de/d14/d38/f25 de/d14/f43 0 2024-09-13T23:06:16.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/128: dwrite f14 [0,4194304] 0 2024-09-13T23:06:16.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/129: chown d18/l1d 8 1 2024-09-13T23:06:16.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/130: chown d18/f26 4 1 2024-09-13T23:06:16.413 INFO:tasks.workunit.client.1.smithi152.stdout:0/131: chown d18/d19/f1e 12813 1 2024-09-13T23:06:16.414 INFO:tasks.workunit.client.0.smithi115.stdout:8/914: truncate d3/d5/dc/d16/d1f/d27/d68/d98/fc2 2650365 0 2024-09-13T23:06:16.414 INFO:tasks.workunit.client.0.smithi115.stdout:0/694: dread d6/d24/d25/d2b/d82/d44/fb7 [0,4194304] 0 2024-09-13T23:06:16.414 INFO:tasks.workunit.client.0.smithi115.stdout:7/759: getdents da/dd/d16/d29 0 2024-09-13T23:06:16.415 INFO:tasks.workunit.client.0.smithi115.stdout:8/915: dread d3/d5/d1c/d41/fff [0,4194304] 0 2024-09-13T23:06:16.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/760: rename da/dd/d1c/d2d/d60/d82/le9 to da/dd/d1c/d2d/d41/de1/df8/l10a 0 2024-09-13T23:06:16.417 INFO:tasks.workunit.client.0.smithi115.stdout:7/761: write da/dd/d1c/d2d/d41/ffd [617160,90816] 0 2024-09-13T23:06:16.419 INFO:tasks.workunit.client.0.smithi115.stdout:8/916: unlink d3/d5/dc/f31 0 2024-09-13T23:06:16.419 INFO:tasks.workunit.client.0.smithi115.stdout:8/917: truncate d3/d87/dc8/f105 337215 0 2024-09-13T23:06:16.419 INFO:tasks.workunit.client.0.smithi115.stdout:8/918: chown d3/d5/f76 11 1 2024-09-13T23:06:16.421 INFO:tasks.workunit.client.0.smithi115.stdout:8/919: creat d3/d5/dc/d23/d4e/f147 x:0 0 0 2024-09-13T23:06:16.426 INFO:tasks.workunit.client.0.smithi115.stdout:6/850: dwrite d4/df/d14/d67/d10e/f8c [0,4194304] 0 2024-09-13T23:06:16.427 INFO:tasks.workunit.client.0.smithi115.stdout:6/851: mkdir d4/df/d14/d38/d2a/d31/d5b/da8/d123 0 2024-09-13T23:06:16.429 INFO:tasks.workunit.client.0.smithi115.stdout:6/852: creat d4/df/d14/d38/d44/d66/d8b/f124 x:0 0 0 2024-09-13T23:06:16.429 INFO:tasks.workunit.client.0.smithi115.stdout:6/853: write d4/df/f1c [3746310,111962] 0 2024-09-13T23:06:16.429 INFO:tasks.workunit.client.0.smithi115.stdout:6/854: write d4/df/d14/d38/d2a/d31/f6a [1962050,96422] 0 2024-09-13T23:06:16.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/855: symlink d4/df/d14/d67/d77/dcf/d115/l125 0 2024-09-13T23:06:16.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/856: fdatasync d4/df/d14/d38/d2a/d31/fbd 0 2024-09-13T23:06:16.431 INFO:tasks.workunit.client.0.smithi115.stdout:6/857: readlink d4/df/d14/d38/d2a/la9 0 2024-09-13T23:06:16.444 INFO:tasks.workunit.client.0.smithi115.stdout:6/858: write d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb [2485350,111355] 0 2024-09-13T23:06:16.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/859: write d4/df/d14/d38/d44/d99/f107 [864865,54248] 0 2024-09-13T23:06:16.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/860: readlink d4/df/d14/d67/d10e/l9c 0 2024-09-13T23:06:16.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/861: write d4/df/d14/d38/d44/d66/fc9 [719010,49534] 0 2024-09-13T23:06:16.446 INFO:tasks.workunit.client.0.smithi115.stdout:6/862: truncate d4/df/d14/d38/d44/fc7 774965 0 2024-09-13T23:06:16.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/175: dread de/d14/d38/f25 [0,4194304] 0 2024-09-13T23:06:16.462 INFO:tasks.workunit.client.0.smithi115.stdout:9/718: dwrite d0/d13/d17/d1f/d4e/d61/d7d/fc7 [0,4194304] 0 2024-09-13T23:06:16.463 INFO:tasks.workunit.client.0.smithi115.stdout:1/718: dwrite d0/de/d1b/d25/d67/fc3 [0,4194304] 0 2024-09-13T23:06:16.464 INFO:tasks.workunit.client.0.smithi115.stdout:2/830: dwrite da/d23/d2c/dc2/de1/d56/d1a/f1d [0,4194304] 0 2024-09-13T23:06:16.464 INFO:tasks.workunit.client.0.smithi115.stdout:2/831: truncate da/d21/d8c/d41/fe4 429494 0 2024-09-13T23:06:16.464 INFO:tasks.workunit.client.0.smithi115.stdout:2/832: write da/d21/d8c/d41/d62/d10a/f110 [564042,99117] 0 2024-09-13T23:06:16.468 INFO:tasks.workunit.client.0.smithi115.stdout:5/789: dwrite d8/d7a/f83 [0,4194304] 0 2024-09-13T23:06:16.468 INFO:tasks.workunit.client.0.smithi115.stdout:8/920: dwrite d3/d5/d1d/d63/f7d [0,4194304] 0 2024-09-13T23:06:16.468 INFO:tasks.workunit.client.0.smithi115.stdout:5/790: stat d8/dd/d20/dbb/lc4 0 2024-09-13T23:06:16.468 INFO:tasks.workunit.client.0.smithi115.stdout:8/921: creat d3/d5/dc/d16/d1f/d27/d68/d98/f148 x:0 0 0 2024-09-13T23:06:16.468 INFO:tasks.workunit.client.0.smithi115.stdout:8/922: chown d3/d5/dc/d16/d1f/d27/d68/dfc/d137 2 1 2024-09-13T23:06:16.469 INFO:tasks.workunit.client.0.smithi115.stdout:5/791: write d8/dd/d5d/d5e/fc0 [1424282,86359] 0 2024-09-13T23:06:16.469 INFO:tasks.workunit.client.0.smithi115.stdout:8/923: creat d3/d5/d1d/f149 x:0 0 0 2024-09-13T23:06:16.469 INFO:tasks.workunit.client.0.smithi115.stdout:4/800: dwrite db/d11/d2e/fed [0,4194304] 0 2024-09-13T23:06:16.470 INFO:tasks.workunit.client.0.smithi115.stdout:7/762: dwrite da/dd/d1c/d2d/d41/de1/df8/ffc [0,4194304] 0 2024-09-13T23:06:16.470 INFO:tasks.workunit.client.1.smithi152.stdout:3/176: getdents de/d14 0 2024-09-13T23:06:16.470 INFO:tasks.workunit.client.1.smithi152.stdout:0/132: dwrite d18/f26 [4194304,4194304] 0 2024-09-13T23:06:16.470 INFO:tasks.workunit.client.1.smithi152.stdout:0/133: creat d18/f28 x:0 0 0 2024-09-13T23:06:16.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/177: symlink de/d1f/l44 0 2024-09-13T23:06:16.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/178: creat de/f45 x:0 0 0 2024-09-13T23:06:16.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/179: rename de/d1f/c29 to de/c46 0 2024-09-13T23:06:16.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/180: write de/d14/d38/f37 [1167289,60766] 0 2024-09-13T23:06:16.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/181: fsync de/d14/d38/f26 0 2024-09-13T23:06:16.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/182: dread - de/f1d zero size 2024-09-13T23:06:16.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/183: write de/d14/d38/f19 [648789,42797] 0 2024-09-13T23:06:16.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/184: fdatasync de/d14/f21 0 2024-09-13T23:06:16.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/185: chown de/d1f/f3d 1527528 1 2024-09-13T23:06:16.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/792: mknod d8/dd/d5d/d9b/ddd/cf0 0 2024-09-13T23:06:16.480 INFO:tasks.workunit.client.0.smithi115.stdout:5/793: creat d8/dd/d20/dbb/ff1 x:0 0 0 2024-09-13T23:06:16.481 INFO:tasks.workunit.client.1.smithi152.stdout:3/186: mkdir de/d14/d47 0 2024-09-13T23:06:16.482 INFO:tasks.workunit.client.1.smithi152.stdout:0/134: rmdir d18/d19/d21 0 2024-09-13T23:06:16.482 INFO:tasks.workunit.client.1.smithi152.stdout:0/135: chown d18/d1f 195820 1 2024-09-13T23:06:16.483 INFO:tasks.workunit.client.1.smithi152.stdout:0/136: mkdir d18/d1f/d29 0 2024-09-13T23:06:16.483 INFO:tasks.workunit.client.1.smithi152.stdout:0/137: chown d18/d19/l24 1068 1 2024-09-13T23:06:16.486 INFO:tasks.workunit.client.1.smithi152.stdout:0/138: link f14 d18/d1f/d29/f2a 0 2024-09-13T23:06:16.499 INFO:tasks.workunit.client.0.smithi115.stdout:4/801: rename db/d16/d3f/d66/d68/d71/cac to db/d19/cf0 0 2024-09-13T23:06:16.500 INFO:tasks.workunit.client.0.smithi115.stdout:4/802: write db/d16/d3f/d66/d68/d71/d84/f88 [3006980,56666] 0 2024-09-13T23:06:16.501 INFO:tasks.workunit.client.0.smithi115.stdout:7/763: creat da/dd/d13/d24/d52/f10b x:0 0 0 2024-09-13T23:06:16.504 INFO:tasks.workunit.client.0.smithi115.stdout:5/794: mknod d8/dd/d6a/d82/d63/d5a/cf2 0 2024-09-13T23:06:16.505 INFO:tasks.workunit.client.0.smithi115.stdout:6/863: dwrite d4/df/d14/d38/d44/d66/fc9 [0,4194304] 0 2024-09-13T23:06:16.505 INFO:tasks.workunit.client.0.smithi115.stdout:6/864: fdatasync d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb 0 2024-09-13T23:06:16.506 INFO:tasks.workunit.client.0.smithi115.stdout:5/795: rename d8/dd/d6a/d8a/f98 to d8/dd/d6a/d82/d63/dd6/dde/ff3 0 2024-09-13T23:06:16.507 INFO:tasks.workunit.client.0.smithi115.stdout:8/924: dwrite d3/d5/dc/d16/d1f/d28/d3e/f100 [4194304,4194304] 0 2024-09-13T23:06:16.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/833: dwrite da/fde [0,4194304] 0 2024-09-13T23:06:16.508 INFO:tasks.workunit.client.1.smithi152.stdout:0/139: dwrite d18/f28 [0,4194304] 0 2024-09-13T23:06:16.508 INFO:tasks.workunit.client.1.smithi152.stdout:0/140: creat d18/f2b x:0 0 0 2024-09-13T23:06:16.509 INFO:tasks.workunit.client.0.smithi115.stdout:6/865: mkdir d4/df/d14/d38/d2a/d31/d5b/da8/d126 0 2024-09-13T23:06:16.510 INFO:tasks.workunit.client.1.smithi152.stdout:9/172: sync 2024-09-13T23:06:16.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/240: sync 2024-09-13T23:06:16.510 INFO:tasks.workunit.client.1.smithi152.stdout:7/184: sync 2024-09-13T23:06:16.511 INFO:tasks.workunit.client.0.smithi115.stdout:9/719: dwrite d0/d13/d17/d1f/d28/d76/fa9 [4194304,4194304] 0 2024-09-13T23:06:16.512 INFO:tasks.workunit.client.1.smithi152.stdout:0/141: truncate d18/d19/f1e 777648 0 2024-09-13T23:06:16.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/925: creat d3/d5/dc/d16/d1f/d27/d79/da0/f14a x:0 0 0 2024-09-13T23:06:16.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/926: dread - d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/f115 zero size 2024-09-13T23:06:16.513 INFO:tasks.workunit.client.0.smithi115.stdout:8/927: dread - d3/d5/dc/d16/d1f/d27/d68/ffe zero size 2024-09-13T23:06:16.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/173: truncate d3/f23 560803 0 2024-09-13T23:06:16.514 INFO:tasks.workunit.client.1.smithi152.stdout:7/185: mkdir d17/d24/d2d/d3f 0 2024-09-13T23:06:16.514 INFO:tasks.workunit.client.0.smithi115.stdout:5/796: dread d8/dd/d6a/d82/d63/f44 [0,4194304] 0 2024-09-13T23:06:16.517 INFO:tasks.workunit.client.1.smithi152.stdout:7/186: symlink d17/d24/l40 0 2024-09-13T23:06:16.517 INFO:tasks.workunit.client.0.smithi115.stdout:6/866: rmdir d4/df/d14/d38/d2a/d31/d5b/d88/d9f 39 2024-09-13T23:06:16.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/187: link d17/d24/d2a/c37 d17/d24/d2a/d2e/c41 0 2024-09-13T23:06:16.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/188: creat d17/d24/d2a/f42 x:0 0 0 2024-09-13T23:06:16.520 INFO:tasks.workunit.client.1.smithi152.stdout:7/189: dread - d17/d24/d2a/d2e/f32 zero size 2024-09-13T23:06:16.520 INFO:tasks.workunit.client.1.smithi152.stdout:7/190: fsync d17/d24/d2a/d2b/f3a 0 2024-09-13T23:06:16.520 INFO:tasks.workunit.client.0.smithi115.stdout:9/720: rmdir d0/d13/d17/d1f/d28 39 2024-09-13T23:06:16.520 INFO:tasks.workunit.client.0.smithi115.stdout:8/928: getdents d3/d5/dc/d16/d1f/d28/dc0/dcd/df1 0 2024-09-13T23:06:16.522 INFO:tasks.workunit.client.1.smithi152.stdout:4/241: dread d3/d4/d6/d8/d17/f24 [0,4194304] 0 2024-09-13T23:06:16.522 INFO:tasks.workunit.client.0.smithi115.stdout:9/721: creat d0/d13/d17/d1f/d35/d40/fe2 x:0 0 0 2024-09-13T23:06:16.523 INFO:tasks.workunit.client.0.smithi115.stdout:4/803: dwrite db/d11/d2e/d33/f6d [0,4194304] 0 2024-09-13T23:06:16.523 INFO:tasks.workunit.client.0.smithi115.stdout:4/804: readlink db/d16/d3f/d66/d68/d71/l7b 0 2024-09-13T23:06:16.524 INFO:tasks.workunit.client.1.smithi152.stdout:4/242: rmdir d3/d4/d6/d8/d17/d39 39 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:8/86: sync 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:5/153: sync 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/136: sync 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/137: stat d4/d16 0 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:6/95: sync 2024-09-13T23:06:16.526 INFO:tasks.workunit.client.1.smithi152.stdout:6/96: chown d4/f7 4011 1 2024-09-13T23:06:16.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/722: unlink d0/d13/d3b/d42/d95/l96 0 2024-09-13T23:06:16.528 INFO:tasks.workunit.client.0.smithi115.stdout:9/723: fsync d0/d13/f2d 0 2024-09-13T23:06:16.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/192: sync 2024-09-13T23:06:16.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/193: fsync d0/d4/d9/d16/d30/f38 0 2024-09-13T23:06:16.529 INFO:tasks.workunit.client.1.smithi152.stdout:1/138: rename d4/d9/d1a/l20 to d4/d9/l25 0 2024-09-13T23:06:16.529 INFO:tasks.workunit.client.0.smithi115.stdout:3/846: sync 2024-09-13T23:06:16.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/139: getdents d4 0 2024-09-13T23:06:16.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/140: stat d4/d9/l15 0 2024-09-13T23:06:16.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/141: chown d4/c5 9599 1 2024-09-13T23:06:16.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/142: readlink l3 0 2024-09-13T23:06:16.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/143: chown d4/c1e 1290 1 2024-09-13T23:06:16.534 INFO:tasks.workunit.client.0.smithi115.stdout:9/724: mknod d0/d13/d17/d1f/d4e/da2/ce3 0 2024-09-13T23:06:16.534 INFO:tasks.workunit.client.0.smithi115.stdout:9/725: readlink d0/d13/d17/lde 0 2024-09-13T23:06:16.537 INFO:tasks.workunit.client.1.smithi152.stdout:0/142: rmdir d18 39 2024-09-13T23:06:16.541 INFO:tasks.workunit.client.1.smithi152.stdout:0/143: mkdir d18/d19/d2c 0 2024-09-13T23:06:16.541 INFO:tasks.workunit.client.1.smithi152.stdout:0/144: chown d18/f28 84 1 2024-09-13T23:06:16.542 INFO:tasks.workunit.client.0.smithi115.stdout:6/867: dread d4/f6c [0,4194304] 0 2024-09-13T23:06:16.543 INFO:tasks.workunit.client.1.smithi152.stdout:7/191: getdents d17/d24/d2d 0 2024-09-13T23:06:16.543 INFO:tasks.workunit.client.1.smithi152.stdout:7/192: read d17/d24/f29 [435176,3402] 0 2024-09-13T23:06:16.544 INFO:tasks.workunit.client.1.smithi152.stdout:9/174: dread d3/ff [0,4194304] 0 2024-09-13T23:06:16.545 INFO:tasks.workunit.client.1.smithi152.stdout:0/145: creat d18/f2d x:0 0 0 2024-09-13T23:06:16.545 INFO:tasks.workunit.client.1.smithi152.stdout:6/97: dread d4/fc [0,4194304] 0 2024-09-13T23:06:16.546 INFO:tasks.workunit.client.1.smithi152.stdout:7/193: truncate d17/d24/f29 398056 0 2024-09-13T23:06:16.546 INFO:tasks.workunit.client.1.smithi152.stdout:7/194: truncate d17/f23 493557 0 2024-09-13T23:06:16.548 INFO:tasks.workunit.client.1.smithi152.stdout:0/146: symlink d18/d19/l2e 0 2024-09-13T23:06:16.549 INFO:tasks.workunit.client.0.smithi115.stdout:9/726: getdents d0/d13/d17/d36/d80 0 2024-09-13T23:06:16.552 INFO:tasks.workunit.client.1.smithi152.stdout:0/147: mkdir d18/d1f/d29/d2f 0 2024-09-13T23:06:16.552 INFO:tasks.workunit.client.1.smithi152.stdout:0/148: chown d18 263247363 1 2024-09-13T23:06:16.552 INFO:tasks.workunit.client.1.smithi152.stdout:0/149: readlink la 0 2024-09-13T23:06:16.552 INFO:tasks.workunit.client.0.smithi115.stdout:6/868: unlink d4/df/d14/d38/d44/d99/dc0/fe3 0 2024-09-13T23:06:16.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/869: fsync d4/d57/d75/fb1 0 2024-09-13T23:06:16.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/870: creat d4/df/d14/d38/d44/d66/d8b/f127 x:0 0 0 2024-09-13T23:06:16.553 INFO:tasks.workunit.client.0.smithi115.stdout:6/871: fsync d4/df/d14/d38/d2a/d3e/d56/d7b/d8e/f10d 0 2024-09-13T23:06:16.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/98: mknod d4/de/c18 0 2024-09-13T23:06:16.554 INFO:tasks.workunit.client.1.smithi152.stdout:6/99: fsync d4/f7 0 2024-09-13T23:06:16.554 INFO:tasks.workunit.client.1.smithi152.stdout:6/100: chown d4/l5 7813 1 2024-09-13T23:06:16.554 INFO:tasks.workunit.client.0.smithi115.stdout:9/727: creat d0/d13/d17/d1f/d28/d76/d81/dd0/fe4 x:0 0 0 2024-09-13T23:06:16.555 INFO:tasks.workunit.client.1.smithi152.stdout:6/101: truncate d4/d11/f14 2587476 0 2024-09-13T23:06:16.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/102: getdents d4 0 2024-09-13T23:06:16.558 INFO:tasks.workunit.client.0.smithi115.stdout:2/834: dwrite da/d21/d8c/d41/f7a [0,4194304] 0 2024-09-13T23:06:16.559 INFO:tasks.workunit.client.0.smithi115.stdout:9/728: creat d0/d13/d17/d1f/d4e/d90/fe5 x:0 0 0 2024-09-13T23:06:16.559 INFO:tasks.workunit.client.1.smithi152.stdout:6/103: mknod d4/de/d12/d16/c19 0 2024-09-13T23:06:16.561 INFO:tasks.workunit.client.0.smithi115.stdout:8/929: getdents d3/d5/dc/d16/d1f/d27/d79/da0 0 2024-09-13T23:06:16.561 INFO:tasks.workunit.client.0.smithi115.stdout:5/797: dwrite d8/dd/d6a/d82/d63/fb9 [0,4194304] 0 2024-09-13T23:06:16.562 INFO:tasks.workunit.client.1.smithi152.stdout:6/104: creat d4/de/d12/f1a x:0 0 0 2024-09-13T23:06:16.562 INFO:tasks.workunit.client.0.smithi115.stdout:2/835: rename da/d21/d8c/f107 to da/f114 0 2024-09-13T23:06:16.563 INFO:tasks.workunit.client.0.smithi115.stdout:2/836: creat da/d23/d2c/dc2/de1/d56/dda/f115 x:0 0 0 2024-09-13T23:06:16.563 INFO:tasks.workunit.client.0.smithi115.stdout:2/837: chown da/d21/f33 21 1 2024-09-13T23:06:16.564 INFO:tasks.workunit.client.1.smithi152.stdout:6/105: link d4/de/d12/d16/c19 d4/de/d12/c1b 0 2024-09-13T23:06:16.564 INFO:tasks.workunit.client.0.smithi115.stdout:9/729: creat d0/d13/d17/d36/d80/fe6 x:0 0 0 2024-09-13T23:06:16.565 INFO:tasks.workunit.client.1.smithi152.stdout:6/106: mknod d4/d11/c1c 0 2024-09-13T23:06:16.569 INFO:tasks.workunit.client.0.smithi115.stdout:5/798: rename d8/d9e/cb1 to d8/dd/d6a/d82/d63/dd6/cf4 0 2024-09-13T23:06:16.570 INFO:tasks.workunit.client.1.smithi152.stdout:0/150: write fb [3328345,81557] 0 2024-09-13T23:06:16.571 INFO:tasks.workunit.client.0.smithi115.stdout:2/838: creat da/d23/d2c/dc2/d104/f116 x:0 0 0 2024-09-13T23:06:16.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/151: creat d18/d19/d2c/f30 x:0 0 0 2024-09-13T23:06:16.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/152: read - f13 zero size 2024-09-13T23:06:16.572 INFO:tasks.workunit.client.0.smithi115.stdout:9/730: mknod d0/d13/d17/d1f/d35/d40/ce7 0 2024-09-13T23:06:16.572 INFO:tasks.workunit.client.0.smithi115.stdout:9/731: chown d0/d13/d17/d19/l8f 511 1 2024-09-13T23:06:16.574 INFO:tasks.workunit.client.0.smithi115.stdout:2/839: creat da/d23/d2c/dc2/de1/d56/d1a/dfa/f117 x:0 0 0 2024-09-13T23:06:16.574 INFO:tasks.workunit.client.0.smithi115.stdout:2/840: readlink da/d21/d8c/d41/l4a 0 2024-09-13T23:06:16.574 INFO:tasks.workunit.client.0.smithi115.stdout:2/841: dread - da/d21/d8c/d41/d62/d10a/d10c/ffb zero size 2024-09-13T23:06:16.574 INFO:tasks.workunit.client.0.smithi115.stdout:2/842: dread - da/d23/d2c/dc2/de1/d56/d1a/d7f/fd4 zero size 2024-09-13T23:06:16.574 INFO:tasks.workunit.client.0.smithi115.stdout:2/843: readlink da/d21/da8/dbc/le0 0 2024-09-13T23:06:16.579 INFO:tasks.workunit.client.0.smithi115.stdout:8/930: dread d3/d5/d1c/fae [0,4194304] 0 2024-09-13T23:06:16.579 INFO:tasks.workunit.client.0.smithi115.stdout:8/931: creat d3/d5/dc/d23/d4e/f14b x:0 0 0 2024-09-13T23:06:16.580 INFO:tasks.workunit.client.1.smithi152.stdout:8/87: dwrite f3 [4194304,4194304] 0 2024-09-13T23:06:16.580 INFO:tasks.workunit.client.1.smithi152.stdout:8/88: creat d17/f1d x:0 0 0 2024-09-13T23:06:16.595 INFO:tasks.workunit.client.0.smithi115.stdout:6/872: dread d4/df/d14/d38/d2a/d3e/fa5 [0,4194304] 0 2024-09-13T23:06:16.596 INFO:tasks.workunit.client.1.smithi152.stdout:6/107: read d4/de/f13 [1082357,27089] 0 2024-09-13T23:06:16.598 INFO:tasks.workunit.client.1.smithi152.stdout:6/108: mkdir d4/de/d1d 0 2024-09-13T23:06:16.600 INFO:tasks.workunit.client.1.smithi152.stdout:6/109: mknod d4/de/c1e 0 2024-09-13T23:06:16.600 INFO:tasks.workunit.client.1.smithi152.stdout:6/110: dread - d4/de/d12/f1a zero size 2024-09-13T23:06:16.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/111: rename d4/fd to d4/d11/f1f 0 2024-09-13T23:06:16.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/112: creat d4/de/d12/f20 x:0 0 0 2024-09-13T23:06:16.601 INFO:tasks.workunit.client.1.smithi152.stdout:6/113: write d4/fc [761189,16026] 0 2024-09-13T23:06:16.609 INFO:tasks.workunit.client.0.smithi115.stdout:6/873: dread d4/df/d14/d38/d44/fc7 [0,4194304] 0 2024-09-13T23:06:16.610 INFO:tasks.workunit.client.0.smithi115.stdout:6/874: write d4/df/d14/d38/d2a/d31/f42 [5063349,105410] 0 2024-09-13T23:06:16.613 INFO:tasks.workunit.client.0.smithi115.stdout:6/875: creat d4/df/d14/d38/d2a/d3e/d56/f128 x:0 0 0 2024-09-13T23:06:16.613 INFO:tasks.workunit.client.0.smithi115.stdout:6/876: stat d4/d57/dcb 0 2024-09-13T23:06:16.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/243: dwrite d3/d4/d6/d8/d17/f24 [0,4194304] 0 2024-09-13T23:06:16.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/244: chown d3/d4/f22 400 1 2024-09-13T23:06:16.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/245: dread d3/d4/d6/f35 [0,4194304] 0 2024-09-13T23:06:16.625 INFO:tasks.workunit.client.1.smithi152.stdout:4/246: fdatasync d3/d4/d32/f45 0 2024-09-13T23:06:16.625 INFO:tasks.workunit.client.1.smithi152.stdout:4/247: symlink d3/d4/d6/d37/l47 0 2024-09-13T23:06:16.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/248: creat d3/d4/d33/f48 x:0 0 0 2024-09-13T23:06:16.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/249: read - d3/d4/d5/f42 zero size 2024-09-13T23:06:16.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/250: readlink d3/d4/l30 0 2024-09-13T23:06:16.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/251: readlink d3/d34/l46 0 2024-09-13T23:06:16.643 INFO:tasks.workunit.client.0.smithi115.stdout:4/805: dwrite db/d11/d54/d17/f24 [0,4194304] 0 2024-09-13T23:06:16.643 INFO:tasks.workunit.client.0.smithi115.stdout:4/806: readlink db/d11/d54/d17/lb1 0 2024-09-13T23:06:16.643 INFO:tasks.workunit.client.0.smithi115.stdout:4/807: write db/d16/d3f/d66/d68/d71/d84/fcc [1908119,26996] 0 2024-09-13T23:06:16.644 INFO:tasks.workunit.client.0.smithi115.stdout:4/808: getdents db/d19/d34 0 2024-09-13T23:06:16.645 INFO:tasks.workunit.client.0.smithi115.stdout:4/809: creat db/ff1 x:0 0 0 2024-09-13T23:06:16.648 INFO:tasks.workunit.client.0.smithi115.stdout:4/810: creat db/d16/ff2 x:0 0 0 2024-09-13T23:06:16.648 INFO:tasks.workunit.client.1.smithi152.stdout:4/252: dread d3/d4/d5/d2b/f2e [4194304,4194304] 0 2024-09-13T23:06:16.648 INFO:tasks.workunit.client.1.smithi152.stdout:4/253: read - d3/d4/d5/d1c/f28 zero size 2024-09-13T23:06:16.648 INFO:tasks.workunit.client.1.smithi152.stdout:4/254: stat d3/d4/d6/d8/d17/c2a 0 2024-09-13T23:06:16.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/144: dwrite d4/d9/fb [4194304,4194304] 0 2024-09-13T23:06:16.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/145: chown d4/f6 51392527 1 2024-09-13T23:06:16.652 INFO:tasks.workunit.client.1.smithi152.stdout:5/154: dwrite d5/f22 [0,4194304] 0 2024-09-13T23:06:16.652 INFO:tasks.workunit.client.1.smithi152.stdout:2/194: dwrite d0/d4/d9/d14/f20 [0,4194304] 0 2024-09-13T23:06:16.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/799: dwrite d8/dd/d20/dbb/ff1 [0,4194304] 0 2024-09-13T23:06:16.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/800: creat d8/dd/d74/ff5 x:0 0 0 2024-09-13T23:06:16.653 INFO:tasks.workunit.client.0.smithi115.stdout:3/847: dwrite d3/d16/d1a/d1e/dd3/f10d [0,4194304] 0 2024-09-13T23:06:16.654 INFO:tasks.workunit.client.0.smithi115.stdout:2/844: dwrite da/d21/da8/fb6 [0,4194304] 0 2024-09-13T23:06:16.654 INFO:tasks.workunit.client.0.smithi115.stdout:2/845: creat da/d23/d2c/dc2/de1/d56/d4b/f118 x:0 0 0 2024-09-13T23:06:16.654 INFO:tasks.workunit.client.0.smithi115.stdout:2/846: read da/d21/d8c/f63 [276689,30065] 0 2024-09-13T23:06:16.654 INFO:tasks.workunit.client.0.smithi115.stdout:2/847: write da/d21/d8c/d41/f61 [1069769,101553] 0 2024-09-13T23:06:16.654 INFO:tasks.workunit.client.0.smithi115.stdout:2/848: chown da/fde 6190 1 2024-09-13T23:06:16.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/195: dread d17/d24/f29 [0,4194304] 0 2024-09-13T23:06:16.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/196: write d17/d24/f3c [4964973,31804] 0 2024-09-13T23:06:16.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/197: dread - d17/f1a zero size 2024-09-13T23:06:16.655 INFO:tasks.workunit.client.1.smithi152.stdout:0/153: dwrite d18/f1a [0,4194304] 0 2024-09-13T23:06:16.657 INFO:tasks.workunit.client.0.smithi115.stdout:9/732: dwrite d0/d13/d17/d36/d80/f87 [0,4194304] 0 2024-09-13T23:06:16.657 INFO:tasks.workunit.client.0.smithi115.stdout:8/932: dwrite d3/d5/dc/d23/d4e/d54/d7f/d10c/f131 [0,4194304] 0 2024-09-13T23:06:16.658 INFO:tasks.workunit.client.0.smithi115.stdout:8/933: read d3/d5/d1c/d41/fff [384262,98026] 0 2024-09-13T23:06:16.661 INFO:tasks.workunit.client.0.smithi115.stdout:6/877: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [0,4194304] 0 2024-09-13T23:06:16.662 INFO:tasks.workunit.client.1.smithi152.stdout:7/198: dread f14 [0,4194304] 0 2024-09-13T23:06:16.662 INFO:tasks.workunit.client.1.smithi152.stdout:7/199: chown d17/f19 5829 1 2024-09-13T23:06:16.662 INFO:tasks.workunit.client.1.smithi152.stdout:7/200: write d17/d24/f3c [5371195,720] 0 2024-09-13T23:06:16.662 INFO:tasks.workunit.client.0.smithi115.stdout:5/801: link d8/dd/d20/d4a/f57 d8/d9e/ff6 0 2024-09-13T23:06:16.664 INFO:tasks.workunit.client.0.smithi115.stdout:3/848: creat d3/d16/d1a/d1e/d76/f116 x:0 0 0 2024-09-13T23:06:16.667 INFO:tasks.workunit.client.1.smithi152.stdout:6/114: rename d4/d11 to d4/de/d21 0 2024-09-13T23:06:16.667 INFO:tasks.workunit.client.0.smithi115.stdout:9/733: chown d0/c12 122 1 2024-09-13T23:06:16.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/255: dwrite d3/d4/d6/f20 [0,4194304] 0 2024-09-13T23:06:16.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/256: write d3/d4/d5/d1c/f1e [4203564,53824] 0 2024-09-13T23:06:16.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/257: creat d3/d4/d5/f49 x:0 0 0 2024-09-13T23:06:16.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/201: symlink d17/d24/d2d/d3f/l43 0 2024-09-13T23:06:16.676 INFO:tasks.workunit.client.0.smithi115.stdout:8/934: mknod d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/d121/c14c 0 2024-09-13T23:06:16.677 INFO:tasks.workunit.client.0.smithi115.stdout:9/734: dread d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:16.677 INFO:tasks.workunit.client.1.smithi152.stdout:1/146: rename d4/d9/d1a/f23 to d4/f26 0 2024-09-13T23:06:16.678 INFO:tasks.workunit.client.1.smithi152.stdout:6/115: symlink d4/de/d1d/l22 0 2024-09-13T23:06:16.678 INFO:tasks.workunit.client.1.smithi152.stdout:4/258: mkdir d3/d4/d6/d8/d4a 0 2024-09-13T23:06:16.679 INFO:tasks.workunit.client.0.smithi115.stdout:3/849: mknod d3/d5/d35/d71/d3b/d47/c117 0 2024-09-13T23:06:16.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/175: truncate d3/f23 513843 0 2024-09-13T23:06:16.681 INFO:tasks.workunit.client.0.smithi115.stdout:4/811: fsync db/ff1 0 2024-09-13T23:06:16.682 INFO:tasks.workunit.client.0.smithi115.stdout:9/735: mknod d0/d43/ce8 0 2024-09-13T23:06:16.684 INFO:tasks.workunit.client.1.smithi152.stdout:0/154: dread fb [0,4194304] 0 2024-09-13T23:06:16.686 INFO:tasks.workunit.client.1.smithi152.stdout:5/155: dwrite d5/dc/d19/d20/f2c [0,4194304] 0 2024-09-13T23:06:16.686 INFO:tasks.workunit.client.1.smithi152.stdout:6/116: dread d4/de/d21/f14 [0,4194304] 0 2024-09-13T23:06:16.686 INFO:tasks.workunit.client.1.smithi152.stdout:5/156: dread - d5/da/f2a zero size 2024-09-13T23:06:16.688 INFO:tasks.workunit.client.0.smithi115.stdout:3/850: truncate d3/f1b 1794824 0 2024-09-13T23:06:16.688 INFO:tasks.workunit.client.0.smithi115.stdout:9/736: mkdir d0/d13/d17/d1f/d4e/de9 0 2024-09-13T23:06:16.688 INFO:tasks.workunit.client.0.smithi115.stdout:4/812: mkdir db/d11/df3 0 2024-09-13T23:06:16.690 INFO:tasks.workunit.client.0.smithi115.stdout:9/737: link d0/d13/d17/d1f/d4e/f5d d0/d43/d53/fea 0 2024-09-13T23:06:16.691 INFO:tasks.workunit.client.0.smithi115.stdout:3/851: creat d3/d5/d65/da8/da4/d10f/f118 x:0 0 0 2024-09-13T23:06:16.692 INFO:tasks.workunit.client.0.smithi115.stdout:4/813: mknod db/d11/d2e/d33/d36/cf4 0 2024-09-13T23:06:16.693 INFO:tasks.workunit.client.0.smithi115.stdout:9/738: mknod d0/d13/d17/d1f/d4e/d61/d7d/d98/ceb 0 2024-09-13T23:06:16.694 INFO:tasks.workunit.client.0.smithi115.stdout:6/878: dwrite d4/df/d14/d38/d2a/d31/fbd [0,4194304] 0 2024-09-13T23:06:16.694 INFO:tasks.workunit.client.0.smithi115.stdout:3/852: rename d3/d5/d35/d71/d3b/d47/de1/dcc/dd4 to d3/d5/d35/d71/d3b/d47/de1/d119 0 2024-09-13T23:06:16.694 INFO:tasks.workunit.client.0.smithi115.stdout:3/853: truncate d3/d5/d5b/f72 1150732 0 2024-09-13T23:06:16.694 INFO:tasks.workunit.client.0.smithi115.stdout:3/854: fdatasync d3/d5/d65/da8/da4/d49/f7d 0 2024-09-13T23:06:16.694 INFO:tasks.workunit.client.0.smithi115.stdout:4/814: mkdir db/d19/d34/df5 0 2024-09-13T23:06:16.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/855: link d3/d5/l18 d3/d16/d1c/l11a 0 2024-09-13T23:06:16.697 INFO:tasks.workunit.client.0.smithi115.stdout:6/879: rename d4/df/d14/d38/d44/d66/d8b/f127 to d4/df/d14/d38/d2a/d31/d5b/da8/d123/f129 0 2024-09-13T23:06:16.699 INFO:tasks.workunit.client.0.smithi115.stdout:3/856: symlink d3/d5/d35/d71/d3b/d47/l11b 0 2024-09-13T23:06:16.701 INFO:tasks.workunit.client.0.smithi115.stdout:4/815: rename db/d11/d54/d17/f77 to db/d11/d2e/d33/ff6 0 2024-09-13T23:06:16.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/195: dwrite d0/d4/d9/d16/d30/f3e [0,4194304] 0 2024-09-13T23:06:16.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/196: stat d0/d4/d9/d14 0 2024-09-13T23:06:16.704 INFO:tasks.workunit.client.0.smithi115.stdout:3/857: unlink d3/d5/d35/d71/d3b/d47/de1/d119/lf3 0 2024-09-13T23:06:16.708 INFO:tasks.workunit.client.0.smithi115.stdout:6/880: read d4/d57/d5a/fde [2191331,75668] 0 2024-09-13T23:06:16.708 INFO:tasks.workunit.client.0.smithi115.stdout:6/881: dread - d4/d57/d5a/db4/f112 zero size 2024-09-13T23:06:16.712 INFO:tasks.workunit.client.1.smithi152.stdout:4/259: dwrite d3/d4/d5/f3d [0,4194304] 0 2024-09-13T23:06:16.712 INFO:tasks.workunit.client.1.smithi152.stdout:4/260: readlink d3/d4/d6/d37/l47 0 2024-09-13T23:06:16.712 INFO:tasks.workunit.client.1.smithi152.stdout:4/261: truncate d3/d4/d6/f35 919436 0 2024-09-13T23:06:16.712 INFO:tasks.workunit.client.0.smithi115.stdout:6/882: mkdir d4/df/d14/d38/d2a/d3e/d56/dff/d12a 0 2024-09-13T23:06:16.714 INFO:tasks.workunit.client.1.smithi152.stdout:9/176: dwrite d3/f1c [0,4194304] 0 2024-09-13T23:06:16.714 INFO:tasks.workunit.client.0.smithi115.stdout:6/883: mkdir d4/d57/d5a/d79/d85/dbf/d12b 0 2024-09-13T23:06:16.714 INFO:tasks.workunit.client.0.smithi115.stdout:6/884: dread - d4/df/d14/d38/d44/ffe zero size 2024-09-13T23:06:16.718 INFO:tasks.workunit.client.0.smithi115.stdout:3/858: rmdir d3/d16/d1a/d1e 39 2024-09-13T23:06:16.722 INFO:tasks.workunit.client.0.smithi115.stdout:0/695: sync 2024-09-13T23:06:16.722 INFO:tasks.workunit.client.0.smithi115.stdout:0/696: dread - d6/d24/d25/d2b/d82/d6b/fa1 zero size 2024-09-13T23:06:16.722 INFO:tasks.workunit.client.0.smithi115.stdout:0/697: stat d6/d24/d25/d2b/d82/d44/d5c/d87/da4 0 2024-09-13T23:06:16.722 INFO:tasks.workunit.client.0.smithi115.stdout:1/719: sync 2024-09-13T23:06:16.722 INFO:tasks.workunit.client.0.smithi115.stdout:7/764: sync 2024-09-13T23:06:16.723 INFO:tasks.workunit.client.0.smithi115.stdout:1/720: chown d0/de/d1b/d25 78 1 2024-09-13T23:06:16.724 INFO:tasks.workunit.client.0.smithi115.stdout:1/721: write d0/de/d1b/d25/f3d [2809621,34435] 0 2024-09-13T23:06:16.725 INFO:tasks.workunit.client.0.smithi115.stdout:7/765: symlink da/dd/d1c/d2d/l10c 0 2024-09-13T23:06:16.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/155: dwrite d18/d19/f1e [0,4194304] 0 2024-09-13T23:06:16.728 INFO:tasks.workunit.client.0.smithi115.stdout:7/766: unlink da/dd/d1c/d2d/d60/lc7 0 2024-09-13T23:06:16.728 INFO:tasks.workunit.client.0.smithi115.stdout:7/767: fsync da/df/f96 0 2024-09-13T23:06:16.728 INFO:tasks.workunit.client.0.smithi115.stdout:7/768: chown da/df/fa6 811168906 1 2024-09-13T23:06:16.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/859: dread d3/d5/d65/da8/da4/d49/f67 [0,4194304] 0 2024-09-13T23:06:16.738 INFO:tasks.workunit.client.0.smithi115.stdout:4/816: dwrite db/d16/d3f/d66/fdf [0,4194304] 0 2024-09-13T23:06:16.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/156: dread d18/f26 [4194304,4194304] 0 2024-09-13T23:06:16.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/157: fdatasync d18/f2d 0 2024-09-13T23:06:16.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/158: creat d18/f31 x:0 0 0 2024-09-13T23:06:16.740 INFO:tasks.workunit.client.0.smithi115.stdout:6/885: dwrite d4/df/d14/d38/d44/d66/fc9 [4194304,4194304] 0 2024-09-13T23:06:16.743 INFO:tasks.workunit.client.0.smithi115.stdout:0/698: write d6/d24/d25/d2b/d61/f96 [4914929,58728] 0 2024-09-13T23:06:16.743 INFO:tasks.workunit.client.0.smithi115.stdout:0/699: chown d6/d24/d25/d2b/d82/d6b 7290 1 2024-09-13T23:06:16.744 INFO:tasks.workunit.client.0.smithi115.stdout:9/739: dwrite d0/d43/f9e [0,4194304] 0 2024-09-13T23:06:16.747 INFO:tasks.workunit.client.0.smithi115.stdout:6/886: mknod d4/df/d14/d38/d2a/d3e/d56/dc4/c12c 0 2024-09-13T23:06:16.748 INFO:tasks.workunit.client.0.smithi115.stdout:0/700: symlink d6/d24/d25/da3/dad/lf5 0 2024-09-13T23:06:16.748 INFO:tasks.workunit.client.0.smithi115.stdout:0/701: fsync d6/d24/d25/d2b/d61/f85 0 2024-09-13T23:06:16.754 INFO:tasks.workunit.client.0.smithi115.stdout:9/740: symlink d0/d13/d17/d1f/d4e/d61/d9b/lec 0 2024-09-13T23:06:16.754 INFO:tasks.workunit.client.0.smithi115.stdout:9/741: truncate d0/d13/d17/d36/f8d 1083570 0 2024-09-13T23:06:16.754 INFO:tasks.workunit.client.0.smithi115.stdout:6/887: mknod d4/df/d14/d38/d44/d99/dc0/c12d 0 2024-09-13T23:06:16.756 INFO:tasks.workunit.client.0.smithi115.stdout:6/888: truncate d4/d57/d5a/fde 1720710 0 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/889: chown d4/df/d14/d38/d44/d99/d10b 1863 1 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/890: chown d4/df/c1a 43172 1 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/891: fsync d4/d57/dab/fb6 0 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/892: dread - d4/df/d14/d38/d2a/d31/d5b/da8/d123/f129 zero size 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/893: chown d4/d57/dab/fb7 99493 1 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/894: chown d4/d57/dab/fb6 3102 1 2024-09-13T23:06:16.757 INFO:tasks.workunit.client.0.smithi115.stdout:6/895: fsync d4/ddd/f117 0 2024-09-13T23:06:16.767 INFO:tasks.workunit.client.0.smithi115.stdout:1/722: dwrite d0/dd/f10 [0,4194304] 0 2024-09-13T23:06:16.767 INFO:tasks.workunit.client.0.smithi115.stdout:1/723: chown d0/de/d66/d8f/dad/ddb/de5/f8b 9 1 2024-09-13T23:06:16.768 INFO:tasks.workunit.client.0.smithi115.stdout:1/724: dread d0/de/d1b/d25/d4d/d51/d23/fc5 [0,4194304] 0 2024-09-13T23:06:16.769 INFO:tasks.workunit.client.0.smithi115.stdout:9/742: write d0/d13/d17/d1f/d28/d76/d81/fab [2960001,49811] 0 2024-09-13T23:06:16.769 INFO:tasks.workunit.client.0.smithi115.stdout:9/743: stat d0/d13/d17/d19 0 2024-09-13T23:06:16.770 INFO:tasks.workunit.client.0.smithi115.stdout:7/769: dwrite da/fc3 [0,4194304] 0 2024-09-13T23:06:16.770 INFO:tasks.workunit.client.0.smithi115.stdout:3/860: dwrite d3/d5/d65/da8/da4/f62 [0,4194304] 0 2024-09-13T23:06:16.770 INFO:tasks.workunit.client.0.smithi115.stdout:6/896: write d4/df/d14/d38/d44/d66/d8b/f98 [3442577,29858] 0 2024-09-13T23:06:16.770 INFO:tasks.workunit.client.0.smithi115.stdout:3/861: write d3/d16/d1a/d1e/d94/f108 [63941,102455] 0 2024-09-13T23:06:16.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/862: fdatasync d3/d5/d35/d71/d3b/f7e 0 2024-09-13T23:06:16.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/863: dread - d3/d16/d1a/d1e/f10b zero size 2024-09-13T23:06:16.771 INFO:tasks.workunit.client.0.smithi115.stdout:3/864: creat d3/d5/d35/d71/d42/f11c x:0 0 0 2024-09-13T23:06:16.771 INFO:tasks.workunit.client.1.smithi152.stdout:7/202: rename d17/d24/d2a/f33 to d17/d24/d2a/d2e/d30/f44 0 2024-09-13T23:06:16.772 INFO:tasks.workunit.client.1.smithi152.stdout:1/147: creat d4/d9/f27 x:0 0 0 2024-09-13T23:06:16.773 INFO:tasks.workunit.client.0.smithi115.stdout:0/702: dwrite d6/d24/d25/da3/dad/f80 [0,4194304] 0 2024-09-13T23:06:16.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/770: mknod da/dd/c10d 0 2024-09-13T23:06:16.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/771: dread - da/dd/d13/d24/fd3 zero size 2024-09-13T23:06:16.774 INFO:tasks.workunit.client.0.smithi115.stdout:7/772: chown da/dd/d13/d36/d5a/d99/ddd/d92/f9a 29 1 2024-09-13T23:06:16.775 INFO:tasks.workunit.client.0.smithi115.stdout:7/773: dread - da/dd/d1c/d2d/d60/fd6 zero size 2024-09-13T23:06:16.775 INFO:tasks.workunit.client.0.smithi115.stdout:7/774: creat da/dd/d1c/d2d/d60/f10e x:0 0 0 2024-09-13T23:06:16.775 INFO:tasks.workunit.client.0.smithi115.stdout:7/775: fsync da/dd/d13/d36/fa9 0 2024-09-13T23:06:16.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/117: creat d4/de/d1d/f23 x:0 0 0 2024-09-13T23:06:16.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/118: readlink l2 0 2024-09-13T23:06:16.778 INFO:tasks.workunit.client.1.smithi152.stdout:5/157: rename d5/dc/d19/d20/d25 to d5/dc/d19/d20/d2e 0 2024-09-13T23:06:16.778 INFO:tasks.workunit.client.0.smithi115.stdout:1/725: link d0/de/d66/d8f/c5e d0/de/d66/d8f/d29/d47/d74/ce8 0 2024-09-13T23:06:16.779 INFO:tasks.workunit.client.0.smithi115.stdout:1/726: fdatasync d0/de/f9e 0 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/897: write d4/df/d14/d38/d2a/d3e/fa5 [8291610,77703] 0 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/898: chown d4/df/d14/d38/f109 177 1 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/899: chown d4/df/l5d 23535961 1 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:6/900: readlink d4/df/d14/d38/d2a/d3e/d56/d7b/la0 0 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:3/865: rename d3/d16/d1c/f38 to d3/d5/d35/d71/f11d 0 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.0.smithi115.stdout:9/744: getdents d0 0 2024-09-13T23:06:16.785 INFO:tasks.workunit.client.1.smithi152.stdout:2/197: write d0/d4/d9/f40 [961670,54828] 0 2024-09-13T23:06:16.786 INFO:tasks.workunit.client.1.smithi152.stdout:4/262: mkdir d3/d4/d6/d8/d4b 0 2024-09-13T23:06:16.787 INFO:tasks.workunit.client.0.smithi115.stdout:0/703: link d6/d24/f95 d6/d24/d25/d58/ff6 0 2024-09-13T23:06:16.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/177: creat d3/d24/d34/d37/f38 x:0 0 0 2024-09-13T23:06:16.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/178: stat d3/l2d 0 2024-09-13T23:06:16.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/179: fdatasync d3/f9 0 2024-09-13T23:06:16.791 INFO:tasks.workunit.client.1.smithi152.stdout:9/180: dread d3/d1e/f2b [0,4194304] 0 2024-09-13T23:06:16.791 INFO:tasks.workunit.client.0.smithi115.stdout:1/727: symlink d0/de/d66/le9 0 2024-09-13T23:06:16.792 INFO:tasks.workunit.client.1.smithi152.stdout:0/159: mknod d18/d1f/d29/c32 0 2024-09-13T23:06:16.793 INFO:tasks.workunit.client.1.smithi152.stdout:7/203: unlink d17/d24/l35 0 2024-09-13T23:06:16.793 INFO:tasks.workunit.client.1.smithi152.stdout:3/187: sync 2024-09-13T23:06:16.794 INFO:tasks.workunit.client.1.smithi152.stdout:1/148: link d4/d9/fd d4/f28 0 2024-09-13T23:06:16.794 INFO:tasks.workunit.client.1.smithi152.stdout:1/149: readlink d4/l8 0 2024-09-13T23:06:16.795 INFO:tasks.workunit.client.0.smithi115.stdout:6/901: creat d4/f12e x:0 0 0 2024-09-13T23:06:16.797 INFO:tasks.workunit.client.1.smithi152.stdout:5/158: rename d5/da/f2a to d5/dc/d19/d20/d2e/d28/f2f 0 2024-09-13T23:06:16.798 INFO:tasks.workunit.client.1.smithi152.stdout:5/159: fdatasync d5/f7 0 2024-09-13T23:06:16.798 INFO:tasks.workunit.client.1.smithi152.stdout:7/204: symlink d17/d24/l45 0 2024-09-13T23:06:16.799 INFO:tasks.workunit.client.1.smithi152.stdout:1/150: creat d4/d9/d1a/d22/f29 x:0 0 0 2024-09-13T23:06:16.801 INFO:tasks.workunit.client.0.smithi115.stdout:3/866: getdents d3/d16/d1a/d1e 0 2024-09-13T23:06:16.801 INFO:tasks.workunit.client.0.smithi115.stdout:9/745: symlink d0/d13/d17/d1f/d4e/d90/led 0 2024-09-13T23:06:16.802 INFO:tasks.workunit.client.0.smithi115.stdout:0/704: mkdir d6/d24/d25/da3/dad/de4/df7 0 2024-09-13T23:06:16.803 INFO:tasks.workunit.client.0.smithi115.stdout:1/728: symlink d0/de/d1b/d25/d4d/d51/lea 0 2024-09-13T23:06:16.804 INFO:tasks.workunit.client.0.smithi115.stdout:3/867: mkdir d3/d5/d35/d71/d3b/d11e 0 2024-09-13T23:06:16.804 INFO:tasks.workunit.client.1.smithi152.stdout:2/198: rename d0/d4/d9/d18/f29 to d0/d4/f45 0 2024-09-13T23:06:16.808 INFO:tasks.workunit.client.0.smithi115.stdout:0/705: creat d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/ff8 x:0 0 0 2024-09-13T23:06:16.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/119: write d4/de/ff [1342383,25806] 0 2024-09-13T23:06:16.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/120: write d4/fc [531605,79026] 0 2024-09-13T23:06:16.809 INFO:tasks.workunit.client.1.smithi152.stdout:4/263: rename d3/d4/d5/d2b/f2e to d3/d4/d6/f4c 0 2024-09-13T23:06:16.814 INFO:tasks.workunit.client.1.smithi152.stdout:6/121: creat d4/de/d21/f24 x:0 0 0 2024-09-13T23:06:16.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/89: sync 2024-09-13T23:06:16.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/90: dread - d17/f1d zero size 2024-09-13T23:06:16.818 INFO:tasks.workunit.client.1.smithi152.stdout:3/188: rename de/d14/d38/f12 to de/d14/d47/f48 0 2024-09-13T23:06:16.818 INFO:tasks.workunit.client.1.smithi152.stdout:6/122: mknod d4/c25 0 2024-09-13T23:06:16.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/160: read d5/f22 [2923791,93930] 0 2024-09-13T23:06:16.819 INFO:tasks.workunit.client.0.smithi115.stdout:0/706: dread d6/d24/d25/d2b/d82/d44/f4b [0,4194304] 0 2024-09-13T23:06:16.820 INFO:tasks.workunit.client.1.smithi152.stdout:1/151: rmdir d4/d16 0 2024-09-13T23:06:16.820 INFO:tasks.workunit.client.1.smithi152.stdout:1/152: rename d4/d9 to d4/d9/d2a 22 2024-09-13T23:06:16.821 INFO:tasks.workunit.client.1.smithi152.stdout:2/199: dread d0/d4/d9/d16/d30/f3e [0,4194304] 0 2024-09-13T23:06:16.822 INFO:tasks.workunit.client.1.smithi152.stdout:3/189: link de/f1d de/d14/f49 0 2024-09-13T23:06:16.822 INFO:tasks.workunit.client.1.smithi152.stdout:3/190: read - de/d1f/f3d zero size 2024-09-13T23:06:16.822 INFO:tasks.workunit.client.0.smithi115.stdout:0/707: mkdir d6/d24/d25/d2b/d82/df9 0 2024-09-13T23:06:16.823 INFO:tasks.workunit.client.0.smithi115.stdout:0/708: truncate d6/fa9 5170929 0 2024-09-13T23:06:16.824 INFO:tasks.workunit.client.0.smithi115.stdout:0/709: mknod d6/d24/d25/d2b/d82/d6b/cfa 0 2024-09-13T23:06:16.824 INFO:tasks.workunit.client.1.smithi152.stdout:1/153: link d4/d9/d1a/d22/f29 d4/d9/f2b 0 2024-09-13T23:06:16.825 INFO:tasks.workunit.client.1.smithi152.stdout:6/123: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:16.826 INFO:tasks.workunit.client.1.smithi152.stdout:3/191: mknod de/d14/c4a 0 2024-09-13T23:06:16.826 INFO:tasks.workunit.client.1.smithi152.stdout:4/264: read d3/d4/d6/d8/d17/f24 [3507586,121218] 0 2024-09-13T23:06:16.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/265: truncate d3/d4/d5/d1c/f2c 156793 0 2024-09-13T23:06:16.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/266: dread - d3/d4/d32/f45 zero size 2024-09-13T23:06:16.827 INFO:tasks.workunit.client.0.smithi115.stdout:0/710: getdents d6/da5/dd4 0 2024-09-13T23:06:16.827 INFO:tasks.workunit.client.0.smithi115.stdout:1/729: read d0/de/d66/d8f/d29/f39 [1181717,97165] 0 2024-09-13T23:06:16.829 INFO:tasks.workunit.client.1.smithi152.stdout:6/124: mkdir d4/de/d26 0 2024-09-13T23:06:16.829 INFO:tasks.workunit.client.1.smithi152.stdout:6/125: rename d4 to d4/de/d12/d16/d27 22 2024-09-13T23:06:16.829 INFO:tasks.workunit.client.1.smithi152.stdout:6/126: write d4/de/d12/f1a [409216,54191] 0 2024-09-13T23:06:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:6/127: creat d4/de/d12/f28 x:0 0 0 2024-09-13T23:06:16.830 INFO:tasks.workunit.client.1.smithi152.stdout:6/128: creat d4/de/d21/f29 x:0 0 0 2024-09-13T23:06:16.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/730: creat d0/de/d66/d8f/dad/ddb/de5/feb x:0 0 0 2024-09-13T23:06:16.830 INFO:tasks.workunit.client.0.smithi115.stdout:1/731: readlink d0/la 0 2024-09-13T23:06:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:1/732: chown d0/de/d62/f84 1 1 2024-09-13T23:06:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:1/733: readlink d0/de/d66/d8f/d29/d47/d74/d9d/da3/lc6 0 2024-09-13T23:06:16.831 INFO:tasks.workunit.client.0.smithi115.stdout:1/734: rename d0/de/d66/d8f/d29/d47/d63/dac to d0/de/d66/d8f/d29/d47/d63/dac/dec 22 2024-09-13T23:06:16.831 INFO:tasks.workunit.client.1.smithi152.stdout:4/267: read d3/d4/d6/f20 [4959388,69687] 0 2024-09-13T23:06:16.831 INFO:tasks.workunit.client.1.smithi152.stdout:4/268: dread - d3/d4/d5/d1c/f28 zero size 2024-09-13T23:06:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:1/735: rename d0/de/d66/d8f/dad/cb3 to d0/de/d66/d8f/d29/d47/ced 0 2024-09-13T23:06:16.832 INFO:tasks.workunit.client.0.smithi115.stdout:1/736: stat d0/de/d1b/d25/d4d/d51/d23 0 2024-09-13T23:06:16.833 INFO:tasks.workunit.client.1.smithi152.stdout:4/269: mknod d3/d4/d5/d2b/c4d 0 2024-09-13T23:06:16.833 INFO:tasks.workunit.client.0.smithi115.stdout:1/737: symlink d0/de/d66/lee 0 2024-09-13T23:06:16.837 INFO:tasks.workunit.client.1.smithi152.stdout:6/129: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:16.839 INFO:tasks.workunit.client.1.smithi152.stdout:6/130: mkdir d4/de/d12/d16/d2a 0 2024-09-13T23:06:16.841 INFO:tasks.workunit.client.1.smithi152.stdout:6/131: mknod d4/de/c2b 0 2024-09-13T23:06:16.841 INFO:tasks.workunit.client.1.smithi152.stdout:6/132: dread - d4/de/d21/f29 zero size 2024-09-13T23:06:16.842 INFO:tasks.workunit.client.1.smithi152.stdout:9/181: dwrite d3/d24/d34/d37/f38 [0,4194304] 0 2024-09-13T23:06:16.842 INFO:tasks.workunit.client.1.smithi152.stdout:9/182: truncate d3/d24/f2e 1298568 0 2024-09-13T23:06:16.845 INFO:tasks.workunit.client.1.smithi152.stdout:8/91: write f10 [917976,15242] 0 2024-09-13T23:06:16.845 INFO:tasks.workunit.client.1.smithi152.stdout:8/92: readlink l6 0 2024-09-13T23:06:16.846 INFO:tasks.workunit.client.1.smithi152.stdout:9/183: rename d3/d1e/f25 to d3/d1e/d30/f39 0 2024-09-13T23:06:16.848 INFO:tasks.workunit.client.1.smithi152.stdout:6/133: link d4/f6 d4/de/f2c 0 2024-09-13T23:06:16.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/93: truncate fd 809599 0 2024-09-13T23:06:16.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/94: chown fd 12 1 2024-09-13T23:06:16.854 INFO:tasks.workunit.client.0.smithi115.stdout:1/738: write d0/de/d66/faa [582666,25785] 0 2024-09-13T23:06:16.855 INFO:tasks.workunit.client.0.smithi115.stdout:1/739: creat d0/de/d1b/d25/d4d/d51/d31/d37/dc8/fef x:0 0 0 2024-09-13T23:06:16.856 INFO:tasks.workunit.client.0.smithi115.stdout:1/740: fsync d0/de/d66/d8f/d29/d9c/fd4 0 2024-09-13T23:06:16.857 INFO:tasks.workunit.client.0.smithi115.stdout:1/741: unlink d0/de/d1b/d25/d4d/d51/d23/c49 0 2024-09-13T23:06:16.857 INFO:tasks.workunit.client.0.smithi115.stdout:1/742: readlink d0/de/d66/d8f/d29/d47/d74/d9d/da3/la8 0 2024-09-13T23:06:16.869 INFO:tasks.workunit.client.0.smithi115.stdout:1/743: write d0/de/d1b/d25/d67/f6e [2939603,60351] 0 2024-09-13T23:06:16.869 INFO:tasks.workunit.client.0.smithi115.stdout:1/744: write d0/de/d66/d8f/f61 [2308709,64308] 0 2024-09-13T23:06:16.870 INFO:tasks.workunit.client.0.smithi115.stdout:1/745: creat d0/de/d1b/ff0 x:0 0 0 2024-09-13T23:06:16.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/200: unlink d0/d4/f45 0 2024-09-13T23:06:16.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/201: chown d0/d4/d9/d18/d1e/f1c 39975 1 2024-09-13T23:06:16.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/202: fsync d0/d4/d9/ff 0 2024-09-13T23:06:16.873 INFO:tasks.workunit.client.0.smithi115.stdout:9/746: dwrite d0/d13/d17/d36/d80/fe6 [0,4194304] 0 2024-09-13T23:06:16.873 INFO:tasks.workunit.client.0.smithi115.stdout:6/902: dwrite d4/df/d14/d38/d44/d66/d8b/f98 [4194304,4194304] 0 2024-09-13T23:06:16.873 INFO:tasks.workunit.client.0.smithi115.stdout:0/711: dwrite d6/d24/d25/d2b/d82/d44/f4b [4194304,4194304] 0 2024-09-13T23:06:16.873 INFO:tasks.workunit.client.0.smithi115.stdout:3/868: dwrite d3/d5/d65/da8/da4/f52 [0,4194304] 0 2024-09-13T23:06:16.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/205: dwrite f16 [0,4194304] 0 2024-09-13T23:06:16.874 INFO:tasks.workunit.client.1.smithi152.stdout:2/203: link d0/d4/d9/d14/f28 d0/d4/d9/d16/d2b/f46 0 2024-09-13T23:06:16.874 INFO:tasks.workunit.client.1.smithi152.stdout:3/192: dwrite de/ff [0,4194304] 0 2024-09-13T23:06:16.874 INFO:tasks.workunit.client.1.smithi152.stdout:3/193: readlink de/l2a 0 2024-09-13T23:06:16.874 INFO:tasks.workunit.client.1.smithi152.stdout:3/194: fsync de/d14/d38/f1a 0 2024-09-13T23:06:16.875 INFO:tasks.workunit.client.1.smithi152.stdout:3/195: readlink de/d14/d38/d27/l42 0 2024-09-13T23:06:16.875 INFO:tasks.workunit.client.1.smithi152.stdout:6/134: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:16.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/95: dwrite d17/f1c [0,4194304] 0 2024-09-13T23:06:16.875 INFO:tasks.workunit.client.0.smithi115.stdout:6/903: symlink d4/df/d14/d38/d2a/d31/d5b/da8/l12f 0 2024-09-13T23:06:16.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/747: creat d0/d13/d17/d1f/d4e/da2/fee x:0 0 0 2024-09-13T23:06:16.876 INFO:tasks.workunit.client.0.smithi115.stdout:9/748: stat d0/d13/d17/d36/d80/f87 0 2024-09-13T23:06:16.877 INFO:tasks.workunit.client.0.smithi115.stdout:9/749: fdatasync d0/d13/d17/d1f/d28/d76/d81/fab 0 2024-09-13T23:06:16.877 INFO:tasks.workunit.client.0.smithi115.stdout:9/750: creat d0/d13/d17/d1f/d35/d40/fef x:0 0 0 2024-09-13T23:06:16.878 INFO:tasks.workunit.client.0.smithi115.stdout:0/712: creat d6/da0/dd9/ffb x:0 0 0 2024-09-13T23:06:16.882 INFO:tasks.workunit.client.1.smithi152.stdout:2/204: symlink d0/d4/d9/d16/d2b/l47 0 2024-09-13T23:06:16.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/869: creat d3/d5/db/f11f x:0 0 0 2024-09-13T23:06:16.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/154: fsync d4/d9/f2b 0 2024-09-13T23:06:16.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/155: chown d4/d9/l15 53 1 2024-09-13T23:06:16.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/156: fdatasync d4/d9/f14 0 2024-09-13T23:06:16.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/157: stat d4/d9/f13 0 2024-09-13T23:06:16.885 INFO:tasks.workunit.client.1.smithi152.stdout:3/196: rename de/d14/d38/d27/f3a to de/d14/f4b 0 2024-09-13T23:06:16.885 INFO:tasks.workunit.client.1.smithi152.stdout:3/197: truncate de/d14/f21 1833215 0 2024-09-13T23:06:16.889 INFO:tasks.workunit.client.1.smithi152.stdout:6/135: truncate d4/f7 4030373 0 2024-09-13T23:06:16.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/904: creat d4/d57/f130 x:0 0 0 2024-09-13T23:06:16.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/905: chown d4/df/d14/d38/d2a/d31/fb5 37077122 1 2024-09-13T23:06:16.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/906: chown d4/df/d14/d38/d2a/d3e/fa5 2718670 1 2024-09-13T23:06:16.894 INFO:tasks.workunit.client.0.smithi115.stdout:6/907: dread - d4/df/d14/d67/d77/dcf/de8/f104 zero size 2024-09-13T23:06:16.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/96: mknod d17/d19/c1e 0 2024-09-13T23:06:16.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/206: getdents d17/d24/d2a/d2e 0 2024-09-13T23:06:16.896 INFO:tasks.workunit.client.1.smithi152.stdout:1/158: symlink d4/l2c 0 2024-09-13T23:06:16.897 INFO:tasks.workunit.client.0.smithi115.stdout:3/870: creat d3/d5/d65/da8/f120 x:0 0 0 2024-09-13T23:06:16.897 INFO:tasks.workunit.client.0.smithi115.stdout:3/871: dread - d3/d5/d35/d71/d42/f115 zero size 2024-09-13T23:06:16.898 INFO:tasks.workunit.client.1.smithi152.stdout:3/198: symlink de/d1f/l4c 0 2024-09-13T23:06:16.899 INFO:tasks.workunit.client.0.smithi115.stdout:6/908: symlink d4/df/d14/d38/d44/d66/dc3/l131 0 2024-09-13T23:06:16.900 INFO:tasks.workunit.client.1.smithi152.stdout:6/136: rmdir d4/de 39 2024-09-13T23:06:16.900 INFO:tasks.workunit.client.0.smithi115.stdout:3/872: mknod d3/d16/d1c/c121 0 2024-09-13T23:06:16.902 INFO:tasks.workunit.client.1.smithi152.stdout:1/159: mknod d4/d9/d1a/c2d 0 2024-09-13T23:06:16.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/199: creat de/d14/f4d x:0 0 0 2024-09-13T23:06:16.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/200: dread - de/d1f/f3d zero size 2024-09-13T23:06:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:8/97: write f15 [3972652,22990] 0 2024-09-13T23:06:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/201: creat de/d14/d38/f4e x:0 0 0 2024-09-13T23:06:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/202: write de/d14/f21 [2847096,78433] 0 2024-09-13T23:06:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/203: creat de/d14/f4f x:0 0 0 2024-09-13T23:06:16.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/204: write de/d14/d38/f1a [958769,61353] 0 2024-09-13T23:06:16.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/98: symlink d17/l1f 0 2024-09-13T23:06:16.908 INFO:tasks.workunit.client.0.smithi115.stdout:3/873: dread d3/f1b [0,4194304] 0 2024-09-13T23:06:16.908 INFO:tasks.workunit.client.0.smithi115.stdout:3/874: truncate d3/d5/d35/f50 304902 0 2024-09-13T23:06:16.908 INFO:tasks.workunit.client.1.smithi152.stdout:3/205: mknod de/d14/c50 0 2024-09-13T23:06:16.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/875: mkdir d3/d16/d1c/d101/d98/d122 0 2024-09-13T23:06:16.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/876: fsync d3/d5/d5b/f72 0 2024-09-13T23:06:16.909 INFO:tasks.workunit.client.0.smithi115.stdout:3/877: chown d3/d5/c14 1670893 1 2024-09-13T23:06:16.910 INFO:tasks.workunit.client.1.smithi152.stdout:8/99: creat d17/d19/f20 x:0 0 0 2024-09-13T23:06:16.910 INFO:tasks.workunit.client.1.smithi152.stdout:3/206: mknod de/d1f/c51 0 2024-09-13T23:06:16.910 INFO:tasks.workunit.client.0.smithi115.stdout:3/878: rename d3/d16/d1c/d101/dfb/cff to d3/d16/d1a/d1e/d94/c123 0 2024-09-13T23:06:16.910 INFO:tasks.workunit.client.1.smithi152.stdout:8/100: truncate f10 5077446 0 2024-09-13T23:06:16.912 INFO:tasks.workunit.client.0.smithi115.stdout:3/879: rename d3/d5/db/dbd to d3/d5/d65/da8/da4/d49/d124 0 2024-09-13T23:06:16.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/207: rename f9 to de/d1f/f52 0 2024-09-13T23:06:16.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/208: stat de/f40 0 2024-09-13T23:06:16.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/209: write de/d14/f4f [313525,102994] 0 2024-09-13T23:06:16.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/137: read d4/f7 [3817817,31681] 0 2024-09-13T23:06:16.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/138: chown d4/de/d12/d16 216989 1 2024-09-13T23:06:16.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/139: creat d4/de/d12/d16/d2a/f2d x:0 0 0 2024-09-13T23:06:16.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/140: stat d4/de/d26 0 2024-09-13T23:06:16.919 INFO:tasks.workunit.client.0.smithi115.stdout:0/713: dwrite d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe [0,4194304] 0 2024-09-13T23:06:16.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/205: dwrite d0/f2e [0,4194304] 0 2024-09-13T23:06:16.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/206: truncate d0/d4/d9/d14/f2f 5040312 0 2024-09-13T23:06:16.923 INFO:tasks.workunit.client.0.smithi115.stdout:9/751: dwrite d0/d13/d3b/d42/d95/fd8 [0,4194304] 0 2024-09-13T23:06:16.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/160: getdents d4/d9/d1a 0 2024-09-13T23:06:16.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/161: chown d4/c5 16405031 1 2024-09-13T23:06:16.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/162: write d4/f7 [984471,53599] 0 2024-09-13T23:06:16.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/207: mkdir d0/d4/d9/d14/d48 0 2024-09-13T23:06:16.931 INFO:tasks.workunit.client.1.smithi152.stdout:2/208: mkdir d0/d4/d9/d14/d48/d49 0 2024-09-13T23:06:16.932 INFO:tasks.workunit.client.0.smithi115.stdout:3/880: getdents d3/d5/db 0 2024-09-13T23:06:16.932 INFO:tasks.workunit.client.0.smithi115.stdout:3/881: chown d3/d16/d1a/d1e/f10b 76 1 2024-09-13T23:06:16.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/849: sync 2024-09-13T23:06:16.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/850: fsync da/d23/d2c/dc2/de1/d56/d4b/f118 0 2024-09-13T23:06:16.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/851: readlink da/d23/d2c/dc2/de1/la3 0 2024-09-13T23:06:16.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/852: read - da/d21/d8c/d41/fff zero size 2024-09-13T23:06:16.933 INFO:tasks.workunit.client.0.smithi115.stdout:2/853: chown da/d21/da8/dbc/le0 304657365 1 2024-09-13T23:06:16.934 INFO:tasks.workunit.client.1.smithi152.stdout:2/209: mkdir d0/d4/d9/d14/d48/d4a 0 2024-09-13T23:06:16.935 INFO:tasks.workunit.client.0.smithi115.stdout:2/854: creat da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/f119 x:0 0 0 2024-09-13T23:06:16.935 INFO:tasks.workunit.client.0.smithi115.stdout:2/855: chown da/d21/d8c/l9b 34 1 2024-09-13T23:06:16.944 INFO:tasks.workunit.client.0.smithi115.stdout:2/856: dread da/d21/f33 [0,4194304] 0 2024-09-13T23:06:16.945 INFO:tasks.workunit.client.0.smithi115.stdout:2/857: getdents da/d23/d2c/dc2/d104/dac 0 2024-09-13T23:06:16.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/858: symlink da/d23/d2c/dc2/d104/l11a 0 2024-09-13T23:06:16.946 INFO:tasks.workunit.client.0.smithi115.stdout:2/859: fdatasync da/d23/d2c/dc2/de1/d56/f45 0 2024-09-13T23:06:16.948 INFO:tasks.workunit.client.1.smithi152.stdout:2/210: read d0/d4/d9/d14/f20 [2487005,62295] 0 2024-09-13T23:06:16.949 INFO:tasks.workunit.client.1.smithi152.stdout:2/211: creat d0/d4/d9/f4b x:0 0 0 2024-09-13T23:06:16.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/212: mknod d0/d8/d43/c4c 0 2024-09-13T23:06:16.951 INFO:tasks.workunit.client.1.smithi152.stdout:2/213: chown d0/d4/d9/l27 0 1 2024-09-13T23:06:16.952 INFO:tasks.workunit.client.1.smithi152.stdout:2/214: mkdir d0/d4/d9/d18/d1e/d3c/d4d 0 2024-09-13T23:06:16.953 INFO:tasks.workunit.client.1.smithi152.stdout:2/215: truncate d0/d4/d9/d16/d2b/f3b 587138 0 2024-09-13T23:06:16.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/101: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:16.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/102: chown fd 10580 1 2024-09-13T23:06:16.953 INFO:tasks.workunit.client.1.smithi152.stdout:2/216: symlink d0/d8/l4e 0 2024-09-13T23:06:16.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/210: dwrite de/d14/d38/f28 [0,4194304] 0 2024-09-13T23:06:16.958 INFO:tasks.workunit.client.0.smithi115.stdout:0/714: dwrite d6/da0/fda [0,4194304] 0 2024-09-13T23:06:16.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/752: dwrite d0/d43/d53/fea [0,4194304] 0 2024-09-13T23:06:16.959 INFO:tasks.workunit.client.0.smithi115.stdout:9/753: stat d0/d13/d17/d36/c54 0 2024-09-13T23:06:16.961 INFO:tasks.workunit.client.1.smithi152.stdout:6/141: dwrite d4/de/d12/d16/d2a/f2d [0,4194304] 0 2024-09-13T23:06:16.961 INFO:tasks.workunit.client.1.smithi152.stdout:6/142: write d4/de/d12/f28 [858081,11225] 0 2024-09-13T23:06:16.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/163: dwrite f1 [0,4194304] 0 2024-09-13T23:06:16.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/164: dread - d4/d9/f2b zero size 2024-09-13T23:06:16.963 INFO:tasks.workunit.client.0.smithi115.stdout:9/754: link d0/d13/d17/d1f/d28/l94 d0/d13/d17/lf0 0 2024-09-13T23:06:16.964 INFO:tasks.workunit.client.0.smithi115.stdout:0/715: getdents d6/d24/d25/d2b/d82/d44/d5c/d87/dc2 0 2024-09-13T23:06:16.964 INFO:tasks.workunit.client.0.smithi115.stdout:0/716: stat d6/d24/d25/d2b/d82/d44/d5c/d87/da4 0 2024-09-13T23:06:16.964 INFO:tasks.workunit.client.0.smithi115.stdout:0/717: write d6/da5/fea [817527,8574] 0 2024-09-13T23:06:16.964 INFO:tasks.workunit.client.0.smithi115.stdout:0/718: truncate d6/da5/dd4/fdb 76948 0 2024-09-13T23:06:16.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/165: creat d4/d9/d1a/f2e x:0 0 0 2024-09-13T23:06:16.972 INFO:tasks.workunit.client.0.smithi115.stdout:2/860: dwrite da/d23/d2c/f47 [4194304,4194304] 0 2024-09-13T23:06:16.972 INFO:tasks.workunit.client.0.smithi115.stdout:2/861: fdatasync da/f114 0 2024-09-13T23:06:16.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/143: write d4/de/d21/f1f [3691108,30289] 0 2024-09-13T23:06:16.979 INFO:tasks.workunit.client.1.smithi152.stdout:6/144: rename d4 to d4/de/d2e 22 2024-09-13T23:06:16.979 INFO:tasks.workunit.client.1.smithi152.stdout:6/145: dread - d4/de/d21/f29 zero size 2024-09-13T23:06:16.981 INFO:tasks.workunit.client.1.smithi152.stdout:6/146: rename d4/de/d21/f29 to d4/de/d1d/f2f 0 2024-09-13T23:06:16.981 INFO:tasks.workunit.client.1.smithi152.stdout:6/147: fsync d4/de/f13 0 2024-09-13T23:06:16.982 INFO:tasks.workunit.client.1.smithi152.stdout:6/148: stat d4/de/c10 0 2024-09-13T23:06:16.984 INFO:tasks.workunit.client.1.smithi152.stdout:6/149: rmdir d4/de/d26 0 2024-09-13T23:06:16.985 INFO:tasks.workunit.client.1.smithi152.stdout:6/150: symlink d4/de/d12/d16/d2a/l30 0 2024-09-13T23:06:16.985 INFO:tasks.workunit.client.1.smithi152.stdout:6/151: read d4/de/f13 [192489,74119] 0 2024-09-13T23:06:16.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/755: dread d0/d13/d17/d36/f46 [0,4194304] 0 2024-09-13T23:06:16.987 INFO:tasks.workunit.client.0.smithi115.stdout:9/756: getdents d0/d13/d3b/d42 0 2024-09-13T23:06:16.990 INFO:tasks.workunit.client.0.smithi115.stdout:2/862: read da/d23/d2c/dc2/de1/d56/dda/ff2 [3247847,113750] 0 2024-09-13T23:06:16.990 INFO:tasks.workunit.client.1.smithi152.stdout:6/152: dread d4/de/f13 [0,4194304] 0 2024-09-13T23:06:17.004 INFO:tasks.workunit.client.1.smithi152.stdout:3/211: dwrite de/f40 [0,4194304] 0 2024-09-13T23:06:17.006 INFO:tasks.workunit.client.1.smithi152.stdout:3/212: symlink de/d1f/l53 0 2024-09-13T23:06:17.006 INFO:tasks.workunit.client.1.smithi152.stdout:6/153: write d4/de/d12/d16/d2a/f2d [3856131,34415] 0 2024-09-13T23:06:17.006 INFO:tasks.workunit.client.0.smithi115.stdout:9/757: write d0/d13/d17/d1f/f66 [7785799,97841] 0 2024-09-13T23:06:17.007 INFO:tasks.workunit.client.1.smithi152.stdout:6/154: creat d4/de/f31 x:0 0 0 2024-09-13T23:06:17.014 INFO:tasks.workunit.client.0.smithi115.stdout:9/758: write d0/d13/d17/d36/d80/fe6 [204197,101828] 0 2024-09-13T23:06:17.014 INFO:tasks.workunit.client.0.smithi115.stdout:9/759: readlink d0/lac 0 2024-09-13T23:06:17.020 INFO:tasks.workunit.client.1.smithi152.stdout:1/166: dwrite d4/d9/f2b [0,4194304] 0 2024-09-13T23:06:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:1/167: chown d4/d9/l15 14041 1 2024-09-13T23:06:17.021 INFO:tasks.workunit.client.1.smithi152.stdout:1/168: creat d4/d9/d1a/f2f x:0 0 0 2024-09-13T23:06:17.024 INFO:tasks.workunit.client.0.smithi115.stdout:0/719: dwrite d6/d24/d25/d2b/f31 [0,4194304] 0 2024-09-13T23:06:17.024 INFO:tasks.workunit.client.1.smithi152.stdout:2/217: dwrite d0/d4/d9/f10 [0,4194304] 0 2024-09-13T23:06:17.024 INFO:tasks.workunit.client.1.smithi152.stdout:8/103: dwrite d17/d19/f20 [0,4194304] 0 2024-09-13T23:06:17.026 INFO:tasks.workunit.client.0.smithi115.stdout:2/863: dwrite da/d21/d8c/f63 [0,4194304] 0 2024-09-13T23:06:17.027 INFO:tasks.workunit.client.0.smithi115.stdout:0/720: rename d6/d24/d25/d2b/d82/d44/f65 to d6/d24/d25/d2b/d82/d44/d5c/d87/da4/ffc 0 2024-09-13T23:06:17.027 INFO:tasks.workunit.client.0.smithi115.stdout:0/721: rename d6 to d6/d24/d25/d2b/d61/dfd 22 2024-09-13T23:06:17.027 INFO:tasks.workunit.client.0.smithi115.stdout:0/722: fdatasync d6/d24/d25/d2b/f31 0 2024-09-13T23:06:17.030 INFO:tasks.workunit.client.1.smithi152.stdout:3/213: dwrite de/f17 [0,4194304] 0 2024-09-13T23:06:17.031 INFO:tasks.workunit.client.0.smithi115.stdout:2/864: creat da/d23/d2c/dc2/de1/d56/d1a/d7f/f11b x:0 0 0 2024-09-13T23:06:17.032 INFO:tasks.workunit.client.0.smithi115.stdout:0/723: mkdir d6/d24/d25/da7/dfe 0 2024-09-13T23:06:17.032 INFO:tasks.workunit.client.0.smithi115.stdout:0/724: write d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe [4308008,27939] 0 2024-09-13T23:06:17.032 INFO:tasks.workunit.client.0.smithi115.stdout:0/725: getdents d6/da5/dd4 0 2024-09-13T23:06:17.032 INFO:tasks.workunit.client.0.smithi115.stdout:0/726: truncate d6/d24/d25/d2b/d82/d44/f55 4615408 0 2024-09-13T23:06:17.033 INFO:tasks.workunit.client.0.smithi115.stdout:0/727: write d6/d24/d25/da7/fc3 [1591563,77982] 0 2024-09-13T23:06:17.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/865: dread da/d23/d2c/fae [4194304,4194304] 0 2024-09-13T23:06:17.033 INFO:tasks.workunit.client.0.smithi115.stdout:2/866: creat da/d23/d2c/dc2/de1/d56/d4b/f11c x:0 0 0 2024-09-13T23:06:17.035 INFO:tasks.workunit.client.1.smithi152.stdout:1/169: write d4/d9/f12 [300549,8300] 0 2024-09-13T23:06:17.035 INFO:tasks.workunit.client.0.smithi115.stdout:2/867: mknod da/d23/d2c/dc2/de1/d56/d74/dc7/c11d 0 2024-09-13T23:06:17.036 INFO:tasks.workunit.client.0.smithi115.stdout:2/868: truncate da/d23/d2c/dc2/d104/dac/fcf 2446499 0 2024-09-13T23:06:17.037 INFO:tasks.workunit.client.1.smithi152.stdout:3/214: symlink de/d14/d38/d27/l54 0 2024-09-13T23:06:17.037 INFO:tasks.workunit.client.1.smithi152.stdout:3/215: creat de/d14/f55 x:0 0 0 2024-09-13T23:06:17.037 INFO:tasks.workunit.client.1.smithi152.stdout:3/216: stat de/ff 0 2024-09-13T23:06:17.037 INFO:tasks.workunit.client.1.smithi152.stdout:3/217: chown de/d14/f4b 1041712533 1 2024-09-13T23:06:17.038 INFO:tasks.workunit.client.1.smithi152.stdout:8/104: read d17/d19/f20 [146370,126967] 0 2024-09-13T23:06:17.038 INFO:tasks.workunit.client.0.smithi115.stdout:2/869: unlink da/d23/d2c/dc2/de1/d53/f6f 0 2024-09-13T23:06:17.039 INFO:tasks.workunit.client.0.smithi115.stdout:2/870: fsync da/d23/d2c/dc2/de1/d56/f24 0 2024-09-13T23:06:17.039 INFO:tasks.workunit.client.0.smithi115.stdout:2/871: fsync da/d23/d2c/dc2/d104/f65 0 2024-09-13T23:06:17.040 INFO:tasks.workunit.client.1.smithi152.stdout:8/105: symlink d17/d19/l21 0 2024-09-13T23:06:17.040 INFO:tasks.workunit.client.0.smithi115.stdout:2/872: link da/d23/d2c/dc2/de1/d56/d74/fdb da/d21/da8/df5/f11e 0 2024-09-13T23:06:17.043 INFO:tasks.workunit.client.0.smithi115.stdout:2/873: symlink da/d23/d2c/dc2/de1/d56/l11f 0 2024-09-13T23:06:17.043 INFO:tasks.workunit.client.0.smithi115.stdout:2/874: creat da/d23/d2c/dc2/de1/d56/d4b/f120 x:0 0 0 2024-09-13T23:06:17.045 INFO:tasks.workunit.client.0.smithi115.stdout:2/875: mknod da/d23/d2c/dc2/de1/d53/c121 0 2024-09-13T23:06:17.047 INFO:tasks.workunit.client.0.smithi115.stdout:9/760: dwrite d0/d13/d17/d1f/d77/fa3 [0,4194304] 0 2024-09-13T23:06:17.048 INFO:tasks.workunit.client.0.smithi115.stdout:2/876: mkdir da/d23/d2c/dc2/de1/d56/d4b/d122 0 2024-09-13T23:06:17.049 INFO:tasks.workunit.client.1.smithi152.stdout:6/155: dread d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:17.049 INFO:tasks.workunit.client.1.smithi152.stdout:6/156: truncate d4/de/f31 910071 0 2024-09-13T23:06:17.049 INFO:tasks.workunit.client.1.smithi152.stdout:6/157: chown d4/de/d12/d16/d2a/l30 47803 1 2024-09-13T23:06:17.049 INFO:tasks.workunit.client.1.smithi152.stdout:6/158: write d4/de/ff [3565365,102703] 0 2024-09-13T23:06:17.049 INFO:tasks.workunit.client.1.smithi152.stdout:6/159: creat d4/de/d1d/f32 x:0 0 0 2024-09-13T23:06:17.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/160: write d4/de/d12/d16/d2a/f2d [1434292,14460] 0 2024-09-13T23:06:17.050 INFO:tasks.workunit.client.0.smithi115.stdout:0/728: dread d6/d24/d25/da3/dad/f80 [0,4194304] 0 2024-09-13T23:06:17.050 INFO:tasks.workunit.client.0.smithi115.stdout:0/729: write d6/d24/d25/da3/dad/f9b [1312589,68523] 0 2024-09-13T23:06:17.051 INFO:tasks.workunit.client.0.smithi115.stdout:2/877: rmdir da/d21/da8/dbc 39 2024-09-13T23:06:17.051 INFO:tasks.workunit.client.1.smithi152.stdout:6/161: dread d4/de/d21/f14 [0,4194304] 0 2024-09-13T23:06:17.052 INFO:tasks.workunit.client.1.smithi152.stdout:8/106: dread f3 [4194304,4194304] 0 2024-09-13T23:06:17.052 INFO:tasks.workunit.client.0.smithi115.stdout:0/730: mknod d6/d24/d25/d2b/cff 0 2024-09-13T23:06:17.052 INFO:tasks.workunit.client.0.smithi115.stdout:0/731: write d6/d24/d25/d2b/d82/d44/d5c/d87/fde [571825,75832] 0 2024-09-13T23:06:17.052 INFO:tasks.workunit.client.0.smithi115.stdout:5/802: sync 2024-09-13T23:06:17.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/162: mknod d4/de/d12/d16/c33 0 2024-09-13T23:06:17.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/163: write d4/de/ff [2499736,48089] 0 2024-09-13T23:06:17.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/164: dread - d4/de/d1d/f23 zero size 2024-09-13T23:06:17.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/165: symlink d4/de/d12/d16/l34 0 2024-09-13T23:06:17.055 INFO:tasks.workunit.client.0.smithi115.stdout:0/732: creat d6/da5/dd4/f100 x:0 0 0 2024-09-13T23:06:17.055 INFO:tasks.workunit.client.0.smithi115.stdout:0/733: write d6/d24/d25/d2b/d61/f85 [936624,86704] 0 2024-09-13T23:06:17.055 INFO:tasks.workunit.client.0.smithi115.stdout:0/734: write d6/d24/d25/d2b/d82/d44/fb7 [2026078,17487] 0 2024-09-13T23:06:17.055 INFO:tasks.workunit.client.0.smithi115.stdout:0/735: read d6/f4d [577477,94642] 0 2024-09-13T23:06:17.056 INFO:tasks.workunit.client.0.smithi115.stdout:5/803: getdents d8/dd/d5d/d5e 0 2024-09-13T23:06:17.056 INFO:tasks.workunit.client.0.smithi115.stdout:5/804: write d8/dd/d20/d27/fa4 [480755,39083] 0 2024-09-13T23:06:17.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/218: dwrite d0/d4/d9/d16/d2b/f3b [0,4194304] 0 2024-09-13T23:06:17.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/219: readlink d0/d4/d9/d18/l33 0 2024-09-13T23:06:17.059 INFO:tasks.workunit.client.0.smithi115.stdout:9/761: write d0/d13/d17/d1f/d35/fb4 [491758,21061] 0 2024-09-13T23:06:17.060 INFO:tasks.workunit.client.1.smithi152.stdout:3/218: dwrite de/f13 [4194304,4194304] 0 2024-09-13T23:06:17.061 INFO:tasks.workunit.client.1.smithi152.stdout:3/219: creat de/d14/d38/d27/f56 x:0 0 0 2024-09-13T23:06:17.061 INFO:tasks.workunit.client.1.smithi152.stdout:3/220: readlink de/d14/d38/l18 0 2024-09-13T23:06:17.061 INFO:tasks.workunit.client.1.smithi152.stdout:3/221: fsync de/ff 0 2024-09-13T23:06:17.061 INFO:tasks.workunit.client.1.smithi152.stdout:2/220: symlink d0/d4/d9/d18/d1e/d3c/d4d/l4f 0 2024-09-13T23:06:17.061 INFO:tasks.workunit.client.1.smithi152.stdout:2/221: readlink d0/d4/d9/d14/l1f 0 2024-09-13T23:06:17.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/166: fsync d4/de/ff 0 2024-09-13T23:06:17.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/167: chown d4/c8 19281 1 2024-09-13T23:06:17.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/168: dread - d4/de/d1d/f32 zero size 2024-09-13T23:06:17.064 INFO:tasks.workunit.client.1.smithi152.stdout:3/222: mkdir de/d14/d47/d57 0 2024-09-13T23:06:17.064 INFO:tasks.workunit.client.1.smithi152.stdout:3/223: write de/d1f/f3d [450657,120775] 0 2024-09-13T23:06:17.064 INFO:tasks.workunit.client.0.smithi115.stdout:9/762: creat d0/d13/d3b/ff1 x:0 0 0 2024-09-13T23:06:17.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/222: creat d0/d4/d9/d16/d2b/f50 x:0 0 0 2024-09-13T23:06:17.065 INFO:tasks.workunit.client.1.smithi152.stdout:1/170: dread d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:17.065 INFO:tasks.workunit.client.1.smithi152.stdout:1/171: fdatasync d4/d9/f1f 0 2024-09-13T23:06:17.065 INFO:tasks.workunit.client.1.smithi152.stdout:1/172: creat d4/d9/d1a/f30 x:0 0 0 2024-09-13T23:06:17.066 INFO:tasks.workunit.client.1.smithi152.stdout:1/173: chown f1 4086 1 2024-09-13T23:06:17.066 INFO:tasks.workunit.client.1.smithi152.stdout:1/174: stat d4 0 2024-09-13T23:06:17.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/224: rename de/d14/c50 to de/d14/d38/d27/c58 0 2024-09-13T23:06:17.067 INFO:tasks.workunit.client.1.smithi152.stdout:3/225: readlink de/d14/d38/l33 0 2024-09-13T23:06:17.067 INFO:tasks.workunit.client.1.smithi152.stdout:2/223: creat d0/d8/d43/f51 x:0 0 0 2024-09-13T23:06:17.067 INFO:tasks.workunit.client.0.smithi115.stdout:9/763: creat d0/d13/d17/d1f/d28/ff2 x:0 0 0 2024-09-13T23:06:17.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/169: symlink d4/de/l35 0 2024-09-13T23:06:17.069 INFO:tasks.workunit.client.0.smithi115.stdout:2/878: write da/d21/f72 [212190,12186] 0 2024-09-13T23:06:17.070 INFO:tasks.workunit.client.0.smithi115.stdout:9/764: creat d0/d13/d17/d1f/d4e/d61/d7d/ff3 x:0 0 0 2024-09-13T23:06:17.070 INFO:tasks.workunit.client.1.smithi152.stdout:1/175: mknod d4/d9/d1a/d22/c31 0 2024-09-13T23:06:17.072 INFO:tasks.workunit.client.0.smithi115.stdout:2/879: rmdir da/d21/d8c/d41/d62/d10a/d10c 39 2024-09-13T23:06:17.072 INFO:tasks.workunit.client.0.smithi115.stdout:2/880: read da/d23/d2c/dc2/de1/d56/f24 [1602961,97515] 0 2024-09-13T23:06:17.073 INFO:tasks.workunit.client.0.smithi115.stdout:9/765: symlink d0/d13/d3b/lf4 0 2024-09-13T23:06:17.075 INFO:tasks.workunit.client.1.smithi152.stdout:9/184: sync 2024-09-13T23:06:17.075 INFO:tasks.workunit.client.1.smithi152.stdout:5/161: sync 2024-09-13T23:06:17.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/160: sync 2024-09-13T23:06:17.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/161: write d18/f25 [171147,109151] 0 2024-09-13T23:06:17.075 INFO:tasks.workunit.client.1.smithi152.stdout:4/270: sync 2024-09-13T23:06:17.076 INFO:tasks.workunit.client.1.smithi152.stdout:4/271: fdatasync d3/d4/f22 0 2024-09-13T23:06:17.076 INFO:tasks.workunit.client.1.smithi152.stdout:3/226: dread de/d14/d38/f19 [0,4194304] 0 2024-09-13T23:06:17.076 INFO:tasks.workunit.client.1.smithi152.stdout:3/227: write de/f3e [508399,91922] 0 2024-09-13T23:06:17.079 INFO:tasks.workunit.client.0.smithi115.stdout:2/881: link da/d21/d8c/d41/f61 da/d23/d2c/dc2/d103/f123 0 2024-09-13T23:06:17.079 INFO:tasks.workunit.client.0.smithi115.stdout:2/882: readlink da/d23/dbd/l10b 0 2024-09-13T23:06:17.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/185: mknod d3/d1e/d30/c3a 0 2024-09-13T23:06:17.081 INFO:tasks.workunit.client.1.smithi152.stdout:5/162: creat d5/dc/f30 x:0 0 0 2024-09-13T23:06:17.085 INFO:tasks.workunit.client.1.smithi152.stdout:7/207: sync 2024-09-13T23:06:17.085 INFO:tasks.workunit.client.1.smithi152.stdout:7/208: stat d17/d24/d2a/d2b/c31 0 2024-09-13T23:06:17.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/162: getdents d18 0 2024-09-13T23:06:17.087 INFO:tasks.workunit.client.1.smithi152.stdout:0/163: mkdir d18/d1f/d33 0 2024-09-13T23:06:17.088 INFO:tasks.workunit.client.0.smithi115.stdout:9/766: rename d0/d13/d17/d1f/d4e/cd9 to d0/d13/d17/d1f/d28/d76/d81/cf5 0 2024-09-13T23:06:17.088 INFO:tasks.workunit.client.0.smithi115.stdout:9/767: stat d0/d13/d17/d1f/d4e/da2/fee 0 2024-09-13T23:06:17.088 INFO:tasks.workunit.client.1.smithi152.stdout:7/209: mkdir d17/d24/d2d/d46 0 2024-09-13T23:06:17.088 INFO:tasks.workunit.client.1.smithi152.stdout:7/210: creat d17/d24/d2a/d2b/f47 x:0 0 0 2024-09-13T23:06:17.091 INFO:tasks.workunit.client.1.smithi152.stdout:0/164: rename d18/d19/f1e to d18/d1f/f34 0 2024-09-13T23:06:17.091 INFO:tasks.workunit.client.1.smithi152.stdout:0/165: chown d18/f28 2205650 1 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.1.smithi152.stdout:0/166: stat f0 0 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.1.smithi152.stdout:0/167: write f14 [4619466,24314] 0 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.0.smithi115.stdout:4/817: sync 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.0.smithi115.stdout:8/935: sync 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.0.smithi115.stdout:9/768: mknod d0/d13/d3b/d42/cf6 0 2024-09-13T23:06:17.092 INFO:tasks.workunit.client.0.smithi115.stdout:9/769: dread - d0/d13/d17/d19/fc6 zero size 2024-09-13T23:06:17.093 INFO:tasks.workunit.client.1.smithi152.stdout:7/211: creat d17/d24/d2d/d46/f48 x:0 0 0 2024-09-13T23:06:17.093 INFO:tasks.workunit.client.1.smithi152.stdout:7/212: dread - d17/d24/d2a/d2b/f3b zero size 2024-09-13T23:06:17.093 INFO:tasks.workunit.client.1.smithi152.stdout:7/213: creat d17/d24/d2a/d2b/f49 x:0 0 0 2024-09-13T23:06:17.093 INFO:tasks.workunit.client.1.smithi152.stdout:7/214: chown d17/f1c 6 1 2024-09-13T23:06:17.094 INFO:tasks.workunit.client.1.smithi152.stdout:7/215: chown c2 1999 1 2024-09-13T23:06:17.095 INFO:tasks.workunit.client.0.smithi115.stdout:4/818: rename db/d16/d3f/fe9 to db/d11/d2e/d33/d36/d51/ff7 0 2024-09-13T23:06:17.095 INFO:tasks.workunit.client.0.smithi115.stdout:4/819: getdents db/d11/df3 0 2024-09-13T23:06:17.096 INFO:tasks.workunit.client.1.smithi152.stdout:0/168: unlink d18/d1f/d29/f2a 0 2024-09-13T23:06:17.097 INFO:tasks.workunit.client.0.smithi115.stdout:8/936: symlink d3/d5/dc/d16/d1f/d28/d3e/d128/l14d 0 2024-09-13T23:06:17.098 INFO:tasks.workunit.client.0.smithi115.stdout:8/937: fsync d3/d5/dc/d23/d4e/d54/d7f/de9/f15 0 2024-09-13T23:06:17.098 INFO:tasks.workunit.client.1.smithi152.stdout:7/216: mknod d17/d24/d2d/d46/c4a 0 2024-09-13T23:06:17.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/169: unlink d18/c22 0 2024-09-13T23:06:17.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/170: fdatasync f10 0 2024-09-13T23:06:17.099 INFO:tasks.workunit.client.1.smithi152.stdout:0/171: write d18/f2d [1007103,115598] 0 2024-09-13T23:06:17.100 INFO:tasks.workunit.client.1.smithi152.stdout:7/217: mkdir d17/d24/d2a/d2b/d4b 0 2024-09-13T23:06:17.101 INFO:tasks.workunit.client.1.smithi152.stdout:0/172: mkdir d18/d1f/d35 0 2024-09-13T23:06:17.102 INFO:tasks.workunit.client.0.smithi115.stdout:9/770: rename d0/d13/d17/d1f/d4e/da2/ca7 to d0/d13/d17/d1f/d4e/cf7 0 2024-09-13T23:06:17.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/218: creat d17/d24/d2d/f4c x:0 0 0 2024-09-13T23:06:17.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/219: chown d17/d24/d2a/d2b/d4b 4 1 2024-09-13T23:06:17.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/220: chown f6 0 1 2024-09-13T23:06:17.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/221: chown d17/d24/d2a/d2b 3 1 2024-09-13T23:06:17.103 INFO:tasks.workunit.client.0.smithi115.stdout:4/820: creat db/d11/d2e/d33/d36/d7f/ff8 x:0 0 0 2024-09-13T23:06:17.103 INFO:tasks.workunit.client.0.smithi115.stdout:4/821: fdatasync db/d16/d3f/f72 0 2024-09-13T23:06:17.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/222: mkdir d17/d24/d2a/d2b/d4b/d4d 0 2024-09-13T23:06:17.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/223: creat d17/d24/d2d/f4e x:0 0 0 2024-09-13T23:06:17.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/224: chown d17/d24/f3c 1006 1 2024-09-13T23:06:17.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/225: write d17/f22 [1881640,124619] 0 2024-09-13T23:06:17.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/226: fsync d17/f27 0 2024-09-13T23:06:17.106 INFO:tasks.workunit.client.0.smithi115.stdout:0/736: dwrite d6/d24/d25/d2b/d82/f36 [0,4194304] 0 2024-09-13T23:06:17.106 INFO:tasks.workunit.client.1.smithi152.stdout:7/227: unlink d17/d24/d2d/f4c 0 2024-09-13T23:06:17.108 INFO:tasks.workunit.client.0.smithi115.stdout:0/737: mknod d6/d24/d25/d2b/d82/c101 0 2024-09-13T23:06:17.115 INFO:tasks.workunit.client.0.smithi115.stdout:8/938: dread d3/d5/dc/d23/fec [0,4194304] 0 2024-09-13T23:06:17.117 INFO:tasks.workunit.client.0.smithi115.stdout:8/939: symlink d3/d5/dc/d23/l14e 0 2024-09-13T23:06:17.117 INFO:tasks.workunit.client.0.smithi115.stdout:8/940: chown d3/d5/dc/d16/d1f/l143 493 1 2024-09-13T23:06:17.117 INFO:tasks.workunit.client.0.smithi115.stdout:8/941: link d3/d5/dc/d16/d1f/d27/d79/da0/dbc/fe7 d3/d5/dc/d16/d1f/d28/dc0/dcd/f14f 0 2024-09-13T23:06:17.119 INFO:tasks.workunit.client.0.smithi115.stdout:8/942: mknod d3/d5/dc/d16/d1f/d27/d79/c150 0 2024-09-13T23:06:17.119 INFO:tasks.workunit.client.0.smithi115.stdout:8/943: readlink d3/l10a 0 2024-09-13T23:06:17.120 INFO:tasks.workunit.client.0.smithi115.stdout:8/944: read d3/d5/d1c/d41/f80 [312726,4065] 0 2024-09-13T23:06:17.137 INFO:tasks.workunit.client.1.smithi152.stdout:6/170: dwrite d4/de/f31 [0,4194304] 0 2024-09-13T23:06:17.141 INFO:tasks.workunit.client.1.smithi152.stdout:6/171: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:17.141 INFO:tasks.workunit.client.1.smithi152.stdout:6/172: chown d4/l5 1 1 2024-09-13T23:06:17.142 INFO:tasks.workunit.client.1.smithi152.stdout:6/173: mknod d4/c36 0 2024-09-13T23:06:17.143 INFO:tasks.workunit.client.1.smithi152.stdout:6/174: link d4/f6 d4/de/d1d/f37 0 2024-09-13T23:06:17.144 INFO:tasks.workunit.client.1.smithi152.stdout:6/175: read d4/de/d12/f28 [353721,13807] 0 2024-09-13T23:06:17.145 INFO:tasks.workunit.client.0.smithi115.stdout:5/805: dwrite d8/dd/d6a/d82/d63/dd6/f95 [4194304,4194304] 0 2024-09-13T23:06:17.145 INFO:tasks.workunit.client.0.smithi115.stdout:5/806: creat d8/dd/d20/dbb/ff7 x:0 0 0 2024-09-13T23:06:17.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/176: mkdir d4/de/d12/d16/d2a/d38 0 2024-09-13T23:06:17.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/224: dwrite d0/d4/d9/d14/f28 [0,4194304] 0 2024-09-13T23:06:17.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/177: creat d4/de/f39 x:0 0 0 2024-09-13T23:06:17.147 INFO:tasks.workunit.client.1.smithi152.stdout:2/225: mknod d0/d4/d9/d18/d1e/d3c/d4d/c52 0 2024-09-13T23:06:17.147 INFO:tasks.workunit.client.0.smithi115.stdout:5/807: mkdir d8/d9e/df8 0 2024-09-13T23:06:17.148 INFO:tasks.workunit.client.0.smithi115.stdout:5/808: write d8/dd/d20/d4a/fe7 [248638,55467] 0 2024-09-13T23:06:17.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/178: truncate d4/de/d1d/f37 3194864 0 2024-09-13T23:06:17.148 INFO:tasks.workunit.client.1.smithi152.stdout:2/226: link d0/d8/f2a d0/d4/f53 0 2024-09-13T23:06:17.149 INFO:tasks.workunit.client.0.smithi115.stdout:5/809: rmdir d8/dd/d5d/d5e/d9a 39 2024-09-13T23:06:17.149 INFO:tasks.workunit.client.1.smithi152.stdout:2/227: symlink d0/d4/d9/d14/d48/l54 0 2024-09-13T23:06:17.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/228: readlink d0/d4/d9/lc 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/229: mkdir d0/d4/d9/d55 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/230: write d0/d4/d9/d18/d1e/f44 [63543,119319] 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/179: dread d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:4/272: dwrite d3/d4/d5/f42 [0,4194304] 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:4/273: readlink d3/d4/d5/d1c/l38 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:8/107: dwrite d17/d19/f20 [4194304,4194304] 0 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:8/108: chown d17/d19 218447 1 2024-09-13T23:06:17.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/186: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:17.153 INFO:tasks.workunit.client.1.smithi152.stdout:5/163: dwrite d5/f8 [0,4194304] 0 2024-09-13T23:06:17.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/231: creat d0/d4/d9/d14/d48/d4a/f56 x:0 0 0 2024-09-13T23:06:17.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/232: chown d0/d8/f2a 351285606 1 2024-09-13T23:06:17.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/233: chown d0/d4/d9/d18/d1e/d3c 123201804 1 2024-09-13T23:06:17.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/180: symlink d4/de/d12/d16/l3a 0 2024-09-13T23:06:17.155 INFO:tasks.workunit.client.0.smithi115.stdout:9/771: rename d0/d13/d17/d1f/d4e/da2 to d0/d43/df8 0 2024-09-13T23:06:17.155 INFO:tasks.workunit.client.0.smithi115.stdout:9/772: write d0/d13/d17/d1f/d35/d62/f6f [2265352,107738] 0 2024-09-13T23:06:17.155 INFO:tasks.workunit.client.0.smithi115.stdout:5/810: write d8/dd/d6a/d82/d63/f65 [517454,99676] 0 2024-09-13T23:06:17.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/274: unlink d3/f26 0 2024-09-13T23:06:17.156 INFO:tasks.workunit.client.0.smithi115.stdout:4/822: rename db/f43 to db/d19/d1d/db5/ff9 0 2024-09-13T23:06:17.157 INFO:tasks.workunit.client.0.smithi115.stdout:9/773: symlink d0/d13/d17/d1f/d67/lf9 0 2024-09-13T23:06:17.157 INFO:tasks.workunit.client.0.smithi115.stdout:9/774: dread - d0/d13/d17/d1f/d35/d40/fef zero size 2024-09-13T23:06:17.158 INFO:tasks.workunit.client.1.smithi152.stdout:8/109: link f15 d17/f22 0 2024-09-13T23:06:17.158 INFO:tasks.workunit.client.1.smithi152.stdout:8/110: fsync d17/d19/f20 0 2024-09-13T23:06:17.159 INFO:tasks.workunit.client.1.smithi152.stdout:7/228: dwrite d17/d24/d2a/f42 [0,4194304] 0 2024-09-13T23:06:17.159 INFO:tasks.workunit.client.1.smithi152.stdout:7/229: chown d17/d24/d2a/d2b/f3a 1647052322 1 2024-09-13T23:06:17.160 INFO:tasks.workunit.client.1.smithi152.stdout:9/187: mknod d3/d1e/d30/c3b 0 2024-09-13T23:06:17.160 INFO:tasks.workunit.client.1.smithi152.stdout:9/188: chown d3/d24/l26 422 1 2024-09-13T23:06:17.161 INFO:tasks.workunit.client.0.smithi115.stdout:5/811: link d8/dd/d5d/d5e/fc0 d8/d9e/dcd/ff9 0 2024-09-13T23:06:17.161 INFO:tasks.workunit.client.0.smithi115.stdout:5/812: readlink d8/dd/d64/lac 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/234: creat d0/d4/d9/d55/f57 x:0 0 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/275: truncate d3/d4/d5/f3d 3516044 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/276: fsync d3/d4/d6/f35 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/277: fdatasync d3/d4/d5/d1c/f28 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.1.smithi152.stdout:5/164: dread d5/f6 [0,4194304] 0 2024-09-13T23:06:17.162 INFO:tasks.workunit.client.0.smithi115.stdout:4/823: rename db/d16/d3f/d66/d68/d71/d84/d96/f98 to db/d16/d3f/d66/d68/d71/ffa 0 2024-09-13T23:06:17.163 INFO:tasks.workunit.client.1.smithi152.stdout:8/111: mkdir d17/d23 0 2024-09-13T23:06:17.163 INFO:tasks.workunit.client.0.smithi115.stdout:8/945: dwrite d3/d5/d1d/d72/fc1 [4194304,4194304] 0 2024-09-13T23:06:17.163 INFO:tasks.workunit.client.0.smithi115.stdout:9/775: mknod d0/d13/cfa 0 2024-09-13T23:06:17.164 INFO:tasks.workunit.client.0.smithi115.stdout:2/883: dwrite da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/fc9 [0,4194304] 0 2024-09-13T23:06:17.166 INFO:tasks.workunit.client.0.smithi115.stdout:5/813: creat d8/dd/d6a/d82/d63/dd6/ffa x:0 0 0 2024-09-13T23:06:17.166 INFO:tasks.workunit.client.1.smithi152.stdout:7/230: mkdir d17/d4f 0 2024-09-13T23:06:17.166 INFO:tasks.workunit.client.1.smithi152.stdout:7/231: write d17/d24/d2a/d2e/f32 [947331,47501] 0 2024-09-13T23:06:17.166 INFO:tasks.workunit.client.1.smithi152.stdout:4/278: dread d3/d4/d6/d8/d17/f24 [0,4194304] 0 2024-09-13T23:06:17.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/189: rename d3/f1c to d3/d1e/f3c 0 2024-09-13T23:06:17.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/190: chown d3/l35 4 1 2024-09-13T23:06:17.169 INFO:tasks.workunit.client.0.smithi115.stdout:4/824: unlink db/d16/d3f/dae/f6f 0 2024-09-13T23:06:17.169 INFO:tasks.workunit.client.0.smithi115.stdout:4/825: chown db/d11/d2e/d33/d36/dad 0 1 2024-09-13T23:06:17.169 INFO:tasks.workunit.client.1.smithi152.stdout:5/165: rmdir d5/dc/d19/d20/d2e/d28 39 2024-09-13T23:06:17.171 INFO:tasks.workunit.client.1.smithi152.stdout:8/112: mknod d17/d19/c24 0 2024-09-13T23:06:17.172 INFO:tasks.workunit.client.1.smithi152.stdout:7/232: link d17/f1d d17/d24/d2d/d46/f50 0 2024-09-13T23:06:17.173 INFO:tasks.workunit.client.1.smithi152.stdout:2/235: write d0/d4/d9/d14/f2f [2545356,6396] 0 2024-09-13T23:06:17.176 INFO:tasks.workunit.client.1.smithi152.stdout:5/166: truncate d5/dc/d19/f13 3787908 0 2024-09-13T23:06:17.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/826: link db/d16/d3f/dae/fca db/ffb 0 2024-09-13T23:06:17.177 INFO:tasks.workunit.client.0.smithi115.stdout:5/814: dread d8/d9e/dcd/fd1 [0,4194304] 0 2024-09-13T23:06:17.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/279: getdents d3/d4/d5 0 2024-09-13T23:06:17.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/280: dread - d3/f40 zero size 2024-09-13T23:06:17.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/281: creat d3/d4/d6/d37/f4e x:0 0 0 2024-09-13T23:06:17.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/282: readlink d3/l3c 0 2024-09-13T23:06:17.178 INFO:tasks.workunit.client.0.smithi115.stdout:2/884: mknod da/d77/d83/c124 0 2024-09-13T23:06:17.180 INFO:tasks.workunit.client.0.smithi115.stdout:4/827: link db/d16/f7e db/d16/d3f/ffc 0 2024-09-13T23:06:17.181 INFO:tasks.workunit.client.0.smithi115.stdout:5/815: symlink d8/dd/d6a/d82/d63/d5a/dc3/lfb 0 2024-09-13T23:06:17.181 INFO:tasks.workunit.client.1.smithi152.stdout:5/167: symlink d5/dc/d19/l31 0 2024-09-13T23:06:17.182 INFO:tasks.workunit.client.0.smithi115.stdout:2/885: unlink da/d23/d2c/cb2 0 2024-09-13T23:06:17.184 INFO:tasks.workunit.client.1.smithi152.stdout:2/236: rename d0/d4/d9/f42 to d0/d4/d9/d18/d1e/d3c/f58 0 2024-09-13T23:06:17.186 INFO:tasks.workunit.client.0.smithi115.stdout:4/828: symlink db/d19/d4e/lfd 0 2024-09-13T23:06:17.187 INFO:tasks.workunit.client.0.smithi115.stdout:4/829: truncate db/d11/d2e/d33/d36/d51/fbc 877087 0 2024-09-13T23:06:17.187 INFO:tasks.workunit.client.0.smithi115.stdout:4/830: dread - db/d11/d2e/d33/d36/d51/d57/f97 zero size 2024-09-13T23:06:17.187 INFO:tasks.workunit.client.0.smithi115.stdout:4/831: write db/d11/d2e/d33/d36/d51/d57/f8f [350593,125146] 0 2024-09-13T23:06:17.188 INFO:tasks.workunit.client.0.smithi115.stdout:5/816: truncate d8/dd/d6a/d82/f58 3763671 0 2024-09-13T23:06:17.192 INFO:tasks.workunit.client.0.smithi115.stdout:5/817: chown d8/dd/d20/f25 118630 1 2024-09-13T23:06:17.192 INFO:tasks.workunit.client.0.smithi115.stdout:2/886: rmdir da/d21/da8/dc4 0 2024-09-13T23:06:17.193 INFO:tasks.workunit.client.0.smithi115.stdout:2/887: stat da/d23/d2c/dc2/de1/f54 0 2024-09-13T23:06:17.193 INFO:tasks.workunit.client.0.smithi115.stdout:5/818: symlink d8/dd/d20/d23/lfc 0 2024-09-13T23:06:17.193 INFO:tasks.workunit.client.0.smithi115.stdout:5/819: stat d8/dd/d20/d23 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.0.smithi115.stdout:2/888: link c8 da/d23/d2c/dc2/de1/d56/d74/d10f/c125 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.0.smithi115.stdout:2/889: readlink da/d21/l79 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.0.smithi115.stdout:2/890: readlink da/d23/dd5/ldd 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/237: rename d0/d4/d9/d14/f20 to d0/d4/d9/d16/d30/f59 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/238: fdatasync d0/d4/d9/f4b 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/239: creat d0/d4/d9/d18/d32/f5a x:0 0 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/240: creat d0/d4/d9/d16/d30/f5b x:0 0 0 2024-09-13T23:06:17.194 INFO:tasks.workunit.client.1.smithi152.stdout:4/283: getdents d3/d4/d6/d8/d17 0 2024-09-13T23:06:17.195 INFO:tasks.workunit.client.1.smithi152.stdout:4/284: creat d3/f4f x:0 0 0 2024-09-13T23:06:17.195 INFO:tasks.workunit.client.1.smithi152.stdout:4/285: fsync d3/d4/d5/f49 0 2024-09-13T23:06:17.200 INFO:tasks.workunit.client.1.smithi152.stdout:4/286: rename d3/d4/c18 to d3/d4/d6/d8/d17/d39/c50 0 2024-09-13T23:06:17.204 INFO:tasks.workunit.client.0.smithi115.stdout:5/820: unlink d8/dd/d6a/d82/d63/f60 0 2024-09-13T23:06:17.204 INFO:tasks.workunit.client.0.smithi115.stdout:4/832: write db/f56 [2992233,122120] 0 2024-09-13T23:06:17.205 INFO:tasks.workunit.client.0.smithi115.stdout:6/909: sync 2024-09-13T23:06:17.205 INFO:tasks.workunit.client.0.smithi115.stdout:7/776: sync 2024-09-13T23:06:17.205 INFO:tasks.workunit.client.0.smithi115.stdout:1/746: sync 2024-09-13T23:06:17.207 INFO:tasks.workunit.client.0.smithi115.stdout:7/777: mkdir da/dd/d1c/d10f 0 2024-09-13T23:06:17.211 INFO:tasks.workunit.client.0.smithi115.stdout:4/833: creat db/d16/d3f/d66/d68/d71/d84/d96/de6/ffe x:0 0 0 2024-09-13T23:06:17.213 INFO:tasks.workunit.client.1.smithi152.stdout:9/191: dwrite d3/f17 [0,4194304] 0 2024-09-13T23:06:17.213 INFO:tasks.workunit.client.1.smithi152.stdout:8/113: rmdir d17 39 2024-09-13T23:06:17.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/192: mknod d3/d24/d34/d37/c3d 0 2024-09-13T23:06:17.215 INFO:tasks.workunit.client.1.smithi152.stdout:9/193: write d3/d24/d34/d37/f38 [4450071,96928] 0 2024-09-13T23:06:17.215 INFO:tasks.workunit.client.0.smithi115.stdout:9/776: dwrite d0/d13/d17/d1f/d4e/d61/d7d/fc7 [0,4194304] 0 2024-09-13T23:06:17.217 INFO:tasks.workunit.client.1.smithi152.stdout:8/114: mkdir d17/d25 0 2024-09-13T23:06:17.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/777: symlink d0/d13/d17/d1f/d4e/d61/d7d/d98/lfb 0 2024-09-13T23:06:17.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/194: link d3/d24/f36 d3/d1e/f3e 0 2024-09-13T23:06:17.222 INFO:tasks.workunit.client.0.smithi115.stdout:9/778: link d0/d43/d53/f59 d0/d43/df8/dd7/ffc 0 2024-09-13T23:06:17.223 INFO:tasks.workunit.client.1.smithi152.stdout:8/115: symlink d17/l26 0 2024-09-13T23:06:17.225 INFO:tasks.workunit.client.1.smithi152.stdout:6/181: dread d4/de/d1d/f37 [0,4194304] 0 2024-09-13T23:06:17.225 INFO:tasks.workunit.client.1.smithi152.stdout:6/182: chown d4/de/ff 587 1 2024-09-13T23:06:17.225 INFO:tasks.workunit.client.0.smithi115.stdout:9/779: rmdir d0/d13/d17/d1f/d28/d76 39 2024-09-13T23:06:17.228 INFO:tasks.workunit.client.0.smithi115.stdout:9/780: creat d0/d13/d17/ffd x:0 0 0 2024-09-13T23:06:17.228 INFO:tasks.workunit.client.0.smithi115.stdout:9/781: chown d0/d13/d17/d1f/d35/d62/l78 22398854 1 2024-09-13T23:06:17.228 INFO:tasks.workunit.client.1.smithi152.stdout:6/183: creat d4/f3b x:0 0 0 2024-09-13T23:06:17.229 INFO:tasks.workunit.client.0.smithi115.stdout:9/782: mkdir d0/d13/d17/d36/dfe 0 2024-09-13T23:06:17.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/184: mkdir d4/de/d12/d16/d2a/d38/d3c 0 2024-09-13T23:06:17.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/185: stat d4/de/c18 0 2024-09-13T23:06:17.232 INFO:tasks.workunit.client.0.smithi115.stdout:3/882: sync 2024-09-13T23:06:17.234 INFO:tasks.workunit.client.1.smithi152.stdout:6/186: write d4/de/d1d/f37 [940510,93621] 0 2024-09-13T23:06:17.236 INFO:tasks.workunit.client.0.smithi115.stdout:9/783: dread d0/d13/d17/d1f/d35/fb4 [0,4194304] 0 2024-09-13T23:06:17.236 INFO:tasks.workunit.client.0.smithi115.stdout:9/784: write d0/d13/d17/d1f/d28/ff2 [782885,10946] 0 2024-09-13T23:06:17.236 INFO:tasks.workunit.client.0.smithi115.stdout:9/785: chown d0/d13/d17/d19/f50 364 1 2024-09-13T23:06:17.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/786: mknod d0/d13/d17/d19/dc8/cff 0 2024-09-13T23:06:17.237 INFO:tasks.workunit.client.0.smithi115.stdout:9/787: write d0/d13/d17/d1f/d77/f93 [589492,63374] 0 2024-09-13T23:06:17.238 INFO:tasks.workunit.client.0.smithi115.stdout:9/788: readlink d0/d13/d17/d1f/d4e/lb1 0 2024-09-13T23:06:17.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/168: dwrite d5/da/f1b [0,4194304] 0 2024-09-13T23:06:17.248 INFO:tasks.workunit.client.0.smithi115.stdout:9/789: write d0/d13/d3b/f97 [493503,108615] 0 2024-09-13T23:06:17.249 INFO:tasks.workunit.client.1.smithi152.stdout:5/169: creat d5/dc/d19/d20/f32 x:0 0 0 2024-09-13T23:06:17.250 INFO:tasks.workunit.client.0.smithi115.stdout:9/790: rename d0/fe0 to d0/d13/d3b/d42/f100 0 2024-09-13T23:06:17.250 INFO:tasks.workunit.client.0.smithi115.stdout:9/791: write d0/d13/d17/d1f/d28/fbf [5333113,10248] 0 2024-09-13T23:06:17.252 INFO:tasks.workunit.client.0.smithi115.stdout:9/792: mknod d0/d13/d17/d1f/d4e/d61/d9b/c101 0 2024-09-13T23:06:17.252 INFO:tasks.workunit.client.0.smithi115.stdout:9/793: dread - d0/d13/d17/d1f/d4e/d90/fe5 zero size 2024-09-13T23:06:17.253 INFO:tasks.workunit.client.0.smithi115.stdout:9/794: mknod d0/d43/c102 0 2024-09-13T23:06:17.254 INFO:tasks.workunit.client.0.smithi115.stdout:9/795: rename d0/d13/ca5 to d0/d13/d17/dc5/c103 0 2024-09-13T23:06:17.254 INFO:tasks.workunit.client.0.smithi115.stdout:9/796: dread - d0/d13/d3b/fae zero size 2024-09-13T23:06:17.254 INFO:tasks.workunit.client.0.smithi115.stdout:9/797: write d0/d13/d17/d1f/d77/fad [677702,100040] 0 2024-09-13T23:06:17.255 INFO:tasks.workunit.client.0.smithi115.stdout:9/798: symlink d0/d13/d17/d19/l104 0 2024-09-13T23:06:17.255 INFO:tasks.workunit.client.0.smithi115.stdout:3/883: dread d3/d5/db/faf [0,4194304] 0 2024-09-13T23:06:17.256 INFO:tasks.workunit.client.0.smithi115.stdout:3/884: creat d3/d16/d1c/d101/d98/dbc/df7/f125 x:0 0 0 2024-09-13T23:06:17.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/241: dwrite d0/d4/f53 [0,4194304] 0 2024-09-13T23:06:17.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/242: read - d0/d4/d9/d16/d30/f5b zero size 2024-09-13T23:06:17.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/243: dread - d0/d4/d9/d14/d48/d4a/f56 zero size 2024-09-13T23:06:17.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/244: creat d0/d4/d9/d16/d30/f5c x:0 0 0 2024-09-13T23:06:17.265 INFO:tasks.workunit.client.1.smithi152.stdout:5/170: write f0 [3930117,29910] 0 2024-09-13T23:06:17.266 INFO:tasks.workunit.client.1.smithi152.stdout:7/233: dwrite f0 [0,4194304] 0 2024-09-13T23:06:17.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/245: symlink d0/d4/d9/d16/l5d 0 2024-09-13T23:06:17.267 INFO:tasks.workunit.client.1.smithi152.stdout:7/234: unlink d17/l18 0 2024-09-13T23:06:17.267 INFO:tasks.workunit.client.1.smithi152.stdout:7/235: truncate d17/d24/d2a/d2e/f32 1737801 0 2024-09-13T23:06:17.267 INFO:tasks.workunit.client.1.smithi152.stdout:7/236: chown c2 6776 1 2024-09-13T23:06:17.267 INFO:tasks.workunit.client.1.smithi152.stdout:5/171: truncate d5/dc/fe 351220 0 2024-09-13T23:06:17.268 INFO:tasks.workunit.client.1.smithi152.stdout:2/246: rename d0/d8/f22 to d0/d4/f5e 0 2024-09-13T23:06:17.269 INFO:tasks.workunit.client.0.smithi115.stdout:2/891: dwrite da/d23/d2c/fae [4194304,4194304] 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/287: dwrite d3/d4/d5/f49 [0,4194304] 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/288: fdatasync d3/d4/d6/d37/f44 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/289: chown d3/d4/d6/d8/d17/d39/c50 64465 1 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/290: readlink d3/lf 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/291: truncate d3/d4/d33/f48 607665 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:7/237: mkdir d17/d24/d2d/d51 0 2024-09-13T23:06:17.270 INFO:tasks.workunit.client.1.smithi152.stdout:7/238: read - d17/d24/d2a/d2b/f49 zero size 2024-09-13T23:06:17.271 INFO:tasks.workunit.client.0.smithi115.stdout:4/834: dwrite db/f10 [4194304,4194304] 0 2024-09-13T23:06:17.271 INFO:tasks.workunit.client.0.smithi115.stdout:2/892: write da/d23/d2c/dc2/de1/d56/d1a/f1d [4760561,362] 0 2024-09-13T23:06:17.271 INFO:tasks.workunit.client.1.smithi152.stdout:5/172: creat d5/d26/f33 x:0 0 0 2024-09-13T23:06:17.271 INFO:tasks.workunit.client.1.smithi152.stdout:5/173: read d5/f22 [564871,85720] 0 2024-09-13T23:06:17.271 INFO:tasks.workunit.client.1.smithi152.stdout:2/247: write d0/d4/d9/f25 [719873,67786] 0 2024-09-13T23:06:17.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/239: rename f13 to d17/d4f/f52 0 2024-09-13T23:06:17.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/240: write d17/d24/d2a/d2b/f3a [330459,81128] 0 2024-09-13T23:06:17.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/241: stat d17/d24/d2a/d2b/f3a 0 2024-09-13T23:06:17.276 INFO:tasks.workunit.client.0.smithi115.stdout:6/910: dwrite d4/d57/dab/fb7 [0,4194304] 0 2024-09-13T23:06:17.276 INFO:tasks.workunit.client.1.smithi152.stdout:5/174: creat d5/dc/d19/d20/d2e/f34 x:0 0 0 2024-09-13T23:06:17.276 INFO:tasks.workunit.client.1.smithi152.stdout:9/195: dwrite d3/d24/f36 [0,4194304] 0 2024-09-13T23:06:17.277 INFO:tasks.workunit.client.0.smithi115.stdout:5/821: dwrite d8/dd/d6a/d82/d63/dd6/f37 [0,4194304] 0 2024-09-13T23:06:17.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/187: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:17.277 INFO:tasks.workunit.client.1.smithi152.stdout:2/248: rename d0/d4/d9/d16/d30/f5b to d0/d4/d9/d55/f5f 0 2024-09-13T23:06:17.278 INFO:tasks.workunit.client.1.smithi152.stdout:2/249: creat d0/d4/d9/d16/d2b/f60 x:0 0 0 2024-09-13T23:06:17.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/835: dread db/d16/d3f/d66/d68/d71/d84/f88 [0,4194304] 0 2024-09-13T23:06:17.280 INFO:tasks.workunit.client.0.smithi115.stdout:6/911: symlink d4/df/d14/d38/d2a/d3e/d56/dff/l132 0 2024-09-13T23:06:17.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/836: read - db/d16/d3f/d66/da6/fe4 zero size 2024-09-13T23:06:17.280 INFO:tasks.workunit.client.0.smithi115.stdout:6/912: readlink d4/df/d14/d38/d44/d66/l91 0 2024-09-13T23:06:17.280 INFO:tasks.workunit.client.0.smithi115.stdout:4/837: write db/d16/d3f/d66/da6/fc4 [417810,82120] 0 2024-09-13T23:06:17.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/242: link d17/f1c d17/d24/d2a/d2e/d30/f53 0 2024-09-13T23:06:17.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/243: creat d17/d24/d2a/f54 x:0 0 0 2024-09-13T23:06:17.282 INFO:tasks.workunit.client.0.smithi115.stdout:2/893: dread da/fde [0,4194304] 0 2024-09-13T23:06:17.282 INFO:tasks.workunit.client.0.smithi115.stdout:5/822: unlink d8/dd/d20/d4a/c8c 0 2024-09-13T23:06:17.283 INFO:tasks.workunit.client.1.smithi152.stdout:5/175: mkdir d5/dc/d35 0 2024-09-13T23:06:17.283 INFO:tasks.workunit.client.1.smithi152.stdout:5/176: stat d5/f14 0 2024-09-13T23:06:17.285 INFO:tasks.workunit.client.1.smithi152.stdout:6/188: dread d4/de/d12/d16/d2a/f2d [0,4194304] 0 2024-09-13T23:06:17.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/799: dwrite d0/d13/d3b/d42/d95/fd8 [0,4194304] 0 2024-09-13T23:06:17.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/800: stat d0/d13/d17/d1f/d4e/d61/d9b/lec 0 2024-09-13T23:06:17.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/801: write d0/d13/d17/d1f/d4e/fd4 [85729,13210] 0 2024-09-13T23:06:17.288 INFO:tasks.workunit.client.0.smithi115.stdout:6/913: dread d4/d57/d5a/fde [0,4194304] 0 2024-09-13T23:06:17.289 INFO:tasks.workunit.client.0.smithi115.stdout:2/894: rmdir da/d21/d8c/d41/d69 39 2024-09-13T23:06:17.289 INFO:tasks.workunit.client.0.smithi115.stdout:2/895: chown da/d21/d8c/d41/d69 1 1 2024-09-13T23:06:17.291 INFO:tasks.workunit.client.0.smithi115.stdout:5/823: creat d8/dd/d20/d27/da9/ffd x:0 0 0 2024-09-13T23:06:17.291 INFO:tasks.workunit.client.0.smithi115.stdout:5/824: read d8/dd/d6a/d82/d63/dd6/f77 [3090557,39300] 0 2024-09-13T23:06:17.291 INFO:tasks.workunit.client.0.smithi115.stdout:5/825: creat d8/dd/d4c/ffe x:0 0 0 2024-09-13T23:06:17.291 INFO:tasks.workunit.client.0.smithi115.stdout:5/826: fdatasync d8/d9e/dcd/ff9 0 2024-09-13T23:06:17.292 INFO:tasks.workunit.client.0.smithi115.stdout:5/827: chown d8/dd/d5d 2081521 1 2024-09-13T23:06:17.292 INFO:tasks.workunit.client.1.smithi152.stdout:9/196: mknod d3/d1e/c3f 0 2024-09-13T23:06:17.295 INFO:tasks.workunit.client.0.smithi115.stdout:9/802: creat d0/d13/d17/d1f/d4e/de9/f105 x:0 0 0 2024-09-13T23:06:17.295 INFO:tasks.workunit.client.0.smithi115.stdout:4/838: dread db/d19/d1d/f8d [0,4194304] 0 2024-09-13T23:06:17.295 INFO:tasks.workunit.client.0.smithi115.stdout:4/839: write db/d11/d2e/d33/d36/fe7 [644527,96035] 0 2024-09-13T23:06:17.297 INFO:tasks.workunit.client.0.smithi115.stdout:6/914: mkdir d4/df/d14/d38/d2a/d31/d133 0 2024-09-13T23:06:17.297 INFO:tasks.workunit.client.0.smithi115.stdout:2/896: rmdir da/d21/da8/dbc 39 2024-09-13T23:06:17.298 INFO:tasks.workunit.client.0.smithi115.stdout:6/915: dread d4/d57/d5a/d79/fdc [0,4194304] 0 2024-09-13T23:06:17.298 INFO:tasks.workunit.client.1.smithi152.stdout:2/250: symlink d0/d4/d9/d18/d1e/l61 0 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: mgrmap e23: smithi152.ntylos(active, since 2s) 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: [13/Sep/2024:23:06:16] ENGINE Bus STARTING 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: [13/Sep/2024:23:06:16] ENGINE Serving on http://172.21.15.152:8765 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: [13/Sep/2024:23:06:16] ENGINE Serving on https://172.21.15.152:7150 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: [13/Sep/2024:23:06:16] ENGINE Bus STARTED 2024-09-13T23:06:17.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:17 smithi115 ceph-mon[27601]: [13/Sep/2024:23:06:16] ENGINE Error in HTTPServer.serve 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:06:17.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T23:06:17.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:06:17.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T23:06:17.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:06:17.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T23:06:17.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:06:17.301 INFO:tasks.workunit.client.1.smithi152.stdout:7/244: getdents d17/d24/d2a/d2b/d4b 0 2024-09-13T23:06:17.301 INFO:tasks.workunit.client.1.smithi152.stdout:6/189: mkdir d4/de/d12/d16/d2a/d3d 0 2024-09-13T23:06:17.301 INFO:tasks.workunit.client.1.smithi152.stdout:6/190: stat d4/c25 0 2024-09-13T23:06:17.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/251: mkdir d0/d4/d9/d18/d1e/d3c/d4d/d62 0 2024-09-13T23:06:17.303 INFO:tasks.workunit.client.1.smithi152.stdout:6/191: mkdir d4/de/d12/d3e 0 2024-09-13T23:06:17.304 INFO:tasks.workunit.client.0.smithi115.stdout:4/840: dread db/d11/d2e/f1f [0,4194304] 0 2024-09-13T23:06:17.307 INFO:tasks.workunit.client.0.smithi115.stdout:2/897: unlink da/d21/f33 0 2024-09-13T23:06:17.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/916: creat d4/df/d14/d76/f134 x:0 0 0 2024-09-13T23:06:17.307 INFO:tasks.workunit.client.0.smithi115.stdout:6/917: chown d4/df/d14/d76/f134 17 1 2024-09-13T23:06:17.307 INFO:tasks.workunit.client.1.smithi152.stdout:9/197: read d3/d1e/f3c [2289130,71212] 0 2024-09-13T23:06:17.307 INFO:tasks.workunit.client.1.smithi152.stdout:9/198: write d3/d1e/f33 [43061,38150] 0 2024-09-13T23:06:17.308 INFO:tasks.workunit.client.1.smithi152.stdout:9/199: chown d3/f28 7295 1 2024-09-13T23:06:17.309 INFO:tasks.workunit.client.0.smithi115.stdout:9/803: getdents d0/d13/d17/d1f/d28 0 2024-09-13T23:06:17.311 INFO:tasks.workunit.client.1.smithi152.stdout:9/200: unlink d3/d1e/f2b 0 2024-09-13T23:06:17.311 INFO:tasks.workunit.client.1.smithi152.stdout:9/201: read d3/f9 [1416397,31937] 0 2024-09-13T23:06:17.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/202: chown d3/c7 23767 1 2024-09-13T23:06:17.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/203: chown d3/d24/l26 6190 1 2024-09-13T23:06:17.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/841: mkdir db/d11/d54/d17/dd1/dd8/dff 0 2024-09-13T23:06:17.312 INFO:tasks.workunit.client.0.smithi115.stdout:4/842: write db/d16/d3f/d66/da6/fe4 [196090,16843] 0 2024-09-13T23:06:17.313 INFO:tasks.workunit.client.1.smithi152.stdout:5/177: dwrite d5/f7 [0,4194304] 0 2024-09-13T23:06:17.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/804: creat d0/d43/f106 x:0 0 0 2024-09-13T23:06:17.315 INFO:tasks.workunit.client.0.smithi115.stdout:9/805: chown d0/d13/d3b/d42/cc0 24336924 1 2024-09-13T23:06:17.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/245: read d17/d24/f3c [351919,116663] 0 2024-09-13T23:06:17.316 INFO:tasks.workunit.client.0.smithi115.stdout:4/843: rmdir db/d19/d1d 39 2024-09-13T23:06:17.318 INFO:tasks.workunit.client.0.smithi115.stdout:2/898: rmdir da/d21/da8/df5 39 2024-09-13T23:06:17.318 INFO:tasks.workunit.client.1.smithi152.stdout:5/178: mknod d5/d26/c36 0 2024-09-13T23:06:17.319 INFO:tasks.workunit.client.0.smithi115.stdout:9/806: mkdir d0/d13/d17/d1f/d28/d76/d81/d107 0 2024-09-13T23:06:17.319 INFO:tasks.workunit.client.0.smithi115.stdout:9/807: write d0/d13/d17/d36/f8d [1377178,54967] 0 2024-09-13T23:06:17.320 INFO:tasks.workunit.client.0.smithi115.stdout:4/844: stat db/d16/d3f/d66/d68/cd2 0 2024-09-13T23:06:17.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/179: symlink d5/dc/d19/d20/d2e/d28/l37 0 2024-09-13T23:06:17.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/180: fsync d5/d26/f33 0 2024-09-13T23:06:17.321 INFO:tasks.workunit.client.0.smithi115.stdout:2/899: mkdir da/d21/da8/d126 0 2024-09-13T23:06:17.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/252: dread d0/d4/d9/f10 [0,4194304] 0 2024-09-13T23:06:17.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/253: dread - d0/d4/d9/d16/d2b/f50 zero size 2024-09-13T23:06:17.322 INFO:tasks.workunit.client.0.smithi115.stdout:6/918: read d4/df/d14/d38/d2a/d3e/d56/dc4/f100 [2573797,116726] 0 2024-09-13T23:06:17.322 INFO:tasks.workunit.client.0.smithi115.stdout:5/828: dwrite d8/dd/d64/fa7 [4194304,4194304] 0 2024-09-13T23:06:17.322 INFO:tasks.workunit.client.0.smithi115.stdout:9/808: link d0/d13/d17/d1f/d4e/d61/d7d/fc7 d0/d13/d17/d1f/d4e/d90/f108 0 2024-09-13T23:06:17.323 INFO:tasks.workunit.client.1.smithi152.stdout:6/192: dwrite d4/de/d1d/f32 [0,4194304] 0 2024-09-13T23:06:17.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/181: symlink d5/dc/d19/d20/d2e/d27/l38 0 2024-09-13T23:06:17.324 INFO:tasks.workunit.client.0.smithi115.stdout:4/845: unlink db/d11/d2e/f1f 0 2024-09-13T23:06:17.324 INFO:tasks.workunit.client.0.smithi115.stdout:4/846: truncate db/d16/d3f/d66/d68/d6a/f82 683634 0 2024-09-13T23:06:17.325 INFO:tasks.workunit.client.1.smithi152.stdout:2/254: creat d0/d4/d9/f63 x:0 0 0 2024-09-13T23:06:17.328 INFO:tasks.workunit.client.0.smithi115.stdout:4/847: dread db/d16/d3f/d66/da6/fc4 [0,4194304] 0 2024-09-13T23:06:17.328 INFO:tasks.workunit.client.0.smithi115.stdout:9/809: creat d0/d13/d17/d1f/d28/d76/d81/f109 x:0 0 0 2024-09-13T23:06:17.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/193: creat d4/de/d12/d16/f3f x:0 0 0 2024-09-13T23:06:17.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/194: chown d4/c17 277 1 2024-09-13T23:06:17.329 INFO:tasks.workunit.client.1.smithi152.stdout:5/182: mknod d5/dc/d19/d20/d2e/d27/c39 0 2024-09-13T23:06:17.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/183: chown c4 21 1 2024-09-13T23:06:17.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/184: chown d5/d26/f33 53257582 1 2024-09-13T23:06:17.331 INFO:tasks.workunit.client.1.smithi152.stdout:5/185: symlink d5/dc/d35/l3a 0 2024-09-13T23:06:17.332 INFO:tasks.workunit.client.1.smithi152.stdout:5/186: rename d5/dc/d19/d20/d2e/d28/c29 to d5/dc/d19/d20/d2e/d27/c3b 0 2024-09-13T23:06:17.333 INFO:tasks.workunit.client.1.smithi152.stdout:5/187: rename d5/c1e to d5/dc/d19/d20/d2e/c3c 0 2024-09-13T23:06:17.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/188: creat d5/da/f3d x:0 0 0 2024-09-13T23:06:17.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/189: truncate d5/dc/d19/d20/d2e/f34 658832 0 2024-09-13T23:06:17.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/190: chown d5/dc/d19/f1a 7359 1 2024-09-13T23:06:17.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/191: write d5/dc/d19/d20/d2e/f34 [732814,111089] 0 2024-09-13T23:06:17.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/204: dwrite d3/f9 [4194304,4194304] 0 2024-09-13T23:06:17.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/192: symlink d5/dc/d35/l3e 0 2024-09-13T23:06:17.338 INFO:tasks.workunit.client.1.smithi152.stdout:2/255: dread d0/d4/d9/d16/d2b/f3b [0,4194304] 0 2024-09-13T23:06:17.338 INFO:tasks.workunit.client.0.smithi115.stdout:4/848: mknod db/d16/d3f/d66/c100 0 2024-09-13T23:06:17.339 INFO:tasks.workunit.client.0.smithi115.stdout:9/810: mknod d0/d13/d17/d36/dd1/c10a 0 2024-09-13T23:06:17.339 INFO:tasks.workunit.client.1.smithi152.stdout:9/205: creat d3/d24/d34/f40 x:0 0 0 2024-09-13T23:06:17.339 INFO:tasks.workunit.client.1.smithi152.stdout:9/206: creat d3/d24/f41 x:0 0 0 2024-09-13T23:06:17.345 INFO:tasks.workunit.client.1.smithi152.stdout:2/256: symlink d0/d4/d9/d14/d48/d4a/l64 0 2024-09-13T23:06:17.345 INFO:tasks.workunit.client.1.smithi152.stdout:2/257: chown d0/d8/l4e 426 1 2024-09-13T23:06:17.345 INFO:tasks.workunit.client.1.smithi152.stdout:2/258: read - d0/d4/d9/d16/d30/f5c zero size 2024-09-13T23:06:17.345 INFO:tasks.workunit.client.1.smithi152.stdout:2/259: getdents d0/d4/d9/d14/d48 0 2024-09-13T23:06:17.345 INFO:tasks.workunit.client.1.smithi152.stdout:2/260: creat d0/d4/d9/d18/d32/f65 x:0 0 0 2024-09-13T23:06:17.346 INFO:tasks.workunit.client.0.smithi115.stdout:6/919: getdents d4/df/d14/d38/d2a/d31 0 2024-09-13T23:06:17.346 INFO:tasks.workunit.client.0.smithi115.stdout:6/920: mkdir d4/df/d14/d135 0 2024-09-13T23:06:17.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/176: sync 2024-09-13T23:06:17.346 INFO:tasks.workunit.client.1.smithi152.stdout:6/195: dwrite d4/de/d1d/f23 [0,4194304] 0 2024-09-13T23:06:17.349 INFO:tasks.workunit.client.1.smithi152.stdout:2/261: dread d0/d4/d9/d16/d2b/f3b [0,4194304] 0 2024-09-13T23:06:17.354 INFO:tasks.workunit.client.1.smithi152.stdout:2/262: mknod d0/c66 0 2024-09-13T23:06:17.356 INFO:tasks.workunit.client.1.smithi152.stdout:2/263: mknod d0/d4/d9/d18/d1e/d3c/d4d/c67 0 2024-09-13T23:06:17.356 INFO:tasks.workunit.client.1.smithi152.stdout:2/264: write d0/d4/d9/d16/d2b/f50 [179006,57413] 0 2024-09-13T23:06:17.358 INFO:tasks.workunit.client.1.smithi152.stdout:2/265: rmdir d0/d4/d9/d18/d1e/d3c/d4d/d62 0 2024-09-13T23:06:17.359 INFO:tasks.workunit.client.1.smithi152.stdout:2/266: stat d0/d8/l4e 0 2024-09-13T23:06:17.360 INFO:tasks.workunit.client.1.smithi152.stdout:2/267: rename d0/d4/d9/d14/d48/l54 to d0/d4/d9/d18/l68 0 2024-09-13T23:06:17.360 INFO:tasks.workunit.client.1.smithi152.stdout:2/268: fdatasync d0/d4/d9/d18/d1e/d3c/f58 0 2024-09-13T23:06:17.380 INFO:tasks.workunit.client.1.smithi152.stdout:9/207: dwrite d3/d1e/f21 [0,4194304] 0 2024-09-13T23:06:17.380 INFO:tasks.workunit.client.1.smithi152.stdout:1/177: dwrite d4/d9/f13 [4194304,4194304] 0 2024-09-13T23:06:17.380 INFO:tasks.workunit.client.1.smithi152.stdout:9/208: creat d3/d1e/d30/f42 x:0 0 0 2024-09-13T23:06:17.380 INFO:tasks.workunit.client.1.smithi152.stdout:6/196: dwrite d4/de/d12/f20 [0,4194304] 0 2024-09-13T23:06:17.381 INFO:tasks.workunit.client.0.smithi115.stdout:9/811: dwrite d0/d13/fdc [0,4194304] 0 2024-09-13T23:06:17.381 INFO:tasks.workunit.client.0.smithi115.stdout:9/812: chown d0/d43/c47 983649 1 2024-09-13T23:06:17.382 INFO:tasks.workunit.client.0.smithi115.stdout:9/813: mkdir d0/d13/d17/d19/dc8/d10b 0 2024-09-13T23:06:17.382 INFO:tasks.workunit.client.1.smithi152.stdout:1/178: link d4/d9/d1a/f19 d4/f32 0 2024-09-13T23:06:17.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/179: fdatasync d4/d9/d1a/f2f 0 2024-09-13T23:06:17.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/209: link d3/l35 d3/d24/d34/d37/l43 0 2024-09-13T23:06:17.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/210: symlink d3/d24/l44 0 2024-09-13T23:06:17.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/211: mkdir d3/d24/d34/d45 0 2024-09-13T23:06:17.393 INFO:tasks.workunit.client.1.smithi152.stdout:9/212: mknod d3/d24/d34/d37/c46 0 2024-09-13T23:06:17.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/197: dwrite d4/de/d21/f24 [0,4194304] 0 2024-09-13T23:06:17.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/198: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:17.425 INFO:tasks.workunit.client.1.smithi152.stdout:6/199: dwrite d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:17.426 INFO:tasks.workunit.client.1.smithi152.stdout:6/200: mknod d4/de/d12/d16/c40 0 2024-09-13T23:06:17.428 INFO:tasks.workunit.client.1.smithi152.stdout:6/201: dread d4/de/d21/f14 [0,4194304] 0 2024-09-13T23:06:17.429 INFO:tasks.workunit.client.1.smithi152.stdout:6/202: symlink d4/de/d12/d16/l41 0 2024-09-13T23:06:17.436 INFO:tasks.workunit.client.1.smithi152.stdout:6/203: dread d4/de/d21/f24 [0,4194304] 0 2024-09-13T23:06:17.436 INFO:tasks.workunit.client.1.smithi152.stdout:6/204: write d4/de/d21/f1f [4807931,119185] 0 2024-09-13T23:06:17.436 INFO:tasks.workunit.client.1.smithi152.stdout:6/205: fdatasync d4/de/f39 0 2024-09-13T23:06:17.436 INFO:tasks.workunit.client.1.smithi152.stdout:6/206: chown d4/de/d12/d16/f3f 523 1 2024-09-13T23:06:17.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/207: fsync d4/de/d12/f1a 0 2024-09-13T23:06:17.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/208: truncate d4/de/d1d/f23 1816266 0 2024-09-13T23:06:17.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/209: creat d4/de/d12/d16/d2a/d38/f42 x:0 0 0 2024-09-13T23:06:17.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/210: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:17.459 INFO:tasks.workunit.client.1.smithi152.stdout:6/211: getdents d4/de/d12/d3e 0 2024-09-13T23:06:17.459 INFO:tasks.workunit.client.1.smithi152.stdout:6/212: write d4/de/f39 [776388,101770] 0 2024-09-13T23:06:17.459 INFO:tasks.workunit.client.0.smithi115.stdout:9/814: dwrite d0/d13/d17/d36/d80/fe6 [4194304,4194304] 0 2024-09-13T23:06:17.460 INFO:tasks.workunit.client.1.smithi152.stdout:1/180: dwrite d4/d9/f14 [0,4194304] 0 2024-09-13T23:06:17.460 INFO:tasks.workunit.client.1.smithi152.stdout:6/213: symlink d4/de/l43 0 2024-09-13T23:06:17.460 INFO:tasks.workunit.client.1.smithi152.stdout:1/181: creat d4/d9/d1a/f33 x:0 0 0 2024-09-13T23:06:17.462 INFO:tasks.workunit.client.0.smithi115.stdout:9/815: rename d0/d13/d17/d19/f1d to d0/d13/d17/d19/dc8/f10c 0 2024-09-13T23:06:17.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/214: symlink d4/l44 0 2024-09-13T23:06:17.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/215: write d4/de/d12/d16/d2a/d38/f42 [483149,124733] 0 2024-09-13T23:06:17.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/216: write d4/de/d12/f1a [460089,42275] 0 2024-09-13T23:06:17.465 INFO:tasks.workunit.client.1.smithi152.stdout:1/182: mknod d4/c34 0 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: mgrmap e23: smithi152.ntylos(active, since 2s) 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: [13/Sep/2024:23:06:16] ENGINE Bus STARTING 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: [13/Sep/2024:23:06:16] ENGINE Serving on http://172.21.15.152:8765 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: [13/Sep/2024:23:06:16] ENGINE Serving on https://172.21.15.152:7150 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: [13/Sep/2024:23:06:16] ENGINE Bus STARTED 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:17 smithi152 ceph-mon[34465]: [13/Sep/2024:23:06:16] ENGINE Error in HTTPServer.serve 2024-09-13T23:06:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-13T23:06:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:06:17.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-13T23:06:17.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:06:17.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-13T23:06:17.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:06:17.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/816: read d0/d13/d17/d1f/f45 [256052,54689] 0 2024-09-13T23:06:17.472 INFO:tasks.workunit.client.0.smithi115.stdout:9/817: stat d0/d13/d17/d1f/d28/c4f 0 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/228: sync 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/116: sync 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/229: fdatasync de/f39 0 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/230: chown de/d14/d38/d27/f2b 25385 1 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:0/173: sync 2024-09-13T23:06:17.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/117: symlink d17/d23/l27 0 2024-09-13T23:06:17.474 INFO:tasks.workunit.client.1.smithi152.stdout:0/174: creat d18/d1f/d33/f36 x:0 0 0 2024-09-13T23:06:17.474 INFO:tasks.workunit.client.1.smithi152.stdout:6/217: dread d4/de/d1d/f32 [0,4194304] 0 2024-09-13T23:06:17.475 INFO:tasks.workunit.client.1.smithi152.stdout:8/118: creat d17/d19/f28 x:0 0 0 2024-09-13T23:06:17.475 INFO:tasks.workunit.client.1.smithi152.stdout:8/119: getdents d17/d25 0 2024-09-13T23:06:17.475 INFO:tasks.workunit.client.0.smithi115.stdout:9/818: rename d0/d43/df8/dd7 to d0/d13/d17/d1f/d28/d76/d81/d10d 0 2024-09-13T23:06:17.476 INFO:tasks.workunit.client.1.smithi152.stdout:0/175: symlink d18/d19/l37 0 2024-09-13T23:06:17.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/218: rename d4/de/f31 to d4/de/d12/d16/d2a/d38/d3c/f45 0 2024-09-13T23:06:17.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/219: truncate d4/f3b 609286 0 2024-09-13T23:06:17.478 INFO:tasks.workunit.client.1.smithi152.stdout:0/176: symlink d18/d1f/d29/d2f/l38 0 2024-09-13T23:06:17.479 INFO:tasks.workunit.client.1.smithi152.stdout:0/177: mkdir d18/d1f/d39 0 2024-09-13T23:06:17.480 INFO:tasks.workunit.client.1.smithi152.stdout:0/178: chown d18/d19/l2e 201281655 1 2024-09-13T23:06:17.480 INFO:tasks.workunit.client.1.smithi152.stdout:0/179: write d18/d1f/f20 [734174,58721] 0 2024-09-13T23:06:17.481 INFO:tasks.workunit.client.0.smithi115.stdout:9/819: dread d0/d13/d17/d1f/d77/f93 [0,4194304] 0 2024-09-13T23:06:17.486 INFO:tasks.workunit.client.1.smithi152.stdout:1/183: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:17.486 INFO:tasks.workunit.client.1.smithi152.stdout:1/184: creat d4/d9/d1a/d22/f35 x:0 0 0 2024-09-13T23:06:17.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/185: symlink d4/d9/d1a/d22/l36 0 2024-09-13T23:06:17.491 INFO:tasks.workunit.client.1.smithi152.stdout:1/186: mknod d4/d9/d1a/d22/c37 0 2024-09-13T23:06:17.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/187: symlink d4/d9/d1a/d22/d24/l38 0 2024-09-13T23:06:17.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/188: write d4/d9/d1a/f2e [826485,31536] 0 2024-09-13T23:06:17.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/189: chown d4/f6 113800304 1 2024-09-13T23:06:17.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/190: symlink d4/d9/d1a/l39 0 2024-09-13T23:06:17.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/191: unlink d4/d9/d1a/f2f 0 2024-09-13T23:06:17.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/231: dwrite de/f1c [0,4194304] 0 2024-09-13T23:06:17.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/232: chown de/d14/d38/l18 7 1 2024-09-13T23:06:17.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/233: read - de/d14/d38/d27/f41 zero size 2024-09-13T23:06:17.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/234: chown de/d14/d38/f1a 85386909 1 2024-09-13T23:06:17.506 INFO:tasks.workunit.client.1.smithi152.stdout:3/235: symlink de/d14/l59 0 2024-09-13T23:06:17.507 INFO:tasks.workunit.client.1.smithi152.stdout:3/236: rename de/d14/d38/l18 to de/d14/d38/d27/l5a 0 2024-09-13T23:06:17.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/237: write de/d1f/f36 [778347,95584] 0 2024-09-13T23:06:17.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/238: write de/d14/d38/f1a [1112054,43924] 0 2024-09-13T23:06:17.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/239: write de/d14/f4d [230884,15837] 0 2024-09-13T23:06:17.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/240: readlink de/d14/l59 0 2024-09-13T23:06:17.509 INFO:tasks.workunit.client.1.smithi152.stdout:3/241: rename de/d14/f43 to de/d14/f5b 0 2024-09-13T23:06:17.509 INFO:tasks.workunit.client.1.smithi152.stdout:3/242: readlink de/d14/l59 0 2024-09-13T23:06:17.509 INFO:tasks.workunit.client.1.smithi152.stdout:3/243: write de/f39 [948671,11939] 0 2024-09-13T23:06:17.515 INFO:tasks.workunit.client.0.smithi115.stdout:9/820: dwrite d0/d13/d17/d1f/d28/d76/d81/dd0/fd2 [0,4194304] 0 2024-09-13T23:06:17.515 INFO:tasks.workunit.client.0.smithi115.stdout:9/821: chown d0/d13/d17/d36/dd1/c10a 76475365 1 2024-09-13T23:06:17.516 INFO:tasks.workunit.client.1.smithi152.stdout:1/192: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:17.516 INFO:tasks.workunit.client.1.smithi152.stdout:1/193: symlink d4/d9/d1a/d22/d24/l3a 0 2024-09-13T23:06:17.517 INFO:tasks.workunit.client.1.smithi152.stdout:6/220: dwrite d4/de/f2c [0,4194304] 0 2024-09-13T23:06:17.519 INFO:tasks.workunit.client.0.smithi115.stdout:9/822: rename d0/d13/d17/d1f/d67 to d0/d13/d17/d36/d80/d10e 0 2024-09-13T23:06:17.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/194: link f1 d4/d9/d1a/d22/f3b 0 2024-09-13T23:06:17.520 INFO:tasks.workunit.client.1.smithi152.stdout:3/244: read de/d14/d38/f28 [3213856,39704] 0 2024-09-13T23:06:17.522 INFO:tasks.workunit.client.0.smithi115.stdout:8/946: sync 2024-09-13T23:06:17.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/747: sync 2024-09-13T23:06:17.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/748: creat d0/de/d1b/ff1 x:0 0 0 2024-09-13T23:06:17.522 INFO:tasks.workunit.client.0.smithi115.stdout:0/738: sync 2024-09-13T23:06:17.528 INFO:tasks.workunit.client.0.smithi115.stdout:0/739: rename d6/f9 to d6/d24/d25/da3/f102 0 2024-09-13T23:06:17.528 INFO:tasks.workunit.client.0.smithi115.stdout:1/749: mknod d0/de/d66/d8f/d29/cf2 0 2024-09-13T23:06:17.530 INFO:tasks.workunit.client.1.smithi152.stdout:1/195: write d4/f7 [378902,7578] 0 2024-09-13T23:06:17.531 INFO:tasks.workunit.client.1.smithi152.stdout:1/196: dread - d4/d9/d1a/d22/f35 zero size 2024-09-13T23:06:17.531 INFO:tasks.workunit.client.0.smithi115.stdout:1/750: stat d0/de/d66/d8f/l9b 0 2024-09-13T23:06:17.531 INFO:tasks.workunit.client.0.smithi115.stdout:1/751: stat d0/de/d1b/d25/d4d/d51/d23/d65 0 2024-09-13T23:06:17.531 INFO:tasks.workunit.client.0.smithi115.stdout:1/752: write d0/de/d66/d8f/dad/ddb/de5/f9a [1810858,87882] 0 2024-09-13T23:06:17.533 INFO:tasks.workunit.client.0.smithi115.stdout:8/947: write d3/d5/dc/d23/d4e/d54/d7f/de9/fd5 [2045026,72387] 0 2024-09-13T23:06:17.560 INFO:tasks.workunit.client.1.smithi152.stdout:6/221: dwrite d4/de/f2c [4194304,4194304] 0 2024-09-13T23:06:17.561 INFO:tasks.workunit.client.0.smithi115.stdout:9/823: dwrite d0/d13/d17/d1f/d4e/d61/d7d/d98/fcc [0,4194304] 0 2024-09-13T23:06:17.561 INFO:tasks.workunit.client.0.smithi115.stdout:9/824: dread - d0/d13/d17/d1f/d28/d76/d81/f109 zero size 2024-09-13T23:06:17.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/825: dread d0/d13/d17/d1f/d77/f93 [0,4194304] 0 2024-09-13T23:06:17.562 INFO:tasks.workunit.client.0.smithi115.stdout:9/826: chown d0/d13/d17/d1f/d35/l8c 264249420 1 2024-09-13T23:06:17.563 INFO:tasks.workunit.client.0.smithi115.stdout:9/827: truncate d0/d13/d17/d36/f8d 1934723 0 2024-09-13T23:06:17.563 INFO:tasks.workunit.client.1.smithi152.stdout:6/222: symlink d4/de/d12/d16/d2a/d38/d3c/l46 0 2024-09-13T23:06:17.564 INFO:tasks.workunit.client.0.smithi115.stdout:9/828: mkdir d0/d13/d17/d1f/d4e/d90/d10f 0 2024-09-13T23:06:17.565 INFO:tasks.workunit.client.0.smithi115.stdout:9/829: mknod d0/d13/d3b/d42/c110 0 2024-09-13T23:06:17.571 INFO:tasks.workunit.client.0.smithi115.stdout:8/948: dwrite d3/d5/dc/d23/fca [0,4194304] 0 2024-09-13T23:06:17.571 INFO:tasks.workunit.client.0.smithi115.stdout:8/949: chown d3/d5/dc/d16/d1f/d28/d3e/d128 5011 1 2024-09-13T23:06:17.572 INFO:tasks.workunit.client.0.smithi115.stdout:8/950: chown d3/d5/dc/d16/d1f/d28/dc0/dcd/c12b 33147 1 2024-09-13T23:06:17.574 INFO:tasks.workunit.client.0.smithi115.stdout:1/753: dwrite d0/de/d66/d8f/f61 [0,4194304] 0 2024-09-13T23:06:17.574 INFO:tasks.workunit.client.0.smithi115.stdout:0/740: dwrite d6/d24/fc6 [0,4194304] 0 2024-09-13T23:06:17.575 INFO:tasks.workunit.client.0.smithi115.stdout:8/951: symlink d3/d5/dc/d16/d1f/d27/d68/dfc/d137/l151 0 2024-09-13T23:06:17.576 INFO:tasks.workunit.client.1.smithi152.stdout:1/197: dwrite d4/d9/f13 [0,4194304] 0 2024-09-13T23:06:17.579 INFO:tasks.workunit.client.0.smithi115.stdout:1/754: getdents d0/de 0 2024-09-13T23:06:17.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/198: dread d4/f28 [0,4194304] 0 2024-09-13T23:06:17.582 INFO:tasks.workunit.client.1.smithi152.stdout:1/199: readlink d4/d9/l25 0 2024-09-13T23:06:17.583 INFO:tasks.workunit.client.0.smithi115.stdout:1/755: creat d0/de/d1b/d25/d4d/db9/ff3 x:0 0 0 2024-09-13T23:06:17.583 INFO:tasks.workunit.client.1.smithi152.stdout:4/292: sync 2024-09-13T23:06:17.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/200: mknod d4/d9/d1a/d22/c3c 0 2024-09-13T23:06:17.585 INFO:tasks.workunit.client.0.smithi115.stdout:1/756: readlink d0/de/d66/d8f/l2b 0 2024-09-13T23:06:17.585 INFO:tasks.workunit.client.0.smithi115.stdout:1/757: chown d0/de/d1b/d25/d4d/d51/l45 0 1 2024-09-13T23:06:17.588 INFO:tasks.workunit.client.0.smithi115.stdout:0/741: rename d6/da5 to d6/d24/d25/d2b/d103 0 2024-09-13T23:06:17.590 INFO:tasks.workunit.client.0.smithi115.stdout:0/742: symlink d6/da0/l104 0 2024-09-13T23:06:17.590 INFO:tasks.workunit.client.0.smithi115.stdout:0/743: chown d6/d24/d25/da3/dad/de4/df7 179 1 2024-09-13T23:06:17.593 INFO:tasks.workunit.client.0.smithi115.stdout:0/744: unlink d6/d24/d25/da3/cf1 0 2024-09-13T23:06:17.593 INFO:tasks.workunit.client.0.smithi115.stdout:0/745: stat d6/c52 0 2024-09-13T23:06:17.593 INFO:tasks.workunit.client.0.smithi115.stdout:0/746: chown d6/d24/d25/cc1 0 1 2024-09-13T23:06:17.593 INFO:tasks.workunit.client.0.smithi115.stdout:0/747: readlink d6/d24/d25/d2b/d61/l74 0 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/293: write d3/d4/f22 [2548204,94829] 0 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/294: chown d3/d4/d6/d8/d17/c1f 471 1 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/295: getdents d3/d4/d6/d37 0 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/296: stat d3/d4/d5/f49 0 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/223: dwrite d4/de/d12/d16/f3f [0,4194304] 0 2024-09-13T23:06:17.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/224: write d4/de/d1d/f2f [583854,66651] 0 2024-09-13T23:06:17.606 INFO:tasks.workunit.client.1.smithi152.stdout:4/297: mknod d3/d4/d5/c51 0 2024-09-13T23:06:17.606 INFO:tasks.workunit.client.1.smithi152.stdout:4/298: creat d3/f52 x:0 0 0 2024-09-13T23:06:17.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/225: dread d4/f6 [4194304,4194304] 0 2024-09-13T23:06:17.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/226: truncate d4/f9 4890031 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.1.smithi152.stdout:1/201: dwrite d4/d9/fb [4194304,4194304] 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.1.smithi152.stdout:1/202: creat d4/d9/d1a/d22/f3d x:0 0 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/830: dwrite d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/831: write d0/d13/d17/d1f/f66 [7375362,7632] 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/832: readlink d0/d13/d17/d1f/d35/d40/l51 0 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/833: chown d0/d13/d17/d1f/d77/fad 3999 1 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/834: dread - d0/d13/d17/d1f/d35/d40/fe2 zero size 2024-09-13T23:06:17.619 INFO:tasks.workunit.client.0.smithi115.stdout:9/835: fsync d0/d13/d17/d1f/d4e/d61/d7d/fb3 0 2024-09-13T23:06:17.620 INFO:tasks.workunit.client.0.smithi115.stdout:8/952: dwrite d3/d5/dc/d16/d1f/d27/d79/da0/fd0 [0,4194304] 0 2024-09-13T23:06:17.620 INFO:tasks.workunit.client.0.smithi115.stdout:1/758: dwrite d0/de/d66/d8f/d29/d47/d6a/f7a [0,4194304] 0 2024-09-13T23:06:17.620 INFO:tasks.workunit.client.0.smithi115.stdout:1/759: stat d0/de/d1b/d25/d4d 0 2024-09-13T23:06:17.620 INFO:tasks.workunit.client.0.smithi115.stdout:1/760: read d0/de/d66/d8f/d29/f39 [1043538,123200] 0 2024-09-13T23:06:17.621 INFO:tasks.workunit.client.1.smithi152.stdout:6/227: fdatasync d4/de/d1d/f2f 0 2024-09-13T23:06:17.623 INFO:tasks.workunit.client.0.smithi115.stdout:9/836: truncate d0/d13/d17/d36/f46 2649605 0 2024-09-13T23:06:17.623 INFO:tasks.workunit.client.0.smithi115.stdout:9/837: write d0/d13/f2d [4822429,23063] 0 2024-09-13T23:06:17.628 INFO:tasks.workunit.client.1.smithi152.stdout:6/228: rename d4/fc to d4/de/d21/f47 0 2024-09-13T23:06:17.630 INFO:tasks.workunit.client.0.smithi115.stdout:9/838: creat d0/d13/d17/d36/dfe/f111 x:0 0 0 2024-09-13T23:06:17.634 INFO:tasks.workunit.client.0.smithi115.stdout:8/953: getdents d3/d5/dc/d16/d1f/d27/d79 0 2024-09-13T23:06:17.638 INFO:tasks.workunit.client.0.smithi115.stdout:0/748: rmdir d6/da0 39 2024-09-13T23:06:17.638 INFO:tasks.workunit.client.0.smithi115.stdout:0/749: truncate d6/d24/d25/d2b/fcf 668284 0 2024-09-13T23:06:17.641 INFO:tasks.workunit.client.0.smithi115.stdout:6/921: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:4/849: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:3/885: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:3/886: chown d3/d16/d1c/d101/c78 342073 1 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:2/900: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:7/778: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:5/829: sync 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:5/830: creat d8/dd/d20/d4a/fff x:0 0 0 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:5/831: dread - d8/dd/d64/fcb zero size 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:4/850: truncate db/d16/d3f/d66/fdf 2264023 0 2024-09-13T23:06:17.642 INFO:tasks.workunit.client.0.smithi115.stdout:4/851: read - db/fb3 zero size 2024-09-13T23:06:17.643 INFO:tasks.workunit.client.1.smithi152.stdout:6/229: dread d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:17.643 INFO:tasks.workunit.client.0.smithi115.stdout:6/922: mkdir d4/df/d14/d67/d77/daf/d136 0 2024-09-13T23:06:17.646 INFO:tasks.workunit.client.0.smithi115.stdout:7/779: rmdir da/dd/d1c/d2d/d60/d82/de6 39 2024-09-13T23:06:17.646 INFO:tasks.workunit.client.0.smithi115.stdout:2/901: creat da/d23/d2c/dc2/de1/d56/d74/dc7/f127 x:0 0 0 2024-09-13T23:06:17.646 INFO:tasks.workunit.client.1.smithi152.stdout:6/230: getdents d4/de/d12/d16/d2a/d38 0 2024-09-13T23:06:17.646 INFO:tasks.workunit.client.1.smithi152.stdout:6/231: creat d4/de/d12/d16/d2a/f48 x:0 0 0 2024-09-13T23:06:17.648 INFO:tasks.workunit.client.0.smithi115.stdout:5/832: mkdir d8/dd/d5d/d100 0 2024-09-13T23:06:17.648 INFO:tasks.workunit.client.0.smithi115.stdout:8/954: write d3/d5/dc/d16/d1f/d27/d79/da0/dbc/ffb [1223789,112119] 0 2024-09-13T23:06:17.650 INFO:tasks.workunit.client.0.smithi115.stdout:4/852: creat db/d16/d3f/f101 x:0 0 0 2024-09-13T23:06:17.650 INFO:tasks.workunit.client.0.smithi115.stdout:4/853: fdatasync db/d16/fc5 0 2024-09-13T23:06:17.651 INFO:tasks.workunit.client.0.smithi115.stdout:6/923: symlink d4/df/d14/d38/d2a/d31/d5b/da8/l137 0 2024-09-13T23:06:17.651 INFO:tasks.workunit.client.0.smithi115.stdout:6/924: fdatasync d4/f12e 0 2024-09-13T23:06:17.651 INFO:tasks.workunit.client.1.smithi152.stdout:6/232: rename d4/f3b to d4/de/f49 0 2024-09-13T23:06:17.652 INFO:tasks.workunit.client.0.smithi115.stdout:7/780: truncate da/dd/d13/d24/d52/fd1 1660400 0 2024-09-13T23:06:17.653 INFO:tasks.workunit.client.1.smithi152.stdout:1/203: dwrite d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:17.653 INFO:tasks.workunit.client.0.smithi115.stdout:2/902: mkdir da/d21/da8/d128 0 2024-09-13T23:06:17.653 INFO:tasks.workunit.client.0.smithi115.stdout:2/903: write da/d23/d2c/dc2/de1/d56/dda/f115 [300946,70626] 0 2024-09-13T23:06:17.655 INFO:tasks.workunit.client.0.smithi115.stdout:5/833: creat d8/dd/d6a/f101 x:0 0 0 2024-09-13T23:06:17.655 INFO:tasks.workunit.client.0.smithi115.stdout:5/834: write d8/dd/d64/fa7 [3827530,11176] 0 2024-09-13T23:06:17.655 INFO:tasks.workunit.client.1.smithi152.stdout:1/204: symlink d4/d9/d1a/d22/l3e 0 2024-09-13T23:06:17.655 INFO:tasks.workunit.client.1.smithi152.stdout:1/205: write d4/d9/d1a/d22/f3d [206668,115442] 0 2024-09-13T23:06:17.657 INFO:tasks.workunit.client.0.smithi115.stdout:8/955: creat d3/d5/dc/d16/d1f/d27/d79/da0/dc9/f152 x:0 0 0 2024-09-13T23:06:17.658 INFO:tasks.workunit.client.1.smithi152.stdout:1/206: mknod d4/d9/c3f 0 2024-09-13T23:06:17.658 INFO:tasks.workunit.client.0.smithi115.stdout:6/925: link d4/df/d14/d67/d77/c11a d4/d57/dab/c138 0 2024-09-13T23:06:17.658 INFO:tasks.workunit.client.0.smithi115.stdout:6/926: truncate d4/df/d14/d38/d44/ffe 271446 0 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:8/956: mknod d3/d5/dc/d16/d1f/d28/dc0/c153 0 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:6/927: mkdir d4/df/d14/d67/d77/dcf/de8/df7/d139 0 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:8/957: chown d3/d5/d1c/d41 748414 1 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:5/835: creat d8/dd/d20/f102 x:0 0 0 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:6/928: chown d4/df/d14/d38/d44/d99/fc6 435085 1 2024-09-13T23:06:17.663 INFO:tasks.workunit.client.0.smithi115.stdout:5/836: read - d8/dd/d20/dbb/fd0 zero size 2024-09-13T23:06:17.664 INFO:tasks.workunit.client.0.smithi115.stdout:8/958: creat d3/d5/dc/d23/d4e/f154 x:0 0 0 2024-09-13T23:06:17.666 INFO:tasks.workunit.client.0.smithi115.stdout:1/761: dwrite d0/de/d1b/d25/d4d/d51/d31/d37/f78 [0,4194304] 0 2024-09-13T23:06:17.666 INFO:tasks.workunit.client.0.smithi115.stdout:1/762: write d0/de/d1b/f2f [3557522,83093] 0 2024-09-13T23:06:17.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/839: dwrite d0/d13/d17/d1f/d35/fb4 [0,4194304] 0 2024-09-13T23:06:17.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/840: truncate d0/d43/f106 945224 0 2024-09-13T23:06:17.669 INFO:tasks.workunit.client.0.smithi115.stdout:9/841: stat d0/d13/d17/d36/d80/d10e/fbb 0 2024-09-13T23:06:17.670 INFO:tasks.workunit.client.0.smithi115.stdout:6/929: creat d4/df/d14/d38/d2a/d3e/d56/dff/d12a/f13a x:0 0 0 2024-09-13T23:06:17.670 INFO:tasks.workunit.client.0.smithi115.stdout:6/930: chown d4/df/d14/d76/cf9 313801 1 2024-09-13T23:06:17.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/959: mknod d3/d5/dc/d16/d1f/d27/c155 0 2024-09-13T23:06:17.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/960: chown d3/d87/dc8/d102/f112 202258 1 2024-09-13T23:06:17.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/961: readlink d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/l124 0 2024-09-13T23:06:17.674 INFO:tasks.workunit.client.0.smithi115.stdout:8/962: readlink d3/d5/d1d/d72/lb2 0 2024-09-13T23:06:17.675 INFO:tasks.workunit.client.0.smithi115.stdout:8/963: readlink d3/d5/d1d/lce 0 2024-09-13T23:06:17.675 INFO:tasks.workunit.client.0.smithi115.stdout:8/964: write d3/d5/dc/d23/d4e/d54/d7f/de9/d4d/f78 [610659,22469] 0 2024-09-13T23:06:17.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/246: sync 2024-09-13T23:06:17.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/247: readlink d17/d24/d2d/d3f/l43 0 2024-09-13T23:06:17.676 INFO:tasks.workunit.client.0.smithi115.stdout:6/931: unlink d4/df/d14/d38/d2a/d31/d5b/d88/fb8 0 2024-09-13T23:06:17.676 INFO:tasks.workunit.client.0.smithi115.stdout:6/932: creat d4/d57/d5a/d79/d85/f13b x:0 0 0 2024-09-13T23:06:17.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/193: sync 2024-09-13T23:06:17.678 INFO:tasks.workunit.client.1.smithi152.stdout:7/248: unlink l7 0 2024-09-13T23:06:17.680 INFO:tasks.workunit.client.0.smithi115.stdout:6/933: truncate d4/df/d14/d38/d44/d66/fac 925285 0 2024-09-13T23:06:17.680 INFO:tasks.workunit.client.1.smithi152.stdout:7/249: link l10 d17/d24/d2a/d2b/d4b/d4d/l55 0 2024-09-13T23:06:17.680 INFO:tasks.workunit.client.1.smithi152.stdout:7/250: truncate d17/d24/d2a/f54 830863 0 2024-09-13T23:06:17.681 INFO:tasks.workunit.client.0.smithi115.stdout:8/965: dread d3/d5/dc/d16/d1f/fac [0,4194304] 0 2024-09-13T23:06:17.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/251: rename fd to d17/d24/d2a/d2e/f56 0 2024-09-13T23:06:17.683 INFO:tasks.workunit.client.1.smithi152.stdout:7/252: truncate f0 3750880 0 2024-09-13T23:06:17.683 INFO:tasks.workunit.client.0.smithi115.stdout:6/934: rename d4/df/d14/d38/d2a/d31/d5b/d88/le4 to d4/df/d14/d67/d77/dcf/l13c 0 2024-09-13T23:06:17.684 INFO:tasks.workunit.client.0.smithi115.stdout:0/750: dwrite d6/d24/d25/da3/fed [0,4194304] 0 2024-09-13T23:06:17.685 INFO:tasks.workunit.client.0.smithi115.stdout:9/842: write d0/d13/d17/d1f/d28/fbf [5191198,110912] 0 2024-09-13T23:06:17.686 INFO:tasks.workunit.client.0.smithi115.stdout:3/887: dwrite d3/d16/d1a/d1e/d8e/faa [0,4194304] 0 2024-09-13T23:06:17.688 INFO:tasks.workunit.client.0.smithi115.stdout:8/966: mknod d3/d5/dc/d23/d4e/d54/d7f/de9/c156 0 2024-09-13T23:06:17.692 INFO:tasks.workunit.client.0.smithi115.stdout:9/843: unlink d0/d13/d17/d19/f50 0 2024-09-13T23:06:17.692 INFO:tasks.workunit.client.0.smithi115.stdout:5/837: write d8/dd/d6a/d82/d63/dd6/f37 [615510,2809] 0 2024-09-13T23:06:17.692 INFO:tasks.workunit.client.0.smithi115.stdout:9/844: chown d0/d13/d17/d19/dc8 1 1 2024-09-13T23:06:17.692 INFO:tasks.workunit.client.0.smithi115.stdout:5/838: fdatasync d8/dd/d20/f1a 0 2024-09-13T23:06:17.695 INFO:tasks.workunit.client.0.smithi115.stdout:6/935: dread d4/df/d14/d38/d2a/d31/f42 [0,4194304] 0 2024-09-13T23:06:17.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/888: dread d3/d5/db/faf [0,4194304] 0 2024-09-13T23:06:17.696 INFO:tasks.workunit.client.0.smithi115.stdout:3/889: chown d3/d5/d35/d71/d3b/d47/d28/lba 26 1 2024-09-13T23:06:17.697 INFO:tasks.workunit.client.1.smithi152.stdout:7/253: dread d17/d24/d2a/d2e/d30/f53 [0,4194304] 0 2024-09-13T23:06:17.697 INFO:tasks.workunit.client.1.smithi152.stdout:7/254: stat d17/d24/l45 0 2024-09-13T23:06:17.697 INFO:tasks.workunit.client.1.smithi152.stdout:7/255: chown cf 241166 1 2024-09-13T23:06:17.698 INFO:tasks.workunit.client.0.smithi115.stdout:8/967: getdents d3/d5/dc/d16/d1f/d27/d79/da0/d122 0 2024-09-13T23:06:17.698 INFO:tasks.workunit.client.0.smithi115.stdout:8/968: chown d3/d87/ld4 375 1 2024-09-13T23:06:17.698 INFO:tasks.workunit.client.0.smithi115.stdout:8/969: creat d3/d5/dc/d23/d4e/d54/d7f/de9/f157 x:0 0 0 2024-09-13T23:06:17.698 INFO:tasks.workunit.client.0.smithi115.stdout:8/970: write d3/d5/dc/d23/d4e/fe6 [544226,108236] 0 2024-09-13T23:06:17.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/256: rename l10 to d17/d24/d2d/d51/l57 0 2024-09-13T23:06:17.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/257: chown d17/d24/d2d/l3e 717173306 1 2024-09-13T23:06:17.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/258: chown d17/d24/d2d/f4e 65251 1 2024-09-13T23:06:17.700 INFO:tasks.workunit.client.0.smithi115.stdout:5/839: truncate d8/dd/d20/dbb/f41 901198 0 2024-09-13T23:06:17.702 INFO:tasks.workunit.client.0.smithi115.stdout:6/936: mknod d4/d57/dce/c13d 0 2024-09-13T23:06:17.702 INFO:tasks.workunit.client.0.smithi115.stdout:9/845: mkdir d0/d112 0 2024-09-13T23:06:17.702 INFO:tasks.workunit.client.0.smithi115.stdout:3/890: getdents d3 0 2024-09-13T23:06:17.704 INFO:tasks.workunit.client.0.smithi115.stdout:8/971: rename d3/d5/dc/d16/d1f/d27/d79/f7c to d3/d5/dc/d16/d1f/d27/d79/da0/d122/f158 0 2024-09-13T23:06:17.705 INFO:tasks.workunit.client.0.smithi115.stdout:8/972: chown d3/d5/dc/d23/d4e/d54/d7f/de9/c2a 2909 1 2024-09-13T23:06:17.705 INFO:tasks.workunit.client.0.smithi115.stdout:8/973: write d3/d5/dc/d16/d1f/d28/dc0/dcd/fdf [419542,128220] 0 2024-09-13T23:06:17.705 INFO:tasks.workunit.client.0.smithi115.stdout:8/974: truncate d3/d5/dc/d23/d4e/f14b 850137 0 2024-09-13T23:06:17.707 INFO:tasks.workunit.client.0.smithi115.stdout:3/891: creat d3/d16/dab/f126 x:0 0 0 2024-09-13T23:06:17.707 INFO:tasks.workunit.client.0.smithi115.stdout:6/937: creat d4/df/d14/d38/d2a/d31/d133/f13e x:0 0 0 2024-09-13T23:06:17.707 INFO:tasks.workunit.client.0.smithi115.stdout:6/938: write d4/df/d14/d38/d2a/d3e/d56/dc4/f100 [3130256,30479] 0 2024-09-13T23:06:17.710 INFO:tasks.workunit.client.0.smithi115.stdout:8/975: mkdir d3/d5/dc/d159 0 2024-09-13T23:06:17.710 INFO:tasks.workunit.client.0.smithi115.stdout:0/751: write d6/d24/d25/d2b/d61/f96 [166908,37001] 0 2024-09-13T23:06:17.710 INFO:tasks.workunit.client.0.smithi115.stdout:3/892: mkdir d3/d5/d65/da8/da4/d127 0 2024-09-13T23:06:17.713 INFO:tasks.workunit.client.0.smithi115.stdout:0/752: symlink d6/d24/d25/d2b/d103/dd4/l105 0 2024-09-13T23:06:17.714 INFO:tasks.workunit.client.0.smithi115.stdout:0/753: truncate d6/d24/d25/d2b/d82/f48 1037336 0 2024-09-13T23:06:17.714 INFO:tasks.workunit.client.0.smithi115.stdout:3/893: mknod d3/d5/d65/da8/da4/d10f/c128 0 2024-09-13T23:06:17.714 INFO:tasks.workunit.client.0.smithi115.stdout:3/894: chown d3/d5/d35/d4c/l75 7625895 1 2024-09-13T23:06:17.725 INFO:tasks.workunit.client.0.smithi115.stdout:8/976: dread d3/d5/dc/d23/f36 [0,4194304] 0 2024-09-13T23:06:17.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/207: dwrite d4/d9/f27 [0,4194304] 0 2024-09-13T23:06:17.727 INFO:tasks.workunit.client.0.smithi115.stdout:4/854: dwrite db/d11/d54/f38 [0,4194304] 0 2024-09-13T23:06:17.727 INFO:tasks.workunit.client.0.smithi115.stdout:4/855: chown db/d16/d3f/d66/cb7 436 1 2024-09-13T23:06:17.730 INFO:tasks.workunit.client.0.smithi115.stdout:3/895: dread d3/d16/f19 [0,4194304] 0 2024-09-13T23:06:17.730 INFO:tasks.workunit.client.1.smithi152.stdout:1/208: rename d4/d9/c3f to d4/c40 0 2024-09-13T23:06:17.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/856: creat db/d11/f102 x:0 0 0 2024-09-13T23:06:17.731 INFO:tasks.workunit.client.0.smithi115.stdout:4/857: fsync db/d11/d2e/d33/d36/d51/f7d 0 2024-09-13T23:06:17.731 INFO:tasks.workunit.client.0.smithi115.stdout:2/904: dwrite da/fd8 [0,4194304] 0 2024-09-13T23:06:17.733 INFO:tasks.workunit.client.0.smithi115.stdout:4/858: mknod db/d19/d1d/db5/c103 0 2024-09-13T23:06:17.733 INFO:tasks.workunit.client.0.smithi115.stdout:4/859: fdatasync db/d19/d4e/f64 0 2024-09-13T23:06:17.733 INFO:tasks.workunit.client.0.smithi115.stdout:4/860: write db/d11/d54/f85 [662511,116221] 0 2024-09-13T23:06:17.734 INFO:tasks.workunit.client.1.smithi152.stdout:5/194: dwrite d5/f22 [0,4194304] 0 2024-09-13T23:06:17.738 INFO:tasks.workunit.client.0.smithi115.stdout:7/781: dwrite da/dd/d1c/d2d/d60/fd6 [0,4194304] 0 2024-09-13T23:06:17.738 INFO:tasks.workunit.client.1.smithi152.stdout:6/233: dwrite d4/de/d21/f24 [0,4194304] 0 2024-09-13T23:06:17.738 INFO:tasks.workunit.client.1.smithi152.stdout:6/234: fsync d4/de/d21/f14 0 2024-09-13T23:06:17.745 INFO:tasks.workunit.client.0.smithi115.stdout:5/840: dwrite d8/dd/d74/ff5 [0,4194304] 0 2024-09-13T23:06:17.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/259: dwrite d17/f25 [0,4194304] 0 2024-09-13T23:06:17.745 INFO:tasks.workunit.client.0.smithi115.stdout:9/846: dwrite d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:17.748 INFO:tasks.workunit.client.1.smithi152.stdout:7/260: truncate d17/d24/f29 375006 0 2024-09-13T23:06:17.749 INFO:tasks.workunit.client.0.smithi115.stdout:2/905: creat da/d21/da6/f129 x:0 0 0 2024-09-13T23:06:17.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/261: rmdir d17/d4f 39 2024-09-13T23:06:17.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/262: chown d17/d24/d2a 398 1 2024-09-13T23:06:17.751 INFO:tasks.workunit.client.1.smithi152.stdout:7/263: chown d17/d24/d2a/f42 302949258 1 2024-09-13T23:06:17.752 INFO:tasks.workunit.client.0.smithi115.stdout:7/782: write da/dd/d1c/d2d/d45/d4d/f73 [6972113,86280] 0 2024-09-13T23:06:17.753 INFO:tasks.workunit.client.1.smithi152.stdout:7/264: symlink d17/d24/d2a/l58 0 2024-09-13T23:06:17.753 INFO:tasks.workunit.client.1.smithi152.stdout:7/265: chown d17/d24/d2a/l58 24441210 1 2024-09-13T23:06:17.754 INFO:tasks.workunit.client.0.smithi115.stdout:0/754: dread d6/d24/d25/d2b/d61/f96 [8388608,4194304] 0 2024-09-13T23:06:17.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/195: write d5/f8 [2716030,6104] 0 2024-09-13T23:06:17.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/196: stat d5/dc/c2d 0 2024-09-13T23:06:17.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/197: readlink d5/dc/d35/l3a 0 2024-09-13T23:06:17.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/977: dwrite d3/d5/d1d/d72/fc1 [4194304,4194304] 0 2024-09-13T23:06:17.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/978: chown d3/d5/d1d/d63/lb7 24413 1 2024-09-13T23:06:17.771 INFO:tasks.workunit.client.0.smithi115.stdout:8/979: fsync d3/d5/dc/d16/d1f/f52 0 2024-09-13T23:06:17.783 INFO:tasks.workunit.client.0.smithi115.stdout:7/783: creat da/dd/d13/d36/d85/f110 x:0 0 0 2024-09-13T23:06:17.783 INFO:tasks.workunit.client.1.smithi152.stdout:1/209: dwrite d4/f1c [0,4194304] 0 2024-09-13T23:06:17.784 INFO:tasks.workunit.client.0.smithi115.stdout:6/939: rename d4/d57 to d4/df/d14/d38/d2a/d3e/d56/d13f 0 2024-09-13T23:06:17.785 INFO:tasks.workunit.client.0.smithi115.stdout:8/980: getdents d3/d87 0 2024-09-13T23:06:17.786 INFO:tasks.workunit.client.0.smithi115.stdout:4/861: rename db/d19/d34/f74 to db/d11/d2e/d33/d36/dad/f104 0 2024-09-13T23:06:17.787 INFO:tasks.workunit.client.0.smithi115.stdout:6/940: mkdir d4/df/d14/d67/d77/dc1/d140 0 2024-09-13T23:06:17.787 INFO:tasks.workunit.client.0.smithi115.stdout:6/941: write d4/df/d14/d38/d2a/d3e/d56/d13f/d75/fb1 [921325,86724] 0 2024-09-13T23:06:17.788 INFO:tasks.workunit.client.1.smithi152.stdout:1/210: getdents d4/d9/d1a 0 2024-09-13T23:06:17.788 INFO:tasks.workunit.client.1.smithi152.stdout:1/211: stat d4/d9/d1a/l21 0 2024-09-13T23:06:17.788 INFO:tasks.workunit.client.0.smithi115.stdout:8/981: symlink d3/d5/dc/d16/d1f/d27/d68/dfc/d13f/l15a 0 2024-09-13T23:06:17.789 INFO:tasks.workunit.client.0.smithi115.stdout:9/847: rename d0/d13/d17/d1f/d4e/d61/d7d/d98/lcf to d0/d13/d17/d36/d80/l113 0 2024-09-13T23:06:17.791 INFO:tasks.workunit.client.0.smithi115.stdout:6/942: creat d4/df/d51/f141 x:0 0 0 2024-09-13T23:06:17.791 INFO:tasks.workunit.client.0.smithi115.stdout:6/943: chown d4/ddd/f117 1986402904 1 2024-09-13T23:06:17.791 INFO:tasks.workunit.client.0.smithi115.stdout:6/944: truncate d4/df/d14/d38/d2a/d3e/d56/d13f/fbe 693113 0 2024-09-13T23:06:17.793 INFO:tasks.workunit.client.0.smithi115.stdout:8/982: unlink d3/d5/dc/d23/fef 0 2024-09-13T23:06:17.795 INFO:tasks.workunit.client.0.smithi115.stdout:9/848: dread d0/d13/d17/d1f/d28/f3e [0,4194304] 0 2024-09-13T23:06:17.796 INFO:tasks.workunit.client.0.smithi115.stdout:3/896: dwrite d3/d16/dab/f126 [0,4194304] 0 2024-09-13T23:06:17.796 INFO:tasks.workunit.client.0.smithi115.stdout:6/945: truncate d4/f1d 3126654 0 2024-09-13T23:06:17.797 INFO:tasks.workunit.client.0.smithi115.stdout:8/983: mkdir d3/d5/dc/d16/d1f/d27/d68/dfc/d137/d15b 0 2024-09-13T23:06:17.797 INFO:tasks.workunit.client.1.smithi152.stdout:1/212: write d4/d9/f12 [613256,161] 0 2024-09-13T23:06:17.798 INFO:tasks.workunit.client.0.smithi115.stdout:3/897: creat d3/d16/d1c/f129 x:0 0 0 2024-09-13T23:06:17.799 INFO:tasks.workunit.client.1.smithi152.stdout:1/213: rmdir d4/d9/d1a/d22 39 2024-09-13T23:06:17.800 INFO:tasks.workunit.client.0.smithi115.stdout:6/946: rename d4/df/d14/d38/d2a/d31/f6a to d4/df/d14/d38/d44/f142 0 2024-09-13T23:06:17.802 INFO:tasks.workunit.client.0.smithi115.stdout:3/898: rename d3/d5/cca to d3/d5/d35/d71/d3b/d47/de1/d119/de2/d102/c12a 0 2024-09-13T23:06:17.802 INFO:tasks.workunit.client.0.smithi115.stdout:3/899: fsync d3/d16/d1c/d101/d98/dbc/df7/f125 0 2024-09-13T23:06:17.803 INFO:tasks.workunit.client.1.smithi152.stdout:6/235: dwrite d4/f6 [4194304,4194304] 0 2024-09-13T23:06:17.803 INFO:tasks.workunit.client.0.smithi115.stdout:6/947: mkdir d4/df/d143 0 2024-09-13T23:06:17.803 INFO:tasks.workunit.client.0.smithi115.stdout:8/984: getdents d3/d5/d1d/d63 0 2024-09-13T23:06:17.805 INFO:tasks.workunit.client.1.smithi152.stdout:6/236: mknod d4/de/d21/c4a 0 2024-09-13T23:06:17.808 INFO:tasks.workunit.client.1.smithi152.stdout:6/237: creat d4/de/d12/d16/d2a/d38/f4b x:0 0 0 2024-09-13T23:06:17.808 INFO:tasks.workunit.client.0.smithi115.stdout:9/849: write d0/d13/d17/d1f/d35/fb4 [606576,7267] 0 2024-09-13T23:06:17.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/238: creat d4/de/d12/d16/d2a/d38/d3c/f4c x:0 0 0 2024-09-13T23:06:17.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/239: creat d4/de/d12/d16/d2a/d3d/f4d x:0 0 0 2024-09-13T23:06:17.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/240: dread - d4/de/d12/d16/d2a/d38/f4b zero size 2024-09-13T23:06:17.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/241: truncate d4/de/d12/f1a 605241 0 2024-09-13T23:06:17.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/242: creat d4/de/d21/f4e x:0 0 0 2024-09-13T23:06:17.813 INFO:tasks.workunit.client.1.smithi152.stdout:6/243: link d4/de/f49 d4/de/d12/d16/d2a/f4f 0 2024-09-13T23:06:17.813 INFO:tasks.workunit.client.1.smithi152.stdout:6/244: truncate d4/de/d1d/f32 4331307 0 2024-09-13T23:06:17.815 INFO:tasks.workunit.client.1.smithi152.stdout:6/245: mknod d4/de/d12/d16/d2a/d38/c50 0 2024-09-13T23:06:17.817 INFO:tasks.workunit.client.0.smithi115.stdout:7/784: dwrite da/dd/d13/f66 [0,4194304] 0 2024-09-13T23:06:17.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/246: rename d4/c8 to d4/de/d21/c51 0 2024-09-13T23:06:17.817 INFO:tasks.workunit.client.1.smithi152.stdout:1/214: dread d4/d9/d1a/d22/f29 [0,4194304] 0 2024-09-13T23:06:17.818 INFO:tasks.workunit.client.1.smithi152.stdout:5/198: dwrite d5/dc/f30 [0,4194304] 0 2024-09-13T23:06:17.819 INFO:tasks.workunit.client.0.smithi115.stdout:5/841: dwrite d8/dd/d4c/f75 [0,4194304] 0 2024-09-13T23:06:17.819 INFO:tasks.workunit.client.0.smithi115.stdout:5/842: write d8/dd/d6a/d82/d63/dd6/ffa [1026562,116924] 0 2024-09-13T23:06:17.819 INFO:tasks.workunit.client.1.smithi152.stdout:1/215: creat d4/f41 x:0 0 0 2024-09-13T23:06:17.821 INFO:tasks.workunit.client.0.smithi115.stdout:0/755: dwrite d6/d24/d25/d2b/d103/fea [0,4194304] 0 2024-09-13T23:06:17.821 INFO:tasks.workunit.client.0.smithi115.stdout:7/785: rename da/l5d to da/dd/d16/d29/l111 0 2024-09-13T23:06:17.821 INFO:tasks.workunit.client.1.smithi152.stdout:7/266: dwrite d17/f19 [0,4194304] 0 2024-09-13T23:06:17.821 INFO:tasks.workunit.client.1.smithi152.stdout:7/267: stat d17/d24/d2d/l36 0 2024-09-13T23:06:17.821 INFO:tasks.workunit.client.1.smithi152.stdout:7/268: chown d17/d24/d2d/d46/c4a 9769 1 2024-09-13T23:06:17.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/199: creat d5/f3f x:0 0 0 2024-09-13T23:06:17.824 INFO:tasks.workunit.client.0.smithi115.stdout:5/843: rmdir d8/dd/d20/d27 39 2024-09-13T23:06:17.825 INFO:tasks.workunit.client.1.smithi152.stdout:1/216: rename d4/d9/c17 to d4/d9/d1a/c42 0 2024-09-13T23:06:17.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/200: symlink d5/dc/d19/d20/d2e/d27/l40 0 2024-09-13T23:06:17.827 INFO:tasks.workunit.client.0.smithi115.stdout:3/900: dread d3/d16/dab/f126 [0,4194304] 0 2024-09-13T23:06:17.827 INFO:tasks.workunit.client.0.smithi115.stdout:8/985: dwrite d3/d87/dc8/d102/f112 [0,4194304] 0 2024-09-13T23:06:17.827 INFO:tasks.workunit.client.0.smithi115.stdout:6/948: dread d4/df/d14/d38/d44/d99/f107 [0,4194304] 0 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:6/949: chown d4/df/d14/d38/d2a/d31/d5b/d88/d9f 128469800 1 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:0/756: symlink d6/d24/d25/l106 0 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:6/950: write d4/df/d14/d67/f7a [1162990,23187] 0 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:6/951: chown d4/df/d51/c70 5354 1 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:0/757: write d6/d24/d25/d2b/d82/d6b/d9f/dab/fef [172864,125602] 0 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:7/786: mknod da/dd/d13/d24/d52/c112 0 2024-09-13T23:06:17.828 INFO:tasks.workunit.client.0.smithi115.stdout:7/787: chown da/dd/d13/d36/d5a/l9b 8 1 2024-09-13T23:06:17.829 INFO:tasks.workunit.client.1.smithi152.stdout:1/217: rename d4/c40 to d4/d9/d1a/c43 0 2024-09-13T23:06:17.829 INFO:tasks.workunit.client.0.smithi115.stdout:5/844: creat d8/dd/d6a/d82/f103 x:0 0 0 2024-09-13T23:06:17.829 INFO:tasks.workunit.client.1.smithi152.stdout:5/201: mknod d5/dc/d19/d20/c41 0 2024-09-13T23:06:17.831 INFO:tasks.workunit.client.0.smithi115.stdout:6/952: dread d4/df/d14/d38/f109 [0,4194304] 0 2024-09-13T23:06:17.831 INFO:tasks.workunit.client.0.smithi115.stdout:8/986: truncate d3/d5/dc/d23/d4e/d54/d8c/ffa 448128 0 2024-09-13T23:06:17.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/218: rename d4/d9/cc to d4/c44 0 2024-09-13T23:06:17.832 INFO:tasks.workunit.client.1.smithi152.stdout:1/219: write d4/d9/d1a/f30 [512643,48417] 0 2024-09-13T23:06:17.832 INFO:tasks.workunit.client.0.smithi115.stdout:0/758: rename d6/d24/d25/d2b/d82/d44/d5c/d87/da4/daf to d6/d24/d25/d2b/d103/dd4/d107 0 2024-09-13T23:06:17.834 INFO:tasks.workunit.client.1.smithi152.stdout:1/220: creat d4/d9/d1a/d22/d24/f45 x:0 0 0 2024-09-13T23:06:17.835 INFO:tasks.workunit.client.0.smithi115.stdout:8/987: creat d3/d5/dc/d23/d4e/d54/f15c x:0 0 0 2024-09-13T23:06:17.836 INFO:tasks.workunit.client.0.smithi115.stdout:8/988: chown d3/d5/d1d/f26 0 1 2024-09-13T23:06:17.836 INFO:tasks.workunit.client.0.smithi115.stdout:0/759: truncate d6/d24/d25/da3/dad/f80 2165697 0 2024-09-13T23:06:17.839 INFO:tasks.workunit.client.0.smithi115.stdout:6/953: dread d4/df/d14/d38/d44/d66/fac [0,4194304] 0 2024-09-13T23:06:17.839 INFO:tasks.workunit.client.0.smithi115.stdout:5/845: rename d8/dd/d6a/d82/d63/dd6/f95 to d8/dd/d20/f104 0 2024-09-13T23:06:17.839 INFO:tasks.workunit.client.1.smithi152.stdout:1/221: link d4/cf d4/d9/d1a/d22/c46 0 2024-09-13T23:06:17.840 INFO:tasks.workunit.client.1.smithi152.stdout:1/222: truncate d4/d9/d1a/d22/f29 4258548 0 2024-09-13T23:06:17.840 INFO:tasks.workunit.client.0.smithi115.stdout:8/989: read d3/d10d/f12e [542315,65384] 0 2024-09-13T23:06:17.841 INFO:tasks.workunit.client.0.smithi115.stdout:6/954: link d4/df/d14/d38/d2a/d3e/f4c d4/df/d14/f144 0 2024-09-13T23:06:17.842 INFO:tasks.workunit.client.0.smithi115.stdout:6/955: fsync d4/df/d14/d38/f109 0 2024-09-13T23:06:17.842 INFO:tasks.workunit.client.0.smithi115.stdout:5/846: symlink d8/dd/d64/l105 0 2024-09-13T23:06:17.843 INFO:tasks.workunit.client.1.smithi152.stdout:1/223: mkdir d4/d47 0 2024-09-13T23:06:17.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/247: dwrite d4/de/d12/d16/d2a/d38/d3c/f4c [0,4194304] 0 2024-09-13T23:06:17.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/248: fsync d4/de/d12/d16/d2a/f2d 0 2024-09-13T23:06:17.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/249: chown d4/de/d21/f1f 208067 1 2024-09-13T23:06:17.845 INFO:tasks.workunit.client.0.smithi115.stdout:8/990: rename d3/d5/dc/d23/d4e/d54/d8c/dd9/d119/f139 to d3/d5/dc/d159/f15d 0 2024-09-13T23:06:17.845 INFO:tasks.workunit.client.0.smithi115.stdout:8/991: chown d3/d5/dc/d16/f83 62586728 1 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:8/992: creat d3/d5/dc/d16/f15e x:0 0 0 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:8/993: creat d3/d5/d1c/df2/f15f x:0 0 0 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:8/994: creat d3/d10d/f160 x:0 0 0 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:8/995: read - d3/d5/dc/d16/f146 zero size 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:6/956: creat d4/df/d14/d38/d2a/d31/d5b/f145 x:0 0 0 2024-09-13T23:06:17.846 INFO:tasks.workunit.client.0.smithi115.stdout:3/901: dread d3/d5/d65/da8/fe6 [0,4194304] 0 2024-09-13T23:06:17.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/847: unlink d8/dd/d20/dbb/ff1 0 2024-09-13T23:06:17.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/848: readlink d8/l21 0 2024-09-13T23:06:17.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/849: chown d8/dd/d6a/d82/d63/dd6/dde/de6 1740057 1 2024-09-13T23:06:17.851 INFO:tasks.workunit.client.0.smithi115.stdout:5/850: readlink d8/dd/d20/d4a/la6 0 2024-09-13T23:06:17.853 INFO:tasks.workunit.client.1.smithi152.stdout:6/250: link d4/de/d12/d16/d2a/l30 d4/de/d12/d3e/l52 0 2024-09-13T23:06:17.855 INFO:tasks.workunit.client.1.smithi152.stdout:1/224: read d4/f6 [565079,47395] 0 2024-09-13T23:06:17.856 INFO:tasks.workunit.client.0.smithi115.stdout:3/902: rmdir d3/d5/d5b 39 2024-09-13T23:06:17.856 INFO:tasks.workunit.client.0.smithi115.stdout:8/996: mknod d3/d5/d1d/c161 0 2024-09-13T23:06:17.856 INFO:tasks.workunit.client.0.smithi115.stdout:3/903: fsync d3/d5/d5b/dd2/fed 0 2024-09-13T23:06:17.856 INFO:tasks.workunit.client.0.smithi115.stdout:6/957: symlink d4/df/d14/d38/d44/d66/dc3/l146 0 2024-09-13T23:06:17.857 INFO:tasks.workunit.client.0.smithi115.stdout:3/904: symlink d3/d5/d35/d71/d3b/d47/d28/l12b 0 2024-09-13T23:06:17.857 INFO:tasks.workunit.client.0.smithi115.stdout:3/905: chown d3/d5/d35/d4c 14 1 2024-09-13T23:06:17.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/225: mkdir d4/d9/d1a/d22/d24/d48 0 2024-09-13T23:06:17.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/226: write d4/d9/d1a/f30 [614149,102928] 0 2024-09-13T23:06:17.859 INFO:tasks.workunit.client.1.smithi152.stdout:2/269: sync 2024-09-13T23:06:17.859 INFO:tasks.workunit.client.1.smithi152.stdout:2/270: write d0/d4/d9/d16/d2b/f60 [425242,23581] 0 2024-09-13T23:06:17.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/299: sync 2024-09-13T23:06:17.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/300: chown d3/d4/d5/d2b 194362412 1 2024-09-13T23:06:17.860 INFO:tasks.workunit.client.0.smithi115.stdout:3/906: mkdir d3/d12c 0 2024-09-13T23:06:17.860 INFO:tasks.workunit.client.0.smithi115.stdout:3/907: read - d3/d5/d5b/fef zero size 2024-09-13T23:06:17.864 INFO:tasks.workunit.client.1.smithi152.stdout:0/180: sync 2024-09-13T23:06:17.864 INFO:tasks.workunit.client.1.smithi152.stdout:9/213: sync 2024-09-13T23:06:17.864 INFO:tasks.workunit.client.1.smithi152.stdout:2/271: truncate d0/fe 6881241 0 2024-09-13T23:06:17.864 INFO:tasks.workunit.client.1.smithi152.stdout:2/272: dread - d0/d4/d9/d18/d1e/d3c/f58 zero size 2024-09-13T23:06:17.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/214: rmdir d3/d1e 39 2024-09-13T23:06:17.866 INFO:tasks.workunit.client.1.smithi152.stdout:2/273: mknod d0/d4/d9/d18/d32/c69 0 2024-09-13T23:06:17.869 INFO:tasks.workunit.client.0.smithi115.stdout:8/997: dread d3/d5/dc/d16/d1f/f52 [0,4194304] 0 2024-09-13T23:06:17.869 INFO:tasks.workunit.client.0.smithi115.stdout:8/998: write d3/d5/dc/f2b [1169292,58939] 0 2024-09-13T23:06:17.873 INFO:tasks.workunit.client.1.smithi152.stdout:5/202: dwrite d5/f3f [0,4194304] 0 2024-09-13T23:06:17.874 INFO:tasks.workunit.client.0.smithi115.stdout:6/958: read d4/df/d14/d38/d2a/d3e/d56/d13f/dab/fb7 [2338281,120441] 0 2024-09-13T23:06:17.874 INFO:tasks.workunit.client.0.smithi115.stdout:7/788: dwrite da/dd/d13/d36/fc4 [0,4194304] 0 2024-09-13T23:06:17.874 INFO:tasks.workunit.client.0.smithi115.stdout:7/789: chown c4 6203 1 2024-09-13T23:06:17.878 INFO:tasks.workunit.client.1.smithi152.stdout:5/203: rename d5/dc/d19/d20/d2e/d27/l38 to d5/dc/d35/l42 0 2024-09-13T23:06:17.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/269: dwrite d17/d24/d2a/d2e/f32 [0,4194304] 0 2024-09-13T23:06:17.879 INFO:tasks.workunit.client.1.smithi152.stdout:9/215: write d3/d1e/f21 [4089975,80116] 0 2024-09-13T23:06:17.879 INFO:tasks.workunit.client.1.smithi152.stdout:9/216: dread - d3/d24/f41 zero size 2024-09-13T23:06:17.880 INFO:tasks.workunit.client.0.smithi115.stdout:8/999: mknod d3/d5/dc/d23/d4e/d54/d8c/dd9/de2/c162 0 2024-09-13T23:06:17.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/270: mkdir d17/d24/d2a/d2e/d59 0 2024-09-13T23:06:17.885 INFO:tasks.workunit.client.0.smithi115.stdout:6/959: link d4/df/d14/d38/la7 d4/df/d14/d38/d44/d99/dc0/l147 0 2024-09-13T23:06:17.885 INFO:tasks.workunit.client.0.smithi115.stdout:6/960: read - d4/df/d14/d38/d44/ffc zero size 2024-09-13T23:06:17.886 INFO:tasks.workunit.client.0.smithi115.stdout:7/790: unlink da/dd/d13/d36/l86 0 2024-09-13T23:06:17.888 INFO:tasks.workunit.client.1.smithi152.stdout:5/204: getdents d5/d26 0 2024-09-13T23:06:17.888 INFO:tasks.workunit.client.1.smithi152.stdout:5/205: creat d5/da/f43 x:0 0 0 2024-09-13T23:06:17.888 INFO:tasks.workunit.client.1.smithi152.stdout:9/217: stat d3/l35 0 2024-09-13T23:06:17.888 INFO:tasks.workunit.client.1.smithi152.stdout:7/271: symlink d17/d24/d2a/d2e/d59/l5a 0 2024-09-13T23:06:17.890 INFO:tasks.workunit.client.1.smithi152.stdout:4/301: dread d3/d4/d5/d1c/f1e [0,4194304] 0 2024-09-13T23:06:17.890 INFO:tasks.workunit.client.1.smithi152.stdout:4/302: dread - d3/d4/d5/d1c/f41 zero size 2024-09-13T23:06:17.893 INFO:tasks.workunit.client.1.smithi152.stdout:9/218: mkdir d3/d24/d34/d37/d47 0 2024-09-13T23:06:17.893 INFO:tasks.workunit.client.0.smithi115.stdout:3/908: dread d3/d5/d65/da8/da4/d49/f67 [0,4194304] 0 2024-09-13T23:06:17.893 INFO:tasks.workunit.client.0.smithi115.stdout:3/909: chown d3/d12c 6034814 1 2024-09-13T23:06:17.893 INFO:tasks.workunit.client.0.smithi115.stdout:3/910: chown d3/d16/d84/fb0 574461803 1 2024-09-13T23:06:17.894 INFO:tasks.workunit.client.0.smithi115.stdout:4/862: write db/d16/d3f/d66/d68/d6a/f82 [1244143,17312] 0 2024-09-13T23:06:17.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/120: sync 2024-09-13T23:06:17.898 INFO:tasks.workunit.client.0.smithi115.stdout:5/851: dwrite d8/f26 [0,4194304] 0 2024-09-13T23:06:17.898 INFO:tasks.workunit.client.0.smithi115.stdout:5/852: write d8/dd/d20/dbb/fd0 [15091,120758] 0 2024-09-13T23:06:17.898 INFO:tasks.workunit.client.0.smithi115.stdout:5/853: chown d8/dd/d64/c69 0 1 2024-09-13T23:06:17.899 INFO:tasks.workunit.client.0.smithi115.stdout:5/854: dread - d8/dd/d5d/d5e/d9a/fea zero size 2024-09-13T23:06:17.899 INFO:tasks.workunit.client.1.smithi152.stdout:4/303: rename d3/d4/d5 to d3/d4/d6/d37/d53 0 2024-09-13T23:06:17.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/181: dwrite d18/f25 [0,4194304] 0 2024-09-13T23:06:17.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/304: dread d3/d4/f22 [4194304,4194304] 0 2024-09-13T23:06:17.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/305: creat d3/d4/d6/f54 x:0 0 0 2024-09-13T23:06:17.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/121: creat d17/f29 x:0 0 0 2024-09-13T23:06:17.902 INFO:tasks.workunit.client.0.smithi115.stdout:7/791: write da/dd/d1c/d2d/d41/de1/df8/ffc [974833,49339] 0 2024-09-13T23:06:17.904 INFO:tasks.workunit.client.1.smithi152.stdout:0/182: symlink d18/d1f/d39/l3a 0 2024-09-13T23:06:17.905 INFO:tasks.workunit.client.1.smithi152.stdout:1/227: dwrite d4/d9/d1a/d22/d24/f45 [0,4194304] 0 2024-09-13T23:06:17.905 INFO:tasks.workunit.client.1.smithi152.stdout:1/228: write d4/f7 [88861,97492] 0 2024-09-13T23:06:17.906 INFO:tasks.workunit.client.1.smithi152.stdout:3/245: sync 2024-09-13T23:06:17.906 INFO:tasks.workunit.client.1.smithi152.stdout:4/306: creat d3/d4/d6/d37/f55 x:0 0 0 2024-09-13T23:06:17.909 INFO:tasks.workunit.client.1.smithi152.stdout:0/183: mknod d18/c3b 0 2024-09-13T23:06:17.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/229: creat d4/d9/d1a/f49 x:0 0 0 2024-09-13T23:06:17.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/230: creat d4/d9/d1a/d22/d24/d48/f4a x:0 0 0 2024-09-13T23:06:17.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/231: write d4/d9/d1a/f30 [879561,74326] 0 2024-09-13T23:06:17.912 INFO:tasks.workunit.client.1.smithi152.stdout:2/274: dwrite d0/d4/f53 [0,4194304] 0 2024-09-13T23:06:17.913 INFO:tasks.workunit.client.1.smithi152.stdout:1/232: dread d4/d9/fd [0,4194304] 0 2024-09-13T23:06:17.913 INFO:tasks.workunit.client.1.smithi152.stdout:1/233: write d4/d9/fb [8613903,15632] 0 2024-09-13T23:06:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:2/275: mknod d0/d4/d9/d18/c6a 0 2024-09-13T23:06:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/234: mknod d4/d9/d1a/d22/d24/c4b 0 2024-09-13T23:06:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:2/276: chown d0/d4/d9/f40 20 1 2024-09-13T23:06:17.917 INFO:tasks.workunit.client.1.smithi152.stdout:2/277: creat d0/d4/d9/d14/f6b x:0 0 0 2024-09-13T23:06:17.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/278: fsync d0/d4/f5e 0 2024-09-13T23:06:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:3/246: read fd [283238,52807] 0 2024-09-13T23:06:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:3/247: chown de/d14/c16 3 1 2024-09-13T23:06:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:1/235: mkdir d4/d4c 0 2024-09-13T23:06:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:1/236: write d4/f41 [104230,55946] 0 2024-09-13T23:06:17.919 INFO:tasks.workunit.client.1.smithi152.stdout:3/248: write de/d1f/f52 [212907,16468] 0 2024-09-13T23:06:17.920 INFO:tasks.workunit.client.1.smithi152.stdout:3/249: write de/d14/d38/f28 [2436389,2072] 0 2024-09-13T23:06:17.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/250: unlink de/d14/d38/f26 0 2024-09-13T23:06:17.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/307: write d3/d4/d6/f4c [2136364,86528] 0 2024-09-13T23:06:17.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/308: dread - d3/d4/d6/d37/f44 zero size 2024-09-13T23:06:17.928 INFO:tasks.workunit.client.0.smithi115.stdout:6/961: dwrite d4/df/d14/f18 [8388608,4194304] 0 2024-09-13T23:06:17.933 INFO:tasks.workunit.client.1.smithi152.stdout:2/279: dread d0/d4/d9/ff [0,4194304] 0 2024-09-13T23:06:17.933 INFO:tasks.workunit.client.1.smithi152.stdout:2/280: fsync d0/d4/d9/d16/f17 0 2024-09-13T23:06:17.933 INFO:tasks.workunit.client.1.smithi152.stdout:2/281: chown d0/d4/d9/d18/c6a 695693206 1 2024-09-13T23:06:17.938 INFO:tasks.workunit.client.1.smithi152.stdout:5/206: dwrite d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:17.942 INFO:tasks.workunit.client.1.smithi152.stdout:6/251: getdents d4/de/d12/d16/d2a/d3d 0 2024-09-13T23:06:17.944 INFO:tasks.workunit.client.1.smithi152.stdout:0/184: dwrite f1 [4194304,4194304] 0 2024-09-13T23:06:17.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/185: fsync f1 0 2024-09-13T23:06:17.946 INFO:tasks.workunit.client.0.smithi115.stdout:3/911: dwrite d3/d5/d35/d71/d3b/d4d/d8d/fc0 [0,4194304] 0 2024-09-13T23:06:17.946 INFO:tasks.workunit.client.0.smithi115.stdout:3/912: chown d3/d16/d1c/d101/d59/f5a 414924351 1 2024-09-13T23:06:17.946 INFO:tasks.workunit.client.1.smithi152.stdout:8/122: dwrite d17/f1d [4194304,4194304] 0 2024-09-13T23:06:17.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/207: creat d5/dc/d19/d20/d2e/d27/f44 x:0 0 0 2024-09-13T23:06:17.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/208: rename d5/dc/d35 to d5/dc/d35/d45 22 2024-09-13T23:06:17.948 INFO:tasks.workunit.client.1.smithi152.stdout:4/309: dwrite d3/f4f [0,4194304] 0 2024-09-13T23:06:17.948 INFO:tasks.workunit.client.1.smithi152.stdout:4/310: read - d3/d4/d6/f54 zero size 2024-09-13T23:06:17.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/252: mkdir d4/de/d12/d16/d2a/d53 0 2024-09-13T23:06:17.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/253: creat d4/de/d12/d16/d2a/d38/d3c/f54 x:0 0 0 2024-09-13T23:06:17.951 INFO:tasks.workunit.client.1.smithi152.stdout:2/282: write d0/d4/d9/d14/f34 [2541909,80611] 0 2024-09-13T23:06:17.951 INFO:tasks.workunit.client.1.smithi152.stdout:2/283: creat d0/d4/d9/d16/d2b/f6c x:0 0 0 2024-09-13T23:06:17.952 INFO:tasks.workunit.client.1.smithi152.stdout:8/123: creat d17/d25/f2a x:0 0 0 2024-09-13T23:06:17.955 INFO:tasks.workunit.client.1.smithi152.stdout:5/209: rename d5/da/c15 to d5/dc/d19/d20/d2e/d27/c46 0 2024-09-13T23:06:17.959 INFO:tasks.workunit.client.0.smithi115.stdout:4/863: rename db/d11/d2e/d33/d36/f9c to db/d16/d3f/d66/d68/d71/d84/f105 0 2024-09-13T23:06:17.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/124: creat d17/d23/f2b x:0 0 0 2024-09-13T23:06:17.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/125: fsync d17/d19/f20 0 2024-09-13T23:06:17.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/219: dwrite d3/d24/f36 [0,4194304] 0 2024-09-13T23:06:17.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/220: creat d3/f48 x:0 0 0 2024-09-13T23:06:17.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/221: creat d3/d24/d34/f49 x:0 0 0 2024-09-13T23:06:17.968 INFO:tasks.workunit.client.1.smithi152.stdout:8/126: rename f10 to d17/f2c 0 2024-09-13T23:06:17.969 INFO:tasks.workunit.client.1.smithi152.stdout:5/210: dread d5/f14 [0,4194304] 0 2024-09-13T23:06:17.978 INFO:tasks.workunit.client.0.smithi115.stdout:6/962: unlink d4/df/d14/d38/d2a/d3e/d56/d13f/d75/l120 0 2024-09-13T23:06:17.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/222: mkdir d3/d24/d34/d37/d4a 0 2024-09-13T23:06:17.986 INFO:tasks.workunit.client.0.smithi115.stdout:5/855: rename d8/dd/d20/f52 to d8/d9e/df8/f106 0 2024-09-13T23:06:17.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/127: rename cc to d17/c2d 0 2024-09-13T23:06:17.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/128: dread - d17/d19/f28 zero size 2024-09-13T23:06:17.988 INFO:tasks.workunit.client.0.smithi115.stdout:6/963: mkdir d4/ddd/d148 0 2024-09-13T23:06:17.988 INFO:tasks.workunit.client.0.smithi115.stdout:6/964: dread - d4/df/d14/d38/d2a/d3e/d56/d13f/dcb/f10c zero size 2024-09-13T23:06:17.989 INFO:tasks.workunit.client.1.smithi152.stdout:5/211: creat d5/d26/f47 x:0 0 0 2024-09-13T23:06:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:9/223: mknod d3/d24/d34/d37/d47/c4b 0 2024-09-13T23:06:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/129: symlink d17/d25/l2e 0 2024-09-13T23:06:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/130: creat d17/d25/f2f x:0 0 0 2024-09-13T23:06:17.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/131: stat d17/d19/f20 0 2024-09-13T23:06:17.992 INFO:tasks.workunit.client.1.smithi152.stdout:8/132: write d17/f22 [1652131,37144] 0 2024-09-13T23:06:17.992 INFO:tasks.workunit.client.1.smithi152.stdout:8/133: truncate d17/d19/f28 259174 0 2024-09-13T23:06:17.992 INFO:tasks.workunit.client.0.smithi115.stdout:3/913: rename d3/d5/d5b/cf8 to d3/d5/d35/d71/d3b/d47/de1/d119/de2/c12d 0 2024-09-13T23:06:17.992 INFO:tasks.workunit.client.0.smithi115.stdout:3/914: chown d3/d5/d35/d71/d3b/lc3 32262007 1 2024-09-13T23:06:17.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/224: dread d3/d24/f2e [0,4194304] 0 2024-09-13T23:06:17.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/225: creat d3/d24/d34/d37/f4c x:0 0 0 2024-09-13T23:06:17.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/226: creat d3/d24/d34/d37/f4d x:0 0 0 2024-09-13T23:06:17.993 INFO:tasks.workunit.client.0.smithi115.stdout:6/965: mkdir d4/df/d14/d67/d77/dcf/d115/d149 0 2024-09-13T23:06:17.997 INFO:tasks.workunit.client.0.smithi115.stdout:4/864: rename db/d16/d3f/d66/d68/d6a/f7a to db/d11/d2e/d33/d36/f106 0 2024-09-13T23:06:17.998 INFO:tasks.workunit.client.0.smithi115.stdout:4/865: fsync db/d16/d3f/d66/da6/fe4 0 2024-09-13T23:06:17.998 INFO:tasks.workunit.client.0.smithi115.stdout:3/915: rmdir d3/d5/d35/d71 39 2024-09-13T23:06:18.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/254: dwrite d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:18.001 INFO:tasks.workunit.client.0.smithi115.stdout:5/856: dread d8/d7a/fdc [0,4194304] 0 2024-09-13T23:06:18.002 INFO:tasks.workunit.client.0.smithi115.stdout:5/857: chown d8/dd/d64/cbd 8299980 1 2024-09-13T23:06:18.002 INFO:tasks.workunit.client.1.smithi152.stdout:9/227: symlink d3/d24/l4e 0 2024-09-13T23:06:18.002 INFO:tasks.workunit.client.1.smithi152.stdout:9/228: write d3/ff [8985270,32207] 0 2024-09-13T23:06:18.002 INFO:tasks.workunit.client.0.smithi115.stdout:3/916: unlink d3/d16/d1a/f57 0 2024-09-13T23:06:18.002 INFO:tasks.workunit.client.0.smithi115.stdout:3/917: truncate d3/d5/d2c/f103 643913 0 2024-09-13T23:06:18.004 INFO:tasks.workunit.client.1.smithi152.stdout:1/237: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:18.005 INFO:tasks.workunit.client.0.smithi115.stdout:3/918: link d3/d5/d65/da8/da4/c46 d3/d16/d1a/dd8/c12e 0 2024-09-13T23:06:18.005 INFO:tasks.workunit.client.0.smithi115.stdout:5/858: dread d8/d7a/fdc [0,4194304] 0 2024-09-13T23:06:18.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/229: unlink d3/d24/d34/d37/f4c 0 2024-09-13T23:06:18.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/230: truncate d3/f23 4617633 0 2024-09-13T23:06:18.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/231: chown d3/d24/d34 3 1 2024-09-13T23:06:18.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/232: creat d3/f4f x:0 0 0 2024-09-13T23:06:18.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/233: chown d3/d24/d34/d37/f4d 27 1 2024-09-13T23:06:18.008 INFO:tasks.workunit.client.0.smithi115.stdout:3/919: link d3/d5/d35/d71/d42/f11c d3/f12f 0 2024-09-13T23:06:18.010 INFO:tasks.workunit.client.0.smithi115.stdout:6/966: read d4/df/d14/d38/d2a/f90 [5409548,96592] 0 2024-09-13T23:06:18.010 INFO:tasks.workunit.client.1.smithi152.stdout:0/186: dwrite d18/d1f/f34 [0,4194304] 0 2024-09-13T23:06:18.011 INFO:tasks.workunit.client.0.smithi115.stdout:5/859: unlink d8/dd/d6a/d82/d63/l3a 0 2024-09-13T23:06:18.011 INFO:tasks.workunit.client.0.smithi115.stdout:6/967: mkdir d4/df/d14/d38/d44/d14a 0 2024-09-13T23:06:18.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/284: dwrite d0/d4/f37 [0,4194304] 0 2024-09-13T23:06:18.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/285: dread - d0/d4/d9/d18/d32/f65 zero size 2024-09-13T23:06:18.016 INFO:tasks.workunit.client.1.smithi152.stdout:1/238: getdents d4/d9/d1a/d22/d24/d48 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.1.smithi152.stdout:1/239: write d4/f6 [3346400,119312] 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.1.smithi152.stdout:1/240: fsync d4/f7 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.1.smithi152.stdout:0/187: unlink d18/f28 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.0.smithi115.stdout:5/860: link d8/dd/d6a/d82/d63/d5a/c67 d8/dd/d4c/c107 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/866: write db/d16/f47 [3464242,89874] 0 2024-09-13T23:06:18.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/867: readlink db/d11/d54/d17/lce 0 2024-09-13T23:06:18.019 INFO:tasks.workunit.client.0.smithi115.stdout:4/868: truncate db/d16/f7e 2923157 0 2024-09-13T23:06:18.025 INFO:tasks.workunit.client.1.smithi152.stdout:0/188: getdents d18/d19 0 2024-09-13T23:06:18.026 INFO:tasks.workunit.client.0.smithi115.stdout:4/869: symlink db/d11/d54/d17/dd1/l107 0 2024-09-13T23:06:18.031 INFO:tasks.workunit.client.0.smithi115.stdout:6/968: dread d4/f6c [0,4194304] 0 2024-09-13T23:06:18.031 INFO:tasks.workunit.client.0.smithi115.stdout:3/920: write d3/d5/d35/d71/d3b/d47/d28/f32 [431372,31437] 0 2024-09-13T23:06:18.031 INFO:tasks.workunit.client.0.smithi115.stdout:3/921: truncate d3/d5/d65/da8/da4/f104 887482 0 2024-09-13T23:06:18.031 INFO:tasks.workunit.client.0.smithi115.stdout:3/922: write d3/d5/f7f [1638964,63160] 0 2024-09-13T23:06:18.033 INFO:tasks.workunit.client.1.smithi152.stdout:4/311: truncate d3/d4/d6/f4c 1262248 0 2024-09-13T23:06:18.033 INFO:tasks.workunit.client.1.smithi152.stdout:4/312: truncate d3/d4/d6/d37/f55 107573 0 2024-09-13T23:06:18.033 INFO:tasks.workunit.client.1.smithi152.stdout:4/313: getdents d3/d4/d6/d8/d17 0 2024-09-13T23:06:18.037 INFO:tasks.workunit.client.1.smithi152.stdout:5/212: dwrite d5/dc/fe [0,4194304] 0 2024-09-13T23:06:18.037 INFO:tasks.workunit.client.0.smithi115.stdout:6/969: link d4/df/c16 d4/df/d14/d76/c14b 0 2024-09-13T23:06:18.037 INFO:tasks.workunit.client.0.smithi115.stdout:6/970: write d4/df/d14/d67/d10e/f39 [2976310,23413] 0 2024-09-13T23:06:18.039 INFO:tasks.workunit.client.1.smithi152.stdout:9/234: dwrite d3/d24/f36 [0,4194304] 0 2024-09-13T23:06:18.042 INFO:tasks.workunit.client.0.smithi115.stdout:1/763: sync 2024-09-13T23:06:18.042 INFO:tasks.workunit.client.0.smithi115.stdout:1/764: chown d0/de/d1b/d25/d67/fc3 862639 1 2024-09-13T23:06:18.043 INFO:tasks.workunit.client.0.smithi115.stdout:6/971: mknod d4/df/d14/d67/d77/dc1/d140/c14c 0 2024-09-13T23:06:18.043 INFO:tasks.workunit.client.0.smithi115.stdout:3/923: mknod d3/d5/d35/d71/d3b/d47/de1/c130 0 2024-09-13T23:06:18.043 INFO:tasks.workunit.client.0.smithi115.stdout:3/924: getdents d3/d5/d65/da8/da4/d127 0 2024-09-13T23:06:18.043 INFO:tasks.workunit.client.1.smithi152.stdout:0/189: dread d18/f1a [0,4194304] 0 2024-09-13T23:06:18.045 INFO:tasks.workunit.client.0.smithi115.stdout:1/765: rename d0/de/d66/le9 to d0/de/d66/lf4 0 2024-09-13T23:06:18.046 INFO:tasks.workunit.client.0.smithi115.stdout:6/972: link d4/f1d d4/df/d14/d38/d44/d99/def/f14d 0 2024-09-13T23:06:18.047 INFO:tasks.workunit.client.0.smithi115.stdout:6/973: stat d4/df/d14/d38/d2a/d3e/l103 0 2024-09-13T23:06:18.048 INFO:tasks.workunit.client.0.smithi115.stdout:3/925: creat d3/d5/d35/d71/d3b/d4d/d8d/f131 x:0 0 0 2024-09-13T23:06:18.048 INFO:tasks.workunit.client.1.smithi152.stdout:5/213: link d5/dc/d19/d20/c41 d5/dc/d19/c48 0 2024-09-13T23:06:18.049 INFO:tasks.workunit.client.0.smithi115.stdout:1/766: symlink d0/de/d66/d8f/d29/d47/d74/lf5 0 2024-09-13T23:06:18.049 INFO:tasks.workunit.client.0.smithi115.stdout:1/767: write d0/de/d1b/d25/d4d/d51/d23/f2c [487703,18848] 0 2024-09-13T23:06:18.050 INFO:tasks.workunit.client.1.smithi152.stdout:8/134: getdents d17/d25 0 2024-09-13T23:06:18.050 INFO:tasks.workunit.client.1.smithi152.stdout:4/314: getdents d3/d4/d6/d37 0 2024-09-13T23:06:18.052 INFO:tasks.workunit.client.1.smithi152.stdout:0/190: mknod d18/d1f/d33/c3c 0 2024-09-13T23:06:18.052 INFO:tasks.workunit.client.1.smithi152.stdout:0/191: fdatasync ff 0 2024-09-13T23:06:18.053 INFO:tasks.workunit.client.0.smithi115.stdout:3/926: rename d3/d5/d65/da8/da4/d49/fa6 to d3/d5/d65/da8/da4/d49/d124/f132 0 2024-09-13T23:06:18.054 INFO:tasks.workunit.client.0.smithi115.stdout:3/927: fsync d3/d5/d35/d71/d3b/d47/d28/f9e 0 2024-09-13T23:06:18.054 INFO:tasks.workunit.client.0.smithi115.stdout:3/928: write d3/d5/d65/da8/da4/f104 [1464822,30674] 0 2024-09-13T23:06:18.054 INFO:tasks.workunit.client.0.smithi115.stdout:6/974: mknod d4/df/d14/d135/c14e 0 2024-09-13T23:06:18.056 INFO:tasks.workunit.client.1.smithi152.stdout:4/315: creat d3/d4/d6/d8/d17/d3a/f56 x:0 0 0 2024-09-13T23:06:18.057 INFO:tasks.workunit.client.1.smithi152.stdout:4/316: readlink d3/lf 0 2024-09-13T23:06:18.057 INFO:tasks.workunit.client.1.smithi152.stdout:0/192: mkdir d18/d1f/d29/d2f/d3d 0 2024-09-13T23:06:18.057 INFO:tasks.workunit.client.1.smithi152.stdout:4/317: symlink d3/d4/d33/l57 0 2024-09-13T23:06:18.058 INFO:tasks.workunit.client.0.smithi115.stdout:3/929: mknod d3/d16/d1a/dd8/c133 0 2024-09-13T23:06:18.058 INFO:tasks.workunit.client.0.smithi115.stdout:3/930: dread - d3/d16/d1a/d1e/d8e/fb5 zero size 2024-09-13T23:06:18.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/193: mknod d18/c3e 0 2024-09-13T23:06:18.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/194: fdatasync d18/d1f/d33/f36 0 2024-09-13T23:06:18.059 INFO:tasks.workunit.client.1.smithi152.stdout:4/318: mkdir d3/d4/d6/d8/d17/d58 0 2024-09-13T23:06:18.059 INFO:tasks.workunit.client.1.smithi152.stdout:4/319: chown d3/f13 55469 1 2024-09-13T23:06:18.060 INFO:tasks.workunit.client.0.smithi115.stdout:3/931: mknod d3/d5/d35/d71/d3b/d47/de1/d119/de2/c134 0 2024-09-13T23:06:18.061 INFO:tasks.workunit.client.1.smithi152.stdout:4/320: mkdir d3/d4/d6/d37/d53/d1c/d59 0 2024-09-13T23:06:18.061 INFO:tasks.workunit.client.1.smithi152.stdout:9/235: write d3/f17 [2887645,63722] 0 2024-09-13T23:06:18.066 INFO:tasks.workunit.client.0.smithi115.stdout:3/932: dread d3/d16/d1a/d1e/d76/f83 [0,4194304] 0 2024-09-13T23:06:18.068 INFO:tasks.workunit.client.0.smithi115.stdout:3/933: symlink d3/d16/d1a/l135 0 2024-09-13T23:06:18.069 INFO:tasks.workunit.client.0.smithi115.stdout:6/975: write d4/df/d14/d38/d2a/d31/fbd [2714569,39873] 0 2024-09-13T23:06:18.070 INFO:tasks.workunit.client.0.smithi115.stdout:3/934: mkdir d3/d5/d65/da8/da4/d10f/d136 0 2024-09-13T23:06:18.070 INFO:tasks.workunit.client.0.smithi115.stdout:3/935: stat d3/d5/db/faf 0 2024-09-13T23:06:18.071 INFO:tasks.workunit.client.0.smithi115.stdout:7/792: dwrite da/dd/d13/d36/fc4 [4194304,4194304] 0 2024-09-13T23:06:18.075 INFO:tasks.workunit.client.1.smithi152.stdout:2/286: dwrite d0/d4/d9/f25 [0,4194304] 0 2024-09-13T23:06:18.075 INFO:tasks.workunit.client.0.smithi115.stdout:6/976: mkdir d4/df/d14/d38/d2a/d31/d5b/d14f 0 2024-09-13T23:06:18.077 INFO:tasks.workunit.client.1.smithi152.stdout:9/236: dread d3/d24/f36 [0,4194304] 0 2024-09-13T23:06:18.079 INFO:tasks.workunit.client.0.smithi115.stdout:4/870: dwrite db/d11/d54/f79 [0,4194304] 0 2024-09-13T23:06:18.079 INFO:tasks.workunit.client.1.smithi152.stdout:9/237: dread d3/d1e/d30/f32 [0,4194304] 0 2024-09-13T23:06:18.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/238: creat d3/d24/d34/d37/f50 x:0 0 0 2024-09-13T23:06:18.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/239: chown d3/d1e/f1f 411254024 1 2024-09-13T23:06:18.080 INFO:tasks.workunit.client.1.smithi152.stdout:1/241: dwrite d4/d9/f2b [0,4194304] 0 2024-09-13T23:06:18.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/861: dwrite d8/d9e/dd8/fe3 [0,4194304] 0 2024-09-13T23:06:18.082 INFO:tasks.workunit.client.0.smithi115.stdout:5/862: dread - d8/dd/d20/d4a/f8f zero size 2024-09-13T23:06:18.082 INFO:tasks.workunit.client.1.smithi152.stdout:2/287: symlink d0/d4/d9/d18/d32/l6d 0 2024-09-13T23:06:18.083 INFO:tasks.workunit.client.0.smithi115.stdout:6/977: symlink d4/df/d14/d38/d2a/d3e/d56/dff/l150 0 2024-09-13T23:06:18.085 INFO:tasks.workunit.client.1.smithi152.stdout:9/240: creat d3/d24/d34/d37/d47/f51 x:0 0 0 2024-09-13T23:06:18.088 INFO:tasks.workunit.client.1.smithi152.stdout:2/288: dread - d0/d4/d9/f3a zero size 2024-09-13T23:06:18.088 INFO:tasks.workunit.client.1.smithi152.stdout:2/289: stat d0/d8/l3f 0 2024-09-13T23:06:18.089 INFO:tasks.workunit.client.1.smithi152.stdout:9/241: mkdir d3/d52 0 2024-09-13T23:06:18.089 INFO:tasks.workunit.client.1.smithi152.stdout:9/242: write d3/d24/d34/f40 [695563,40830] 0 2024-09-13T23:06:18.089 INFO:tasks.workunit.client.0.smithi115.stdout:5/863: dread d8/d7a/fdc [0,4194304] 0 2024-09-13T23:06:18.093 INFO:tasks.workunit.client.0.smithi115.stdout:6/978: mknod d4/df/d14/d38/d44/d66/dc3/c151 0 2024-09-13T23:06:18.095 INFO:tasks.workunit.client.1.smithi152.stdout:5/214: dwrite d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:18.096 INFO:tasks.workunit.client.1.smithi152.stdout:9/243: read d3/d24/f2e [1151278,88954] 0 2024-09-13T23:06:18.096 INFO:tasks.workunit.client.0.smithi115.stdout:6/979: rename d4/df/d14/d67/d77/dcf/d115/d149 to d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/d152 0 2024-09-13T23:06:18.097 INFO:tasks.workunit.client.0.smithi115.stdout:6/980: write d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/fbc [930091,53365] 0 2024-09-13T23:06:18.098 INFO:tasks.workunit.client.1.smithi152.stdout:5/215: truncate d5/f14 2512921 0 2024-09-13T23:06:18.098 INFO:tasks.workunit.client.0.smithi115.stdout:6/981: creat d4/df/d14/d38/d2a/d3e/d56/d7b/f153 x:0 0 0 2024-09-13T23:06:18.098 INFO:tasks.workunit.client.0.smithi115.stdout:6/982: write d4/df/d14/d38/d44/fe0 [416457,116269] 0 2024-09-13T23:06:18.101 INFO:tasks.workunit.client.1.smithi152.stdout:5/216: rename d5/dc/d19/d20/c41 to d5/dc/d19/d20/d2e/d27/c49 0 2024-09-13T23:06:18.110 INFO:tasks.workunit.client.1.smithi152.stdout:8/135: dwrite d17/d25/f2a [0,4194304] 0 2024-09-13T23:06:18.111 INFO:tasks.workunit.client.1.smithi152.stdout:8/136: write d17/d23/f2b [337847,83872] 0 2024-09-13T23:06:18.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/137: truncate d17/f2c 4982107 0 2024-09-13T23:06:18.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/138: chown d17/d23/l27 2 1 2024-09-13T23:06:18.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/139: creat d17/d23/f30 x:0 0 0 2024-09-13T23:06:18.115 INFO:tasks.workunit.client.1.smithi152.stdout:8/140: link cf d17/d19/c31 0 2024-09-13T23:06:18.115 INFO:tasks.workunit.client.1.smithi152.stdout:8/141: dread - d17/d23/f30 zero size 2024-09-13T23:06:18.117 INFO:tasks.workunit.client.1.smithi152.stdout:8/142: mkdir d17/d25/d32 0 2024-09-13T23:06:18.117 INFO:tasks.workunit.client.1.smithi152.stdout:8/143: chown d17/d25/f2a 1016 1 2024-09-13T23:06:18.128 INFO:tasks.workunit.client.0.smithi115.stdout:6/983: dread d4/df/d14/d38/f68 [4194304,4194304] 0 2024-09-13T23:06:18.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/984: symlink d4/df/d143/l154 0 2024-09-13T23:06:18.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/985: chown d4/ddd/d148 207 1 2024-09-13T23:06:18.130 INFO:tasks.workunit.client.0.smithi115.stdout:6/986: stat d4/df/d14/f18 0 2024-09-13T23:06:18.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/760: sync 2024-09-13T23:06:18.131 INFO:tasks.workunit.client.0.smithi115.stdout:9/850: sync 2024-09-13T23:06:18.132 INFO:tasks.workunit.client.0.smithi115.stdout:9/851: write d0/d13/d3b/d42/f100 [1027751,28546] 0 2024-09-13T23:06:18.133 INFO:tasks.workunit.client.0.smithi115.stdout:0/761: creat d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/f108 x:0 0 0 2024-09-13T23:06:18.133 INFO:tasks.workunit.client.0.smithi115.stdout:0/762: fdatasync d6/d24/d25/d58/f7a 0 2024-09-13T23:06:18.133 INFO:tasks.workunit.client.0.smithi115.stdout:3/936: dwrite d3/d5/d35/d71/d3b/d47/d28/fe0 [4194304,4194304] 0 2024-09-13T23:06:18.133 INFO:tasks.workunit.client.0.smithi115.stdout:9/852: mkdir d0/d13/d17/d1f/d35/d62/d114 0 2024-09-13T23:06:18.134 INFO:tasks.workunit.client.0.smithi115.stdout:9/853: truncate d0/d13/d17/d1f/d28/f91 3173115 0 2024-09-13T23:06:18.134 INFO:tasks.workunit.client.0.smithi115.stdout:3/937: creat d3/d5/d35/d71/d3b/d47/de1/f137 x:0 0 0 2024-09-13T23:06:18.135 INFO:tasks.workunit.client.0.smithi115.stdout:3/938: chown d3/lc 23135 1 2024-09-13T23:06:18.140 INFO:tasks.workunit.client.0.smithi115.stdout:9/854: dread d0/d13/d17/d1f/d35/d62/f6f [0,4194304] 0 2024-09-13T23:06:18.140 INFO:tasks.workunit.client.0.smithi115.stdout:9/855: chown d0/d43/df8/ce3 495385 1 2024-09-13T23:06:18.140 INFO:tasks.workunit.client.0.smithi115.stdout:9/856: chown d0/d43/c47 421852 1 2024-09-13T23:06:18.141 INFO:tasks.workunit.client.0.smithi115.stdout:3/939: dread d3/d5/f7f [0,4194304] 0 2024-09-13T23:06:18.142 INFO:tasks.workunit.client.0.smithi115.stdout:3/940: write d3/d16/f97 [2963340,116091] 0 2024-09-13T23:06:18.142 INFO:tasks.workunit.client.0.smithi115.stdout:9/857: creat d0/d13/d17/d19/dc8/f115 x:0 0 0 2024-09-13T23:06:18.142 INFO:tasks.workunit.client.0.smithi115.stdout:9/858: chown d0/d13/d17/lde 448 1 2024-09-13T23:06:18.142 INFO:tasks.workunit.client.0.smithi115.stdout:2/906: sync 2024-09-13T23:06:18.143 INFO:tasks.workunit.client.0.smithi115.stdout:3/941: symlink d3/d16/d1c/d101/dfb/l138 0 2024-09-13T23:06:18.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/321: dwrite d3/d4/d33/f48 [0,4194304] 0 2024-09-13T23:06:18.145 INFO:tasks.workunit.client.0.smithi115.stdout:9/859: creat d0/d13/d17/d1f/d4e/d61/d9b/f116 x:0 0 0 2024-09-13T23:06:18.145 INFO:tasks.workunit.client.0.smithi115.stdout:2/907: truncate da/d77/d83/fd0 469345 0 2024-09-13T23:06:18.145 INFO:tasks.workunit.client.0.smithi115.stdout:3/942: mkdir d3/d12c/d139 0 2024-09-13T23:06:18.146 INFO:tasks.workunit.client.1.smithi152.stdout:4/322: unlink d3/d4/d6/d8/c29 0 2024-09-13T23:06:18.146 INFO:tasks.workunit.client.0.smithi115.stdout:9/860: truncate d0/d13/fbc 809501 0 2024-09-13T23:06:18.147 INFO:tasks.workunit.client.1.smithi152.stdout:4/323: mkdir d3/d5a 0 2024-09-13T23:06:18.148 INFO:tasks.workunit.client.0.smithi115.stdout:2/908: creat da/d21/f12a x:0 0 0 2024-09-13T23:06:18.148 INFO:tasks.workunit.client.1.smithi152.stdout:4/324: mknod d3/d4/d6/d37/c5b 0 2024-09-13T23:06:18.149 INFO:tasks.workunit.client.1.smithi152.stdout:4/325: getdents d3/d4 0 2024-09-13T23:06:18.149 INFO:tasks.workunit.client.1.smithi152.stdout:4/326: dread - d3/d4/d6/d37/d53/d1c/f41 zero size 2024-09-13T23:06:18.150 INFO:tasks.workunit.client.0.smithi115.stdout:9/861: creat d0/d13/d17/d36/dd1/f117 x:0 0 0 2024-09-13T23:06:18.151 INFO:tasks.workunit.client.0.smithi115.stdout:2/909: creat da/d23/f12b x:0 0 0 2024-09-13T23:06:18.151 INFO:tasks.workunit.client.0.smithi115.stdout:2/910: fsync da/d23/d2c/dc2/d104/dac/fcf 0 2024-09-13T23:06:18.151 INFO:tasks.workunit.client.0.smithi115.stdout:2/911: fdatasync da/d23/d2c/dc2/fef 0 2024-09-13T23:06:18.151 INFO:tasks.workunit.client.1.smithi152.stdout:4/327: unlink d3/d4/d6/d37/f4e 0 2024-09-13T23:06:18.152 INFO:tasks.workunit.client.0.smithi115.stdout:3/943: rename d3/d5/d35/d71/d3b/d4d to d3/d16/d1a/d13a 0 2024-09-13T23:06:18.153 INFO:tasks.workunit.client.0.smithi115.stdout:9/862: symlink d0/d13/d17/dc5/l118 0 2024-09-13T23:06:18.153 INFO:tasks.workunit.client.0.smithi115.stdout:9/863: dread - d0/d13/d17/d1f/d4e/d61/d7d/fb3 zero size 2024-09-13T23:06:18.153 INFO:tasks.workunit.client.0.smithi115.stdout:9/864: fdatasync d0/d13/d17/d36/d80/fe6 0 2024-09-13T23:06:18.154 INFO:tasks.workunit.client.0.smithi115.stdout:3/944: creat d3/d16/d1a/d13a/d8d/f13b x:0 0 0 2024-09-13T23:06:18.155 INFO:tasks.workunit.client.0.smithi115.stdout:2/912: getdents da/d23/d2c/dc2/de1/d56/dda 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/913: write da/d21/d8c/d41/fff [441860,103136] 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/914: write da/d21/da8/df5/f11e [4200270,98985] 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.0.smithi115.stdout:2/915: stat da/d23/d2c/dc2/d104/dac/ce5 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/328: write d3/d4/d6/d37/d53/d1c/f1e [3052916,83812] 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.1.smithi152.stdout:1/242: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:18.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/329: chown d3/d4/d6/d37/d53/d1c/f27 3277704 1 2024-09-13T23:06:18.159 INFO:tasks.workunit.client.0.smithi115.stdout:3/945: link d3/fd9 d3/d16/dab/f13c 0 2024-09-13T23:06:18.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/330: getdents d3/d34 0 2024-09-13T23:06:18.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/331: dread - d3/f40 zero size 2024-09-13T23:06:18.160 INFO:tasks.workunit.client.1.smithi152.stdout:1/243: dread d4/d9/d1a/f2e [0,4194304] 0 2024-09-13T23:06:18.160 INFO:tasks.workunit.client.1.smithi152.stdout:1/244: write d4/d9/fb [2839643,55208] 0 2024-09-13T23:06:18.160 INFO:tasks.workunit.client.1.smithi152.stdout:1/245: chown d4/d9/d1a/d22/l36 30174 1 2024-09-13T23:06:18.161 INFO:tasks.workunit.client.1.smithi152.stdout:1/246: truncate d4/d9/fd 970348 0 2024-09-13T23:06:18.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/332: symlink d3/d4/d32/l5c 0 2024-09-13T23:06:18.163 INFO:tasks.workunit.client.0.smithi115.stdout:4/871: dwrite db/d11/d2e/f5d [4194304,4194304] 0 2024-09-13T23:06:18.164 INFO:tasks.workunit.client.1.smithi152.stdout:1/247: rename d4/l8 to d4/d9/d1a/d22/l4d 0 2024-09-13T23:06:18.167 INFO:tasks.workunit.client.0.smithi115.stdout:3/946: creat d3/d16/d1a/d1e/d94/f13d x:0 0 0 2024-09-13T23:06:18.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/290: dwrite d0/d4/f37 [4194304,4194304] 0 2024-09-13T23:06:18.169 INFO:tasks.workunit.client.0.smithi115.stdout:7/793: dwrite da/dd/d13/d36/d5a/d99/ddd/d92/db1/fca [0,4194304] 0 2024-09-13T23:06:18.172 INFO:tasks.workunit.client.0.smithi115.stdout:0/763: dwrite d6/d24/d25/d58/ff6 [0,4194304] 0 2024-09-13T23:06:18.173 INFO:tasks.workunit.client.1.smithi152.stdout:5/217: dwrite d5/dc/d19/d20/d2e/d27/f44 [0,4194304] 0 2024-09-13T23:06:18.174 INFO:tasks.workunit.client.1.smithi152.stdout:8/144: dwrite d17/f29 [0,4194304] 0 2024-09-13T23:06:18.177 INFO:tasks.workunit.client.0.smithi115.stdout:4/872: creat db/d19/d34/f108 x:0 0 0 2024-09-13T23:06:18.178 INFO:tasks.workunit.client.0.smithi115.stdout:3/947: chown d3/d16/d1a/d1e/dd3/l10e 5454855 1 2024-09-13T23:06:18.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/248: write d4/f7 [3309761,126404] 0 2024-09-13T23:06:18.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/249: creat d4/d9/d1a/f4e x:0 0 0 2024-09-13T23:06:18.184 INFO:tasks.workunit.client.0.smithi115.stdout:7/794: rename da/dd/d1c/d2d/d41/fbb to da/dd/d1c/d84/f113 0 2024-09-13T23:06:18.184 INFO:tasks.workunit.client.0.smithi115.stdout:7/795: write da/dd/d1c/f7d [106866,71244] 0 2024-09-13T23:06:18.185 INFO:tasks.workunit.client.1.smithi152.stdout:1/250: symlink d4/d9/d1a/d22/d24/d48/l4f 0 2024-09-13T23:06:18.185 INFO:tasks.workunit.client.1.smithi152.stdout:1/251: chown d4/d9/d1a/d22/d24/d48 2683137 1 2024-09-13T23:06:18.185 INFO:tasks.workunit.client.1.smithi152.stdout:1/252: readlink d4/d9/d1a/d22/d24/l3a 0 2024-09-13T23:06:18.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/253: symlink d4/d9/d1a/d22/l50 0 2024-09-13T23:06:18.188 INFO:tasks.workunit.client.0.smithi115.stdout:4/873: mkdir db/d109 0 2024-09-13T23:06:18.193 INFO:tasks.workunit.client.0.smithi115.stdout:3/948: mkdir d3/d5/d5b/dd2/d13e 0 2024-09-13T23:06:18.194 INFO:tasks.workunit.client.1.smithi152.stdout:5/218: dread d5/f7 [0,4194304] 0 2024-09-13T23:06:18.196 INFO:tasks.workunit.client.0.smithi115.stdout:7/796: link c4 da/dd/d1c/c114 0 2024-09-13T23:06:18.197 INFO:tasks.workunit.client.0.smithi115.stdout:4/874: mknod db/d11/d2e/d33/d36/d51/d57/c10a 0 2024-09-13T23:06:18.198 INFO:tasks.workunit.client.0.smithi115.stdout:3/949: chown d3/d16/d1a/d1e/cc8 1137914015 1 2024-09-13T23:06:18.200 INFO:tasks.workunit.client.0.smithi115.stdout:7/797: mkdir da/dd/d13/d24/d67/d115 0 2024-09-13T23:06:18.201 INFO:tasks.workunit.client.1.smithi152.stdout:8/145: write d17/f1d [4315305,42615] 0 2024-09-13T23:06:18.201 INFO:tasks.workunit.client.1.smithi152.stdout:8/146: chown d17/d23 0 1 2024-09-13T23:06:18.201 INFO:tasks.workunit.client.0.smithi115.stdout:4/875: creat db/d19/daa/f10b x:0 0 0 2024-09-13T23:06:18.201 INFO:tasks.workunit.client.0.smithi115.stdout:4/876: readlink db/d11/d54/d17/lb1 0 2024-09-13T23:06:18.201 INFO:tasks.workunit.client.0.smithi115.stdout:4/877: stat db/d11/d2e/d33/d36/d7f/l8a 0 2024-09-13T23:06:18.202 INFO:tasks.workunit.client.0.smithi115.stdout:3/950: rename d3/d5/d35/l54 to d3/d16/l13f 0 2024-09-13T23:06:18.203 INFO:tasks.workunit.client.0.smithi115.stdout:7/798: mknod da/dd/d13/d36/c116 0 2024-09-13T23:06:18.204 INFO:tasks.workunit.client.0.smithi115.stdout:3/951: creat d3/d12c/d139/f140 x:0 0 0 2024-09-13T23:06:18.206 INFO:tasks.workunit.client.0.smithi115.stdout:3/952: creat d3/d5/d35/d4c/f141 x:0 0 0 2024-09-13T23:06:18.208 INFO:tasks.workunit.client.0.smithi115.stdout:3/953: mkdir d3/d5/d5b/dd2/d142 0 2024-09-13T23:06:18.211 INFO:tasks.workunit.client.0.smithi115.stdout:9/865: dwrite d0/d13/d17/d1f/d28/d76/d81/dd0/fe4 [0,4194304] 0 2024-09-13T23:06:18.211 INFO:tasks.workunit.client.0.smithi115.stdout:2/916: dwrite da/d23/d2c/dc2/d103/f123 [0,4194304] 0 2024-09-13T23:06:18.218 INFO:tasks.workunit.client.0.smithi115.stdout:4/878: write db/d16/d3f/f67 [130597,128281] 0 2024-09-13T23:06:18.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:18 smithi152 ceph-mon[34465]: mgrmap e24: smithi152.ntylos(active, since 3s) 2024-09-13T23:06:18.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:18 smithi152 ceph-mon[34465]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:18.219 INFO:tasks.workunit.client.0.smithi115.stdout:2/917: rename da/d23/d2c/dc2/d104/dac to da/d21/da6/de7/d12c 0 2024-09-13T23:06:18.219 INFO:tasks.workunit.client.0.smithi115.stdout:9/866: getdents d0/d13/d17 0 2024-09-13T23:06:18.220 INFO:tasks.workunit.client.0.smithi115.stdout:9/867: chown d0/d13/d17/d36/c48 2734759 1 2024-09-13T23:06:18.220 INFO:tasks.workunit.client.0.smithi115.stdout:9/868: creat d0/d13/f119 x:0 0 0 2024-09-13T23:06:18.224 INFO:tasks.workunit.client.0.smithi115.stdout:4/879: truncate db/d11/d2e/d33/d36/d51/f7d 1389371 0 2024-09-13T23:06:18.227 INFO:tasks.workunit.client.0.smithi115.stdout:3/954: dread d3/d16/d1c/d101/fc4 [0,4194304] 0 2024-09-13T23:06:18.228 INFO:tasks.workunit.client.0.smithi115.stdout:3/955: chown d3/d5/d65/da8/da4/d49/f67 11332739 1 2024-09-13T23:06:18.229 INFO:tasks.workunit.client.0.smithi115.stdout:3/956: rename d3/d5/d5b/f70 to d3/d5/d35/d71/d3b/d47/de1/f143 0 2024-09-13T23:06:18.230 INFO:tasks.workunit.client.0.smithi115.stdout:2/918: write da/d21/d8c/d41/f7a [6124417,11259] 0 2024-09-13T23:06:18.231 INFO:tasks.workunit.client.0.smithi115.stdout:3/957: rename d3/d5/d35/d71/d3b/d47/de1/d119 to d3/d5/d35/d71/d3b/d47/de1/d144 0 2024-09-13T23:06:18.231 INFO:tasks.workunit.client.0.smithi115.stdout:2/919: symlink da/d23/d2c/dc2/de1/d56/d74/d10f/l12d 0 2024-09-13T23:06:18.231 INFO:tasks.workunit.client.0.smithi115.stdout:2/920: chown da/d23/d2c/dc2/de1/d56/d4b/l92 856080412 1 2024-09-13T23:06:18.232 INFO:tasks.workunit.client.0.smithi115.stdout:3/958: mkdir d3/d145 0 2024-09-13T23:06:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/333: dwrite d3/d4/d6/d37/d53/f49 [0,4194304] 0 2024-09-13T23:06:18.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/334: write d3/d4/d6/d37/d53/d1c/f28 [242749,113619] 0 2024-09-13T23:06:18.236 INFO:tasks.workunit.client.1.smithi152.stdout:4/335: mkdir d3/d4/d6/d8/d17/d5d 0 2024-09-13T23:06:18.237 INFO:tasks.workunit.client.1.smithi152.stdout:4/336: rmdir d3/d4/d6/d8/d17/d39 39 2024-09-13T23:06:18.237 INFO:tasks.workunit.client.1.smithi152.stdout:4/337: chown d3/d4/d6/f20 102 1 2024-09-13T23:06:18.237 INFO:tasks.workunit.client.1.smithi152.stdout:4/338: chown d3/d4/d6/d37/d53/d1c/l38 202583465 1 2024-09-13T23:06:18.243 INFO:tasks.workunit.client.0.smithi115.stdout:2/921: write da/d21/da8/fb6 [3194086,8797] 0 2024-09-13T23:06:18.243 INFO:tasks.workunit.client.0.smithi115.stdout:6/987: dwrite d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/fbc [0,4194304] 0 2024-09-13T23:06:18.243 INFO:tasks.workunit.client.0.smithi115.stdout:0/764: dwrite d6/fe7 [0,4194304] 0 2024-09-13T23:06:18.244 INFO:tasks.workunit.client.0.smithi115.stdout:0/765: write d6/d24/d25/da3/f102 [7982170,61546] 0 2024-09-13T23:06:18.244 INFO:tasks.workunit.client.0.smithi115.stdout:0/766: readlink d6/d24/d25/d7f/l94 0 2024-09-13T23:06:18.244 INFO:tasks.workunit.client.0.smithi115.stdout:0/767: chown d6/da0 3 1 2024-09-13T23:06:18.244 INFO:tasks.workunit.client.1.smithi152.stdout:1/254: dwrite d4/d9/f2b [0,4194304] 0 2024-09-13T23:06:18.244 INFO:tasks.workunit.client.0.smithi115.stdout:7/799: dwrite da/dd/fe5 [0,4194304] 0 2024-09-13T23:06:18.245 INFO:tasks.workunit.client.0.smithi115.stdout:9/869: dwrite d0/d43/f6d [0,4194304] 0 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/147: dwrite d17/d23/f30 [0,4194304] 0 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/148: chown c16 337279697 1 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/149: chown cf 7624132 1 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/150: stat d17/l26 0 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/151: creat d17/d19/f33 x:0 0 0 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/152: chown d17/d23 12196919 1 2024-09-13T23:06:18.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/153: creat d17/d23/f34 x:0 0 0 2024-09-13T23:06:18.247 INFO:tasks.workunit.client.1.smithi152.stdout:1/255: symlink d4/d9/d1a/d22/d24/d48/l51 0 2024-09-13T23:06:18.247 INFO:tasks.workunit.client.0.smithi115.stdout:2/922: dread da/d23/d2c/dc2/de1/d56/d1a/f44 [0,4194304] 0 2024-09-13T23:06:18.248 INFO:tasks.workunit.client.1.smithi152.stdout:4/339: dread d3/d4/d6/d37/d53/f3d [0,4194304] 0 2024-09-13T23:06:18.248 INFO:tasks.workunit.client.1.smithi152.stdout:2/291: dwrite d0/d4/d9/d16/d2b/f60 [0,4194304] 0 2024-09-13T23:06:18.250 INFO:tasks.workunit.client.0.smithi115.stdout:6/988: dread d4/df/d14/d38/d2a/d31/d5b/d88/d9f/fdb [0,4194304] 0 2024-09-13T23:06:18.251 INFO:tasks.workunit.client.1.smithi152.stdout:8/154: truncate fd 769615 0 2024-09-13T23:06:18.252 INFO:tasks.workunit.client.0.smithi115.stdout:0/768: creat d6/d24/d25/da3/dad/de4/df7/f109 x:0 0 0 2024-09-13T23:06:18.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/256: link d4/d9/fb d4/d9/d1a/d22/d24/f52 0 2024-09-13T23:06:18.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/257: truncate d4/d9/d1a/f33 805308 0 2024-09-13T23:06:18.254 INFO:tasks.workunit.client.0.smithi115.stdout:0/769: read d6/d24/d25/da3/dad/f9b [1261167,62981] 0 2024-09-13T23:06:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/292: mknod d0/d4/d9/d18/d32/c6e 0 2024-09-13T23:06:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/293: readlink d0/d4/d9/lc 0 2024-09-13T23:06:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/294: fdatasync d0/d4/f1a 0 2024-09-13T23:06:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/295: chown d0/d4/l7 397 1 2024-09-13T23:06:18.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/296: write d0/d4/d9/d55/f57 [678243,16104] 0 2024-09-13T23:06:18.258 INFO:tasks.workunit.client.1.smithi152.stdout:8/155: creat d17/d25/f35 x:0 0 0 2024-09-13T23:06:18.258 INFO:tasks.workunit.client.1.smithi152.stdout:8/156: readlink d17/l26 0 2024-09-13T23:06:18.258 INFO:tasks.workunit.client.1.smithi152.stdout:8/157: chown fd 570048629 1 2024-09-13T23:06:18.260 INFO:tasks.workunit.client.0.smithi115.stdout:7/800: mkdir da/dd/d13/d24/d52/da1/d117 0 2024-09-13T23:06:18.261 INFO:tasks.workunit.client.1.smithi152.stdout:8/158: link l6 d17/d23/l36 0 2024-09-13T23:06:18.263 INFO:tasks.workunit.client.1.smithi152.stdout:1/258: dread d4/d9/f13 [0,4194304] 0 2024-09-13T23:06:18.263 INFO:tasks.workunit.client.0.smithi115.stdout:6/989: symlink d4/df/d14/d38/d2a/d31/d5b/d14f/l155 0 2024-09-13T23:06:18.263 INFO:tasks.workunit.client.1.smithi152.stdout:8/159: rename d17/d23/l27 to d17/d23/l37 0 2024-09-13T23:06:18.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/259: rename d4/f6 to d4/d9/d1a/d22/d24/f53 0 2024-09-13T23:06:18.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/260: fdatasync d4/d9/d1a/f49 0 2024-09-13T23:06:18.266 INFO:tasks.workunit.client.0.smithi115.stdout:0/770: write d6/d24/d25/d58/f92 [2631273,38873] 0 2024-09-13T23:06:18.269 INFO:tasks.workunit.client.1.smithi152.stdout:1/261: creat d4/d4c/f54 x:0 0 0 2024-09-13T23:06:18.273 INFO:tasks.workunit.client.0.smithi115.stdout:9/870: getdents d0/d13/d17/d1f/d28/d76/d81/dd0 0 2024-09-13T23:06:18.274 INFO:tasks.workunit.client.0.smithi115.stdout:9/871: write d0/fb8 [695218,98844] 0 2024-09-13T23:06:18.274 INFO:tasks.workunit.client.0.smithi115.stdout:9/872: dread - d0/d13/d17/d1f/d4e/d61/d9b/f116 zero size 2024-09-13T23:06:18.274 INFO:tasks.workunit.client.0.smithi115.stdout:9/873: fdatasync d0/d43/df8/fee 0 2024-09-13T23:06:18.274 INFO:tasks.workunit.client.0.smithi115.stdout:9/874: creat d0/d13/d17/d36/dd1/f11a x:0 0 0 2024-09-13T23:06:18.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/801: dread da/dd/d13/d24/f4f [0,4194304] 0 2024-09-13T23:06:18.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/802: fsync da/dd/d13/d24/d67/fe2 0 2024-09-13T23:06:18.277 INFO:tasks.workunit.client.0.smithi115.stdout:9/875: write d0/fb8 [262259,122868] 0 2024-09-13T23:06:18.277 INFO:tasks.workunit.client.0.smithi115.stdout:9/876: fdatasync d0/d13/d17/d1f/d28/f91 0 2024-09-13T23:06:18.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/803: rename da/dd/d1c/f22 to da/dd/d1c/d10f/f118 0 2024-09-13T23:06:18.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/804: fsync da/dd/d13/d24/d67/fe2 0 2024-09-13T23:06:18.279 INFO:tasks.workunit.client.0.smithi115.stdout:7/805: creat da/df/d3b/f119 x:0 0 0 2024-09-13T23:06:18.283 INFO:tasks.workunit.client.0.smithi115.stdout:9/877: rename d0/d43/d53/l84 to d0/d13/d17/d1f/d77/l11b 0 2024-09-13T23:06:18.286 INFO:tasks.workunit.client.0.smithi115.stdout:9/878: link d0/d13/f72 d0/d13/d3b/f11c 0 2024-09-13T23:06:18.288 INFO:tasks.workunit.client.0.smithi115.stdout:9/879: mkdir d0/d13/d17/d1f/d28/d76/d81/dd0/d11d 0 2024-09-13T23:06:18.288 INFO:tasks.workunit.client.0.smithi115.stdout:9/880: truncate d0/d13/d17/d1f/d28/ff2 1125278 0 2024-09-13T23:06:18.288 INFO:tasks.workunit.client.0.smithi115.stdout:9/881: creat d0/d13/d17/d36/dfe/f11e x:0 0 0 2024-09-13T23:06:18.298 INFO:tasks.workunit.client.0.smithi115.stdout:6/990: dwrite d4/df/d14/d38/d44/d99/def/f14d [0,4194304] 0 2024-09-13T23:06:18.300 INFO:tasks.workunit.client.1.smithi152.stdout:2/297: dwrite d0/f2e [0,4194304] 0 2024-09-13T23:06:18.301 INFO:tasks.workunit.client.1.smithi152.stdout:1/262: rmdir d4/d9/d1a 39 2024-09-13T23:06:18.301 INFO:tasks.workunit.client.1.smithi152.stdout:8/160: dwrite d17/d23/f2b [0,4194304] 0 2024-09-13T23:06:18.302 INFO:tasks.workunit.client.1.smithi152.stdout:8/161: stat c14 0 2024-09-13T23:06:18.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/298: write d0/d4/d9/d16/f17 [560797,99521] 0 2024-09-13T23:06:18.304 INFO:tasks.workunit.client.0.smithi115.stdout:0/771: dwrite d6/d24/d25/d2b/d82/d6b/d9f/f83 [4194304,4194304] 0 2024-09-13T23:06:18.304 INFO:tasks.workunit.client.0.smithi115.stdout:0/772: creat d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f10a x:0 0 0 2024-09-13T23:06:18.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/299: rename d0/d4/d9/d16/d2b/f60 to d0/d4/d9/d18/f6f 0 2024-09-13T23:06:18.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/300: fdatasync d0/d4/d9/ff 0 2024-09-13T23:06:18.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/301: chown d0/d4/d9/d16/d2b/f3b 0 1 2024-09-13T23:06:18.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/302: dread - d0/d8/d43/f51 zero size 2024-09-13T23:06:18.307 INFO:tasks.workunit.client.1.smithi152.stdout:2/303: write d0/d4/d9/d18/f6f [4665131,34270] 0 2024-09-13T23:06:18.308 INFO:tasks.workunit.client.0.smithi115.stdout:0/773: unlink d6/d24/d25/d2b/d82/d44/fb7 0 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:6/255: sync 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:7/272: sync 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:3/251: sync 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/304: symlink d0/d4/d9/d55/l70 0 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/305: fsync d0/d4/d9/d18/d32/f5a 0 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/306: dread - d0/d4/d9/f63 zero size 2024-09-13T23:06:18.309 INFO:tasks.workunit.client.0.smithi115.stdout:9/882: dwrite d0/d13/d17/d36/dfe/f11e [0,4194304] 0 2024-09-13T23:06:18.311 INFO:tasks.workunit.client.1.smithi152.stdout:6/256: rename d4/de/d21/f4e to d4/de/d12/f55 0 2024-09-13T23:06:18.311 INFO:tasks.workunit.client.0.smithi115.stdout:0/774: dread d6/f20 [0,4194304] 0 2024-09-13T23:06:18.312 INFO:tasks.workunit.client.0.smithi115.stdout:6/991: read d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/fbc [104777,128605] 0 2024-09-13T23:06:18.312 INFO:tasks.workunit.client.1.smithi152.stdout:2/307: unlink d0/d4/f5e 0 2024-09-13T23:06:18.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/252: rename de/d14/f21 to de/f5c 0 2024-09-13T23:06:18.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/162: dread f15 [0,4194304] 0 2024-09-13T23:06:18.318 INFO:tasks.workunit.client.0.smithi115.stdout:9/883: dread d0/d13/d3b/d42/f100 [0,4194304] 0 2024-09-13T23:06:18.319 INFO:tasks.workunit.client.0.smithi115.stdout:9/884: write d0/d13/d17/d1f/d4e/d61/d7d/ff3 [604963,75442] 0 2024-09-13T23:06:18.319 INFO:tasks.workunit.client.1.smithi152.stdout:3/253: rmdir de/d14/d38 39 2024-09-13T23:06:18.319 INFO:tasks.workunit.client.1.smithi152.stdout:3/254: chown de/ff 960101 1 2024-09-13T23:06:18.319 INFO:tasks.workunit.client.0.smithi115.stdout:6/992: link d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/db4/fd8 d4/df/d14/d67/d77/dc1/d140/f156 0 2024-09-13T23:06:18.322 INFO:tasks.workunit.client.0.smithi115.stdout:9/885: symlink d0/d13/d17/d19/l11f 0 2024-09-13T23:06:18.323 INFO:tasks.workunit.client.0.smithi115.stdout:6/993: rmdir d4/df/d14/d38/d2a/d31 39 2024-09-13T23:06:18.324 INFO:tasks.workunit.client.0.smithi115.stdout:9/886: mknod d0/d13/d17/d1f/d4e/de9/c120 0 2024-09-13T23:06:18.326 INFO:tasks.workunit.client.0.smithi115.stdout:6/994: link d4/df/d14/d67/f7a d4/df/d14/d67/d77/dcf/de8/dec/f157 0 2024-09-13T23:06:18.328 INFO:tasks.workunit.client.0.smithi115.stdout:9/887: mkdir d0/d13/d3b/d42/d95/d121 0 2024-09-13T23:06:18.328 INFO:tasks.workunit.client.0.smithi115.stdout:6/995: mkdir d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/d158 0 2024-09-13T23:06:18.329 INFO:tasks.workunit.client.0.smithi115.stdout:9/888: mknod d0/d13/d17/d1f/d4e/d61/d7d/d98/c122 0 2024-09-13T23:06:18.330 INFO:tasks.workunit.client.0.smithi115.stdout:9/889: dread - d0/d13/d17/d1f/d4e/d90/fe5 zero size 2024-09-13T23:06:18.330 INFO:tasks.workunit.client.0.smithi115.stdout:0/775: read d6/d24/d25/d2b/d61/f69 [3751077,121321] 0 2024-09-13T23:06:18.330 INFO:tasks.workunit.client.0.smithi115.stdout:0/776: dread - d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/ff8 zero size 2024-09-13T23:06:18.330 INFO:tasks.workunit.client.0.smithi115.stdout:6/996: mkdir d4/df/d14/d135/d159 0 2024-09-13T23:06:18.330 INFO:tasks.workunit.client.0.smithi115.stdout:6/997: truncate d4/df/d14/d67/d10e/ffa 1746378 0 2024-09-13T23:06:18.331 INFO:tasks.workunit.client.1.smithi152.stdout:3/255: dread de/f40 [0,4194304] 0 2024-09-13T23:06:18.331 INFO:tasks.workunit.client.1.smithi152.stdout:3/256: write de/d14/d38/d27/f41 [823424,85728] 0 2024-09-13T23:06:18.331 INFO:tasks.workunit.client.0.smithi115.stdout:0/777: symlink d6/d24/d25/da3/dad/de4/df7/l10b 0 2024-09-13T23:06:18.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/778: mkdir d6/d24/d25/d10c 0 2024-09-13T23:06:18.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/779: readlink d6/da0/lc9 0 2024-09-13T23:06:18.332 INFO:tasks.workunit.client.0.smithi115.stdout:0/780: chown d6/l9c 0 1 2024-09-13T23:06:18.333 INFO:tasks.workunit.client.0.smithi115.stdout:0/781: symlink d6/d24/d25/d2b/d82/d6b/l10d 0 2024-09-13T23:06:18.334 INFO:tasks.workunit.client.1.smithi152.stdout:3/257: rename de/d14/d38/d27 to de/d14/d47/d57/d5d 0 2024-09-13T23:06:18.335 INFO:tasks.workunit.client.0.smithi115.stdout:0/782: symlink d6/d24/d25/da3/dad/l10e 0 2024-09-13T23:06:18.339 INFO:tasks.workunit.client.0.smithi115.stdout:0/783: rename d6/d24/d25/da3/cbd to d6/d24/d25/da3/dad/c10f 0 2024-09-13T23:06:18.339 INFO:tasks.workunit.client.1.smithi152.stdout:1/263: dwrite d4/d9/d1a/d22/d24/f53 [4194304,4194304] 0 2024-09-13T23:06:18.339 INFO:tasks.workunit.client.1.smithi152.stdout:6/257: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:18.340 INFO:tasks.workunit.client.1.smithi152.stdout:6/258: readlink d4/de/l43 0 2024-09-13T23:06:18.340 INFO:tasks.workunit.client.1.smithi152.stdout:7/273: dwrite d17/d24/d2a/d2e/f32 [0,4194304] 0 2024-09-13T23:06:18.340 INFO:tasks.workunit.client.1.smithi152.stdout:7/274: write d17/d24/d2a/d2e/d30/f53 [3858394,56459] 0 2024-09-13T23:06:18.340 INFO:tasks.workunit.client.1.smithi152.stdout:7/275: readlink d17/d24/d2d/d3f/l43 0 2024-09-13T23:06:18.342 INFO:tasks.workunit.client.1.smithi152.stdout:6/259: mknod d4/de/d1d/c56 0 2024-09-13T23:06:18.343 INFO:tasks.workunit.client.0.smithi115.stdout:0/784: creat d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/f110 x:0 0 0 2024-09-13T23:06:18.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/260: dread d4/de/f49 [0,4194304] 0 2024-09-13T23:06:18.345 INFO:tasks.workunit.client.0.smithi115.stdout:6/998: dread d4/df/d14/f144 [4194304,4194304] 0 2024-09-13T23:06:18.345 INFO:tasks.workunit.client.1.smithi152.stdout:8/163: dwrite d17/d25/f2f [0,4194304] 0 2024-09-13T23:06:18.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/785: link d6/d24/d25/d2b/fcf d6/d24/d25/d2b/d82/d6b/f111 0 2024-09-13T23:06:18.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/786: truncate d6/d24/d25/d7f/f9a 1554400 0 2024-09-13T23:06:18.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/787: write d6/d24/d25/d2b/d103/dd4/d107/f8f [1072354,17272] 0 2024-09-13T23:06:18.346 INFO:tasks.workunit.client.0.smithi115.stdout:6/999: mknod d4/df/d14/d38/d2a/d3e/d56/d13f/d5a/d79/d85/c15a 0 2024-09-13T23:06:18.349 INFO:tasks.workunit.client.1.smithi152.stdout:7/276: dread d17/d24/d2d/d46/f50 [0,4194304] 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:8/164: creat d17/d25/d32/f38 x:0 0 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:8/165: write d17/d19/f33 [972812,19712] 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:8/166: chown d17/f2c 497 1 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:8/167: creat d17/d25/f39 x:0 0 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:8/168: write d17/d19/f20 [1495804,9816] 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:1/264: dread d4/d9/fb [4194304,4194304] 0 2024-09-13T23:06:18.354 INFO:tasks.workunit.client.1.smithi152.stdout:7/277: mkdir d17/d24/d2d/d51/d5b 0 2024-09-13T23:06:18.356 INFO:tasks.workunit.client.1.smithi152.stdout:6/261: dread d4/de/f2c [0,4194304] 0 2024-09-13T23:06:18.358 INFO:tasks.workunit.client.1.smithi152.stdout:8/169: dread f15 [0,4194304] 0 2024-09-13T23:06:18.358 INFO:tasks.workunit.client.1.smithi152.stdout:8/170: creat d17/f3a x:0 0 0 2024-09-13T23:06:18.359 INFO:tasks.workunit.client.1.smithi152.stdout:6/262: mkdir d4/de/d12/d16/d2a/d3d/d57 0 2024-09-13T23:06:18.359 INFO:tasks.workunit.client.1.smithi152.stdout:6/263: creat d4/de/d12/d16/f58 x:0 0 0 2024-09-13T23:06:18.359 INFO:tasks.workunit.client.1.smithi152.stdout:8/171: mknod d17/c3b 0 2024-09-13T23:06:18.360 INFO:tasks.workunit.client.1.smithi152.stdout:8/172: mknod d17/d19/c3c 0 2024-09-13T23:06:18.361 INFO:tasks.workunit.client.1.smithi152.stdout:3/258: dwrite de/d14/d47/d57/d5d/f2b [0,4194304] 0 2024-09-13T23:06:18.361 INFO:tasks.workunit.client.0.smithi115.stdout:9/890: dwrite d0/d43/d53/f59 [0,4194304] 0 2024-09-13T23:06:18.361 INFO:tasks.workunit.client.0.smithi115.stdout:9/891: dread - d0/d13/d17/d1f/d35/d40/fef zero size 2024-09-13T23:06:18.362 INFO:tasks.workunit.client.1.smithi152.stdout:8/173: truncate d17/d23/f30 928281 0 2024-09-13T23:06:18.362 INFO:tasks.workunit.client.1.smithi152.stdout:8/174: readlink l6 0 2024-09-13T23:06:18.362 INFO:tasks.workunit.client.1.smithi152.stdout:8/175: readlink l13 0 2024-09-13T23:06:18.364 INFO:tasks.workunit.client.0.smithi115.stdout:9/892: unlink d0/d13/d3b/d42/d95/fd8 0 2024-09-13T23:06:18.364 INFO:tasks.workunit.client.0.smithi115.stdout:9/893: chown d0/d13/d3b/d42 1598 1 2024-09-13T23:06:18.364 INFO:tasks.workunit.client.0.smithi115.stdout:9/894: dread - d0/d13/d17/d19/dc8/f115 zero size 2024-09-13T23:06:18.364 INFO:tasks.workunit.client.0.smithi115.stdout:9/895: dread - d0/d13/d3b/fae zero size 2024-09-13T23:06:18.365 INFO:tasks.workunit.client.1.smithi152.stdout:3/259: rename de/c24 to de/d14/d47/c5e 0 2024-09-13T23:06:18.365 INFO:tasks.workunit.client.1.smithi152.stdout:8/176: stat l6 0 2024-09-13T23:06:18.368 INFO:tasks.workunit.client.0.smithi115.stdout:9/896: dread d0/d13/d17/d36/f8d [0,4194304] 0 2024-09-13T23:06:18.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/260: rename la to de/d1f/l5f 0 2024-09-13T23:06:18.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/261: chown de/d14/d47/f48 0 1 2024-09-13T23:06:18.370 INFO:tasks.workunit.client.1.smithi152.stdout:8/177: link d17/d25/f2f d17/d19/f3d 0 2024-09-13T23:06:18.371 INFO:tasks.workunit.client.0.smithi115.stdout:9/897: rename d0/d13/d17/d1f/d4e/d90/led to d0/d13/d3b/l123 0 2024-09-13T23:06:18.371 INFO:tasks.workunit.client.1.smithi152.stdout:3/262: symlink de/d14/d47/l60 0 2024-09-13T23:06:18.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/263: write de/f1d [285077,11579] 0 2024-09-13T23:06:18.372 INFO:tasks.workunit.client.0.smithi115.stdout:9/898: creat d0/d13/d3b/d42/d95/f124 x:0 0 0 2024-09-13T23:06:18.372 INFO:tasks.workunit.client.0.smithi115.stdout:9/899: chown d0/d13/d17/d19/c3d 437544 1 2024-09-13T23:06:18.373 INFO:tasks.workunit.client.0.smithi115.stdout:9/900: write d0/d13/d17/d1f/d77/f93 [1681397,4279] 0 2024-09-13T23:06:18.374 INFO:tasks.workunit.client.1.smithi152.stdout:3/264: rename de/d14/d47/l60 to de/l61 0 2024-09-13T23:06:18.388 INFO:tasks.workunit.client.0.smithi115.stdout:9/901: write d0/d13/f2d [2490102,113664] 0 2024-09-13T23:06:18.389 INFO:tasks.workunit.client.0.smithi115.stdout:9/902: write d0/d13/d17/d36/d80/fe6 [1493240,124612] 0 2024-09-13T23:06:18.389 INFO:tasks.workunit.client.0.smithi115.stdout:9/903: stat d0/d13/d17/d1f/d35/d40/l6e 0 2024-09-13T23:06:18.390 INFO:tasks.workunit.client.0.smithi115.stdout:9/904: unlink d0/fb8 0 2024-09-13T23:06:18.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/905: mknod d0/d13/d17/d1f/d4e/d61/c125 0 2024-09-13T23:06:18.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/906: stat d0/d13/d17/d1f/d28/f38 0 2024-09-13T23:06:18.391 INFO:tasks.workunit.client.0.smithi115.stdout:9/907: link d0/d13/c4a d0/d13/d17/d1f/d28/c126 0 2024-09-13T23:06:18.393 INFO:tasks.workunit.client.0.smithi115.stdout:9/908: mknod d0/d13/d17/d1f/d4e/d61/c127 0 2024-09-13T23:06:18.393 INFO:tasks.workunit.client.0.smithi115.stdout:0/788: dwrite d6/fe7 [0,4194304] 0 2024-09-13T23:06:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/264: dwrite d4/de/d21/f14 [0,4194304] 0 2024-09-13T23:06:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/265: read d4/de/d12/f28 [243847,113490] 0 2024-09-13T23:06:18.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/266: write d4/de/d12/d16/d2a/d38/d3c/f54 [911168,88053] 0 2024-09-13T23:06:18.396 INFO:tasks.workunit.client.1.smithi152.stdout:8/178: dwrite d17/f29 [0,4194304] 0 2024-09-13T23:06:18.396 INFO:tasks.workunit.client.1.smithi152.stdout:8/179: chown d17/f1d 14 1 2024-09-13T23:06:18.396 INFO:tasks.workunit.client.1.smithi152.stdout:8/180: creat d17/d25/d32/f3e x:0 0 0 2024-09-13T23:06:18.396 INFO:tasks.workunit.client.1.smithi152.stdout:3/265: dwrite de/f1e [0,4194304] 0 2024-09-13T23:06:18.397 INFO:tasks.workunit.client.0.smithi115.stdout:9/909: rename d0/c2b to d0/d13/c128 0 2024-09-13T23:06:18.399 INFO:tasks.workunit.client.0.smithi115.stdout:0/789: mknod d6/d24/d25/d7f/c112 0 2024-09-13T23:06:18.400 INFO:tasks.workunit.client.0.smithi115.stdout:0/790: symlink d6/d24/d25/d2b/d82/d44/l113 0 2024-09-13T23:06:18.401 INFO:tasks.workunit.client.0.smithi115.stdout:0/791: fdatasync d6/d24/d25/dc7/ff4 0 2024-09-13T23:06:18.402 INFO:tasks.workunit.client.0.smithi115.stdout:0/792: creat d6/d24/d25/d2b/d82/f114 x:0 0 0 2024-09-13T23:06:18.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/267: write d4/de/d12/f20 [3568890,57575] 0 2024-09-13T23:06:18.406 INFO:tasks.workunit.client.1.smithi152.stdout:6/268: mknod d4/de/d12/d3e/c59 0 2024-09-13T23:06:18.406 INFO:tasks.workunit.client.0.smithi115.stdout:0/793: dread d6/d24/f63 [0,4194304] 0 2024-09-13T23:06:18.408 INFO:tasks.workunit.client.0.smithi115.stdout:0/794: symlink d6/da0/dd9/l115 0 2024-09-13T23:06:18.408 INFO:tasks.workunit.client.0.smithi115.stdout:0/795: readlink d6/d24/d25/d2b/d82/d44/l6f 0 2024-09-13T23:06:18.411 INFO:tasks.workunit.client.0.smithi115.stdout:9/910: dwrite d0/d13/d17/d1f/d4e/d61/d7d/fb3 [0,4194304] 0 2024-09-13T23:06:18.414 INFO:tasks.workunit.client.1.smithi152.stdout:8/181: rmdir d17/d25/d32 39 2024-09-13T23:06:18.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/796: dread d6/da0/fda [0,4194304] 0 2024-09-13T23:06:18.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/797: truncate d6/d24/d25/d2b/d103/dd4/fdb 205375 0 2024-09-13T23:06:18.429 INFO:tasks.workunit.client.0.smithi115.stdout:9/911: write d0/d13/d17/d1f/d4e/d61/d7d/fb3 [1052925,61868] 0 2024-09-13T23:06:18.431 INFO:tasks.workunit.client.0.smithi115.stdout:9/912: mknod d0/d13/d17/d1f/d4e/d61/d7d/d98/c129 0 2024-09-13T23:06:18.431 INFO:tasks.workunit.client.0.smithi115.stdout:9/913: chown d0/d13/d17/d1f/d4e/d90 1 1 2024-09-13T23:06:18.433 INFO:tasks.workunit.client.0.smithi115.stdout:9/914: rename d0/d112 to d0/d13/d17/d1f/d4e/d12a 0 2024-09-13T23:06:18.433 INFO:tasks.workunit.client.0.smithi115.stdout:9/915: write d0/d13/d17/d1f/d28/d76/fa9 [9195657,124603] 0 2024-09-13T23:06:18.434 INFO:tasks.workunit.client.0.smithi115.stdout:9/916: stat d0/d13/d17/d1f/d28/d76/d81/l9a 0 2024-09-13T23:06:18.434 INFO:tasks.workunit.client.1.smithi152.stdout:6/269: dwrite d4/de/d12/d16/d2a/f48 [0,4194304] 0 2024-09-13T23:06:18.435 INFO:tasks.workunit.client.0.smithi115.stdout:9/917: rmdir d0/d13/d17/d1f/d4e/d90 39 2024-09-13T23:06:18.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/270: mknod d4/de/d12/d16/d2a/d38/c5a 0 2024-09-13T23:06:18.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/271: write d4/de/d21/f14 [4844767,21638] 0 2024-09-13T23:06:18.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/272: stat d4/de/c2b 0 2024-09-13T23:06:18.439 INFO:tasks.workunit.client.1.smithi152.stdout:6/273: mkdir d4/de/d21/d5b 0 2024-09-13T23:06:18.450 INFO:tasks.workunit.client.1.smithi152.stdout:8/182: dwrite d17/f1c [4194304,4194304] 0 2024-09-13T23:06:18.451 INFO:tasks.workunit.client.0.smithi115.stdout:0/798: dwrite d6/d24/d25/d2b/d82/d44/d5c/d87/fde [0,4194304] 0 2024-09-13T23:06:18.451 INFO:tasks.workunit.client.0.smithi115.stdout:0/799: truncate d6/d24/d25/d2b/d82/d6b/f111 1601950 0 2024-09-13T23:06:18.451 INFO:tasks.workunit.client.0.smithi115.stdout:1/768: sync 2024-09-13T23:06:18.452 INFO:tasks.workunit.client.1.smithi152.stdout:8/183: rmdir d17 39 2024-09-13T23:06:18.453 INFO:tasks.workunit.client.0.smithi115.stdout:9/918: dwrite d0/d43/d53/fea [0,4194304] 0 2024-09-13T23:06:18.453 INFO:tasks.workunit.client.0.smithi115.stdout:9/919: chown d0/d13/f119 0 1 2024-09-13T23:06:18.455 INFO:tasks.workunit.client.0.smithi115.stdout:0/800: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/d116 0 2024-09-13T23:06:18.455 INFO:tasks.workunit.client.0.smithi115.stdout:0/801: write d6/d24/d25/d7f/f98 [395967,83262] 0 2024-09-13T23:06:18.456 INFO:tasks.workunit.client.0.smithi115.stdout:1/769: getdents d0/de/d1b/d25/d4d/d51 0 2024-09-13T23:06:18.457 INFO:tasks.workunit.client.0.smithi115.stdout:9/920: rmdir d0/d43/df8 39 2024-09-13T23:06:18.458 INFO:tasks.workunit.client.0.smithi115.stdout:0/802: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/d116/d117 0 2024-09-13T23:06:18.458 INFO:tasks.workunit.client.0.smithi115.stdout:0/803: dread - d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/f108 zero size 2024-09-13T23:06:18.459 INFO:tasks.workunit.client.0.smithi115.stdout:1/770: creat d0/de/d66/d8f/d29/d47/ff6 x:0 0 0 2024-09-13T23:06:18.460 INFO:tasks.workunit.client.0.smithi115.stdout:9/921: rename d0/d13/d17/d1f/d35/d40/c82 to d0/c12b 0 2024-09-13T23:06:18.461 INFO:tasks.workunit.client.0.smithi115.stdout:1/771: mknod d0/de/d66/d8f/d29/d9c/cf7 0 2024-09-13T23:06:18.461 INFO:tasks.workunit.client.0.smithi115.stdout:1/772: chown d0/de/d66/d8f/dad/ddb/de5/feb 21922 1 2024-09-13T23:06:18.461 INFO:tasks.workunit.client.0.smithi115.stdout:1/773: chown d0/de/d66/d8f/d29/d47/d63/dac/dc7/fcf 3 1 2024-09-13T23:06:18.461 INFO:tasks.workunit.client.0.smithi115.stdout:1/774: fsync d0/de/d1b/f85 0 2024-09-13T23:06:18.462 INFO:tasks.workunit.client.1.smithi152.stdout:8/184: dread d17/d19/f3d [0,4194304] 0 2024-09-13T23:06:18.462 INFO:tasks.workunit.client.0.smithi115.stdout:0/804: rename d6/d24/d25/da7/dfe to d6/d24/d25/d2b/d82/d6b/d9f/dab/d118 0 2024-09-13T23:06:18.462 INFO:tasks.workunit.client.0.smithi115.stdout:0/805: chown d6/d24/d25/dc7/ff4 14317313 1 2024-09-13T23:06:18.463 INFO:tasks.workunit.client.0.smithi115.stdout:9/922: mkdir d0/d13/d3b/d42/d12c 0 2024-09-13T23:06:18.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/775: mkdir d0/de/df8 0 2024-09-13T23:06:18.465 INFO:tasks.workunit.client.0.smithi115.stdout:1/776: chown d0/de/d1b/d25/d4d/d51/d31/f53 954 1 2024-09-13T23:06:18.466 INFO:tasks.workunit.client.0.smithi115.stdout:0/806: mknod d6/d24/d25/d2b/d103/dd4/c119 0 2024-09-13T23:06:18.467 INFO:tasks.workunit.client.0.smithi115.stdout:9/923: mkdir d0/d13/d17/d1f/d28/d12d 0 2024-09-13T23:06:18.469 INFO:tasks.workunit.client.0.smithi115.stdout:9/924: mkdir d0/d13/d3b/d42/d12c/d12e 0 2024-09-13T23:06:18.469 INFO:tasks.workunit.client.0.smithi115.stdout:9/925: creat d0/d13/d17/d36/dd1/f12f x:0 0 0 2024-09-13T23:06:18.470 INFO:tasks.workunit.client.0.smithi115.stdout:1/777: symlink d0/de/d66/d8f/lf9 0 2024-09-13T23:06:18.471 INFO:tasks.workunit.client.1.smithi152.stdout:8/185: dread d17/d23/f2b [0,4194304] 0 2024-09-13T23:06:18.471 INFO:tasks.workunit.client.1.smithi152.stdout:8/186: stat d17/d25/f2f 0 2024-09-13T23:06:18.471 INFO:tasks.workunit.client.0.smithi115.stdout:9/926: truncate d0/d43/fca 826955 0 2024-09-13T23:06:18.471 INFO:tasks.workunit.client.1.smithi152.stdout:8/187: truncate d17/d25/f2f 1339491 0 2024-09-13T23:06:18.472 INFO:tasks.workunit.client.1.smithi152.stdout:8/188: creat d17/d25/d32/f3f x:0 0 0 2024-09-13T23:06:18.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/189: truncate d17/f1d 1091343 0 2024-09-13T23:06:18.473 INFO:tasks.workunit.client.0.smithi115.stdout:9/927: unlink d0/d13/d17/d19/dc8/f10c 0 2024-09-13T23:06:18.474 INFO:tasks.workunit.client.0.smithi115.stdout:9/928: chown d0/d13/d17/d1f/d28/f38 1 1 2024-09-13T23:06:18.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/190: mknod d17/d25/c40 0 2024-09-13T23:06:18.474 INFO:tasks.workunit.client.0.smithi115.stdout:1/778: link d0/de/d1b/d25/d4d/d51/d31/d37/ca9 d0/de/d66/d8f/d29/cfa 0 2024-09-13T23:06:18.475 INFO:tasks.workunit.client.0.smithi115.stdout:9/929: truncate d0/d13/d17/d1f/d28/d76/fa9 6962541 0 2024-09-13T23:06:18.477 INFO:tasks.workunit.client.0.smithi115.stdout:1/779: symlink d0/de/d66/d8f/d29/d47/d6a/lfb 0 2024-09-13T23:06:18.477 INFO:tasks.workunit.client.0.smithi115.stdout:1/780: write d0/f9 [2045966,20314] 0 2024-09-13T23:06:18.478 INFO:tasks.workunit.client.0.smithi115.stdout:9/930: rename d0/d13/d17/d1f/d28/l5f to d0/d13/d17/d36/dfe/l130 0 2024-09-13T23:06:18.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/195: sync 2024-09-13T23:06:18.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/196: chown d18/f2d 18006 1 2024-09-13T23:06:18.500 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:18 smithi115 ceph-mon[27601]: mgrmap e24: smithi152.ntylos(active, since 3s) 2024-09-13T23:06:18.500 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:18 smithi115 ceph-mon[27601]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:18.501 INFO:tasks.workunit.client.0.smithi115.stdout:3/959: sync 2024-09-13T23:06:18.501 INFO:tasks.workunit.client.0.smithi115.stdout:2/923: sync 2024-09-13T23:06:18.501 INFO:tasks.workunit.client.0.smithi115.stdout:5/864: sync 2024-09-13T23:06:18.501 INFO:tasks.workunit.client.0.smithi115.stdout:7/806: sync 2024-09-13T23:06:18.501 INFO:tasks.workunit.client.0.smithi115.stdout:4/880: sync 2024-09-13T23:06:18.502 INFO:tasks.workunit.client.0.smithi115.stdout:2/924: link da/d23/d2c/dc2/de1/d56/d1a/f1d da/d23/dd5/f12e 0 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.0.smithi115.stdout:2/925: dread - da/f114 zero size 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/197: rename d18/d1f/d35 to d18/d1f/d29/d3f 0 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/198: truncate d18/f1b 613863 0 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/199: read - d18/d19/d2c/f30 zero size 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.0.smithi115.stdout:5/865: symlink d8/dd/d5d/l108 0 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.0.smithi115.stdout:5/866: truncate d8/dd/d20/dbb/faa 556867 0 2024-09-13T23:06:18.503 INFO:tasks.workunit.client.0.smithi115.stdout:5/867: write d8/dd/d6a/d82/d63/f65 [3003160,53220] 0 2024-09-13T23:06:18.504 INFO:tasks.workunit.client.1.smithi152.stdout:0/200: mkdir d18/d1f/d29/d3f/d40 0 2024-09-13T23:06:18.504 INFO:tasks.workunit.client.1.smithi152.stdout:0/201: dread - f13 zero size 2024-09-13T23:06:18.504 INFO:tasks.workunit.client.0.smithi115.stdout:4/881: mkdir db/d11/d10c 0 2024-09-13T23:06:18.505 INFO:tasks.workunit.client.0.smithi115.stdout:4/882: chown db/d19/d4e/ca1 11790 1 2024-09-13T23:06:18.505 INFO:tasks.workunit.client.0.smithi115.stdout:4/883: read db/d16/d3f/d66/da6/fc4 [482276,94298] 0 2024-09-13T23:06:18.505 INFO:tasks.workunit.client.0.smithi115.stdout:7/807: truncate da/dd/d13/d24/d52/fd1 778755 0 2024-09-13T23:06:18.505 INFO:tasks.workunit.client.0.smithi115.stdout:4/884: chown db/d11/d2e/d33/ff6 143018 1 2024-09-13T23:06:18.505 INFO:tasks.workunit.client.0.smithi115.stdout:3/960: rmdir d3/d5/d65 39 2024-09-13T23:06:18.507 INFO:tasks.workunit.client.0.smithi115.stdout:2/926: symlink da/d21/d8c/l12f 0 2024-09-13T23:06:18.509 INFO:tasks.workunit.client.0.smithi115.stdout:7/808: link da/dd/d1c/fad da/dd/d1c/d2d/d41/de1/df8/f11a 0 2024-09-13T23:06:18.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/191: dwrite f15 [0,4194304] 0 2024-09-13T23:06:18.511 INFO:tasks.workunit.client.0.smithi115.stdout:3/961: link d3/d5/f7f d3/d5/d65/da8/da4/d10f/f146 0 2024-09-13T23:06:18.511 INFO:tasks.workunit.client.1.smithi152.stdout:8/192: rename d17/d25/f39 to d17/d25/f41 0 2024-09-13T23:06:18.512 INFO:tasks.workunit.client.0.smithi115.stdout:7/809: mknod da/df/dcc/c11b 0 2024-09-13T23:06:18.513 INFO:tasks.workunit.client.0.smithi115.stdout:7/810: readlink da/l79 0 2024-09-13T23:06:18.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/962: dread - d3/d16/d1a/d1e/f10b zero size 2024-09-13T23:06:18.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/963: fsync d3/d5/d35/f91 0 2024-09-13T23:06:18.513 INFO:tasks.workunit.client.0.smithi115.stdout:3/964: dread - d3/d5/db/f11f zero size 2024-09-13T23:06:18.514 INFO:tasks.workunit.client.0.smithi115.stdout:7/811: mkdir da/dd/d16/d11c 0 2024-09-13T23:06:18.527 INFO:tasks.workunit.client.0.smithi115.stdout:3/965: read d3/d16/d1a/d1e/d76/f83 [8128,73542] 0 2024-09-13T23:06:18.569 INFO:tasks.workunit.client.0.smithi115.stdout:9/931: dwrite d0/d13/d17/d36/dd1/f117 [0,4194304] 0 2024-09-13T23:06:18.569 INFO:tasks.workunit.client.0.smithi115.stdout:5/868: dwrite d8/dd/d20/d27/fbf [0,4194304] 0 2024-09-13T23:06:18.569 INFO:tasks.workunit.client.1.smithi152.stdout:0/202: dwrite d18/d19/d2c/f30 [0,4194304] 0 2024-09-13T23:06:18.571 INFO:tasks.workunit.client.1.smithi152.stdout:0/203: mkdir d18/d1f/d41 0 2024-09-13T23:06:18.571 INFO:tasks.workunit.client.0.smithi115.stdout:5/869: creat d8/dd/d6a/d82/d63/d5a/dc3/f109 x:0 0 0 2024-09-13T23:06:18.572 INFO:tasks.workunit.client.0.smithi115.stdout:7/812: dwrite da/dd/d16/d29/f108 [0,4194304] 0 2024-09-13T23:06:18.574 INFO:tasks.workunit.client.0.smithi115.stdout:7/813: creat da/dd/d16/f11d x:0 0 0 2024-09-13T23:06:18.575 INFO:tasks.workunit.client.0.smithi115.stdout:7/814: rename da/dd/d1c/db0 to da/dd/d13/d24/d11e 0 2024-09-13T23:06:18.581 INFO:tasks.workunit.client.0.smithi115.stdout:9/932: dread d0/d13/d17/d1f/d28/d76/fa9 [0,4194304] 0 2024-09-13T23:06:18.583 INFO:tasks.workunit.client.0.smithi115.stdout:9/933: mkdir d0/d13/d3b/d42/d95/d121/d131 0 2024-09-13T23:06:18.583 INFO:tasks.workunit.client.0.smithi115.stdout:9/934: stat d0/d13/d17/d1f/d28/d76/d81/cf5 0 2024-09-13T23:06:18.583 INFO:tasks.workunit.client.1.smithi152.stdout:0/204: dread fb [0,4194304] 0 2024-09-13T23:06:18.584 INFO:tasks.workunit.client.1.smithi152.stdout:0/205: fsync d18/f26 0 2024-09-13T23:06:18.584 INFO:tasks.workunit.client.1.smithi152.stdout:0/206: dread d18/f1b [0,4194304] 0 2024-09-13T23:06:18.584 INFO:tasks.workunit.client.1.smithi152.stdout:0/207: fsync d18/f2b 0 2024-09-13T23:06:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:0/208: symlink d18/d1f/l42 0 2024-09-13T23:06:18.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/193: dwrite d17/d23/f30 [0,4194304] 0 2024-09-13T23:06:18.589 INFO:tasks.workunit.client.0.smithi115.stdout:7/815: write da/dd/d13/d36/fc4 [84527,120300] 0 2024-09-13T23:06:18.589 INFO:tasks.workunit.client.0.smithi115.stdout:7/816: chown da/df/f28 350 1 2024-09-13T23:06:18.589 INFO:tasks.workunit.client.0.smithi115.stdout:7/817: chown da/dd/d1c/d2d/d60/d82/de6 5235102 1 2024-09-13T23:06:18.589 INFO:tasks.workunit.client.0.smithi115.stdout:2/927: dwrite da/d23/dd5/f12e [0,4194304] 0 2024-09-13T23:06:18.589 INFO:tasks.workunit.client.0.smithi115.stdout:7/818: write da/dd/d1c/fad [564518,29073] 0 2024-09-13T23:06:18.590 INFO:tasks.workunit.client.1.smithi152.stdout:0/209: creat d18/d1f/d39/f43 x:0 0 0 2024-09-13T23:06:18.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/210: mkdir d18/d1f/d39/d44 0 2024-09-13T23:06:18.593 INFO:tasks.workunit.client.0.smithi115.stdout:7/819: unlink da/df/f26 0 2024-09-13T23:06:18.593 INFO:tasks.workunit.client.0.smithi115.stdout:7/820: write da/dd/d13/fda [334320,11194] 0 2024-09-13T23:06:18.593 INFO:tasks.workunit.client.0.smithi115.stdout:2/928: mknod da/d23/d2c/dc2/de1/d56/d74/d10f/c130 0 2024-09-13T23:06:18.593 INFO:tasks.workunit.client.0.smithi115.stdout:2/929: fsync da/d21/d8c/d41/d62/fce 0 2024-09-13T23:06:18.595 INFO:tasks.workunit.client.0.smithi115.stdout:9/935: write d0/d13/d17/d1f/d28/d76/d81/dd0/fe4 [2210155,7213] 0 2024-09-13T23:06:18.595 INFO:tasks.workunit.client.0.smithi115.stdout:3/966: dwrite d3/d5/d35/d71/d42/f115 [0,4194304] 0 2024-09-13T23:06:18.599 INFO:tasks.workunit.client.0.smithi115.stdout:5/870: dwrite d8/dd/d20/f104 [0,4194304] 0 2024-09-13T23:06:18.599 INFO:tasks.workunit.client.0.smithi115.stdout:5/871: readlink d8/dd/d20/d23/lfc 0 2024-09-13T23:06:18.601 INFO:tasks.workunit.client.0.smithi115.stdout:9/936: creat d0/d13/d17/d1f/d28/d12d/f132 x:0 0 0 2024-09-13T23:06:18.601 INFO:tasks.workunit.client.0.smithi115.stdout:9/937: readlink d0/d13/d17/d1f/d4e/d61/d7d/d98/lfb 0 2024-09-13T23:06:18.603 INFO:tasks.workunit.client.0.smithi115.stdout:3/967: mkdir d3/d16/d1c/d101/d98/dbc/d147 0 2024-09-13T23:06:18.604 INFO:tasks.workunit.client.0.smithi115.stdout:2/930: mknod da/d77/d83/c131 0 2024-09-13T23:06:18.604 INFO:tasks.workunit.client.0.smithi115.stdout:7/821: dread da/dd/d1c/d2d/f70 [0,4194304] 0 2024-09-13T23:06:18.604 INFO:tasks.workunit.client.0.smithi115.stdout:7/822: stat da/dd/d13/d36/d5a/d6d/cc0 0 2024-09-13T23:06:18.605 INFO:tasks.workunit.client.0.smithi115.stdout:2/931: truncate da/d21/d8c/d41/fe4 302245 0 2024-09-13T23:06:18.609 INFO:tasks.workunit.client.0.smithi115.stdout:5/872: dread d8/d7a/f84 [0,4194304] 0 2024-09-13T23:06:18.609 INFO:tasks.workunit.client.0.smithi115.stdout:9/938: dread d0/d13/d3b/f68 [0,4194304] 0 2024-09-13T23:06:18.609 INFO:tasks.workunit.client.1.smithi152.stdout:8/194: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:18.610 INFO:tasks.workunit.client.1.smithi152.stdout:8/195: chown fd 219485 1 2024-09-13T23:06:18.611 INFO:tasks.workunit.client.0.smithi115.stdout:9/939: creat d0/d13/d17/d1f/d28/d76/d81/d10d/f133 x:0 0 0 2024-09-13T23:06:18.612 INFO:tasks.workunit.client.1.smithi152.stdout:8/196: mknod d17/d25/d32/c42 0 2024-09-13T23:06:18.613 INFO:tasks.workunit.client.1.smithi152.stdout:8/197: dread d17/d19/f28 [0,4194304] 0 2024-09-13T23:06:18.616 INFO:tasks.workunit.client.1.smithi152.stdout:8/198: creat d17/f43 x:0 0 0 2024-09-13T23:06:18.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/211: dwrite fb [0,4194304] 0 2024-09-13T23:06:18.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/212: creat d18/d1f/d39/f45 x:0 0 0 2024-09-13T23:06:18.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/213: getdents d18/d19 0 2024-09-13T23:06:18.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/214: chown ce 2 1 2024-09-13T23:06:18.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/215: write ff [408737,18897] 0 2024-09-13T23:06:18.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/216: unlink f10 0 2024-09-13T23:06:18.629 INFO:tasks.workunit.client.1.smithi152.stdout:0/217: creat d18/d1f/d29/f46 x:0 0 0 2024-09-13T23:06:18.629 INFO:tasks.workunit.client.1.smithi152.stdout:0/218: dread - d18/d1f/d33/f36 zero size 2024-09-13T23:06:18.629 INFO:tasks.workunit.client.1.smithi152.stdout:0/219: truncate d18/d1f/d33/f36 290314 0 2024-09-13T23:06:18.630 INFO:tasks.workunit.client.1.smithi152.stdout:8/199: dread d17/f22 [0,4194304] 0 2024-09-13T23:06:18.631 INFO:tasks.workunit.client.0.smithi115.stdout:2/932: dwrite da/d21/d8c/d41/d62/d10a/d10c/ff8 [0,4194304] 0 2024-09-13T23:06:18.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/200: mkdir d17/d25/d32/d44 0 2024-09-13T23:06:18.631 INFO:tasks.workunit.client.0.smithi115.stdout:3/968: dwrite d3/d5/d65/da8/da4/f104 [0,4194304] 0 2024-09-13T23:06:18.633 INFO:tasks.workunit.client.1.smithi152.stdout:8/201: creat d17/d23/f45 x:0 0 0 2024-09-13T23:06:18.633 INFO:tasks.workunit.client.1.smithi152.stdout:8/202: truncate d17/d19/f28 1298985 0 2024-09-13T23:06:18.633 INFO:tasks.workunit.client.1.smithi152.stdout:8/203: fsync d17/d23/f30 0 2024-09-13T23:06:18.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/933: truncate da/d23/d2c/dc2/de1/d56/d1a/f1d 2386494 0 2024-09-13T23:06:18.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/934: creat da/d23/f132 x:0 0 0 2024-09-13T23:06:18.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/935: dread - da/d23/d2c/dc2/de1/d56/d1a/d7f/fd4 zero size 2024-09-13T23:06:18.635 INFO:tasks.workunit.client.0.smithi115.stdout:2/936: dread - da/d23/d2c/dc2/de1/d56/d1a/dfa/f117 zero size 2024-09-13T23:06:18.638 INFO:tasks.workunit.client.0.smithi115.stdout:3/969: mkdir d3/d16/d1c/d101/d98/dbc/d147/d148 0 2024-09-13T23:06:18.639 INFO:tasks.workunit.client.0.smithi115.stdout:2/937: symlink da/d21/da8/l133 0 2024-09-13T23:06:18.642 INFO:tasks.workunit.client.1.smithi152.stdout:0/220: dread f1 [0,4194304] 0 2024-09-13T23:06:18.644 INFO:tasks.workunit.client.1.smithi152.stdout:0/221: mknod d18/d1f/d29/d2f/c47 0 2024-09-13T23:06:18.645 INFO:tasks.workunit.client.1.smithi152.stdout:0/222: creat d18/d1f/f48 x:0 0 0 2024-09-13T23:06:18.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/873: dwrite d8/dd/d6a/fa1 [0,4194304] 0 2024-09-13T23:06:18.653 INFO:tasks.workunit.client.0.smithi115.stdout:5/874: write d8/dd/d20/dbb/fd0 [494336,49460] 0 2024-09-13T23:06:18.654 INFO:tasks.workunit.client.0.smithi115.stdout:5/875: fdatasync d8/f16 0 2024-09-13T23:06:18.658 INFO:tasks.workunit.client.0.smithi115.stdout:9/940: dwrite d0/d43/f9e [0,4194304] 0 2024-09-13T23:06:18.659 INFO:tasks.workunit.client.1.smithi152.stdout:5/219: sync 2024-09-13T23:06:18.659 INFO:tasks.workunit.client.1.smithi152.stdout:9/244: sync 2024-09-13T23:06:18.660 INFO:tasks.workunit.client.1.smithi152.stdout:5/220: write d5/d26/f33 [350690,24906] 0 2024-09-13T23:06:18.660 INFO:tasks.workunit.client.1.smithi152.stdout:5/221: chown d5/f8 1558268 1 2024-09-13T23:06:18.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/245: symlink d3/d24/d34/d37/d4a/l53 0 2024-09-13T23:06:18.686 INFO:tasks.workunit.client.0.smithi115.stdout:2/938: dread da/d23/d2c/dc2/de1/d56/d1a/f90 [0,4194304] 0 2024-09-13T23:06:18.688 INFO:tasks.workunit.client.0.smithi115.stdout:2/939: mkdir da/d77/d134 0 2024-09-13T23:06:18.688 INFO:tasks.workunit.client.0.smithi115.stdout:2/940: creat da/d23/d2c/dc2/de1/d56/d1a/d7f/f135 x:0 0 0 2024-09-13T23:06:18.688 INFO:tasks.workunit.client.1.smithi152.stdout:9/246: dread d3/ff [4194304,4194304] 0 2024-09-13T23:06:18.689 INFO:tasks.workunit.client.1.smithi152.stdout:9/247: write d3/f4 [3103586,63520] 0 2024-09-13T23:06:18.690 INFO:tasks.workunit.client.0.smithi115.stdout:9/941: dread d0/d13/d17/f1e [0,4194304] 0 2024-09-13T23:06:18.690 INFO:tasks.workunit.client.1.smithi152.stdout:9/248: symlink d3/d24/d34/d45/l54 0 2024-09-13T23:06:18.691 INFO:tasks.workunit.client.0.smithi115.stdout:9/942: creat d0/d13/d17/d1f/d4e/d90/f134 x:0 0 0 2024-09-13T23:06:18.692 INFO:tasks.workunit.client.0.smithi115.stdout:9/943: rmdir d0/d13/d17/d1f 39 2024-09-13T23:06:18.692 INFO:tasks.workunit.client.0.smithi115.stdout:9/944: write d0/d13/d17/d1f/d4e/d61/d9b/f116 [509940,109066] 0 2024-09-13T23:06:18.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/249: creat d3/d24/d34/d37/d4a/f55 x:0 0 0 2024-09-13T23:06:18.692 INFO:tasks.workunit.client.0.smithi115.stdout:9/945: creat d0/d13/d3b/d42/d95/d121/d131/f135 x:0 0 0 2024-09-13T23:06:18.693 INFO:tasks.workunit.client.0.smithi115.stdout:9/946: getdents d0/d13/d17/d1f/d4e/d61/d7d/d98 0 2024-09-13T23:06:18.693 INFO:tasks.workunit.client.0.smithi115.stdout:9/947: rmdir d0/d13/d17/d36/d80/d10e 39 2024-09-13T23:06:18.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/250: mkdir d3/d24/d34/d37/d56 0 2024-09-13T23:06:18.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/251: write d3/f4f [870261,90782] 0 2024-09-13T23:06:18.694 INFO:tasks.workunit.client.1.smithi152.stdout:9/252: symlink d3/d1e/d30/l57 0 2024-09-13T23:06:18.695 INFO:tasks.workunit.client.0.smithi115.stdout:9/948: creat d0/d13/d17/d36/f136 x:0 0 0 2024-09-13T23:06:18.695 INFO:tasks.workunit.client.0.smithi115.stdout:9/949: getdents d0/d13/d17/d1f/d28/d76/d81/dd0/d11d 0 2024-09-13T23:06:18.695 INFO:tasks.workunit.client.0.smithi115.stdout:2/941: dread da/d23/d2c/dc2/de1/d48/ff3 [0,4194304] 0 2024-09-13T23:06:18.695 INFO:tasks.workunit.client.0.smithi115.stdout:2/942: stat da/d23/d2c/dc2/de1/d56/d1a 0 2024-09-13T23:06:18.696 INFO:tasks.workunit.client.1.smithi152.stdout:9/253: link d3/d24/d34/d37/d47/f51 d3/d24/d34/d37/d56/f58 0 2024-09-13T23:06:18.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/204: dwrite d17/f1c [4194304,4194304] 0 2024-09-13T23:06:18.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/205: truncate d17/d25/d32/f3f 951243 0 2024-09-13T23:06:18.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/206: fdatasync d17/d25/f41 0 2024-09-13T23:06:18.702 INFO:tasks.workunit.client.1.smithi152.stdout:0/223: dwrite d18/d1f/d29/f46 [0,4194304] 0 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.1.smithi152.stdout:5/222: dwrite f0 [8388608,4194304] 0 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.1.smithi152.stdout:5/223: stat d5/d26/f33 0 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.0.smithi115.stdout:5/876: dwrite d8/dd/d20/d27/fbf [0,4194304] 0 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.0.smithi115.stdout:5/877: dread - d8/dd/d6a/d8a/fcc zero size 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.0.smithi115.stdout:5/878: creat d8/dd/d20/dbb/deb/f10a x:0 0 0 2024-09-13T23:06:18.703 INFO:tasks.workunit.client.0.smithi115.stdout:3/970: dwrite d3/d5/d5b/f72 [0,4194304] 0 2024-09-13T23:06:18.704 INFO:tasks.workunit.client.1.smithi152.stdout:8/207: link d17/c3b d17/c46 0 2024-09-13T23:06:18.706 INFO:tasks.workunit.client.1.smithi152.stdout:9/254: dread d3/f9 [4194304,4194304] 0 2024-09-13T23:06:18.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/224: unlink f1 0 2024-09-13T23:06:18.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/225: readlink la 0 2024-09-13T23:06:18.707 INFO:tasks.workunit.client.0.smithi115.stdout:9/950: dread d0/d13/d17/d1f/d28/f91 [0,4194304] 0 2024-09-13T23:06:18.707 INFO:tasks.workunit.client.0.smithi115.stdout:9/951: write d0/d13/d17/d1f/d35/d40/fe2 [95531,104344] 0 2024-09-13T23:06:18.710 INFO:tasks.workunit.client.0.smithi115.stdout:9/952: getdents d0/d13/d17/d1f/d4e 0 2024-09-13T23:06:18.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/255: mknod d3/d1e/d30/c59 0 2024-09-13T23:06:18.723 INFO:tasks.workunit.client.0.smithi115.stdout:2/943: dread da/d21/da8/df5/f11e [0,4194304] 0 2024-09-13T23:06:18.723 INFO:tasks.workunit.client.0.smithi115.stdout:2/944: chown da/f73 63735 1 2024-09-13T23:06:18.723 INFO:tasks.workunit.client.0.smithi115.stdout:2/945: write da/d23/d2c/dc2/de1/d56/d1a/d7f/f97 [5492615,75084] 0 2024-09-13T23:06:18.723 INFO:tasks.workunit.client.0.smithi115.stdout:5/879: dread d8/dd/d20/d23/f59 [0,4194304] 0 2024-09-13T23:06:18.723 INFO:tasks.workunit.client.0.smithi115.stdout:5/880: creat d8/dd/d6a/d8a/f10b x:0 0 0 2024-09-13T23:06:18.726 INFO:tasks.workunit.client.0.smithi115.stdout:2/946: mkdir da/d77/d83/d136 0 2024-09-13T23:06:18.727 INFO:tasks.workunit.client.0.smithi115.stdout:3/971: dwrite d3/d5/d35/d71/d3b/d47/f86 [0,4194304] 0 2024-09-13T23:06:18.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/224: rmdir d5/dc 39 2024-09-13T23:06:18.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/225: truncate d5/dc/d19/f1a 51748 0 2024-09-13T23:06:18.730 INFO:tasks.workunit.client.0.smithi115.stdout:3/972: creat d3/d5/d5b/f149 x:0 0 0 2024-09-13T23:06:18.731 INFO:tasks.workunit.client.1.smithi152.stdout:9/256: rename d3/l14 to d3/d24/d34/d45/l5a 0 2024-09-13T23:06:18.731 INFO:tasks.workunit.client.0.smithi115.stdout:3/973: symlink d3/d5/d2c/l14a 0 2024-09-13T23:06:18.733 INFO:tasks.workunit.client.0.smithi115.stdout:3/974: chown d3/d16/d1a/d1e/ff9 3663 1 2024-09-13T23:06:18.733 INFO:tasks.workunit.client.1.smithi152.stdout:5/226: symlink d5/l4a 0 2024-09-13T23:06:18.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/975: symlink d3/d5/d65/da8/l14b 0 2024-09-13T23:06:18.735 INFO:tasks.workunit.client.0.smithi115.stdout:3/976: chown d3/d5/d65/da8/f120 4227736 1 2024-09-13T23:06:18.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/227: creat d5/dc/d35/f4b x:0 0 0 2024-09-13T23:06:18.740 INFO:tasks.workunit.client.1.smithi152.stdout:5/228: mkdir d5/dc/d4c 0 2024-09-13T23:06:18.740 INFO:tasks.workunit.client.1.smithi152.stdout:5/229: write f0 [7863618,111149] 0 2024-09-13T23:06:18.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/226: dwrite f8 [0,4194304] 0 2024-09-13T23:06:18.755 INFO:tasks.workunit.client.0.smithi115.stdout:9/953: dwrite d0/d13/d17/d36/d80/fe6 [4194304,4194304] 0 2024-09-13T23:06:18.756 INFO:tasks.workunit.client.0.smithi115.stdout:9/954: symlink d0/d43/l137 0 2024-09-13T23:06:18.756 INFO:tasks.workunit.client.1.smithi152.stdout:8/208: dwrite d17/f29 [4194304,4194304] 0 2024-09-13T23:06:18.756 INFO:tasks.workunit.client.1.smithi152.stdout:8/209: write d17/d19/f33 [1533414,89889] 0 2024-09-13T23:06:18.757 INFO:tasks.workunit.client.1.smithi152.stdout:0/227: rename fb to d18/d1f/d29/d2f/d3d/f49 0 2024-09-13T23:06:18.757 INFO:tasks.workunit.client.1.smithi152.stdout:0/228: dread - d18/d1f/f48 zero size 2024-09-13T23:06:18.757 INFO:tasks.workunit.client.0.smithi115.stdout:9/955: creat d0/d13/d17/d1f/f138 x:0 0 0 2024-09-13T23:06:18.759 INFO:tasks.workunit.client.0.smithi115.stdout:5/881: dwrite d8/dd/d64/dc5/fce [0,4194304] 0 2024-09-13T23:06:18.761 INFO:tasks.workunit.client.0.smithi115.stdout:9/956: dread d0/d13/d17/d1f/d28/f91 [0,4194304] 0 2024-09-13T23:06:18.764 INFO:tasks.workunit.client.0.smithi115.stdout:2/947: dwrite da/d77/d83/ff7 [0,4194304] 0 2024-09-13T23:06:18.767 INFO:tasks.workunit.client.0.smithi115.stdout:2/948: symlink da/d23/d2c/dc2/de1/d56/d4b/d122/l137 0 2024-09-13T23:06:18.770 INFO:tasks.workunit.client.0.smithi115.stdout:2/949: rename da/fd8 to da/d21/da8/df5/f138 0 2024-09-13T23:06:18.770 INFO:tasks.workunit.client.0.smithi115.stdout:3/977: dwrite d3/d5/d65/da8/fe6 [0,4194304] 0 2024-09-13T23:06:18.772 INFO:tasks.workunit.client.0.smithi115.stdout:5/882: write d8/dd/ff [2049621,120455] 0 2024-09-13T23:06:18.772 INFO:tasks.workunit.client.0.smithi115.stdout:2/950: mknod da/d21/d8c/c139 0 2024-09-13T23:06:18.772 INFO:tasks.workunit.client.0.smithi115.stdout:2/951: truncate da/d23/d2c/dc2/de1/d56/dda/f115 470383 0 2024-09-13T23:06:18.773 INFO:tasks.workunit.client.1.smithi152.stdout:8/210: dread d17/f29 [4194304,4194304] 0 2024-09-13T23:06:18.773 INFO:tasks.workunit.client.1.smithi152.stdout:8/211: write f3 [8802494,85177] 0 2024-09-13T23:06:18.773 INFO:tasks.workunit.client.1.smithi152.stdout:8/212: truncate d17/f2c 5103476 0 2024-09-13T23:06:18.774 INFO:tasks.workunit.client.0.smithi115.stdout:5/883: symlink d8/dd/d6a/d82/d63/dd6/dde/l10c 0 2024-09-13T23:06:18.775 INFO:tasks.workunit.client.0.smithi115.stdout:2/952: rename da/d23/d2c/dc2/de1/d56/d74/dc7/c101 to da/d21/da8/df5/c13a 0 2024-09-13T23:06:18.775 INFO:tasks.workunit.client.0.smithi115.stdout:2/953: stat da/d23/d2c/dc2/de1/d48/cd7 0 2024-09-13T23:06:18.775 INFO:tasks.workunit.client.0.smithi115.stdout:2/954: creat da/d23/d2c/dc2/d108/f13b x:0 0 0 2024-09-13T23:06:18.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/213: rename d17/l26 to d17/d23/l47 0 2024-09-13T23:06:18.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/214: write d17/d23/f34 [514093,94229] 0 2024-09-13T23:06:18.776 INFO:tasks.workunit.client.0.smithi115.stdout:5/884: truncate d8/dd/d74/ff5 1835920 0 2024-09-13T23:06:18.777 INFO:tasks.workunit.client.1.smithi152.stdout:8/215: creat d17/d25/d32/d44/f48 x:0 0 0 2024-09-13T23:06:18.778 INFO:tasks.workunit.client.1.smithi152.stdout:8/216: rmdir d17/d25 39 2024-09-13T23:06:18.778 INFO:tasks.workunit.client.1.smithi152.stdout:8/217: chown d17/c46 956 1 2024-09-13T23:06:18.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/955: mknod da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/c13c 0 2024-09-13T23:06:18.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/956: chown da/d23/d2c/dc2/de1/d56/d74/dc7/cd6 63329 1 2024-09-13T23:06:18.779 INFO:tasks.workunit.client.0.smithi115.stdout:2/957: write da/f114 [742536,245] 0 2024-09-13T23:06:18.779 INFO:tasks.workunit.client.1.smithi152.stdout:5/230: dwrite d5/dc/d19/d20/d2e/f34 [0,4194304] 0 2024-09-13T23:06:18.779 INFO:tasks.workunit.client.1.smithi152.stdout:0/229: dwrite d18/f1b [0,4194304] 0 2024-09-13T23:06:18.780 INFO:tasks.workunit.client.1.smithi152.stdout:8/218: rename d17/f3a to d17/d25/d32/d44/f49 0 2024-09-13T23:06:18.780 INFO:tasks.workunit.client.1.smithi152.stdout:8/219: creat d17/f4a x:0 0 0 2024-09-13T23:06:18.781 INFO:tasks.workunit.client.0.smithi115.stdout:5/885: dread d8/d7a/f7e [0,4194304] 0 2024-09-13T23:06:18.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/231: unlink d5/dc/d19/d20/f2c 0 2024-09-13T23:06:18.782 INFO:tasks.workunit.client.0.smithi115.stdout:2/958: rename da/d21/da6/de7/f112 to da/d23/d2c/dc2/de1/d53/f13d 0 2024-09-13T23:06:18.785 INFO:tasks.workunit.client.1.smithi152.stdout:5/232: symlink d5/dc/d35/l4d 0 2024-09-13T23:06:18.785 INFO:tasks.workunit.client.1.smithi152.stdout:5/233: truncate d5/dc/d19/d20/d2e/d28/f2f 1004723 0 2024-09-13T23:06:18.785 INFO:tasks.workunit.client.0.smithi115.stdout:2/959: mkdir da/d23/d2c/dc2/d108/d13e 0 2024-09-13T23:06:18.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/234: rename d5/dc/d19/f13 to d5/dc/d19/d20/f4e 0 2024-09-13T23:06:18.792 INFO:tasks.workunit.client.0.smithi115.stdout:3/978: dwrite d3/d16/dab/f126 [0,4194304] 0 2024-09-13T23:06:18.792 INFO:tasks.workunit.client.0.smithi115.stdout:9/957: dwrite d0/d13/d17/d1f/d4e/d61/d7d/fc7 [0,4194304] 0 2024-09-13T23:06:18.793 INFO:tasks.workunit.client.1.smithi152.stdout:0/230: rmdir d18 39 2024-09-13T23:06:18.801 INFO:tasks.workunit.client.1.smithi152.stdout:8/220: getdents d17 0 2024-09-13T23:06:18.801 INFO:tasks.workunit.client.1.smithi152.stdout:8/221: chown d17/d25/d32/f3f 7362 1 2024-09-13T23:06:18.808 INFO:tasks.workunit.client.1.smithi152.stdout:8/222: mkdir d17/d25/d32/d4b 0 2024-09-13T23:06:18.821 INFO:tasks.workunit.client.0.smithi115.stdout:5/886: dwrite d8/dd/d20/dbb/faa [0,4194304] 0 2024-09-13T23:06:18.822 INFO:tasks.workunit.client.0.smithi115.stdout:5/887: read d8/d7a/f7e [482521,13088] 0 2024-09-13T23:06:18.823 INFO:tasks.workunit.client.0.smithi115.stdout:5/888: dread d8/f51 [0,4194304] 0 2024-09-13T23:06:18.824 INFO:tasks.workunit.client.0.smithi115.stdout:5/889: readlink d8/dd/d20/d23/lfc 0 2024-09-13T23:06:18.824 INFO:tasks.workunit.client.0.smithi115.stdout:5/890: read d8/fbc [2050514,37514] 0 2024-09-13T23:06:18.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/223: write d17/f1d [1770796,65848] 0 2024-09-13T23:06:18.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/231: dwrite d18/f2b [0,4194304] 0 2024-09-13T23:06:18.825 INFO:tasks.workunit.client.0.smithi115.stdout:2/960: dwrite da/d23/d2c/dc2/de1/d56/d1a/d7f/f97 [0,4194304] 0 2024-09-13T23:06:18.825 INFO:tasks.workunit.client.0.smithi115.stdout:3/979: dwrite d3/d5/d35/d71/d3b/fda [0,4194304] 0 2024-09-13T23:06:18.825 INFO:tasks.workunit.client.0.smithi115.stdout:1/781: sync 2024-09-13T23:06:18.826 INFO:tasks.workunit.client.0.smithi115.stdout:0/807: sync 2024-09-13T23:06:18.826 INFO:tasks.workunit.client.0.smithi115.stdout:4/885: sync 2024-09-13T23:06:18.826 INFO:tasks.workunit.client.0.smithi115.stdout:0/808: write d6/d24/d25/d2b/d82/d44/f4b [9086406,43435] 0 2024-09-13T23:06:18.828 INFO:tasks.workunit.client.1.smithi152.stdout:0/232: mknod d18/d1f/d33/c4a 0 2024-09-13T23:06:18.828 INFO:tasks.workunit.client.0.smithi115.stdout:2/961: creat da/d23/d2c/dc2/de1/d56/d1a/f13f x:0 0 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:3/980: creat d3/d5/d35/d71/d3b/d47/de1/d144/de2/d102/f14c x:0 0 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:3/981: fdatasync d3/d5/d5b/f149 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/886: dread db/d16/d3f/d66/da6/fc4 [0,4194304] 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/887: truncate db/d11/d2e/d33/d36/f9b 340293 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/888: write db/d16/d3f/d66/d68/d71/d84/f105 [4286226,67067] 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:4/889: readlink db/d16/d3f/dae/le2 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:1/782: mkdir d0/de/d1b/d25/d4d/d51/d31/dfc 0 2024-09-13T23:06:18.833 INFO:tasks.workunit.client.0.smithi115.stdout:0/809: rename d6/d24/fc6 to d6/d24/d25/d10c/f11a 0 2024-09-13T23:06:18.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/224: dread d17/d19/f33 [0,4194304] 0 2024-09-13T23:06:18.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/225: dread - d17/d25/d32/f38 zero size 2024-09-13T23:06:18.834 INFO:tasks.workunit.client.1.smithi152.stdout:0/233: mkdir d18/d1f/d29/d3f/d4b 0 2024-09-13T23:06:18.835 INFO:tasks.workunit.client.1.smithi152.stdout:8/226: creat d17/d25/d32/f4c x:0 0 0 2024-09-13T23:06:18.835 INFO:tasks.workunit.client.0.smithi115.stdout:2/962: mknod da/d21/d8c/d41/d69/c140 0 2024-09-13T23:06:18.835 INFO:tasks.workunit.client.0.smithi115.stdout:2/963: getdents da/d23/d2c/dc2/de1/d56/d1a/d7f/df1 0 2024-09-13T23:06:18.836 INFO:tasks.workunit.client.0.smithi115.stdout:0/810: read d6/f20 [1175388,61842] 0 2024-09-13T23:06:18.836 INFO:tasks.workunit.client.0.smithi115.stdout:0/811: fsync d6/d24/d25/d58/f92 0 2024-09-13T23:06:18.837 INFO:tasks.workunit.client.1.smithi152.stdout:0/234: creat d18/d1f/d29/d2f/d3d/f4c x:0 0 0 2024-09-13T23:06:18.837 INFO:tasks.workunit.client.0.smithi115.stdout:2/964: write da/f114 [43033,79651] 0 2024-09-13T23:06:18.837 INFO:tasks.workunit.client.0.smithi115.stdout:2/965: chown da/d21/d8c/d41/d62/d10a/d10c 1000122 1 2024-09-13T23:06:18.838 INFO:tasks.workunit.client.1.smithi152.stdout:0/235: unlink f17 0 2024-09-13T23:06:18.838 INFO:tasks.workunit.client.0.smithi115.stdout:1/783: creat d0/de/d1b/d25/d4d/d51/d23/d65/ffd x:0 0 0 2024-09-13T23:06:18.840 INFO:tasks.workunit.client.1.smithi152.stdout:0/236: creat d18/d1f/d33/f4d x:0 0 0 2024-09-13T23:06:18.840 INFO:tasks.workunit.client.0.smithi115.stdout:7/823: sync 2024-09-13T23:06:18.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/237: mkdir d18/d1f/d29/d4e 0 2024-09-13T23:06:18.842 INFO:tasks.workunit.client.0.smithi115.stdout:3/982: link d3/d16/d1a/d1e/l99 d3/l14d 0 2024-09-13T23:06:18.842 INFO:tasks.workunit.client.0.smithi115.stdout:3/983: stat d3/d5/d65/f113 0 2024-09-13T23:06:18.844 INFO:tasks.workunit.client.1.smithi152.stdout:0/238: creat d18/d1f/d29/d3f/d40/f4f x:0 0 0 2024-09-13T23:06:18.845 INFO:tasks.workunit.client.1.smithi152.stdout:0/239: chown d18/d1f/l42 31 1 2024-09-13T23:06:18.847 INFO:tasks.workunit.client.0.smithi115.stdout:1/784: link d0/de/d1b/d25/laf d0/de/d66/d8f/d29/d47/d6a/lfe 0 2024-09-13T23:06:18.848 INFO:tasks.workunit.client.0.smithi115.stdout:1/785: write d0/de/d1b/d25/d4d/d51/d31/d79/fb5 [1626325,58407] 0 2024-09-13T23:06:18.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/240: rename d18/d1f/l42 to d18/d1f/d39/l50 0 2024-09-13T23:06:18.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/241: write d18/d1f/d39/f45 [827644,57138] 0 2024-09-13T23:06:18.849 INFO:tasks.workunit.client.0.smithi115.stdout:2/966: rmdir da/d21/da6 39 2024-09-13T23:06:18.849 INFO:tasks.workunit.client.1.smithi152.stdout:0/242: symlink d18/d1f/d29/l51 0 2024-09-13T23:06:18.850 INFO:tasks.workunit.client.0.smithi115.stdout:0/812: dread d6/d24/d25/d2b/d82/d44/f55 [0,4194304] 0 2024-09-13T23:06:18.851 INFO:tasks.workunit.client.0.smithi115.stdout:0/813: write d6/d24/d25/d2b/d82/d44/d5c/d87/da4/ffc [731608,97448] 0 2024-09-13T23:06:18.852 INFO:tasks.workunit.client.1.smithi152.stdout:0/243: rmdir d18/d1f/d41 0 2024-09-13T23:06:18.853 INFO:tasks.workunit.client.0.smithi115.stdout:1/786: mknod d0/dd/cff 0 2024-09-13T23:06:18.853 INFO:tasks.workunit.client.0.smithi115.stdout:1/787: creat d0/de/d66/d8f/d29/d47/d63/f100 x:0 0 0 2024-09-13T23:06:18.853 INFO:tasks.workunit.client.1.smithi152.stdout:0/244: rename d18/d1f/d29/d2f/c47 to d18/d1f/d29/c52 0 2024-09-13T23:06:18.855 INFO:tasks.workunit.client.0.smithi115.stdout:0/814: mknod d6/d24/d25/d2b/d103/c11b 0 2024-09-13T23:06:18.855 INFO:tasks.workunit.client.0.smithi115.stdout:2/967: mkdir da/d77/d83/d141 0 2024-09-13T23:06:18.856 INFO:tasks.workunit.client.0.smithi115.stdout:2/968: symlink da/d21/d8c/d41/d62/d10a/d10c/l142 0 2024-09-13T23:06:18.861 INFO:tasks.workunit.client.0.smithi115.stdout:5/891: dwrite d8/d9e/dd8/fe3 [4194304,4194304] 0 2024-09-13T23:06:18.863 INFO:tasks.workunit.client.0.smithi115.stdout:2/969: dread da/d21/f5b [0,4194304] 0 2024-09-13T23:06:18.863 INFO:tasks.workunit.client.0.smithi115.stdout:2/970: truncate da/d21/da6/de7/d12c/fcf 3410052 0 2024-09-13T23:06:18.864 INFO:tasks.workunit.client.0.smithi115.stdout:5/892: truncate d8/dd/d64/fa7 7194309 0 2024-09-13T23:06:18.864 INFO:tasks.workunit.client.0.smithi115.stdout:5/893: write d8/dd/d5d/d5e/fdf [1598747,7451] 0 2024-09-13T23:06:18.864 INFO:tasks.workunit.client.0.smithi115.stdout:5/894: fdatasync d8/f51 0 2024-09-13T23:06:18.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/895: read - d8/dd/d6a/d8a/f10b zero size 2024-09-13T23:06:18.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/896: dread - d8/d9e/dd8/fe2 zero size 2024-09-13T23:06:18.865 INFO:tasks.workunit.client.0.smithi115.stdout:5/897: dread - d8/dd/d20/dbb/fa0 zero size 2024-09-13T23:06:18.865 INFO:tasks.workunit.client.1.smithi152.stdout:8/227: dwrite d17/d25/f35 [0,4194304] 0 2024-09-13T23:06:18.867 INFO:tasks.workunit.client.0.smithi115.stdout:4/890: dwrite db/d11/fdc [0,4194304] 0 2024-09-13T23:06:18.868 INFO:tasks.workunit.client.1.smithi152.stdout:8/228: creat d17/d19/f4d x:0 0 0 2024-09-13T23:06:18.869 INFO:tasks.workunit.client.0.smithi115.stdout:3/984: getdents d3/d5/d35/d71/d3b/d47/de1/d144/de2/d102 0 2024-09-13T23:06:18.876 INFO:tasks.workunit.client.0.smithi115.stdout:3/985: unlink d3/d16/d1a/d13a/l8b 0 2024-09-13T23:06:18.877 INFO:tasks.workunit.client.0.smithi115.stdout:4/891: mkdir db/d16/d3f/d66/d68/d10d 0 2024-09-13T23:06:18.879 INFO:tasks.workunit.client.0.smithi115.stdout:3/986: creat d3/d5/d2c/f14e x:0 0 0 2024-09-13T23:06:18.879 INFO:tasks.workunit.client.0.smithi115.stdout:3/987: chown d3/d5/d65/da8/ca1 170 1 2024-09-13T23:06:18.880 INFO:tasks.workunit.client.0.smithi115.stdout:2/971: dread da/d23/dd5/fd9 [0,4194304] 0 2024-09-13T23:06:18.880 INFO:tasks.workunit.client.0.smithi115.stdout:4/892: mknod db/d16/d3f/d66/d68/d71/d84/c10e 0 2024-09-13T23:06:18.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/988: link d3/d5/d65/da8/da4/c46 d3/d5/d65/da8/da4/d127/c14f 0 2024-09-13T23:06:18.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/989: write d3/d5/d35/d71/d42/f115 [4950615,63855] 0 2024-09-13T23:06:18.882 INFO:tasks.workunit.client.0.smithi115.stdout:3/990: write d3/d16/d1a/d1e/d94/fb6 [4641492,21081] 0 2024-09-13T23:06:18.883 INFO:tasks.workunit.client.0.smithi115.stdout:2/972: creat da/d23/d2c/dc2/de1/d56/dda/f143 x:0 0 0 2024-09-13T23:06:18.884 INFO:tasks.workunit.client.0.smithi115.stdout:3/991: creat d3/d16/d1c/d101/f150 x:0 0 0 2024-09-13T23:06:18.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/992: creat d3/d16/d1c/d101/dfb/f151 x:0 0 0 2024-09-13T23:06:18.885 INFO:tasks.workunit.client.0.smithi115.stdout:3/993: fsync d3/d5/d5b/fe7 0 2024-09-13T23:06:18.886 INFO:tasks.workunit.client.0.smithi115.stdout:3/994: chown d3/d5/d35/f91 0 1 2024-09-13T23:06:18.886 INFO:tasks.workunit.client.0.smithi115.stdout:3/995: mknod d3/c152 0 2024-09-13T23:06:18.889 INFO:tasks.workunit.client.0.smithi115.stdout:3/996: rmdir d3/d12c/d139 39 2024-09-13T23:06:18.891 INFO:tasks.workunit.client.0.smithi115.stdout:3/997: mkdir d3/d16/d84/d153 0 2024-09-13T23:06:18.891 INFO:tasks.workunit.client.0.smithi115.stdout:2/973: dread da/d21/d8c/d41/d69/f87 [0,4194304] 0 2024-09-13T23:06:18.894 INFO:tasks.workunit.client.0.smithi115.stdout:0/815: dwrite d6/d24/d25/d2b/d82/d44/d5c/fc0 [0,4194304] 0 2024-09-13T23:06:18.895 INFO:tasks.workunit.client.0.smithi115.stdout:1/788: dwrite d0/de/d1b/f26 [0,4194304] 0 2024-09-13T23:06:18.897 INFO:tasks.workunit.client.0.smithi115.stdout:0/816: getdents d6/da0/dd9 0 2024-09-13T23:06:18.899 INFO:tasks.workunit.client.0.smithi115.stdout:0/817: creat d6/d24/d25/d2b/d82/d6b/d9f/dab/d118/f11c x:0 0 0 2024-09-13T23:06:18.901 INFO:tasks.workunit.client.0.smithi115.stdout:0/818: creat d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/d116/f11d x:0 0 0 2024-09-13T23:06:18.901 INFO:tasks.workunit.client.0.smithi115.stdout:0/819: creat d6/d24/d25/da3/dad/f11e x:0 0 0 2024-09-13T23:06:18.905 INFO:tasks.workunit.client.0.smithi115.stdout:0/820: link d6/d24/cb8 d6/d24/d25/d2b/d82/d6b/c11f 0 2024-09-13T23:06:18.905 INFO:tasks.workunit.client.0.smithi115.stdout:0/821: dread - d6/d24/d25/d2b/d82/d6b/fa1 zero size 2024-09-13T23:06:18.905 INFO:tasks.workunit.client.0.smithi115.stdout:0/822: write d6/d24/d25/d2b/d82/d44/f46 [1248043,50884] 0 2024-09-13T23:06:18.906 INFO:tasks.workunit.client.1.smithi152.stdout:0/245: dwrite f0 [0,4194304] 0 2024-09-13T23:06:18.907 INFO:tasks.workunit.client.0.smithi115.stdout:5/898: dwrite d8/f51 [0,4194304] 0 2024-09-13T23:06:18.907 INFO:tasks.workunit.client.0.smithi115.stdout:0/823: write d6/d24/d25/da3/dad/f9b [12833,42943] 0 2024-09-13T23:06:18.910 INFO:tasks.workunit.client.0.smithi115.stdout:0/824: symlink d6/d24/d25/da3/dad/l120 0 2024-09-13T23:06:18.910 INFO:tasks.workunit.client.0.smithi115.stdout:0/825: creat d6/d24/d25/da3/dad/f121 x:0 0 0 2024-09-13T23:06:18.911 INFO:tasks.workunit.client.0.smithi115.stdout:1/789: write d0/de/d66/d8f/d29/d47/d63/fb8 [1417052,68373] 0 2024-09-13T23:06:18.914 INFO:tasks.workunit.client.0.smithi115.stdout:1/790: rename d0/de/d66/d8f/d29/d47/d6a/f7a to d0/de/d1b/d25/d4d/d51/d31/d37/d72/f101 0 2024-09-13T23:06:18.916 INFO:tasks.workunit.client.0.smithi115.stdout:1/791: link d0/de/d66/faa d0/de/d66/d8f/d29/d47/d63/dac/f102 0 2024-09-13T23:06:18.922 INFO:tasks.workunit.client.0.smithi115.stdout:2/974: dwrite da/d23/d2c/f3d [4194304,4194304] 0 2024-09-13T23:06:18.922 INFO:tasks.workunit.client.0.smithi115.stdout:2/975: dread - da/d23/d2c/dc2/de1/d56/d1a/d7f/f135 zero size 2024-09-13T23:06:18.923 INFO:tasks.workunit.client.0.smithi115.stdout:2/976: truncate da/d21/f12a 187146 0 2024-09-13T23:06:18.923 INFO:tasks.workunit.client.1.smithi152.stdout:8/229: dwrite d17/d25/f2a [0,4194304] 0 2024-09-13T23:06:18.924 INFO:tasks.workunit.client.1.smithi152.stdout:0/246: read f8 [1366990,87465] 0 2024-09-13T23:06:18.924 INFO:tasks.workunit.client.1.smithi152.stdout:0/247: truncate d18/d1f/d29/d2f/d3d/f4c 990977 0 2024-09-13T23:06:18.925 INFO:tasks.workunit.client.0.smithi115.stdout:3/998: dwrite d3/d16/fdf [0,4194304] 0 2024-09-13T23:06:18.925 INFO:tasks.workunit.client.0.smithi115.stdout:4/893: dwrite db/d16/d3f/d66/da6/fe4 [0,4194304] 0 2024-09-13T23:06:18.926 INFO:tasks.workunit.client.1.smithi152.stdout:0/248: rename c12 to d18/d1f/c53 0 2024-09-13T23:06:18.929 INFO:tasks.workunit.client.0.smithi115.stdout:2/977: rename da/d23/d2c/dc2/de1/cee to da/d23/d2c/dc2/de1/d48/c144 0 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:4/340: sync 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:6/274: sync 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:6/275: chown d4/f7 53 1 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/278: sync 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/265: sync 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/235: sync 2024-09-13T23:06:18.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/236: write d5/dc/d19/f1d [201044,82415] 0 2024-09-13T23:06:18.931 INFO:tasks.workunit.client.1.smithi152.stdout:0/249: rmdir d18/d1f/d39/d44 0 2024-09-13T23:06:18.931 INFO:tasks.workunit.client.0.smithi115.stdout:3/999: write d3/d16/d1a/d1e/f80 [4997785,40940] 0 2024-09-13T23:06:18.932 INFO:tasks.workunit.client.1.smithi152.stdout:4/341: unlink d3/d4/d6/c3b 0 2024-09-13T23:06:18.934 INFO:tasks.workunit.client.0.smithi115.stdout:2/978: creat da/d21/d8c/d41/d95/f145 x:0 0 0 2024-09-13T23:06:18.934 INFO:tasks.workunit.client.0.smithi115.stdout:2/979: chown da/d23/d2c/dc2/de1/d56/d1a/d7f/daa/lc1 0 1 2024-09-13T23:06:18.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/276: rename d4/de/d12/d16/d2a/d53 to d4/de/d21/d5c 0 2024-09-13T23:06:18.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/257: sync 2024-09-13T23:06:18.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/266: sync 2024-09-13T23:06:18.936 INFO:tasks.workunit.client.1.smithi152.stdout:2/308: sync 2024-09-13T23:06:18.936 INFO:tasks.workunit.client.1.smithi152.stdout:6/277: dread d4/de/f49 [0,4194304] 0 2024-09-13T23:06:18.937 INFO:tasks.workunit.client.0.smithi115.stdout:2/980: symlink da/d21/da8/dbc/l146 0 2024-09-13T23:06:18.937 INFO:tasks.workunit.client.0.smithi115.stdout:2/981: write da/d23/d2c/dc2/de1/d56/f24 [1034473,41448] 0 2024-09-13T23:06:18.938 INFO:tasks.workunit.client.1.smithi152.stdout:7/279: rmdir d17/d24/d2a/d2e/d30 39 2024-09-13T23:06:18.939 INFO:tasks.workunit.client.1.smithi152.stdout:1/266: unlink d4/d9/d1a/d22/d24/l3a 0 2024-09-13T23:06:18.939 INFO:tasks.workunit.client.1.smithi152.stdout:1/267: creat d4/f55 x:0 0 0 2024-09-13T23:06:18.939 INFO:tasks.workunit.client.1.smithi152.stdout:0/250: creat d18/d19/d2c/f54 x:0 0 0 2024-09-13T23:06:18.939 INFO:tasks.workunit.client.0.smithi115.stdout:1/792: dread d0/de/d1b/d25/d4d/d51/d23/d65/f7d [0,4194304] 0 2024-09-13T23:06:18.939 INFO:tasks.workunit.client.0.smithi115.stdout:2/982: unlink da/d21/da6/de7/d12c/f106 0 2024-09-13T23:06:18.940 INFO:tasks.workunit.client.0.smithi115.stdout:2/983: write da/d21/d8c/d41/d69/f87 [1381994,122996] 0 2024-09-13T23:06:18.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/258: mkdir d3/d24/d34/d37/d5b 0 2024-09-13T23:06:18.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/259: truncate d3/d24/f41 749689 0 2024-09-13T23:06:18.943 INFO:tasks.workunit.client.1.smithi152.stdout:9/260: chown d3/d24/d34/d45/l5a 1 1 2024-09-13T23:06:18.943 INFO:tasks.workunit.client.1.smithi152.stdout:2/309: unlink d0/d8/d43/c4c 0 2024-09-13T23:06:18.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/261: read d3/d1e/f33 [12293,16678] 0 2024-09-13T23:06:18.944 INFO:tasks.workunit.client.1.smithi152.stdout:7/280: rename d17/d24/d2d/l38 to d17/d24/d2d/d3f/l5c 0 2024-09-13T23:06:18.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/899: dwrite d8/dd/d20/d27/fa4 [0,4194304] 0 2024-09-13T23:06:18.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/251: mknod d18/d1f/c55 0 2024-09-13T23:06:18.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/252: readlink la 0 2024-09-13T23:06:18.948 INFO:tasks.workunit.client.1.smithi152.stdout:7/281: getdents d17/d24/d2a 0 2024-09-13T23:06:18.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/310: mkdir d0/d4/d9/d14/d48/d71 0 2024-09-13T23:06:18.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/311: write d0/d4/d9/d16/f21 [4217100,80532] 0 2024-09-13T23:06:18.953 INFO:tasks.workunit.client.1.smithi152.stdout:3/267: dread de/f5c [0,4194304] 0 2024-09-13T23:06:18.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/262: dread d3/d24/f2e [0,4194304] 0 2024-09-13T23:06:18.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/263: stat d3/d1e/d30/f39 0 2024-09-13T23:06:18.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/264: write d3/d24/d34/d37/d56/f58 [289354,87422] 0 2024-09-13T23:06:18.953 INFO:tasks.workunit.client.1.smithi152.stdout:2/312: dread - d0/d4/d9/f3a zero size 2024-09-13T23:06:18.954 INFO:tasks.workunit.client.0.smithi115.stdout:5/900: rename d8/dd/d6a/d8a to d8/dd/d20/dbb/deb/d10d 0 2024-09-13T23:06:18.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/268: rename de/d14/d38/f28 to de/d14/f62 0 2024-09-13T23:06:18.957 INFO:tasks.workunit.client.0.smithi115.stdout:5/901: mknod d8/dd/d20/dbb/deb/d10d/c10e 0 2024-09-13T23:06:18.958 INFO:tasks.workunit.client.1.smithi152.stdout:1/268: dread d4/d9/f27 [0,4194304] 0 2024-09-13T23:06:18.960 INFO:tasks.workunit.client.1.smithi152.stdout:9/265: link d3/d24/fb d3/d24/d34/d37/f5c 0 2024-09-13T23:06:18.960 INFO:tasks.workunit.client.1.smithi152.stdout:2/313: truncate d0/fa 4612914 0 2024-09-13T23:06:18.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/269: mkdir de/d63 0 2024-09-13T23:06:18.963 INFO:tasks.workunit.client.0.smithi115.stdout:0/826: dwrite d6/f20 [0,4194304] 0 2024-09-13T23:06:18.963 INFO:tasks.workunit.client.0.smithi115.stdout:0/827: chown d6/fd 8307044 1 2024-09-13T23:06:18.964 INFO:tasks.workunit.client.1.smithi152.stdout:0/253: dread f0 [0,4194304] 0 2024-09-13T23:06:18.965 INFO:tasks.workunit.client.1.smithi152.stdout:0/254: truncate d18/f31 127204 0 2024-09-13T23:06:18.965 INFO:tasks.workunit.client.1.smithi152.stdout:0/255: chown d18/c3b 161 1 2024-09-13T23:06:18.967 INFO:tasks.workunit.client.0.smithi115.stdout:2/984: read da/d23/d2c/f47 [5884176,124201] 0 2024-09-13T23:06:18.967 INFO:tasks.workunit.client.0.smithi115.stdout:2/985: creat da/d23/d2c/dc2/d108/f147 x:0 0 0 2024-09-13T23:06:18.967 INFO:tasks.workunit.client.0.smithi115.stdout:2/986: write da/f114 [1016985,65830] 0 2024-09-13T23:06:18.969 INFO:tasks.workunit.client.1.smithi152.stdout:1/269: link d4/d9/fb d4/d9/d1a/d22/d24/f56 0 2024-09-13T23:06:18.969 INFO:tasks.workunit.client.1.smithi152.stdout:1/270: fsync d4/d9/d1a/d22/f35 0 2024-09-13T23:06:18.970 INFO:tasks.workunit.client.1.smithi152.stdout:2/314: mknod d0/d4/c72 0 2024-09-13T23:06:18.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/270: creat de/d14/d47/d57/f64 x:0 0 0 2024-09-13T23:06:18.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/271: write de/d14/f4f [695553,112428] 0 2024-09-13T23:06:18.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/272: truncate de/d1f/f52 762077 0 2024-09-13T23:06:18.973 INFO:tasks.workunit.client.1.smithi152.stdout:0/256: creat d18/d1f/d29/d3f/f56 x:0 0 0 2024-09-13T23:06:18.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/271: symlink d4/d9/d1a/d22/d24/l57 0 2024-09-13T23:06:18.977 INFO:tasks.workunit.client.0.smithi115.stdout:2/987: rename da/d23/d2c/dc2/de1/d56/d1a/d7f/daa to da/d23/d148 0 2024-09-13T23:06:18.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/230: dwrite d17/d25/f35 [0,4194304] 0 2024-09-13T23:06:18.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/231: creat d17/d25/d32/f4e x:0 0 0 2024-09-13T23:06:18.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/232: readlink d17/d23/l37 0 2024-09-13T23:06:18.978 INFO:tasks.workunit.client.1.smithi152.stdout:0/257: creat d18/d1f/d29/d3f/d4b/f57 x:0 0 0 2024-09-13T23:06:18.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/988: mknod da/d77/d83/c149 0 2024-09-13T23:06:18.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/989: write da/d23/d148/fe6 [313543,9960] 0 2024-09-13T23:06:18.979 INFO:tasks.workunit.client.0.smithi115.stdout:2/990: truncate da/d23/d2c/dc2/de1/f4c 641895 0 2024-09-13T23:06:18.981 INFO:tasks.workunit.client.0.smithi115.stdout:2/991: mknod da/d21/d8c/c14a 0 2024-09-13T23:06:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:8/233: link d17/d25/d32/d44/f48 d17/d23/f4f 0 2024-09-13T23:06:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/342: dwrite d3/d4/d6/d37/d53/f42 [0,4194304] 0 2024-09-13T23:06:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/343: truncate d3/d4/d33/f48 4362574 0 2024-09-13T23:06:18.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/344: dread - d3/d4/d6/d8/d17/d3a/f56 zero size 2024-09-13T23:06:18.982 INFO:tasks.workunit.client.0.smithi115.stdout:0/828: dread d6/d24/d25/d58/f7a [0,4194304] 0 2024-09-13T23:06:18.983 INFO:tasks.workunit.client.0.smithi115.stdout:4/894: dwrite db/d19/d4e/f5b [0,4194304] 0 2024-09-13T23:06:18.983 INFO:tasks.workunit.client.1.smithi152.stdout:0/258: mknod d18/d1f/d33/c58 0 2024-09-13T23:06:18.983 INFO:tasks.workunit.client.1.smithi152.stdout:1/272: dread d4/d9/fd [0,4194304] 0 2024-09-13T23:06:18.984 INFO:tasks.workunit.client.0.smithi115.stdout:2/992: mkdir da/d23/d2c/dc2/de1/d56/d14b 0 2024-09-13T23:06:18.984 INFO:tasks.workunit.client.0.smithi115.stdout:2/993: chown da/d23/d2c/dc2/de1/d56/d74/c8a 1 1 2024-09-13T23:06:18.984 INFO:tasks.workunit.client.1.smithi152.stdout:8/234: mkdir d17/d25/d32/d50 0 2024-09-13T23:06:18.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/345: mknod d3/d4/d6/d37/d53/d1c/d59/c5e 0 2024-09-13T23:06:18.986 INFO:tasks.workunit.client.0.smithi115.stdout:0/829: mkdir d6/da0/dd9/d122 0 2024-09-13T23:06:18.987 INFO:tasks.workunit.client.0.smithi115.stdout:0/830: chown d6/d24/d25/d58/db4 26 1 2024-09-13T23:06:18.987 INFO:tasks.workunit.client.1.smithi152.stdout:1/273: rename d4/f55 to d4/d9/d1a/f58 0 2024-09-13T23:06:18.987 INFO:tasks.workunit.client.1.smithi152.stdout:0/259: creat d18/d1f/d29/d3f/f59 x:0 0 0 2024-09-13T23:06:18.987 INFO:tasks.workunit.client.1.smithi152.stdout:0/260: read - d18/d1f/d29/d3f/d4b/f57 zero size 2024-09-13T23:06:18.988 INFO:tasks.workunit.client.0.smithi115.stdout:4/895: mknod db/d11/d2e/c10f 0 2024-09-13T23:06:18.989 INFO:tasks.workunit.client.1.smithi152.stdout:8/235: symlink d17/d25/l51 0 2024-09-13T23:06:18.989 INFO:tasks.workunit.client.1.smithi152.stdout:8/236: read - d17/d25/d32/d44/f49 zero size 2024-09-13T23:06:18.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/346: mkdir d3/d4/d6/d37/d53/d1c/d5f 0 2024-09-13T23:06:18.990 INFO:tasks.workunit.client.1.smithi152.stdout:0/261: rename d18/f27 to d18/d1f/d33/f5a 0 2024-09-13T23:06:18.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/347: mkdir d3/d4/d6/d37/d53/d1c/d59/d60 0 2024-09-13T23:06:18.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/348: fsync d3/d4/d6/d8/f19 0 2024-09-13T23:06:18.992 INFO:tasks.workunit.client.1.smithi152.stdout:0/262: mkdir d18/d5b 0 2024-09-13T23:06:18.992 INFO:tasks.workunit.client.0.smithi115.stdout:4/896: symlink db/d16/d3f/dae/l110 0 2024-09-13T23:06:18.992 INFO:tasks.workunit.client.1.smithi152.stdout:4/349: mknod d3/d4/c61 0 2024-09-13T23:06:18.992 INFO:tasks.workunit.client.1.smithi152.stdout:8/237: dread d17/d19/f3d [0,4194304] 0 2024-09-13T23:06:18.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/238: truncate d17/d23/f45 111472 0 2024-09-13T23:06:18.994 INFO:tasks.workunit.client.1.smithi152.stdout:0/263: unlink d18/f2b 0 2024-09-13T23:06:18.994 INFO:tasks.workunit.client.1.smithi152.stdout:0/264: readlink d18/d19/l24 0 2024-09-13T23:06:18.994 INFO:tasks.workunit.client.0.smithi115.stdout:4/897: symlink db/d11/d2e/d33/d36/l111 0 2024-09-13T23:06:18.994 INFO:tasks.workunit.client.0.smithi115.stdout:4/898: dread - db/d16/d3f/dae/fcb zero size 2024-09-13T23:06:18.996 INFO:tasks.workunit.client.1.smithi152.stdout:4/350: rename d3/d4/d6/d8/d17/d58 to d3/d4/d6/d37/d53/d62 0 2024-09-13T23:06:18.996 INFO:tasks.workunit.client.0.smithi115.stdout:4/899: mkdir db/d19/d4e/d112 0 2024-09-13T23:06:18.996 INFO:tasks.workunit.client.0.smithi115.stdout:4/900: write db/d16/d3f/f72 [2901651,66107] 0 2024-09-13T23:06:18.997 INFO:tasks.workunit.client.1.smithi152.stdout:8/239: mknod d17/d23/c52 0 2024-09-13T23:06:18.998 INFO:tasks.workunit.client.1.smithi152.stdout:0/265: creat d18/d1f/d29/d3f/f5c x:0 0 0 2024-09-13T23:06:18.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/351: mkdir d3/d4/d6/d63 0 2024-09-13T23:06:19.000 INFO:tasks.workunit.client.1.smithi152.stdout:0/266: rename f8 to d18/d19/d2c/f5d 0 2024-09-13T23:06:19.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/352: link d3/f13 d3/d4/d6/d37/d53/d62/f64 0 2024-09-13T23:06:19.003 INFO:tasks.workunit.client.0.smithi115.stdout:2/994: dread da/d23/d2c/dc2/de1/f54 [0,4194304] 0 2024-09-13T23:06:19.003 INFO:tasks.workunit.client.1.smithi152.stdout:0/267: truncate d18/d1f/d39/f45 814708 0 2024-09-13T23:06:19.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/315: write d0/d4/d9/ff [4012342,100499] 0 2024-09-13T23:06:19.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/316: read d0/d4/d9/d14/f2f [3656809,3348] 0 2024-09-13T23:06:19.004 INFO:tasks.workunit.client.1.smithi152.stdout:0/268: link d18/d1f/d29/d3f/d4b/f57 d18/d1f/d29/d2f/d3d/f5e 0 2024-09-13T23:06:19.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/269: readlink d18/d1f/d39/l3a 0 2024-09-13T23:06:19.005 INFO:tasks.workunit.client.0.smithi115.stdout:2/995: creat da/d77/d83/d141/f14c x:0 0 0 2024-09-13T23:06:19.006 INFO:tasks.workunit.client.0.smithi115.stdout:2/996: symlink da/d21/d8c/d41/d62/d10a/d10c/l14d 0 2024-09-13T23:06:19.006 INFO:tasks.workunit.client.0.smithi115.stdout:2/997: chown da/d23/d2c/dc2/d103 17319564 1 2024-09-13T23:06:19.006 INFO:tasks.workunit.client.0.smithi115.stdout:2/998: truncate da/d21/da6/f129 218195 0 2024-09-13T23:06:19.008 INFO:tasks.workunit.client.0.smithi115.stdout:1/793: dwrite d0/de/d1b/d25/d4d/d51/d23/d65/f7f [0,4194304] 0 2024-09-13T23:06:19.009 INFO:tasks.workunit.client.0.smithi115.stdout:1/794: fsync d0/de/d66/d8f/d29/d47/d74/d9d/da3/fcd 0 2024-09-13T23:06:19.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/795: rmdir d0/de/d66/d8f/d29/d47/d63/dac/dc7 39 2024-09-13T23:06:19.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/796: write d0/de/f46 [4831594,101454] 0 2024-09-13T23:06:19.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/797: truncate d0/de/d66/d8f/d29/d47/d74/fcc 4930501 0 2024-09-13T23:06:19.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/798: write d0/de/f9e [484923,35457] 0 2024-09-13T23:06:19.013 INFO:tasks.workunit.client.0.smithi115.stdout:4/901: dread db/d11/d2e/d33/fc9 [0,4194304] 0 2024-09-13T23:06:19.014 INFO:tasks.workunit.client.0.smithi115.stdout:4/902: truncate db/d11/d54/fc1 792559 0 2024-09-13T23:06:19.014 INFO:tasks.workunit.client.0.smithi115.stdout:4/903: truncate db/d16/d3f/d66/d68/d71/ffa 790226 0 2024-09-13T23:06:19.014 INFO:tasks.workunit.client.0.smithi115.stdout:1/799: unlink d0/de/d66/d8f/d29/f87 0 2024-09-13T23:06:19.014 INFO:tasks.workunit.client.0.smithi115.stdout:1/800: fsync d0/fb0 0 2024-09-13T23:06:19.014 INFO:tasks.workunit.client.0.smithi115.stdout:1/801: chown d0/l56 7 1 2024-09-13T23:06:19.015 INFO:tasks.workunit.client.0.smithi115.stdout:4/904: link db/d11/d2e/f5d db/d11/d2e/db4/f113 0 2024-09-13T23:06:19.015 INFO:tasks.workunit.client.0.smithi115.stdout:4/905: dread - db/d11/d2e/d33/d36/f60 zero size 2024-09-13T23:06:19.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/278: dwrite d4/de/d12/d16/d2a/f48 [0,4194304] 0 2024-09-13T23:06:19.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/279: readlink d4/de/d12/d16/d2a/l30 0 2024-09-13T23:06:19.016 INFO:tasks.workunit.client.0.smithi115.stdout:2/999: dread da/d23/d2c/dc2/d104/fe8 [0,4194304] 0 2024-09-13T23:06:19.018 INFO:tasks.workunit.client.1.smithi152.stdout:6/280: symlink d4/de/d12/d16/l5d 0 2024-09-13T23:06:19.019 INFO:tasks.workunit.client.0.smithi115.stdout:1/802: rename d0/de/d1b/f26 to d0/de/d66/d8f/d29/d47/d6a/f103 0 2024-09-13T23:06:19.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/282: dwrite d17/d24/d2d/f4e [0,4194304] 0 2024-09-13T23:06:19.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/317: dread d0/d4/d9/d18/f6f [0,4194304] 0 2024-09-13T23:06:19.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/318: fdatasync d0/d4/d9/d18/d32/f35 0 2024-09-13T23:06:19.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/319: readlink d0/d4/d9/d16/l5d 0 2024-09-13T23:06:19.021 INFO:tasks.workunit.client.1.smithi152.stdout:7/283: write d17/d24/f3c [2877737,65846] 0 2024-09-13T23:06:19.022 INFO:tasks.workunit.client.0.smithi115.stdout:4/906: truncate db/d11/d2e/d33/f4c 1009231 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:6/281: rename d4/de/d1d/f32 to d4/de/d21/d5b/f5e 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:3/273: dwrite de/d14/d38/f37 [0,4194304] 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:3/274: stat de/d14/d38/l33 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:6/282: creat d4/de/d12/f5f x:0 0 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:3/275: write de/d1f/f52 [19196,100699] 0 2024-09-13T23:06:19.023 INFO:tasks.workunit.client.1.smithi152.stdout:3/276: write de/f1e [4738360,46046] 0 2024-09-13T23:06:19.027 INFO:tasks.workunit.client.0.smithi115.stdout:5/902: dwrite d8/dd/d64/fcb [0,4194304] 0 2024-09-13T23:06:19.029 INFO:tasks.workunit.client.1.smithi152.stdout:2/320: dread d0/d4/d9/d14/f34 [0,4194304] 0 2024-09-13T23:06:19.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/284: mkdir d17/d24/d2a/d2b/d4b/d5d 0 2024-09-13T23:06:19.030 INFO:tasks.workunit.client.0.smithi115.stdout:1/803: dread d0/de/d1b/d25/f3d [0,4194304] 0 2024-09-13T23:06:19.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/266: rmdir d3/d24/d34/d37 39 2024-09-13T23:06:19.034 INFO:tasks.workunit.client.0.smithi115.stdout:5/903: unlink d8/dd/d20/f25 0 2024-09-13T23:06:19.034 INFO:tasks.workunit.client.0.smithi115.stdout:5/904: write d8/dd/d20/d4a/f57 [258561,59028] 0 2024-09-13T23:06:19.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/283: creat d4/de/d12/d16/d2a/d3d/d57/f60 x:0 0 0 2024-09-13T23:06:19.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/284: write d4/de/d12/d16/d2a/f48 [4976326,10535] 0 2024-09-13T23:06:19.036 INFO:tasks.workunit.client.0.smithi115.stdout:1/804: mknod d0/de/d1b/d25/d4d/d51/d31/dfc/c104 0 2024-09-13T23:06:19.040 INFO:tasks.workunit.client.1.smithi152.stdout:2/321: symlink d0/d4/d9/d18/d1e/d3c/l73 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:2/322: chown d0/d4/d9/d16/d2b/l47 49 1 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:2/323: write d0/d4/d9/d18/d1e/d3c/f58 [302458,105739] 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:9/267: rmdir d3/d24/d34/d37/d4a 39 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/274: dwrite d4/d9/d1a/d22/d24/f45 [0,4194304] 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:1/275: write d4/d9/fd [1959426,90766] 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:6/285: rename d4/f7 to d4/de/d12/d16/d2a/d38/f61 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:6/286: readlink d4/de/d12/d16/l3a 0 2024-09-13T23:06:19.041 INFO:tasks.workunit.client.1.smithi152.stdout:7/285: dread d17/f1d [0,4194304] 0 2024-09-13T23:06:19.042 INFO:tasks.workunit.client.0.smithi115.stdout:0/831: dwrite d6/d24/d25/d2b/fdf [0,4194304] 0 2024-09-13T23:06:19.042 INFO:tasks.workunit.client.0.smithi115.stdout:4/907: write f5 [107644,58447] 0 2024-09-13T23:06:19.045 INFO:tasks.workunit.client.1.smithi152.stdout:4/353: dwrite d3/d4/d6/d8/f1b [0,4194304] 0 2024-09-13T23:06:19.045 INFO:tasks.workunit.client.1.smithi152.stdout:3/277: dwrite de/d14/d47/d57/d5d/f56 [0,4194304] 0 2024-09-13T23:06:19.048 INFO:tasks.workunit.client.0.smithi115.stdout:5/905: link d8/d9e/dcd/ff9 d8/dd/d5d/d5e/f10f 0 2024-09-13T23:06:19.050 INFO:tasks.workunit.client.1.smithi152.stdout:2/324: dread d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:19.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/805: rename d0/cf to d0/de/d1b/d25/d4d/c105 0 2024-09-13T23:06:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:9/268: mkdir d3/d1e/d30/d5d 0 2024-09-13T23:06:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/286: read d17/d24/d2d/f4e [1328093,44098] 0 2024-09-13T23:06:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/287: creat d17/d24/d2d/d46/f5e x:0 0 0 2024-09-13T23:06:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/288: fsync f0 0 2024-09-13T23:06:19.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/289: stat d17/d24/d2d/d51/d5b 0 2024-09-13T23:06:19.063 INFO:tasks.workunit.client.1.smithi152.stdout:1/276: symlink d4/d4c/l59 0 2024-09-13T23:06:19.069 INFO:tasks.workunit.client.1.smithi152.stdout:2/325: rename d0/d4/d9/d14/d48/d4a/l64 to d0/d4/d9/d14/d48/d49/l74 0 2024-09-13T23:06:19.069 INFO:tasks.workunit.client.1.smithi152.stdout:2/326: creat d0/d4/d9/d14/d48/d4a/f75 x:0 0 0 2024-09-13T23:06:19.070 INFO:tasks.workunit.client.1.smithi152.stdout:9/269: creat d3/d52/f5e x:0 0 0 2024-09-13T23:06:19.070 INFO:tasks.workunit.client.1.smithi152.stdout:9/270: dread - d3/d24/d34/d37/d4a/f55 zero size 2024-09-13T23:06:19.071 INFO:tasks.workunit.client.0.smithi115.stdout:5/906: creat d8/dd/d5d/f110 x:0 0 0 2024-09-13T23:06:19.072 INFO:tasks.workunit.client.1.smithi152.stdout:7/290: creat d17/d24/d2a/d2e/f5f x:0 0 0 2024-09-13T23:06:19.072 INFO:tasks.workunit.client.0.smithi115.stdout:1/806: mkdir d0/de/d1b/d25/d4d/d51/d31/d37/d106 0 2024-09-13T23:06:19.073 INFO:tasks.workunit.client.1.smithi152.stdout:1/277: mknod d4/d4c/c5a 0 2024-09-13T23:06:19.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/327: symlink d0/d4/d9/d18/d1e/d3c/l76 0 2024-09-13T23:06:19.076 INFO:tasks.workunit.client.0.smithi115.stdout:4/908: getdents db/d11/d2e/dc7 0 2024-09-13T23:06:19.078 INFO:tasks.workunit.client.0.smithi115.stdout:0/832: dwrite d6/d24/d25/da3/f102 [8388608,4194304] 0 2024-09-13T23:06:19.078 INFO:tasks.workunit.client.1.smithi152.stdout:7/291: symlink d17/d24/d2d/l60 0 2024-09-13T23:06:19.078 INFO:tasks.workunit.client.1.smithi152.stdout:7/292: dread - d17/d24/d2d/d46/f48 zero size 2024-09-13T23:06:19.078 INFO:tasks.workunit.client.1.smithi152.stdout:7/293: chown c12 32 1 2024-09-13T23:06:19.078 INFO:tasks.workunit.client.1.smithi152.stdout:6/287: dwrite d4/de/f39 [0,4194304] 0 2024-09-13T23:06:19.079 INFO:tasks.workunit.client.1.smithi152.stdout:4/354: dwrite d3/f52 [0,4194304] 0 2024-09-13T23:06:19.079 INFO:tasks.workunit.client.1.smithi152.stdout:4/355: chown d3/d4/d6/d37/d53/f42 988329 1 2024-09-13T23:06:19.079 INFO:tasks.workunit.client.1.smithi152.stdout:2/328: creat d0/f77 x:0 0 0 2024-09-13T23:06:19.080 INFO:tasks.workunit.client.0.smithi115.stdout:5/907: truncate d8/d7a/f83 559552 0 2024-09-13T23:06:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/270: read d18/d1f/d39/f45 [352533,77547] 0 2024-09-13T23:06:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/271: read d18/d1f/d39/f45 [286076,74855] 0 2024-09-13T23:06:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:0/272: chown f0 411 1 2024-09-13T23:06:19.081 INFO:tasks.workunit.client.1.smithi152.stdout:7/294: truncate d17/f22 880263 0 2024-09-13T23:06:19.082 INFO:tasks.workunit.client.0.smithi115.stdout:1/807: mkdir d0/de/d66/d8f/dad/d107 0 2024-09-13T23:06:19.084 INFO:tasks.workunit.client.0.smithi115.stdout:4/909: creat db/d11/d2e/db4/f114 x:0 0 0 2024-09-13T23:06:19.085 INFO:tasks.workunit.client.0.smithi115.stdout:4/910: write db/ffb [934026,64881] 0 2024-09-13T23:06:19.085 INFO:tasks.workunit.client.1.smithi152.stdout:6/288: truncate d4/de/d21/f24 698160 0 2024-09-13T23:06:19.085 INFO:tasks.workunit.client.1.smithi152.stdout:9/271: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:19.087 INFO:tasks.workunit.client.0.smithi115.stdout:0/833: rename d6/d24/d25/d58/l5f to d6/d24/d25/dc7/l123 0 2024-09-13T23:06:19.090 INFO:tasks.workunit.client.1.smithi152.stdout:4/356: mknod d3/d4/d6/d37/d53/d1c/d59/c65 0 2024-09-13T23:06:19.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/908: link d8/d9e/dd8/fe3 d8/dd/d6a/d82/d63/d5a/f111 0 2024-09-13T23:06:19.090 INFO:tasks.workunit.client.0.smithi115.stdout:5/909: stat d8/dd/l3d 0 2024-09-13T23:06:19.091 INFO:tasks.workunit.client.1.smithi152.stdout:9/272: read d3/d1e/f21 [3530163,110126] 0 2024-09-13T23:06:19.092 INFO:tasks.workunit.client.0.smithi115.stdout:5/910: mknod d8/dd/d20/d27/da9/c112 0 2024-09-13T23:06:19.094 INFO:tasks.workunit.client.0.smithi115.stdout:4/911: dread db/d11/d2e/d33/f6d [0,4194304] 0 2024-09-13T23:06:19.095 INFO:tasks.workunit.client.1.smithi152.stdout:1/278: dwrite d4/d9/d1a/f58 [0,4194304] 0 2024-09-13T23:06:19.096 INFO:tasks.workunit.client.0.smithi115.stdout:5/911: rename d8/dd/d20/d27/fa4 to d8/dd/f113 0 2024-09-13T23:06:19.096 INFO:tasks.workunit.client.1.smithi152.stdout:7/295: mkdir d17/d24/d2a/d2b/d4b/d61 0 2024-09-13T23:06:19.097 INFO:tasks.workunit.client.1.smithi152.stdout:0/273: mknod d18/d1f/d29/d2f/d3d/c5f 0 2024-09-13T23:06:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:6/289: truncate d4/de/d21/f1f 2408530 0 2024-09-13T23:06:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:6/290: chown d4/f9 186361198 1 2024-09-13T23:06:19.098 INFO:tasks.workunit.client.1.smithi152.stdout:6/291: chown d4/de/d12/d16/d2a/d38/d3c/f45 24643124 1 2024-09-13T23:06:19.099 INFO:tasks.workunit.client.0.smithi115.stdout:4/912: unlink db/d16/d3f/f101 0 2024-09-13T23:06:19.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/296: creat d17/d24/d2a/d2b/d4b/f62 x:0 0 0 2024-09-13T23:06:19.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/297: write d17/d24/d2a/d2b/f3b [636431,1194] 0 2024-09-13T23:06:19.103 INFO:tasks.workunit.client.1.smithi152.stdout:6/292: mknod d4/c62 0 2024-09-13T23:06:19.103 INFO:tasks.workunit.client.1.smithi152.stdout:6/293: write d4/de/d12/d16/d2a/d3d/f4d [406068,102604] 0 2024-09-13T23:06:19.105 INFO:tasks.workunit.client.0.smithi115.stdout:4/913: mknod db/d11/d2e/dc7/c115 0 2024-09-13T23:06:19.105 INFO:tasks.workunit.client.1.smithi152.stdout:2/329: write d0/d4/d9/f25 [3181873,119820] 0 2024-09-13T23:06:19.105 INFO:tasks.workunit.client.1.smithi152.stdout:2/330: fdatasync d0/d4/f1d 0 2024-09-13T23:06:19.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/331: chown d0/d4/d9/d14 2140663 1 2024-09-13T23:06:19.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/332: creat d0/d8/f78 x:0 0 0 2024-09-13T23:06:19.106 INFO:tasks.workunit.client.0.smithi115.stdout:5/912: rmdir d8/dd/d6a/d82/d63/dd6 39 2024-09-13T23:06:19.106 INFO:tasks.workunit.client.0.smithi115.stdout:5/913: write d8/dd/d20/dbb/deb/d10d/f9f [62722,92373] 0 2024-09-13T23:06:19.106 INFO:tasks.workunit.client.0.smithi115.stdout:5/914: creat d8/dd/d6a/d82/d63/d5a/dc3/f114 x:0 0 0 2024-09-13T23:06:19.107 INFO:tasks.workunit.client.0.smithi115.stdout:5/915: write d8/dd/d20/d27/fb2 [4377660,97178] 0 2024-09-13T23:06:19.113 INFO:tasks.workunit.client.0.smithi115.stdout:1/808: dwrite d0/de/d62/fa6 [0,4194304] 0 2024-09-13T23:06:19.113 INFO:tasks.workunit.client.0.smithi115.stdout:1/809: chown d0/de/d66/lf4 948722 1 2024-09-13T23:06:19.115 INFO:tasks.workunit.client.0.smithi115.stdout:4/914: symlink db/d11/d2e/l116 0 2024-09-13T23:06:19.115 INFO:tasks.workunit.client.0.smithi115.stdout:5/916: creat d8/dd/d5d/d9b/de1/f115 x:0 0 0 2024-09-13T23:06:19.116 INFO:tasks.workunit.client.1.smithi152.stdout:9/273: rmdir d3/d52 39 2024-09-13T23:06:19.116 INFO:tasks.workunit.client.1.smithi152.stdout:9/274: stat d3/d24/d34/d37/c46 0 2024-09-13T23:06:19.116 INFO:tasks.workunit.client.1.smithi152.stdout:9/275: truncate d3/d1e/f33 843693 0 2024-09-13T23:06:19.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/276: creat d3/d24/d34/d45/f5f x:0 0 0 2024-09-13T23:06:19.121 INFO:tasks.workunit.client.0.smithi115.stdout:4/915: getdents db/d11/d2e/d33/d36 0 2024-09-13T23:06:19.121 INFO:tasks.workunit.client.0.smithi115.stdout:4/916: chown db/d16/fe5 15319804 1 2024-09-13T23:06:19.121 INFO:tasks.workunit.client.0.smithi115.stdout:4/917: chown db/d16/ff2 7267 1 2024-09-13T23:06:19.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/917: mkdir d8/dd/d64/d116 0 2024-09-13T23:06:19.122 INFO:tasks.workunit.client.0.smithi115.stdout:5/918: stat d8/fb 0 2024-09-13T23:06:19.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/918: mkdir db/d11/d117 0 2024-09-13T23:06:19.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/919: stat db/d11/d54/d17 0 2024-09-13T23:06:19.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/920: fsync db/fb3 0 2024-09-13T23:06:19.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/921: write db/d11/fdc [4349783,46239] 0 2024-09-13T23:06:19.124 INFO:tasks.workunit.client.0.smithi115.stdout:4/922: readlink db/d16/d3f/d66/l78 0 2024-09-13T23:06:19.126 INFO:tasks.workunit.client.1.smithi152.stdout:4/357: rename d3/d4/d6/d37/d53 to d3/d4/d6/d66 0 2024-09-13T23:06:19.126 INFO:tasks.workunit.client.1.smithi152.stdout:4/358: creat d3/d4/d6/f67 x:0 0 0 2024-09-13T23:06:19.127 INFO:tasks.workunit.client.0.smithi115.stdout:0/834: dwrite d6/da0/fda [0,4194304] 0 2024-09-13T23:06:19.128 INFO:tasks.workunit.client.0.smithi115.stdout:0/835: read d6/d24/d25/d2b/d82/d6b/f111 [678551,123554] 0 2024-09-13T23:06:19.128 INFO:tasks.workunit.client.1.smithi152.stdout:0/274: rename d18/f31 to d18/d1f/d29/f60 0 2024-09-13T23:06:19.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/836: mknod d6/d24/d25/d2b/d103/dd4/c124 0 2024-09-13T23:06:19.131 INFO:tasks.workunit.client.0.smithi115.stdout:0/837: chown d6/d24/d25/d2b/d82/d6b/d9f/f83 826749049 1 2024-09-13T23:06:19.138 INFO:tasks.workunit.client.1.smithi152.stdout:4/359: getdents d3/d4/d6/d66/d1c/d59 0 2024-09-13T23:06:19.138 INFO:tasks.workunit.client.0.smithi115.stdout:1/810: dread d0/de/d1b/d25/d4d/d51/d23/d65/f7f [0,4194304] 0 2024-09-13T23:06:19.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/811: getdents d0/de/d62 0 2024-09-13T23:06:19.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/812: write d0/de/d62/f84 [2361420,40848] 0 2024-09-13T23:06:19.140 INFO:tasks.workunit.client.0.smithi115.stdout:1/813: link d0/de/d1b/d25/d4d/d51/d23/f2c d0/de/d1b/d25/d4d/d51/d31/d37/dc8/f108 0 2024-09-13T23:06:19.141 INFO:tasks.workunit.client.1.smithi152.stdout:2/333: rename d0/d8/f2a to d0/d4/d9/d14/d48/d49/f79 0 2024-09-13T23:06:19.141 INFO:tasks.workunit.client.1.smithi152.stdout:2/334: write d0/d4/d9/d16/f21 [4712481,77029] 0 2024-09-13T23:06:19.142 INFO:tasks.workunit.client.0.smithi115.stdout:4/923: read db/d11/d2e/faf [764019,62521] 0 2024-09-13T23:06:19.142 INFO:tasks.workunit.client.0.smithi115.stdout:1/814: creat d0/de/d66/d8f/d29/f109 x:0 0 0 2024-09-13T23:06:19.142 INFO:tasks.workunit.client.0.smithi115.stdout:4/924: fsync db/d16/d3f/d66/d68/d71/d84/d96/de6/ffe 0 2024-09-13T23:06:19.142 INFO:tasks.workunit.client.0.smithi115.stdout:4/925: readlink db/d16/d3f/dae/l110 0 2024-09-13T23:06:19.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/360: creat d3/d4/d6/d66/d1c/d59/f68 x:0 0 0 2024-09-13T23:06:19.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/361: readlink d3/d4/d33/l57 0 2024-09-13T23:06:19.145 INFO:tasks.workunit.client.1.smithi152.stdout:2/335: read d0/d4/d9/d55/f57 [317894,78632] 0 2024-09-13T23:06:19.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/336: stat d0/d4/d9/d14/d48/d49 0 2024-09-13T23:06:19.146 INFO:tasks.workunit.client.0.smithi115.stdout:0/838: write d6/d24/d25/d2b/d103/dd4/d107/f8f [400009,88620] 0 2024-09-13T23:06:19.147 INFO:tasks.workunit.client.1.smithi152.stdout:4/362: mknod d3/d4/d6/d8/d17/d39/c69 0 2024-09-13T23:06:19.147 INFO:tasks.workunit.client.1.smithi152.stdout:4/363: write d3/d4/d6/d37/f55 [872204,90727] 0 2024-09-13T23:06:19.148 INFO:tasks.workunit.client.1.smithi152.stdout:2/337: mknod d0/d4/d9/d16/d2b/c7a 0 2024-09-13T23:06:19.157 INFO:tasks.workunit.client.0.smithi115.stdout:1/815: dread d0/de/d1b/d25/d4d/d51/d23/d65/db6/fda [0,4194304] 0 2024-09-13T23:06:19.157 INFO:tasks.workunit.client.1.smithi152.stdout:6/294: dwrite d4/de/d1d/f23 [0,4194304] 0 2024-09-13T23:06:19.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/295: creat d4/de/f63 x:0 0 0 2024-09-13T23:06:19.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/296: stat d4/c36 0 2024-09-13T23:06:19.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/297: chown d4/de/d12/d16/d2a/d38/f42 2046497 1 2024-09-13T23:06:19.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/298: write d4/de/d12/d16/f58 [848075,12853] 0 2024-09-13T23:06:19.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/338: dread d0/f2e [0,4194304] 0 2024-09-13T23:06:19.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/339: stat d0/d4/d9/d18/d1e/f44 0 2024-09-13T23:06:19.171 INFO:tasks.workunit.client.0.smithi115.stdout:1/816: dread d0/de/d1b/d25/f77 [0,4194304] 0 2024-09-13T23:06:19.172 INFO:tasks.workunit.client.0.smithi115.stdout:1/817: truncate d0/de/f46 2135823 0 2024-09-13T23:06:19.174 INFO:tasks.workunit.client.0.smithi115.stdout:1/818: rename d0/de/d1b/d25/d4d/d51/d31/d37/ca9 to d0/de/d1b/d25/d4d/d51/c10a 0 2024-09-13T23:06:19.174 INFO:tasks.workunit.client.0.smithi115.stdout:1/819: write d0/de/d66/d8f/d29/f42 [1464531,82414] 0 2024-09-13T23:06:19.175 INFO:tasks.workunit.client.0.smithi115.stdout:1/820: rename d0/de/d66/d8f/d29/d47/d63/f100 to d0/de/d66/d8f/d29/d47/d63/dac/dc7/f10b 0 2024-09-13T23:06:19.176 INFO:tasks.workunit.client.0.smithi115.stdout:1/821: rmdir d0/de/d1b/d25/d4d/d51/d23/d65 39 2024-09-13T23:06:19.179 INFO:tasks.workunit.client.1.smithi152.stdout:9/277: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:19.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/278: fdatasync d3/d24/f36 0 2024-09-13T23:06:19.180 INFO:tasks.workunit.client.1.smithi152.stdout:7/298: dwrite d17/d24/d2a/d2e/d30/f44 [0,4194304] 0 2024-09-13T23:06:19.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/279: dwrite d4/d9/d1a/f49 [0,4194304] 0 2024-09-13T23:06:19.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/280: chown d4/d9/d1a/d22/l50 56 1 2024-09-13T23:06:19.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/281: write d4/f26 [581493,71383] 0 2024-09-13T23:06:19.182 INFO:tasks.workunit.client.1.smithi152.stdout:9/279: unlink d3/d24/d34/d37/f38 0 2024-09-13T23:06:19.182 INFO:tasks.workunit.client.1.smithi152.stdout:9/280: write d3/d24/f2a [4761477,111292] 0 2024-09-13T23:06:19.182 INFO:tasks.workunit.client.1.smithi152.stdout:9/281: read d3/d24/f36 [3500073,10645] 0 2024-09-13T23:06:19.184 INFO:tasks.workunit.client.1.smithi152.stdout:7/299: rmdir d17/d24/d2a/d2b/d4b/d5d 0 2024-09-13T23:06:19.185 INFO:tasks.workunit.client.1.smithi152.stdout:7/300: fsync d17/f1d 0 2024-09-13T23:06:19.190 INFO:tasks.workunit.client.0.smithi115.stdout:5/919: dwrite d8/dd/d64/dc5/fc9 [0,4194304] 0 2024-09-13T23:06:19.190 INFO:tasks.workunit.client.0.smithi115.stdout:5/920: chown d8/dd/d5d 17699 1 2024-09-13T23:06:19.191 INFO:tasks.workunit.client.0.smithi115.stdout:0/839: dwrite d6/d24/d25/d2b/d82/d6b/d9f/f83 [4194304,4194304] 0 2024-09-13T23:06:19.191 INFO:tasks.workunit.client.0.smithi115.stdout:0/840: fsync d6/d24/d25/d2b/d82/d6b/fa1 0 2024-09-13T23:06:19.192 INFO:tasks.workunit.client.1.smithi152.stdout:6/299: dread d4/de/d12/d16/f58 [0,4194304] 0 2024-09-13T23:06:19.192 INFO:tasks.workunit.client.1.smithi152.stdout:2/340: dwrite d0/d8/d43/f51 [0,4194304] 0 2024-09-13T23:06:19.192 INFO:tasks.workunit.client.1.smithi152.stdout:0/275: dwrite d18/d1f/d29/d2f/d3d/f49 [0,4194304] 0 2024-09-13T23:06:19.192 INFO:tasks.workunit.client.0.smithi115.stdout:7/824: sync 2024-09-13T23:06:19.193 INFO:tasks.workunit.client.0.smithi115.stdout:9/958: sync 2024-09-13T23:06:19.193 INFO:tasks.workunit.client.0.smithi115.stdout:9/959: fsync d0/d13/d17/d36/dd1/f12f 0 2024-09-13T23:06:19.196 INFO:tasks.workunit.client.1.smithi152.stdout:9/282: rename d3/d24/d34/d37/d56 to d3/d24/d34/d37/d60 0 2024-09-13T23:06:19.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/364: rmdir d3 39 2024-09-13T23:06:19.203 INFO:tasks.workunit.client.1.smithi152.stdout:2/341: mknod d0/d4/d9/d14/d48/d49/c7b 0 2024-09-13T23:06:19.203 INFO:tasks.workunit.client.1.smithi152.stdout:2/342: stat d0/d4/d9/d16/d2b 0 2024-09-13T23:06:19.204 INFO:tasks.workunit.client.1.smithi152.stdout:2/343: creat d0/d4/d9/d14/f7c x:0 0 0 2024-09-13T23:06:19.204 INFO:tasks.workunit.client.1.smithi152.stdout:1/282: dread d4/f1c [0,4194304] 0 2024-09-13T23:06:19.208 INFO:tasks.workunit.client.0.smithi115.stdout:7/825: creat da/dd/d13/d24/d52/da1/f11f x:0 0 0 2024-09-13T23:06:19.208 INFO:tasks.workunit.client.0.smithi115.stdout:7/826: readlink da/dd/d1c/l46 0 2024-09-13T23:06:19.209 INFO:tasks.workunit.client.1.smithi152.stdout:1/283: getdents d4/d9/d1a 0 2024-09-13T23:06:19.209 INFO:tasks.workunit.client.0.smithi115.stdout:1/822: rename d0/de/d1b to d0/de/df8/d10c 0 2024-09-13T23:06:19.210 INFO:tasks.workunit.client.0.smithi115.stdout:7/827: mknod da/dd/d16/c120 0 2024-09-13T23:06:19.210 INFO:tasks.workunit.client.0.smithi115.stdout:7/828: write da/dd/d1c/d2d/d41/fbc [3130826,95346] 0 2024-09-13T23:06:19.210 INFO:tasks.workunit.client.0.smithi115.stdout:7/829: read da/df/fa6 [1021760,105212] 0 2024-09-13T23:06:19.210 INFO:tasks.workunit.client.0.smithi115.stdout:7/830: chown da/dd/d13/d24/d11e/le3 3 1 2024-09-13T23:06:19.211 INFO:tasks.workunit.client.0.smithi115.stdout:5/921: rename d8/dd/c81 to d8/dd/d20/d6d/c117 0 2024-09-13T23:06:19.213 INFO:tasks.workunit.client.0.smithi115.stdout:9/960: rename d0/d13/d17/d19/l11f to d0/d13/d17/l139 0 2024-09-13T23:06:19.213 INFO:tasks.workunit.client.0.smithi115.stdout:5/922: getdents d8/dd/d5d/d5e 0 2024-09-13T23:06:19.214 INFO:tasks.workunit.client.0.smithi115.stdout:9/961: symlink d0/d13/d17/d1f/d4e/de9/l13a 0 2024-09-13T23:06:19.216 INFO:tasks.workunit.client.0.smithi115.stdout:9/962: link d0/d13/d3b/fae d0/d13/d17/d1f/d28/f13b 0 2024-09-13T23:06:19.216 INFO:tasks.workunit.client.0.smithi115.stdout:9/963: read d0/d13/d17/d1f/d28/f3e [1564,18470] 0 2024-09-13T23:06:19.217 INFO:tasks.workunit.client.1.smithi152.stdout:1/284: dread d4/f26 [0,4194304] 0 2024-09-13T23:06:19.218 INFO:tasks.workunit.client.0.smithi115.stdout:9/964: mknod d0/d13/d17/d1f/d28/d12d/c13c 0 2024-09-13T23:06:19.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/283: read d3/f28 [2486776,86472] 0 2024-09-13T23:06:19.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/284: write d3/d1e/f3c [1624057,50340] 0 2024-09-13T23:06:19.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/285: read d3/d24/fb [788187,30981] 0 2024-09-13T23:06:19.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/286: chown d3/d24/c31 30936 1 2024-09-13T23:06:19.221 INFO:tasks.workunit.client.0.smithi115.stdout:9/965: link d0/d13/d3b/d42/d95/f124 d0/d13/d17/d19/dc8/d10b/f13d 0 2024-09-13T23:06:19.221 INFO:tasks.workunit.client.0.smithi115.stdout:9/966: fdatasync d0/d43/d53/fea 0 2024-09-13T23:06:19.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/285: link d4/d9/d1a/f2e d4/d9/d1a/d22/f5b 0 2024-09-13T23:06:19.224 INFO:tasks.workunit.client.0.smithi115.stdout:1/823: write d0/de/d66/d8f/d29/d47/d6a/f103 [2130552,123534] 0 2024-09-13T23:06:19.224 INFO:tasks.workunit.client.0.smithi115.stdout:1/824: stat d0/fb0 0 2024-09-13T23:06:19.224 INFO:tasks.workunit.client.0.smithi115.stdout:1/825: read - d0/de/d66/d8f/d29/d9c/fd4 zero size 2024-09-13T23:06:19.224 INFO:tasks.workunit.client.0.smithi115.stdout:1/826: chown d0/dd/c18 9026453 1 2024-09-13T23:06:19.224 INFO:tasks.workunit.client.1.smithi152.stdout:9/287: rename d3/d1e/d30/l57 to d3/d1e/d30/d5d/l61 0 2024-09-13T23:06:19.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/288: truncate d3/f9 4236257 0 2024-09-13T23:06:19.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/827: mknod d0/de/df8/d10c/d25/d4d/d51/c10d 0 2024-09-13T23:06:19.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/828: dread - d0/de/fd2 zero size 2024-09-13T23:06:19.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/829: creat d0/de/d66/d8f/d29/d47/d74/d9d/da3/f10e x:0 0 0 2024-09-13T23:06:19.226 INFO:tasks.workunit.client.0.smithi115.stdout:1/830: write d0/de/df8/d10c/d25/d4d/d51/d31/d79/fb5 [1089023,91530] 0 2024-09-13T23:06:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:9/289: getdents d3/d24/d34/d37/d47 0 2024-09-13T23:06:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:9/290: chown d3/d24 149078733 1 2024-09-13T23:06:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:9/291: readlink d3/d24/l27 0 2024-09-13T23:06:19.227 INFO:tasks.workunit.client.1.smithi152.stdout:9/292: chown d3/d24/d34/d37/l43 14 1 2024-09-13T23:06:19.228 INFO:tasks.workunit.client.0.smithi115.stdout:1/831: mknod d0/de/df8/d10c/d25/d4d/d51/d23/d65/db6/c10f 0 2024-09-13T23:06:19.229 INFO:tasks.workunit.client.1.smithi152.stdout:9/293: rename d3/d24/c13 to d3/d24/d34/d37/d4a/c62 0 2024-09-13T23:06:19.229 INFO:tasks.workunit.client.1.smithi152.stdout:9/294: write d3/ff [3350684,130257] 0 2024-09-13T23:06:19.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/301: dwrite d17/f25 [0,4194304] 0 2024-09-13T23:06:19.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/300: dwrite d4/de/d21/f47 [0,4194304] 0 2024-09-13T23:06:19.231 INFO:tasks.workunit.client.0.smithi115.stdout:1/832: mkdir d0/de/d66/d8f/d29/d47/d74/dcb/d110 0 2024-09-13T23:06:19.231 INFO:tasks.workunit.client.0.smithi115.stdout:1/833: write d0/de/df8/d10c/d25/d4d/d51/d31/d37/dc8/f108 [2980052,70527] 0 2024-09-13T23:06:19.232 INFO:tasks.workunit.client.1.smithi152.stdout:9/295: dread d3/d24/d34/f40 [0,4194304] 0 2024-09-13T23:06:19.235 INFO:tasks.workunit.client.0.smithi115.stdout:0/841: dwrite d6/d24/d25/d2b/d61/f69 [0,4194304] 0 2024-09-13T23:06:19.236 INFO:tasks.workunit.client.1.smithi152.stdout:1/286: write d4/d9/d1a/d22/d24/f53 [7554921,22479] 0 2024-09-13T23:06:19.236 INFO:tasks.workunit.client.1.smithi152.stdout:7/302: dread d17/d24/d2a/d2b/f3b [0,4194304] 0 2024-09-13T23:06:19.236 INFO:tasks.workunit.client.1.smithi152.stdout:7/303: fdatasync d17/d24/d2a/d2e/f5f 0 2024-09-13T23:06:19.236 INFO:tasks.workunit.client.1.smithi152.stdout:4/365: dwrite d3/d4/f22 [0,4194304] 0 2024-09-13T23:06:19.240 INFO:tasks.workunit.client.1.smithi152.stdout:1/287: rename d4/d9/d1a/d22/d24/l38 to d4/d9/d1a/d22/l5c 0 2024-09-13T23:06:19.244 INFO:tasks.workunit.client.1.smithi152.stdout:7/304: mkdir d17/d24/d2d/d51/d5b/d63 0 2024-09-13T23:06:19.245 INFO:tasks.workunit.client.1.smithi152.stdout:4/366: link d3/d4/d6/d66/f49 d3/d4/d6/d66/d62/f6a 0 2024-09-13T23:06:19.245 INFO:tasks.workunit.client.0.smithi115.stdout:0/842: dread d6/d24/d25/d2b/d82/d44/f66 [0,4194304] 0 2024-09-13T23:06:19.246 INFO:tasks.workunit.client.1.smithi152.stdout:1/288: truncate d4/d9/d1a/d22/d24/f52 7492009 0 2024-09-13T23:06:19.247 INFO:tasks.workunit.client.1.smithi152.stdout:4/367: symlink d3/d4/d32/l6b 0 2024-09-13T23:06:19.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/368: creat d3/d34/f6c x:0 0 0 2024-09-13T23:06:19.254 INFO:tasks.workunit.client.0.smithi115.stdout:9/967: dwrite d0/d13/d17/d1f/f45 [0,4194304] 0 2024-09-13T23:06:19.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/289: rmdir d4/d4c 39 2024-09-13T23:06:19.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/290: dread - d4/d9/f1f zero size 2024-09-13T23:06:19.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/291: creat d4/f5d x:0 0 0 2024-09-13T23:06:19.257 INFO:tasks.workunit.client.0.smithi115.stdout:1/834: dwrite d0/de/df8/d10c/f7b [0,4194304] 0 2024-09-13T23:06:19.258 INFO:tasks.workunit.client.1.smithi152.stdout:1/292: rename d4/d9/f1f to d4/d4c/f5e 0 2024-09-13T23:06:19.258 INFO:tasks.workunit.client.1.smithi152.stdout:1/293: creat d4/f5f x:0 0 0 2024-09-13T23:06:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:1/294: write d4/d9/d1a/f4e [324990,53768] 0 2024-09-13T23:06:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:7/305: write d17/f25 [2953412,98836] 0 2024-09-13T23:06:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:1/295: write d4/d9/d1a/f33 [629950,92808] 0 2024-09-13T23:06:19.259 INFO:tasks.workunit.client.1.smithi152.stdout:1/296: chown d4/f28 21 1 2024-09-13T23:06:19.261 INFO:tasks.workunit.client.1.smithi152.stdout:7/306: symlink d17/d24/d2a/d2b/d4b/d61/l64 0 2024-09-13T23:06:19.261 INFO:tasks.workunit.client.1.smithi152.stdout:7/307: truncate d17/d24/d2a/d2b/d4b/f62 759315 0 2024-09-13T23:06:19.261 INFO:tasks.workunit.client.1.smithi152.stdout:1/297: mknod d4/d9/c60 0 2024-09-13T23:06:19.261 INFO:tasks.workunit.client.1.smithi152.stdout:7/308: symlink d17/d24/d2d/d51/l65 0 2024-09-13T23:06:19.263 INFO:tasks.workunit.client.1.smithi152.stdout:1/298: write d4/f41 [92541,14935] 0 2024-09-13T23:06:19.264 INFO:tasks.workunit.client.1.smithi152.stdout:1/299: creat d4/d9/d1a/d22/f61 x:0 0 0 2024-09-13T23:06:19.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/300: stat d4/d9/d1a/d22/l50 0 2024-09-13T23:06:19.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/296: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:19.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/369: write d3/d4/d6/f1a [3740232,107269] 0 2024-09-13T23:06:19.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/370: rename d3 to d3/d5a/d6d 22 2024-09-13T23:06:19.267 INFO:tasks.workunit.client.1.smithi152.stdout:9/297: mkdir d3/d24/d34/d45/d63 0 2024-09-13T23:06:19.267 INFO:tasks.workunit.client.1.smithi152.stdout:9/298: read d3/d1e/f3e [965244,107631] 0 2024-09-13T23:06:19.267 INFO:tasks.workunit.client.1.smithi152.stdout:9/299: truncate d3/d24/f2a 4957850 0 2024-09-13T23:06:19.268 INFO:tasks.workunit.client.0.smithi115.stdout:0/843: dwrite d6/d24/d25/d2b/d82/d44/f46 [0,4194304] 0 2024-09-13T23:06:19.268 INFO:tasks.workunit.client.0.smithi115.stdout:0/844: write d6/d24/d25/d58/f7e [4979110,62531] 0 2024-09-13T23:06:19.269 INFO:tasks.workunit.client.0.smithi115.stdout:0/845: mkdir d6/d24/d25/da3/d125 0 2024-09-13T23:06:19.270 INFO:tasks.workunit.client.1.smithi152.stdout:9/300: creat d3/d24/d34/d37/d47/f64 x:0 0 0 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/846: rename d6/d24/d25/d2b/d103/dd4/cd7 to d6/d24/d25/d2b/d82/d44/d5c/d87/c126 0 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:0/847: write d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/f108 [999426,124749] 0 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:1/835: dread d0/de/d66/d8f/dad/ddb/de5/f9a [0,4194304] 0 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:1/836: readlink d0/de/df8/d10c/d25/d4d/d51/l33 0 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:1/837: chown d0/de/df8/d10c/d25/d67/f6e 3 1 2024-09-13T23:06:19.272 INFO:tasks.workunit.client.0.smithi115.stdout:1/838: readlink d0/de/d66/d8f/d29/d47/d74/d9d/lbf 0 2024-09-13T23:06:19.275 INFO:tasks.workunit.client.0.smithi115.stdout:0/848: mknod d6/d24/d25/d2b/d82/d6b/d9f/c127 0 2024-09-13T23:06:19.275 INFO:tasks.workunit.client.0.smithi115.stdout:0/849: fdatasync d6/d24/f95 0 2024-09-13T23:06:19.275 INFO:tasks.workunit.client.0.smithi115.stdout:0/850: dread - d6/d24/d25/da3/dad/fb6 zero size 2024-09-13T23:06:19.279 INFO:tasks.workunit.client.0.smithi115.stdout:0/851: mknod d6/d24/d25/da3/dad/de4/c128 0 2024-09-13T23:06:19.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/309: write d17/d24/d2a/d2e/f32 [725631,82479] 0 2024-09-13T23:06:19.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/310: write d17/d24/d2a/d2b/d4b/f62 [1569129,17032] 0 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/311: fdatasync d17/d24/d2a/d2b/f49 0 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/312: read - d17/d24/d2a/d2b/f49 zero size 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/313: readlink d17/d24/d2d/d51/l65 0 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/314: chown d17/d24/d2a/d2b/f3b 969 1 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/315: write f5 [5108058,93796] 0 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/316: chown d17/d24/d2d/d46/c4a 197751 1 2024-09-13T23:06:19.280 INFO:tasks.workunit.client.0.smithi115.stdout:0/852: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dca/d129 0 2024-09-13T23:06:19.282 INFO:tasks.workunit.client.0.smithi115.stdout:0/853: getdents d6/d24/d25/d2b/d82/d6b/d9f/dab 0 2024-09-13T23:06:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/317: mknod d17/d24/d2d/d51/d5b/c66 0 2024-09-13T23:06:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/318: fdatasync d17/d24/f29 0 2024-09-13T23:06:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/319: write d17/f22 [1047304,29722] 0 2024-09-13T23:06:19.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/320: stat d17/d24/d2d/d3f/l43 0 2024-09-13T23:06:19.284 INFO:tasks.workunit.client.0.smithi115.stdout:0/854: mkdir d6/d24/d25/dc7/d12a 0 2024-09-13T23:06:19.284 INFO:tasks.workunit.client.0.smithi115.stdout:0/855: fdatasync d6/d24/d25/d2b/d82/f114 0 2024-09-13T23:06:19.284 INFO:tasks.workunit.client.0.smithi115.stdout:0/856: dread - d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/f110 zero size 2024-09-13T23:06:19.284 INFO:tasks.workunit.client.1.smithi152.stdout:7/321: unlink d17/f20 0 2024-09-13T23:06:19.288 INFO:tasks.workunit.client.0.smithi115.stdout:9/968: dwrite d0/d13/d17/d1f/d4e/d61/d9b/f116 [0,4194304] 0 2024-09-13T23:06:19.295 INFO:tasks.workunit.client.0.smithi115.stdout:1/839: dwrite d0/de/d66/d8f/d29/d47/ff6 [0,4194304] 0 2024-09-13T23:06:19.296 INFO:tasks.workunit.client.0.smithi115.stdout:1/840: dread - d0/de/d66/d8f/dad/ddb/de5/feb zero size 2024-09-13T23:06:19.296 INFO:tasks.workunit.client.1.smithi152.stdout:4/371: dwrite d3/d4/d6/f35 [0,4194304] 0 2024-09-13T23:06:19.299 INFO:tasks.workunit.client.1.smithi152.stdout:1/301: read d4/d9/d1a/d22/d24/f52 [6469521,122865] 0 2024-09-13T23:06:19.300 INFO:tasks.workunit.client.1.smithi152.stdout:4/372: rmdir d3/d4/d6/d8/d17/d39 39 2024-09-13T23:06:19.300 INFO:tasks.workunit.client.1.smithi152.stdout:4/373: readlink d3/d4/d6/d66/d1c/l2f 0 2024-09-13T23:06:19.300 INFO:tasks.workunit.client.0.smithi115.stdout:1/841: mknod d0/de/df8/d10c/d25/d4d/d51/d31/c111 0 2024-09-13T23:06:19.301 INFO:tasks.workunit.client.0.smithi115.stdout:1/842: chown d0/de/d66/faa 22441866 1 2024-09-13T23:06:19.301 INFO:tasks.workunit.client.0.smithi115.stdout:1/843: dread - d0/de/d66/d8f/d29/d47/d74/dcb/fce zero size 2024-09-13T23:06:19.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/302: rename d4/c1e to d4/d47/c62 0 2024-09-13T23:06:19.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/303: creat d4/d9/d1a/d22/f63 x:0 0 0 2024-09-13T23:06:19.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/304: readlink d4/d9/l25 0 2024-09-13T23:06:19.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/305: write d4/d4c/f54 [746749,44698] 0 2024-09-13T23:06:19.303 INFO:tasks.workunit.client.1.smithi152.stdout:4/374: rename d3/d4/d6/d66/c51 to d3/d4/d6/d8/d17/d5d/c6e 0 2024-09-13T23:06:19.307 INFO:tasks.workunit.client.0.smithi115.stdout:0/857: rmdir d6/d24/d25/da3/dad 39 2024-09-13T23:06:19.310 INFO:tasks.workunit.client.0.smithi115.stdout:0/858: getdents d6/d24/d25/d2b/d82/d44/d5c 0 2024-09-13T23:06:19.312 INFO:tasks.workunit.client.0.smithi115.stdout:9/969: dwrite d0/d13/d17/d36/d80/f87 [0,4194304] 0 2024-09-13T23:06:19.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/859: unlink d6/d24/d25/d2b/d82/d44/d5c/d87/da4/caa 0 2024-09-13T23:06:19.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/860: chown d6/d24/d25/d2b 56109 1 2024-09-13T23:06:19.313 INFO:tasks.workunit.client.0.smithi115.stdout:0/861: chown d6/d24/d25/d2b/d82 0 1 2024-09-13T23:06:19.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/862: mknod d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/c12b 0 2024-09-13T23:06:19.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/863: readlink d6/d24/d25/da3/dad/l120 0 2024-09-13T23:06:19.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/864: fsync d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/f110 0 2024-09-13T23:06:19.315 INFO:tasks.workunit.client.0.smithi115.stdout:0/865: read d6/f4d [86829,13772] 0 2024-09-13T23:06:19.316 INFO:tasks.workunit.client.0.smithi115.stdout:0/866: creat d6/d24/d25/f12c x:0 0 0 2024-09-13T23:06:19.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/306: dread d4/d9/d1a/d22/d24/f45 [0,4194304] 0 2024-09-13T23:06:19.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/307: fdatasync d4/d9/d1a/f49 0 2024-09-13T23:06:19.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/308: truncate d4/f41 871613 0 2024-09-13T23:06:19.317 INFO:tasks.workunit.client.0.smithi115.stdout:0/867: mknod d6/c12d 0 2024-09-13T23:06:19.319 INFO:tasks.workunit.client.1.smithi152.stdout:1/309: rename d4/f41 to d4/d9/f64 0 2024-09-13T23:06:19.319 INFO:tasks.workunit.client.1.smithi152.stdout:1/310: dread - d4/d9/d1a/d22/f63 zero size 2024-09-13T23:06:19.320 INFO:tasks.workunit.client.1.smithi152.stdout:1/311: mknod d4/d47/c65 0 2024-09-13T23:06:19.320 INFO:tasks.workunit.client.1.smithi152.stdout:1/312: fsync d4/f5d 0 2024-09-13T23:06:19.320 INFO:tasks.workunit.client.1.smithi152.stdout:1/313: write d4/d9/fd [1960103,30642] 0 2024-09-13T23:06:19.320 INFO:tasks.workunit.client.1.smithi152.stdout:1/314: readlink d4/l2c 0 2024-09-13T23:06:19.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/315: getdents d4/d9/d1a/d22/d24/d48 0 2024-09-13T23:06:19.322 INFO:tasks.workunit.client.1.smithi152.stdout:1/316: read - d4/d4c/f5e zero size 2024-09-13T23:06:19.322 INFO:tasks.workunit.client.1.smithi152.stdout:1/317: rmdir d4/d47 39 2024-09-13T23:06:19.329 INFO:tasks.workunit.client.1.smithi152.stdout:4/375: dwrite d3/d4/f22 [4194304,4194304] 0 2024-09-13T23:06:19.333 INFO:tasks.workunit.client.1.smithi152.stdout:4/376: rename d3/d4/d6/d8/f19 to d3/d4/d6/d66/f6f 0 2024-09-13T23:06:19.333 INFO:tasks.workunit.client.1.smithi152.stdout:4/377: fdatasync d3/d4/d6/d66/f6f 0 2024-09-13T23:06:19.333 INFO:tasks.workunit.client.1.smithi152.stdout:1/318: write d4/d9/d1a/d22/d24/f53 [2498390,100207] 0 2024-09-13T23:06:19.335 INFO:tasks.workunit.client.1.smithi152.stdout:4/378: rename d3/d4/d6/d66/d1c/l2f to d3/d4/d32/l70 0 2024-09-13T23:06:19.335 INFO:tasks.workunit.client.1.smithi152.stdout:1/319: creat d4/d9/d1a/d22/d24/d48/f66 x:0 0 0 2024-09-13T23:06:19.336 INFO:tasks.workunit.client.1.smithi152.stdout:4/379: creat d3/d4/d6/d8/f71 x:0 0 0 2024-09-13T23:06:19.337 INFO:tasks.workunit.client.1.smithi152.stdout:4/380: unlink d3/d4/d6/d8/d17/f24 0 2024-09-13T23:06:19.338 INFO:tasks.workunit.client.1.smithi152.stdout:4/381: symlink d3/d4/d6/d66/l72 0 2024-09-13T23:06:19.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/382: chown d3/d4/d6/d37/l47 839815 1 2024-09-13T23:06:19.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/383: getdents d3/d4/d6/d8/d4b 0 2024-09-13T23:06:19.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/384: symlink d3/d4/d6/d66/d1c/d59/l73 0 2024-09-13T23:06:19.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/385: fdatasync d3/d4/d6/f35 0 2024-09-13T23:06:19.340 INFO:tasks.workunit.client.1.smithi152.stdout:4/386: rename d3/d5a to d3/d4/d6/d66/d1c/d59/d60/d74 0 2024-09-13T23:06:19.346 INFO:tasks.workunit.client.0.smithi115.stdout:9/970: dwrite d0/d43/f7e [0,4194304] 0 2024-09-13T23:06:19.346 INFO:tasks.workunit.client.0.smithi115.stdout:1/844: dwrite d0/de/d66/d8f/f61 [4194304,4194304] 0 2024-09-13T23:06:19.346 INFO:tasks.workunit.client.0.smithi115.stdout:0/868: dwrite d6/d24/d25/da3/dad/de4/df7/f109 [0,4194304] 0 2024-09-13T23:06:19.353 INFO:tasks.workunit.client.1.smithi152.stdout:4/387: dread d3/d4/d6/f35 [0,4194304] 0 2024-09-13T23:06:19.355 INFO:tasks.workunit.client.0.smithi115.stdout:1/845: write d0/de/df8/d10c/f7b [693600,42971] 0 2024-09-13T23:06:19.357 INFO:tasks.workunit.client.0.smithi115.stdout:1/846: mkdir d0/de/d66/d8f/d29/d47/d74/d9d/da3/d112 0 2024-09-13T23:06:19.357 INFO:tasks.workunit.client.0.smithi115.stdout:1/847: getdents d0/de/df8/d10c/d25/d4d/d51/d23/d65/db6 0 2024-09-13T23:06:19.358 INFO:tasks.workunit.client.0.smithi115.stdout:9/971: dread d0/d13/d17/d1f/d4e/f5d [0,4194304] 0 2024-09-13T23:06:19.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/848: symlink d0/de/df8/d10c/d25/d4d/d51/d31/d37/d72/l113 0 2024-09-13T23:06:19.359 INFO:tasks.workunit.client.0.smithi115.stdout:1/849: write d0/de/d66/d8f/d29/d47/d74/dcb/fce [98782,65202] 0 2024-09-13T23:06:19.360 INFO:tasks.workunit.client.0.smithi115.stdout:9/972: creat d0/d13/d17/d19/dc8/d10b/f13e x:0 0 0 2024-09-13T23:06:19.361 INFO:tasks.workunit.client.0.smithi115.stdout:9/973: mkdir d0/d13/d17/d1f/d4e/d61/d13f 0 2024-09-13T23:06:19.363 INFO:tasks.workunit.client.0.smithi115.stdout:9/974: mkdir d0/d13/d3b/d42/d95/d121/d140 0 2024-09-13T23:06:19.364 INFO:tasks.workunit.client.0.smithi115.stdout:9/975: unlink d0/d13/d17/d1f/d4e/fd5 0 2024-09-13T23:06:19.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/976: creat d0/d13/d3b/d42/f141 x:0 0 0 2024-09-13T23:06:19.365 INFO:tasks.workunit.client.0.smithi115.stdout:9/977: readlink d0/d13/d3b/lf4 0 2024-09-13T23:06:19.366 INFO:tasks.workunit.client.0.smithi115.stdout:9/978: truncate d0/d13/d17/d1f/d28/f91 1134804 0 2024-09-13T23:06:19.367 INFO:tasks.workunit.client.0.smithi115.stdout:9/979: rename d0/d13/d17/d1f/d28/c4f to d0/d13/d17/d1f/d4e/d61/d13f/c142 0 2024-09-13T23:06:19.367 INFO:tasks.workunit.client.0.smithi115.stdout:0/869: dwrite d6/d24/d25/da3/dad/f11e [0,4194304] 0 2024-09-13T23:06:19.367 INFO:tasks.workunit.client.0.smithi115.stdout:0/870: truncate d6/d24/fdc 93955 0 2024-09-13T23:06:19.369 INFO:tasks.workunit.client.0.smithi115.stdout:0/871: write d6/d24/d25/d2b/d82/d44/f56 [4242850,39292] 0 2024-09-13T23:06:19.371 INFO:tasks.workunit.client.0.smithi115.stdout:0/872: mknod d6/da0/dd9/d122/c12e 0 2024-09-13T23:06:19.372 INFO:tasks.workunit.client.0.smithi115.stdout:1/850: dread d0/de/df8/d10c/d25/d4d/d51/d31/d37/d72/f101 [0,4194304] 0 2024-09-13T23:06:19.374 INFO:tasks.workunit.client.0.smithi115.stdout:0/873: dread d6/f81 [0,4194304] 0 2024-09-13T23:06:19.374 INFO:tasks.workunit.client.0.smithi115.stdout:0/874: stat d6/d24/d25/d2b/d82/l3e 0 2024-09-13T23:06:19.374 INFO:tasks.workunit.client.0.smithi115.stdout:0/875: fsync d6/d24/d25/d2b/d82/d44/f55 0 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:8/240: sync 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/237: sync 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:8/241: dread - d17/f4a zero size 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:8/242: chown d17/d25/f2a 136 1 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/238: truncate d5/dc/d19/d20/d2e/d28/f2f 1552966 0 2024-09-13T23:06:19.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/239: readlink d5/dc/d19/d20/d2e/d27/l40 0 2024-09-13T23:06:19.377 INFO:tasks.workunit.client.0.smithi115.stdout:1/851: truncate d0/de/df8/d10c/d25/d4d/d51/d31/d79/f96 19986 0 2024-09-13T23:06:19.377 INFO:tasks.workunit.client.1.smithi152.stdout:5/240: write d5/dc/d19/d20/d2e/d28/f2f [1519714,95378] 0 2024-09-13T23:06:19.377 INFO:tasks.workunit.client.0.smithi115.stdout:0/876: mkdir d6/da0/dd9/d12f 0 2024-09-13T23:06:19.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/241: mknod d5/dc/c4f 0 2024-09-13T23:06:19.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/242: stat d5/dc/d19/d20/d2e/d27/l40 0 2024-09-13T23:06:19.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/877: mknod d6/d24/d25/d2b/d82/d44/c130 0 2024-09-13T23:06:19.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/878: chown d6/d24/d25/d2b/d82/d44/f56 6 1 2024-09-13T23:06:19.380 INFO:tasks.workunit.client.0.smithi115.stdout:0/879: creat d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f131 x:0 0 0 2024-09-13T23:06:19.383 INFO:tasks.workunit.client.0.smithi115.stdout:0/880: mknod d6/d24/d25/d2b/d103/dd4/c132 0 2024-09-13T23:06:19.383 INFO:tasks.workunit.client.0.smithi115.stdout:0/881: write d6/d24/d25/d10c/f11a [4938289,70897] 0 2024-09-13T23:06:19.385 INFO:tasks.workunit.client.0.smithi115.stdout:0/882: rmdir d6/d24/d25/da3/dad 39 2024-09-13T23:06:19.386 INFO:tasks.workunit.client.0.smithi115.stdout:1/852: write d0/de/df8/d10c/d25/d4d/d51/d23/d65/f7d [2229623,7476] 0 2024-09-13T23:06:19.387 INFO:tasks.workunit.client.0.smithi115.stdout:0/883: rename d6/d24/d25/da3/dad/l120 to d6/da0/l133 0 2024-09-13T23:06:19.388 INFO:tasks.workunit.client.0.smithi115.stdout:1/853: truncate d0/de/d66/d8f/d29/d47/d74/fcc 255296 0 2024-09-13T23:06:19.388 INFO:tasks.workunit.client.0.smithi115.stdout:1/854: fdatasync d0/de/f60 0 2024-09-13T23:06:19.388 INFO:tasks.workunit.client.1.smithi152.stdout:8/243: write f3 [4596011,88401] 0 2024-09-13T23:06:19.389 INFO:tasks.workunit.client.0.smithi115.stdout:0/884: unlink d6/d24/d25/dc7/ff4 0 2024-09-13T23:06:19.390 INFO:tasks.workunit.client.1.smithi152.stdout:5/243: dread d5/dc/d19/d20/d2e/d27/f44 [0,4194304] 0 2024-09-13T23:06:19.390 INFO:tasks.workunit.client.1.smithi152.stdout:8/244: rename d17/d19/c1e to d17/d23/c53 0 2024-09-13T23:06:19.390 INFO:tasks.workunit.client.1.smithi152.stdout:8/245: creat d17/d25/d32/f54 x:0 0 0 2024-09-13T23:06:19.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/246: dread - d17/d19/f4d zero size 2024-09-13T23:06:19.392 INFO:tasks.workunit.client.0.smithi115.stdout:0/885: unlink d6/d24/d25/d2b/d82/f48 0 2024-09-13T23:06:19.393 INFO:tasks.workunit.client.0.smithi115.stdout:1/855: dread d0/de/df8/d10c/d25/d4d/d51/d23/d65/f7f [0,4194304] 0 2024-09-13T23:06:19.395 INFO:tasks.workunit.client.0.smithi115.stdout:0/886: dread d6/d24/d25/d2b/d82/d44/d5c/f6c [0,4194304] 0 2024-09-13T23:06:19.395 INFO:tasks.workunit.client.1.smithi152.stdout:8/247: rmdir d17/d25/d32 39 2024-09-13T23:06:19.396 INFO:tasks.workunit.client.0.smithi115.stdout:0/887: link d6/d24/d25/d58/l5a d6/d24/d25/d2b/d61/l134 0 2024-09-13T23:06:19.396 INFO:tasks.workunit.client.0.smithi115.stdout:0/888: fsync d6/f4d 0 2024-09-13T23:06:19.399 INFO:tasks.workunit.client.0.smithi115.stdout:0/889: write d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/f108 [826048,4135] 0 2024-09-13T23:06:19.399 INFO:tasks.workunit.client.0.smithi115.stdout:0/890: write d6/d24/d25/d2b/d82/d44/d5c/f6c [1343028,9703] 0 2024-09-13T23:06:19.401 INFO:tasks.workunit.client.0.smithi115.stdout:0/891: link d6/c90 d6/d24/d25/d10c/c135 0 2024-09-13T23:06:19.402 INFO:tasks.workunit.client.1.smithi152.stdout:5/244: write d5/f3f [466185,27788] 0 2024-09-13T23:06:19.402 INFO:tasks.workunit.client.1.smithi152.stdout:5/245: creat d5/dc/d35/f50 x:0 0 0 2024-09-13T23:06:19.403 INFO:tasks.workunit.client.0.smithi115.stdout:0/892: mkdir d6/d24/d136 0 2024-09-13T23:06:19.403 INFO:tasks.workunit.client.0.smithi115.stdout:0/893: write d6/da0/fd5 [349435,48597] 0 2024-09-13T23:06:19.405 INFO:tasks.workunit.client.0.smithi115.stdout:0/894: mknod d6/d24/d25/d2b/d82/d6b/c137 0 2024-09-13T23:06:19.405 INFO:tasks.workunit.client.0.smithi115.stdout:0/895: chown d6/d24/d25/d2b/d103/fea 63 1 2024-09-13T23:06:19.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/246: dread d5/dc/fe [0,4194304] 0 2024-09-13T23:06:19.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/247: mkdir d5/dc/d35/d51 0 2024-09-13T23:06:19.416 INFO:tasks.workunit.client.1.smithi152.stdout:5/248: mknod d5/dc/d19/d20/d2e/c52 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/249: mknod d5/dc/d35/c53 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/250: stat d5/da/cb 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/896: dread d6/d24/d25/d2b/d82/f36 [0,4194304] 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.0.smithi115.stdout:1/856: dwrite d0/de/df8/d10c/d25/d4d/d51/d23/d65/f7d [0,4194304] 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.0.smithi115.stdout:1/857: creat d0/de/d66/d8f/d29/d47/d74/d9d/da3/f114 x:0 0 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/897: creat d6/d24/d25/d2b/d82/d44/f138 x:0 0 0 2024-09-13T23:06:19.417 INFO:tasks.workunit.client.0.smithi115.stdout:0/898: chown d6/d24/d25/da3/dad/f11e 629 1 2024-09-13T23:06:19.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/251: creat d5/dc/f54 x:0 0 0 2024-09-13T23:06:19.428 INFO:tasks.workunit.client.0.smithi115.stdout:0/899: dread d6/d24/d25/d2b/d82/d44/f66 [0,4194304] 0 2024-09-13T23:06:19.428 INFO:tasks.workunit.client.0.smithi115.stdout:1/858: dread d0/de/d66/d8f/f61 [0,4194304] 0 2024-09-13T23:06:19.431 INFO:tasks.workunit.client.0.smithi115.stdout:1/859: creat d0/de/f115 x:0 0 0 2024-09-13T23:06:19.431 INFO:tasks.workunit.client.0.smithi115.stdout:0/900: dread d6/d24/d25/d2b/d82/d44/d5c/d87/da4/ffc [0,4194304] 0 2024-09-13T23:06:19.432 INFO:tasks.workunit.client.0.smithi115.stdout:0/901: symlink d6/d24/d25/d2b/d82/df9/l139 0 2024-09-13T23:06:19.433 INFO:tasks.workunit.client.0.smithi115.stdout:0/902: mkdir d6/d24/d25/da7/d13a 0 2024-09-13T23:06:19.434 INFO:tasks.workunit.client.0.smithi115.stdout:0/903: creat d6/da0/f13b x:0 0 0 2024-09-13T23:06:19.434 INFO:tasks.workunit.client.0.smithi115.stdout:0/904: chown d6/d24/d25/d2b/d82/d44/c130 2739 1 2024-09-13T23:06:19.448 INFO:tasks.workunit.client.1.smithi152.stdout:5/252: dwrite d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:19.456 INFO:tasks.workunit.client.0.smithi115.stdout:0/905: dwrite d6/d24/d25/da3/dad/f11e [0,4194304] 0 2024-09-13T23:06:19.458 INFO:tasks.workunit.client.0.smithi115.stdout:1/860: dwrite d0/de/d66/d8f/d29/d47/d6a/f103 [0,4194304] 0 2024-09-13T23:06:19.458 INFO:tasks.workunit.client.0.smithi115.stdout:0/906: rmdir d6/d24/d25/d2b/d82/d44/d5c 39 2024-09-13T23:06:19.459 INFO:tasks.workunit.client.0.smithi115.stdout:1/861: link d0/de/df8/d10c/d25/d4d/d51/l5a d0/de/df8/l116 0 2024-09-13T23:06:19.460 INFO:tasks.workunit.client.0.smithi115.stdout:0/907: rename d6/d24/d25/dc7/l123 to d6/da0/dd9/d122/l13c 0 2024-09-13T23:06:19.460 INFO:tasks.workunit.client.0.smithi115.stdout:0/908: readlink d6/da0/lc9 0 2024-09-13T23:06:19.468 INFO:tasks.workunit.client.1.smithi152.stdout:5/253: dwrite d5/dc/fe [0,4194304] 0 2024-09-13T23:06:19.482 INFO:tasks.workunit.client.0.smithi115.stdout:1/862: dwrite d0/de/df8/d10c/f85 [4194304,4194304] 0 2024-09-13T23:06:19.482 INFO:tasks.workunit.client.0.smithi115.stdout:1/863: stat d0/de/df8/d10c/d25/d4d/d51/d31/d37/f78 0 2024-09-13T23:06:19.491 INFO:tasks.workunit.client.0.smithi115.stdout:0/909: dwrite d6/fd [4194304,4194304] 0 2024-09-13T23:06:19.491 INFO:tasks.workunit.client.0.smithi115.stdout:0/910: mknod d6/d24/d25/da3/c13d 0 2024-09-13T23:06:19.492 INFO:tasks.workunit.client.1.smithi152.stdout:5/254: dwrite d5/dc/d19/f1a [0,4194304] 0 2024-09-13T23:06:19.494 INFO:tasks.workunit.client.1.smithi152.stdout:5/255: rename d5/dc/d35/d51 to d5/dc/d19/d20/d55 0 2024-09-13T23:06:19.505 INFO:tasks.workunit.client.0.smithi115.stdout:0/911: dread d6/d24/d25/d2b/d82/d6b/d9f/fbc [0,4194304] 0 2024-09-13T23:06:19.506 INFO:tasks.workunit.client.0.smithi115.stdout:1/864: dwrite d0/de/df8/d10c/d25/d67/fc3 [4194304,4194304] 0 2024-09-13T23:06:19.507 INFO:tasks.workunit.client.0.smithi115.stdout:0/912: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/d118/d13e 0 2024-09-13T23:06:19.507 INFO:tasks.workunit.client.0.smithi115.stdout:1/865: mkdir d0/de/d66/d8f/d117 0 2024-09-13T23:06:19.508 INFO:tasks.workunit.client.0.smithi115.stdout:0/913: creat d6/d24/d136/f13f x:0 0 0 2024-09-13T23:06:19.508 INFO:tasks.workunit.client.0.smithi115.stdout:0/914: fsync d6/fa9 0 2024-09-13T23:06:19.509 INFO:tasks.workunit.client.0.smithi115.stdout:1/866: creat d0/de/d66/d8f/d29/d47/d74/dcb/d110/f118 x:0 0 0 2024-09-13T23:06:19.510 INFO:tasks.workunit.client.0.smithi115.stdout:1/867: rename d0/de/d66/d8f/dad/ddb/de5/feb to d0/de/df8/d10c/d25/d67/f119 0 2024-09-13T23:06:19.510 INFO:tasks.workunit.client.0.smithi115.stdout:1/868: read d0/f83 [734727,77900] 0 2024-09-13T23:06:19.512 INFO:tasks.workunit.client.0.smithi115.stdout:1/869: dread d0/de/d66/d8f/d29/d47/d74/dcb/fce [0,4194304] 0 2024-09-13T23:06:19.522 INFO:tasks.workunit.client.0.smithi115.stdout:1/870: dread d0/de/d66/d8f/d29/f42 [0,4194304] 0 2024-09-13T23:06:19.529 INFO:tasks.workunit.client.0.smithi115.stdout:0/915: dwrite d6/d24/f95 [0,4194304] 0 2024-09-13T23:06:19.529 INFO:tasks.workunit.client.0.smithi115.stdout:0/916: fdatasync d6/d24/d25/da3/dad/f8a 0 2024-09-13T23:06:19.531 INFO:tasks.workunit.client.1.smithi152.stdout:3/278: sync 2024-09-13T23:06:19.537 INFO:tasks.workunit.client.0.smithi115.stdout:0/917: mkdir d6/d24/d140 0 2024-09-13T23:06:19.537 INFO:tasks.workunit.client.0.smithi115.stdout:0/918: write d6/f81 [1818629,49113] 0 2024-09-13T23:06:19.539 INFO:tasks.workunit.client.0.smithi115.stdout:0/919: dread d6/f4d [0,4194304] 0 2024-09-13T23:06:19.543 INFO:tasks.workunit.client.0.smithi115.stdout:1/871: dwrite d0/de/d66/d8f/d29/d47/d74/fcc [0,4194304] 0 2024-09-13T23:06:19.544 INFO:tasks.workunit.client.0.smithi115.stdout:1/872: mkdir d0/de/d62/d11a 0 2024-09-13T23:06:19.554 INFO:tasks.workunit.client.1.smithi152.stdout:3/279: dwrite de/d14/f4b [0,4194304] 0 2024-09-13T23:06:19.554 INFO:tasks.workunit.client.1.smithi152.stdout:3/280: fsync de/ff 0 2024-09-13T23:06:19.556 INFO:tasks.workunit.client.0.smithi115.stdout:1/873: dread d0/de/df8/d10c/d25/d67/fba [0,4194304] 0 2024-09-13T23:06:19.556 INFO:tasks.workunit.client.0.smithi115.stdout:1/874: stat d0/de/df8/d10c/d25/d4d/d51/d23/d65 0 2024-09-13T23:06:19.557 INFO:tasks.workunit.client.0.smithi115.stdout:1/875: truncate d0/de/d66/d8f/d29/d47/d63/dac/f102 443216 0 2024-09-13T23:06:19.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/876: creat d0/de/d66/d8f/d29/d47/d6a/f11b x:0 0 0 2024-09-13T23:06:19.568 INFO:tasks.workunit.client.0.smithi115.stdout:0/920: dwrite d6/f20 [0,4194304] 0 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.0.smithi115.stdout:0/921: fsync d6/da0/f13b 0 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.0.smithi115.stdout:0/922: dread - d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f10a zero size 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.0.smithi115.stdout:0/923: truncate d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f131 557030 0 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.0.smithi115.stdout:1/877: fsync d0/de/d66/d8f/d29/d47/d63/dac/f102 0 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.1.smithi152.stdout:3/281: dwrite de/d14/d47/d57/f64 [0,4194304] 0 2024-09-13T23:06:19.569 INFO:tasks.workunit.client.1.smithi152.stdout:3/282: chown de/d14/d38/f19 29 1 2024-09-13T23:06:19.570 INFO:tasks.workunit.client.1.smithi152.stdout:3/283: stat de/l61 0 2024-09-13T23:06:19.570 INFO:tasks.workunit.client.0.smithi115.stdout:0/924: symlink d6/d24/d25/d2b/d82/d6b/d9f/dab/dca/d129/l141 0 2024-09-13T23:06:19.570 INFO:tasks.workunit.client.0.smithi115.stdout:0/925: truncate d6/d24/d25/d58/f7a 5013798 0 2024-09-13T23:06:19.570 INFO:tasks.workunit.client.0.smithi115.stdout:0/926: stat d6/d24/d25/d7f/f9a 0 2024-09-13T23:06:19.571 INFO:tasks.workunit.client.0.smithi115.stdout:1/878: creat d0/de/d62/f11c x:0 0 0 2024-09-13T23:06:19.571 INFO:tasks.workunit.client.0.smithi115.stdout:1/879: stat d0/de/d66/faa 0 2024-09-13T23:06:19.571 INFO:tasks.workunit.client.0.smithi115.stdout:1/880: mkdir d0/de/d62/d11a/d11d 0 2024-09-13T23:06:19.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/284: rmdir de/d14 39 2024-09-13T23:06:19.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/285: dread - de/f45 zero size 2024-09-13T23:06:19.576 INFO:tasks.workunit.client.0.smithi115.stdout:0/927: dread d6/d24/d25/da3/dad/f80 [0,4194304] 0 2024-09-13T23:06:19.576 INFO:tasks.workunit.client.0.smithi115.stdout:0/928: truncate d6/d24/d25/f12c 174426 0 2024-09-13T23:06:19.577 INFO:tasks.workunit.client.0.smithi115.stdout:0/929: mkdir d6/d24/d25/d2b/d103/dd4/d142 0 2024-09-13T23:06:19.579 INFO:tasks.workunit.client.0.smithi115.stdout:0/930: mkdir d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/d143 0 2024-09-13T23:06:19.579 INFO:tasks.workunit.client.0.smithi115.stdout:0/931: write d6/d24/d25/d58/fec [41368,70537] 0 2024-09-13T23:06:19.579 INFO:tasks.workunit.client.0.smithi115.stdout:0/932: chown d6/d24/d25/d2b/d61 72 1 2024-09-13T23:06:19.585 INFO:tasks.workunit.client.0.smithi115.stdout:0/933: write d6/d24/d25/d2b/d82/d6b/d9f/fbc [1248468,92865] 0 2024-09-13T23:06:19.585 INFO:tasks.workunit.client.0.smithi115.stdout:0/934: creat d6/d24/d25/d2b/d82/d44/f144 x:0 0 0 2024-09-13T23:06:19.585 INFO:tasks.workunit.client.0.smithi115.stdout:0/935: creat d6/d24/d25/dc7/f145 x:0 0 0 2024-09-13T23:06:19.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/936: mkdir d6/d24/d25/d2b/d82/d44/d5c/d146 0 2024-09-13T23:06:19.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/937: chown d6/d24/d25/d2b/d103/lac 0 1 2024-09-13T23:06:19.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/938: fdatasync d6/d24/d25/d58/f7e 0 2024-09-13T23:06:19.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/939: dread - d6/d24/d25/d2b/d82/d44/f144 zero size 2024-09-13T23:06:19.587 INFO:tasks.workunit.client.0.smithi115.stdout:0/940: truncate d6/d24/d25/d2b/f42 934821 0 2024-09-13T23:06:19.588 INFO:tasks.workunit.client.0.smithi115.stdout:0/941: symlink d6/d24/d25/d2b/d82/df9/l147 0 2024-09-13T23:06:19.589 INFO:tasks.workunit.client.0.smithi115.stdout:1/881: dwrite d0/de/d66/d8f/d29/d47/d74/d9d/da3/f10e [0,4194304] 0 2024-09-13T23:06:19.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/344: sync 2024-09-13T23:06:19.609 INFO:tasks.workunit.client.1.smithi152.stdout:0/276: sync 2024-09-13T23:06:19.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/345: truncate d0/d4/d9/d16/d30/f38 4627554 0 2024-09-13T23:06:19.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/346: chown d0/d4/d9/f10 118665 1 2024-09-13T23:06:19.610 INFO:tasks.workunit.client.1.smithi152.stdout:2/347: chown d0/d8/c19 4045 1 2024-09-13T23:06:19.610 INFO:tasks.workunit.client.1.smithi152.stdout:2/348: creat d0/d8/f7d x:0 0 0 2024-09-13T23:06:19.610 INFO:tasks.workunit.client.1.smithi152.stdout:0/277: symlink d18/d19/l61 0 2024-09-13T23:06:19.611 INFO:tasks.workunit.client.0.smithi115.stdout:1/882: dwrite d0/de/df8/d10c/d25/d4d/d51/d31/d37/d72/f101 [0,4194304] 0 2024-09-13T23:06:19.611 INFO:tasks.workunit.client.0.smithi115.stdout:0/942: dwrite d6/d24/d25/da3/dad/f121 [0,4194304] 0 2024-09-13T23:06:19.612 INFO:tasks.workunit.client.1.smithi152.stdout:0/278: creat d18/d1f/d29/d4e/f62 x:0 0 0 2024-09-13T23:06:19.613 INFO:tasks.workunit.client.1.smithi152.stdout:2/349: getdents d0/d4/d9/d18/d32 0 2024-09-13T23:06:19.613 INFO:tasks.workunit.client.1.smithi152.stdout:0/279: mknod d18/d1f/c63 0 2024-09-13T23:06:19.614 INFO:tasks.workunit.client.1.smithi152.stdout:0/280: write d18/d1f/d39/f45 [625085,11365] 0 2024-09-13T23:06:19.615 INFO:tasks.workunit.client.1.smithi152.stdout:2/350: link d0/d4/d9/d18/d32/l6d d0/d4/d9/d14/l7e 0 2024-09-13T23:06:19.616 INFO:tasks.workunit.client.0.smithi115.stdout:0/943: symlink d6/d24/d25/da3/dad/de4/l148 0 2024-09-13T23:06:19.623 INFO:tasks.workunit.client.1.smithi152.stdout:2/351: dread d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:19.624 INFO:tasks.workunit.client.1.smithi152.stdout:2/352: rmdir d0/d4/d9/d18/d1e 39 2024-09-13T23:06:19.624 INFO:tasks.workunit.client.0.smithi115.stdout:0/944: write d6/f72 [2068932,32471] 0 2024-09-13T23:06:19.625 INFO:tasks.workunit.client.1.smithi152.stdout:2/353: mknod d0/d4/d9/d14/d48/d4a/c7f 0 2024-09-13T23:06:19.625 INFO:tasks.workunit.client.0.smithi115.stdout:0/945: mkdir d6/d24/d25/d2b/d82/d6b/d9f/dab/d118/d149 0 2024-09-13T23:06:19.625 INFO:tasks.workunit.client.0.smithi115.stdout:0/946: creat d6/d24/d25/d7f/f14a x:0 0 0 2024-09-13T23:06:19.625 INFO:tasks.workunit.client.0.smithi115.stdout:0/947: chown d6/d24/d25/d7f/f9a 45284 1 2024-09-13T23:06:19.626 INFO:tasks.workunit.client.0.smithi115.stdout:0/948: rmdir d6/d24/d25/d2b/d82/df9 39 2024-09-13T23:06:19.626 INFO:tasks.workunit.client.0.smithi115.stdout:0/949: stat d6/d24/d25/da3/dad/de4/l148 0 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:0/950: write d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f131 [350147,29715] 0 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:5/923: sync 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:9/980: sync 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:4/926: sync 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:7/831: sync 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:9/981: truncate d0/d13/d3b/d42/d95/f124 612406 0 2024-09-13T23:06:19.627 INFO:tasks.workunit.client.0.smithi115.stdout:4/927: chown db/d16/d3f/d66/da6/dec 770849 1 2024-09-13T23:06:19.628 INFO:tasks.workunit.client.0.smithi115.stdout:7/832: fsync da/dd/d1c/d2d/d41/fbc 0 2024-09-13T23:06:19.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/924: symlink d8/d9e/dd8/l118 0 2024-09-13T23:06:19.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/925: write d8/dd/ff [1126522,1217] 0 2024-09-13T23:06:19.628 INFO:tasks.workunit.client.0.smithi115.stdout:5/926: readlink d8/dd/d20/d23/lbe 0 2024-09-13T23:06:19.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/833: unlink da/dd/d13/d36/d5a/d99/ddd/d92/f9a 0 2024-09-13T23:06:19.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/834: chown da/df/d3b/c109 1 1 2024-09-13T23:06:19.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/835: write da/dd/d16/d29/f108 [4325805,28451] 0 2024-09-13T23:06:19.630 INFO:tasks.workunit.client.0.smithi115.stdout:7/836: readlink da/df/l3f 0 2024-09-13T23:06:19.631 INFO:tasks.workunit.client.0.smithi115.stdout:7/837: mkdir da/dd/d1c/d2d/d45/d121 0 2024-09-13T23:06:19.631 INFO:tasks.workunit.client.0.smithi115.stdout:7/838: creat da/dd/d1c/d2d/d41/de1/df8/f122 x:0 0 0 2024-09-13T23:06:19.632 INFO:tasks.workunit.client.0.smithi115.stdout:7/839: read da/dd/d1c/fad [256872,6209] 0 2024-09-13T23:06:19.643 INFO:tasks.workunit.client.0.smithi115.stdout:4/928: dread db/f56 [0,4194304] 0 2024-09-13T23:06:19.644 INFO:tasks.workunit.client.0.smithi115.stdout:9/982: write d0/d13/d17/d1f/f45 [154751,9077] 0 2024-09-13T23:06:19.645 INFO:tasks.workunit.client.0.smithi115.stdout:5/927: read d8/dd/d5d/f6e [1488364,20415] 0 2024-09-13T23:06:19.647 INFO:tasks.workunit.client.0.smithi115.stdout:5/928: mkdir d8/dd/d4c/d119 0 2024-09-13T23:06:19.647 INFO:tasks.workunit.client.0.smithi115.stdout:5/929: read d8/dd/d64/fa7 [525161,91031] 0 2024-09-13T23:06:19.647 INFO:tasks.workunit.client.0.smithi115.stdout:5/930: truncate d8/dd/d6a/d82/d63/dd6/dde/ff3 369655 0 2024-09-13T23:06:19.647 INFO:tasks.workunit.client.0.smithi115.stdout:5/931: truncate d8/dd/d20/d27/f72 1385624 0 2024-09-13T23:06:19.648 INFO:tasks.workunit.client.0.smithi115.stdout:5/932: stat d8/dd/d6a/d82/d63/dd6/dde/de6 0 2024-09-13T23:06:19.648 INFO:tasks.workunit.client.0.smithi115.stdout:4/929: dread db/d16/d3f/d66/d68/d71/d84/f88 [0,4194304] 0 2024-09-13T23:06:19.651 INFO:tasks.workunit.client.0.smithi115.stdout:5/933: rename d8/d9e/dd8/fe2 to d8/dd/d5d/f11a 0 2024-09-13T23:06:19.651 INFO:tasks.workunit.client.0.smithi115.stdout:5/934: dread - d8/dd/d20/d27/f96 zero size 2024-09-13T23:06:19.651 INFO:tasks.workunit.client.0.smithi115.stdout:5/935: chown d8/dd/l22 14 1 2024-09-13T23:06:19.651 INFO:tasks.workunit.client.0.smithi115.stdout:0/951: dwrite d6/f81 [0,4194304] 0 2024-09-13T23:06:19.652 INFO:tasks.workunit.client.0.smithi115.stdout:4/930: creat db/d19/d4e/f118 x:0 0 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:5/936: dread d8/dd/d5d/d5e/fc0 [0,4194304] 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:0/952: rename d6/d24/d25/d7f/f9d to d6/da0/f14b 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/931: dread db/d11/f70 [0,4194304] 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/932: fdatasync db/d11/d2e/d33/d36/f42 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:5/937: mkdir d8/dd/d6a/d82/d11b 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:0/953: mkdir d6/d24/d25/d2b/d82/d6b/d9f/d14c 0 2024-09-13T23:06:19.657 INFO:tasks.workunit.client.0.smithi115.stdout:4/933: symlink db/d16/d3f/l119 0 2024-09-13T23:06:19.658 INFO:tasks.workunit.client.0.smithi115.stdout:4/934: write db/d11/d2e/d33/d36/d7f/ff8 [605550,116082] 0 2024-09-13T23:06:19.659 INFO:tasks.workunit.client.0.smithi115.stdout:5/938: rename d8/dd/d20/d4a/la6 to d8/dd/d6a/d82/d63/de8/l11c 0 2024-09-13T23:06:19.660 INFO:tasks.workunit.client.0.smithi115.stdout:0/954: link d6/c90 d6/d24/d25/d2b/d82/d6b/d9f/dab/d118/d149/c14d 0 2024-09-13T23:06:19.661 INFO:tasks.workunit.client.0.smithi115.stdout:4/935: symlink db/d16/d3f/d66/d68/d6a/l11a 0 2024-09-13T23:06:19.662 INFO:tasks.workunit.client.0.smithi115.stdout:0/955: mknod d6/d24/d25/d2b/d82/d44/d5c/d146/c14e 0 2024-09-13T23:06:19.663 INFO:tasks.workunit.client.0.smithi115.stdout:0/956: fsync d6/d24/d25/d2b/f42 0 2024-09-13T23:06:19.664 INFO:tasks.workunit.client.0.smithi115.stdout:0/957: rename d6/d24/d25/d2b/d82/d44/f4b to d6/d24/f14f 0 2024-09-13T23:06:19.666 INFO:tasks.workunit.client.0.smithi115.stdout:7/840: dwrite da/dd/d1c/d2d/f54 [0,4194304] 0 2024-09-13T23:06:19.666 INFO:tasks.workunit.client.0.smithi115.stdout:0/958: dread d6/d24/f3d [0,4194304] 0 2024-09-13T23:06:19.666 INFO:tasks.workunit.client.0.smithi115.stdout:7/841: write da/dd/d1c/d2d/d45/f5f [4386101,35965] 0 2024-09-13T23:06:19.668 INFO:tasks.workunit.client.0.smithi115.stdout:0/959: rmdir d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/d116/d117 0 2024-09-13T23:06:19.669 INFO:tasks.workunit.client.0.smithi115.stdout:7/842: rmdir da/dd/d13/d36/d5a/d99/ddd/d92/db1/dd8 39 2024-09-13T23:06:19.671 INFO:tasks.workunit.client.0.smithi115.stdout:5/939: write d8/dd/d64/fcb [3595790,25776] 0 2024-09-13T23:06:19.672 INFO:tasks.workunit.client.0.smithi115.stdout:5/940: symlink d8/dd/d4c/l11d 0 2024-09-13T23:06:19.674 INFO:tasks.workunit.client.0.smithi115.stdout:4/936: read db/d11/d2e/d33/d36/d51/d57/fab [3114531,93355] 0 2024-09-13T23:06:19.674 INFO:tasks.workunit.client.0.smithi115.stdout:5/941: rename d8/d9e/dd8/fe3 to d8/dd/f11e 0 2024-09-13T23:06:19.674 INFO:tasks.workunit.client.0.smithi115.stdout:5/942: chown d8/dd/d6a/d82/d63/dd6 16797703 1 2024-09-13T23:06:19.676 INFO:tasks.workunit.client.0.smithi115.stdout:4/937: mknod db/d16/d3f/d66/da6/c11b 0 2024-09-13T23:06:19.676 INFO:tasks.workunit.client.0.smithi115.stdout:5/943: truncate d8/f51 2846248 0 2024-09-13T23:06:19.679 INFO:tasks.workunit.client.0.smithi115.stdout:4/938: rename db/d16/d3f/d66/d68/d71/f9e to db/d16/d3f/d66/da6/ddb/f11c 0 2024-09-13T23:06:19.681 INFO:tasks.workunit.client.0.smithi115.stdout:5/944: dread d8/dd/d20/dbb/f41 [0,4194304] 0 2024-09-13T23:06:19.682 INFO:tasks.workunit.client.0.smithi115.stdout:5/945: chown d8/dd/d6a/d82/d63/f8b 20484108 1 2024-09-13T23:06:19.682 INFO:tasks.workunit.client.0.smithi115.stdout:5/946: stat l2 0 2024-09-13T23:06:19.682 INFO:tasks.workunit.client.0.smithi115.stdout:5/947: dread - d8/dd/d20/d4a/f93 zero size 2024-09-13T23:06:19.682 INFO:tasks.workunit.client.0.smithi115.stdout:5/948: write d8/dd/d6a/d82/d63/dd6/fa5 [2556645,44183] 0 2024-09-13T23:06:19.683 INFO:tasks.workunit.client.0.smithi115.stdout:5/949: symlink d8/dd/d5d/d9b/ddd/l11f 0 2024-09-13T23:06:19.684 INFO:tasks.workunit.client.0.smithi115.stdout:5/950: symlink d8/dd/d6a/d82/d63/dd6/dde/l120 0 2024-09-13T23:06:19.685 INFO:tasks.workunit.client.0.smithi115.stdout:5/951: getdents d8/dd/d20/d27 0 2024-09-13T23:06:19.686 INFO:tasks.workunit.client.0.smithi115.stdout:5/952: link d8/dd/d64/fb0 d8/dd/d4c/d119/f121 0 2024-09-13T23:06:19.687 INFO:tasks.workunit.client.0.smithi115.stdout:5/953: mkdir d8/d9e/dcd/d122 0 2024-09-13T23:06:19.689 INFO:tasks.workunit.client.0.smithi115.stdout:5/954: dread d8/dd/f5c [0,4194304] 0 2024-09-13T23:06:19.693 INFO:tasks.workunit.client.0.smithi115.stdout:7/843: dwrite da/dd/d13/d36/f3a [0,4194304] 0 2024-09-13T23:06:19.693 INFO:tasks.workunit.client.0.smithi115.stdout:7/844: fdatasync da/dd/d1c/d2d/d41/d98/fd5 0 2024-09-13T23:06:19.693 INFO:tasks.workunit.client.0.smithi115.stdout:7/845: truncate da/dd/d13/d24/d52/fe8 1014330 0 2024-09-13T23:06:19.694 INFO:tasks.workunit.client.0.smithi115.stdout:0/960: dwrite d6/d24/d25/d2b/d82/d44/d5c/d87/da4/ffc [0,4194304] 0 2024-09-13T23:06:19.694 INFO:tasks.workunit.client.0.smithi115.stdout:4/939: write f5 [6900437,43213] 0 2024-09-13T23:06:19.694 INFO:tasks.workunit.client.0.smithi115.stdout:0/961: chown d6/d24/d25/da3/dad/f121 262155301 1 2024-09-13T23:06:19.694 INFO:tasks.workunit.client.0.smithi115.stdout:0/962: readlink d6/d24/d25/l106 0 2024-09-13T23:06:19.694 INFO:tasks.workunit.client.0.smithi115.stdout:0/963: chown d6/da0/dd9/d122/c12e 654834849 1 2024-09-13T23:06:19.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/846: truncate da/dd/d1c/d2d/d60/d82/fd7 103119 0 2024-09-13T23:06:19.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/847: chown da/dd/d13/d36/d5a/c69 7034457 1 2024-09-13T23:06:19.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/848: fsync da/dd/d13/d36/f3a 0 2024-09-13T23:06:19.697 INFO:tasks.workunit.client.0.smithi115.stdout:7/849: creat da/dd/d16/f123 x:0 0 0 2024-09-13T23:06:19.698 INFO:tasks.workunit.client.0.smithi115.stdout:4/940: creat db/d16/d3f/d66/da6/dec/f11d x:0 0 0 2024-09-13T23:06:19.699 INFO:tasks.workunit.client.0.smithi115.stdout:0/964: symlink d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/l150 0 2024-09-13T23:06:19.703 INFO:tasks.workunit.client.0.smithi115.stdout:7/850: creat da/dd/d1c/f124 x:0 0 0 2024-09-13T23:06:19.705 INFO:tasks.workunit.client.0.smithi115.stdout:4/941: link db/d11/d2e/d33/d36/d7f/l8a db/d11/d54/d17/l11e 0 2024-09-13T23:06:19.708 INFO:tasks.workunit.client.0.smithi115.stdout:0/965: mkdir d6/d24/d25/da3/d125/d151 0 2024-09-13T23:06:19.708 INFO:tasks.workunit.client.0.smithi115.stdout:7/851: creat da/dd/f125 x:0 0 0 2024-09-13T23:06:19.708 INFO:tasks.workunit.client.0.smithi115.stdout:0/966: creat d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f152 x:0 0 0 2024-09-13T23:06:19.708 INFO:tasks.workunit.client.0.smithi115.stdout:0/967: chown d6/d24/d25/d2b/d82/d6b/d9f/l77 41108204 1 2024-09-13T23:06:19.709 INFO:tasks.workunit.client.0.smithi115.stdout:5/955: dwrite d8/dd/d6a/d82/d63/d5a/dc3/f109 [0,4194304] 0 2024-09-13T23:06:19.709 INFO:tasks.workunit.client.0.smithi115.stdout:5/956: chown d8/d7a 3 1 2024-09-13T23:06:19.715 INFO:tasks.workunit.client.0.smithi115.stdout:7/852: truncate da/dd/d1c/d2d/d41/fbc 2585603 0 2024-09-13T23:06:19.715 INFO:tasks.workunit.client.0.smithi115.stdout:7/853: chown da/dd/d1c/c1d 4023601 1 2024-09-13T23:06:19.715 INFO:tasks.workunit.client.0.smithi115.stdout:7/854: stat da/dd/d1c/d2d/d45/d4d/f6f 0 2024-09-13T23:06:19.723 INFO:tasks.workunit.client.0.smithi115.stdout:7/855: rename da/ca4 to da/dd/d13/d36/d5a/d99/ddd/d92/db1/c126 0 2024-09-13T23:06:19.724 INFO:tasks.workunit.client.0.smithi115.stdout:4/942: dread db/d11/d54/f79 [0,4194304] 0 2024-09-13T23:06:19.733 INFO:tasks.workunit.client.0.smithi115.stdout:7/856: creat da/dd/d13/d24/d67/d81/f127 x:0 0 0 2024-09-13T23:06:19.734 INFO:tasks.workunit.client.0.smithi115.stdout:4/943: link db/d16/d3f/dae/fcb db/d19/f11f 0 2024-09-13T23:06:19.736 INFO:tasks.workunit.client.0.smithi115.stdout:0/968: dwrite d6/d24/d25/d2b/d82/d44/d5c/d87/fde [0,4194304] 0 2024-09-13T23:06:19.737 INFO:tasks.workunit.client.0.smithi115.stdout:7/857: mknod da/dd/d1c/d10f/c128 0 2024-09-13T23:06:19.739 INFO:tasks.workunit.client.0.smithi115.stdout:7/858: symlink da/dd/d1c/d2d/d41/d98/l129 0 2024-09-13T23:06:19.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/859: truncate da/dd/d13/d36/fc4 981287 0 2024-09-13T23:06:19.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/860: chown da/dd/d13/d24/d67/d115 6930 1 2024-09-13T23:06:19.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/861: creat da/dd/f12a x:0 0 0 2024-09-13T23:06:19.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/862: truncate da/f103 4259266 0 2024-09-13T23:06:19.741 INFO:tasks.workunit.client.0.smithi115.stdout:7/863: write da/dd/d1c/d2d/d41/de1/df8/f11a [798843,109248] 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:5/957: dwrite d8/dd/d20/d4a/fe7 [0,4194304] 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:5/958: fsync d8/dd/d74/fca 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:5/959: write d8/dd/d5d/f110 [899357,61634] 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:7/864: creat da/dd/d13/d36/d5a/d99/f12b x:0 0 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:7/865: write da/dd/d1c/f124 [993028,9635] 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:7/866: dread - da/dd/d1c/d2d/d41/d98/fd5 zero size 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:4/944: dread db/d16/f47 [0,4194304] 0 2024-09-13T23:06:19.745 INFO:tasks.workunit.client.0.smithi115.stdout:4/945: chown db/d19/daa/lb8 61 1 2024-09-13T23:06:19.749 INFO:tasks.workunit.client.0.smithi115.stdout:5/960: rename d8/dd/d6a/d82/f103 to d8/dd/d20/dbb/deb/f123 0 2024-09-13T23:06:19.751 INFO:tasks.workunit.client.0.smithi115.stdout:7/867: mknod da/dd/d1c/d84/c12c 0 2024-09-13T23:06:19.751 INFO:tasks.workunit.client.0.smithi115.stdout:7/868: write da/dd/d1c/d84/f113 [330794,52166] 0 2024-09-13T23:06:19.751 INFO:tasks.workunit.client.0.smithi115.stdout:7/869: chown da/dd/d13/d36/d85/cf3 26327 1 2024-09-13T23:06:19.752 INFO:tasks.workunit.client.0.smithi115.stdout:7/870: dread - da/dd/d13/d36/d5a/f102 zero size 2024-09-13T23:06:19.753 INFO:tasks.workunit.client.0.smithi115.stdout:4/946: truncate db/d19/fc2 1812303 0 2024-09-13T23:06:19.754 INFO:tasks.workunit.client.0.smithi115.stdout:7/871: symlink da/dd/d1c/d2d/d45/l12d 0 2024-09-13T23:06:19.755 INFO:tasks.workunit.client.1.smithi152.stdout:6/301: sync 2024-09-13T23:06:19.755 INFO:tasks.workunit.client.1.smithi152.stdout:6/302: chown d4/de/d12/d16/d2a/d38/f61 19 1 2024-09-13T23:06:19.756 INFO:tasks.workunit.client.1.smithi152.stdout:6/303: dread - d4/de/d12/f55 zero size 2024-09-13T23:06:19.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/301: sync 2024-09-13T23:06:19.757 INFO:tasks.workunit.client.0.smithi115.stdout:4/947: mknod db/d11/d54/d17/dd1/c120 0 2024-09-13T23:06:19.758 INFO:tasks.workunit.client.1.smithi152.stdout:6/304: mknod d4/de/d21/d5b/c64 0 2024-09-13T23:06:19.759 INFO:tasks.workunit.client.0.smithi115.stdout:7/872: rename da/df/cbf to da/df/dcc/c12e 0 2024-09-13T23:06:19.760 INFO:tasks.workunit.client.1.smithi152.stdout:9/302: symlink d3/d24/d34/d37/d4a/l65 0 2024-09-13T23:06:19.760 INFO:tasks.workunit.client.1.smithi152.stdout:9/303: readlink d3/d24/d34/d37/d4a/l65 0 2024-09-13T23:06:19.763 INFO:tasks.workunit.client.0.smithi115.stdout:5/961: write d8/dd/d20/f1a [12271850,74094] 0 2024-09-13T23:06:19.763 INFO:tasks.workunit.client.1.smithi152.stdout:9/304: rmdir d3/d24/d34/d45/d63 0 2024-09-13T23:06:19.764 INFO:tasks.workunit.client.0.smithi115.stdout:7/873: creat da/dd/d13/d24/f12f x:0 0 0 2024-09-13T23:06:19.767 INFO:tasks.workunit.client.0.smithi115.stdout:5/962: dread d8/dd/d6a/d82/d63/dd6/dde/ff3 [0,4194304] 0 2024-09-13T23:06:19.767 INFO:tasks.workunit.client.0.smithi115.stdout:5/963: chown d8/dd/d4c/c107 3 1 2024-09-13T23:06:19.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/874: getdents da/dd/d1c/d2d/d60/d82/de6 0 2024-09-13T23:06:19.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/875: creat da/dd/d16/f130 x:0 0 0 2024-09-13T23:06:19.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/876: fsync da/f103 0 2024-09-13T23:06:19.768 INFO:tasks.workunit.client.0.smithi115.stdout:7/877: truncate da/dd/d1c/fad 923124 0 2024-09-13T23:06:19.769 INFO:tasks.workunit.client.0.smithi115.stdout:0/969: dwrite d6/d24/d25/d7f/f14a [0,4194304] 0 2024-09-13T23:06:19.769 INFO:tasks.workunit.client.0.smithi115.stdout:0/970: write d6/d24/d25/d2b/d82/d6b/d9f/dab/dee/f110 [44395,12028] 0 2024-09-13T23:06:19.773 INFO:tasks.workunit.client.1.smithi152.stdout:6/305: write d4/de/d12/d16/d2a/f48 [2947846,40751] 0 2024-09-13T23:06:19.773 INFO:tasks.workunit.client.1.smithi152.stdout:6/306: fsync d4/de/d21/f47 0 2024-09-13T23:06:19.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/307: mknod d4/de/d12/d16/d2a/c65 0 2024-09-13T23:06:19.781 INFO:tasks.workunit.client.0.smithi115.stdout:0/971: creat d6/d24/d25/da3/dad/de4/f153 x:0 0 0 2024-09-13T23:06:19.781 INFO:tasks.workunit.client.0.smithi115.stdout:0/972: chown d6/d24/d25/d7f 7365 1 2024-09-13T23:06:19.782 INFO:tasks.workunit.client.0.smithi115.stdout:7/878: getdents da/dd/d1c/d2d/d41/de1/df8 0 2024-09-13T23:06:19.782 INFO:tasks.workunit.client.0.smithi115.stdout:7/879: chown da/dd/d1c/d2d/d41/c87 255 1 2024-09-13T23:06:19.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/973: truncate d6/d24/d25/d10c/f11a 3955846 0 2024-09-13T23:06:19.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/974: truncate d6/da0/f13b 893135 0 2024-09-13T23:06:19.784 INFO:tasks.workunit.client.0.smithi115.stdout:0/975: chown d6/d24/d25/d2b/d82/d44/d5c/d87/c8d 13447185 1 2024-09-13T23:06:19.789 INFO:tasks.workunit.client.0.smithi115.stdout:7/880: dread da/df/fa6 [0,4194304] 0 2024-09-13T23:06:19.793 INFO:tasks.workunit.client.0.smithi115.stdout:7/881: link da/dd/d1c/c32 da/dd/d1c/d2d/d41/c131 0 2024-09-13T23:06:19.793 INFO:tasks.workunit.client.0.smithi115.stdout:7/882: chown da/dd/c25 0 1 2024-09-13T23:06:19.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/883: symlink da/dd/d1c/d10f/l132 0 2024-09-13T23:06:19.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/884: dread - da/dd/d13/d36/d5a/d99/ddd/d92/db1/ff1 zero size 2024-09-13T23:06:19.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/885: truncate da/dd/d13/d24/fd3 519202 0 2024-09-13T23:06:19.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/886: truncate da/dd/d16/f123 296958 0 2024-09-13T23:06:19.797 INFO:tasks.workunit.client.0.smithi115.stdout:7/887: mkdir da/dd/d1c/d2d/d45/d4d/d133 0 2024-09-13T23:06:19.797 INFO:tasks.workunit.client.0.smithi115.stdout:7/888: write da/dd/d1c/d2d/d45/d4d/f73 [8828069,10738] 0 2024-09-13T23:06:19.798 INFO:tasks.workunit.client.1.smithi152.stdout:6/308: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:19.799 INFO:tasks.workunit.client.0.smithi115.stdout:4/948: dwrite db/d16/d3f/fcf [0,4194304] 0 2024-09-13T23:06:19.799 INFO:tasks.workunit.client.0.smithi115.stdout:4/949: creat db/d11/d2e/d33/d36/d51/d57/f121 x:0 0 0 2024-09-13T23:06:19.799 INFO:tasks.workunit.client.1.smithi152.stdout:9/305: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:19.800 INFO:tasks.workunit.client.1.smithi152.stdout:9/306: fdatasync d3/d24/f20 0 2024-09-13T23:06:19.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/889: creat da/dd/d13/d36/d5a/d99/ddd/d92/f134 x:0 0 0 2024-09-13T23:06:19.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/890: creat da/dd/d13/d36/d5a/d99/ddd/f135 x:0 0 0 2024-09-13T23:06:19.800 INFO:tasks.workunit.client.0.smithi115.stdout:7/891: write da/dd/d13/d36/f71 [4775368,30670] 0 2024-09-13T23:06:19.803 INFO:tasks.workunit.client.1.smithi152.stdout:9/307: symlink d3/d24/d34/d37/l66 0 2024-09-13T23:06:19.806 INFO:tasks.workunit.client.0.smithi115.stdout:5/964: dwrite d8/d9e/dcd/ff9 [0,4194304] 0 2024-09-13T23:06:19.807 INFO:tasks.workunit.client.0.smithi115.stdout:7/892: mkdir da/dd/d1c/d10f/d136 0 2024-09-13T23:06:19.812 INFO:tasks.workunit.client.1.smithi152.stdout:6/309: write d4/de/d21/f15 [2763157,10119] 0 2024-09-13T23:06:19.819 INFO:tasks.workunit.client.0.smithi115.stdout:7/893: write da/dd/d13/d36/f3a [1615894,68890] 0 2024-09-13T23:06:19.819 INFO:tasks.workunit.client.1.smithi152.stdout:9/308: rename d3/d24/d34/d37 to d3/d24/d67 0 2024-09-13T23:06:19.822 INFO:tasks.workunit.client.1.smithi152.stdout:6/310: rename d4/de/d12/d16/d2a/d38/f61 to d4/de/d12/f66 0 2024-09-13T23:06:19.822 INFO:tasks.workunit.client.1.smithi152.stdout:6/311: write d4/de/d1d/f2f [1438605,11572] 0 2024-09-13T23:06:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:9/309: truncate d3/f4 1105225 0 2024-09-13T23:06:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:7/322: sync 2024-09-13T23:06:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:7/323: write d17/d24/d2a/d2b/f49 [94680,101570] 0 2024-09-13T23:06:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:7/324: truncate d17/f27 505042 0 2024-09-13T23:06:19.824 INFO:tasks.workunit.client.1.smithi152.stdout:7/325: write d17/d24/d2a/d2e/f32 [910422,51277] 0 2024-09-13T23:06:19.826 INFO:tasks.workunit.client.1.smithi152.stdout:7/326: mkdir d17/d24/d2a/d2b/d4b/d61/d67 0 2024-09-13T23:06:19.827 INFO:tasks.workunit.client.1.smithi152.stdout:7/327: symlink d17/d24/d2d/d3f/l68 0 2024-09-13T23:06:19.829 INFO:tasks.workunit.client.1.smithi152.stdout:7/328: mknod d17/d24/d2d/d3f/c69 0 2024-09-13T23:06:19.831 INFO:tasks.workunit.client.1.smithi152.stdout:7/329: creat d17/d24/d2a/f6a x:0 0 0 2024-09-13T23:06:19.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/330: creat d17/d24/d2a/d2b/d4b/f6b x:0 0 0 2024-09-13T23:06:19.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/331: mkdir d17/d6c 0 2024-09-13T23:06:19.834 INFO:tasks.workunit.client.1.smithi152.stdout:7/332: stat d17/d24/l45 0 2024-09-13T23:06:19.842 INFO:tasks.workunit.client.0.smithi115.stdout:0/976: dwrite d6/d24/d25/d2b/d82/d44/fd2 [0,4194304] 0 2024-09-13T23:06:19.846 INFO:tasks.workunit.client.0.smithi115.stdout:5/965: dwrite d8/d9e/dcd/fd1 [0,4194304] 0 2024-09-13T23:06:19.847 INFO:tasks.workunit.client.0.smithi115.stdout:5/966: stat d8/dd/d20/d27/c8d 0 2024-09-13T23:06:19.850 INFO:tasks.workunit.client.0.smithi115.stdout:5/967: creat d8/dd/d6a/d82/d63/dd6/dde/de6/f124 x:0 0 0 2024-09-13T23:06:19.852 INFO:tasks.workunit.client.0.smithi115.stdout:5/968: creat d8/dd/d5d/d5e/f125 x:0 0 0 2024-09-13T23:06:19.853 INFO:tasks.workunit.client.1.smithi152.stdout:6/312: dwrite d4/de/d21/d5b/f5e [0,4194304] 0 2024-09-13T23:06:19.853 INFO:tasks.workunit.client.1.smithi152.stdout:6/313: chown d4/de/d21/f24 2009 1 2024-09-13T23:06:19.854 INFO:tasks.workunit.client.0.smithi115.stdout:5/969: getdents d8/dd/d20 0 2024-09-13T23:06:19.854 INFO:tasks.workunit.client.0.smithi115.stdout:5/970: creat d8/dd/d5d/d9b/de1/f126 x:0 0 0 2024-09-13T23:06:19.856 INFO:tasks.workunit.client.0.smithi115.stdout:5/971: mkdir d8/dd/d20/d23/d127 0 2024-09-13T23:06:19.858 INFO:tasks.workunit.client.0.smithi115.stdout:5/972: symlink d8/dd/d6a/d82/d63/d5a/dc3/l128 0 2024-09-13T23:06:19.858 INFO:tasks.workunit.client.0.smithi115.stdout:5/973: write d8/d7a/fdc [4339538,78016] 0 2024-09-13T23:06:19.858 INFO:tasks.workunit.client.0.smithi115.stdout:5/974: chown d8/dd/d6a/d82/d63/dd6/c53 18657813 1 2024-09-13T23:06:19.858 INFO:tasks.workunit.client.0.smithi115.stdout:5/975: chown d8/dd/d64/cbd 10518558 1 2024-09-13T23:06:19.858 INFO:tasks.workunit.client.0.smithi115.stdout:5/976: read - d8/dd/d20/d4a/f8f zero size 2024-09-13T23:06:19.865 INFO:tasks.workunit.client.1.smithi152.stdout:9/310: dwrite d3/d24/fb [0,4194304] 0 2024-09-13T23:06:19.865 INFO:tasks.workunit.client.1.smithi152.stdout:7/333: dwrite d17/d24/d2d/d46/f48 [0,4194304] 0 2024-09-13T23:06:19.867 INFO:tasks.workunit.client.1.smithi152.stdout:9/311: rename d3/d1e/d30/c59 to d3/d24/d67/d60/c68 0 2024-09-13T23:06:19.868 INFO:tasks.workunit.client.1.smithi152.stdout:9/312: creat d3/d24/d67/d60/f69 x:0 0 0 2024-09-13T23:06:19.869 INFO:tasks.workunit.client.1.smithi152.stdout:9/313: symlink d3/d24/l6a 0 2024-09-13T23:06:19.869 INFO:tasks.workunit.client.1.smithi152.stdout:9/314: chown d3/d24/f36 2 1 2024-09-13T23:06:19.871 INFO:tasks.workunit.client.0.smithi115.stdout:0/977: dwrite d6/d24/d25/d2b/d82/d44/d5c/d87/dc2/f108 [0,4194304] 0 2024-09-13T23:06:19.871 INFO:tasks.workunit.client.1.smithi152.stdout:9/315: link d3/d24/f2a d3/f6b 0 2024-09-13T23:06:19.872 INFO:tasks.workunit.client.1.smithi152.stdout:9/316: creat d3/d1e/d30/f6c x:0 0 0 2024-09-13T23:06:19.875 INFO:tasks.workunit.client.0.smithi115.stdout:0/978: unlink d6/da0/l133 0 2024-09-13T23:06:19.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/388: sync 2024-09-13T23:06:19.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/389: readlink d3/d4/d6/d66/l72 0 2024-09-13T23:06:19.876 INFO:tasks.workunit.client.1.smithi152.stdout:2/354: sync 2024-09-13T23:06:19.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/256: sync 2024-09-13T23:06:19.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/257: fdatasync d5/f8 0 2024-09-13T23:06:19.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/286: sync 2024-09-13T23:06:19.877 INFO:tasks.workunit.client.1.smithi152.stdout:0/281: sync 2024-09-13T23:06:19.877 INFO:tasks.workunit.client.1.smithi152.stdout:1/320: sync 2024-09-13T23:06:19.877 INFO:tasks.workunit.client.1.smithi152.stdout:7/334: dread f16 [0,4194304] 0 2024-09-13T23:06:19.877 INFO:tasks.workunit.client.0.smithi115.stdout:5/977: rename d8/dd/d20/d23 to d8/dd/d6a/d82/d11b/d129 0 2024-09-13T23:06:19.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/248: sync 2024-09-13T23:06:19.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/314: dwrite d4/de/d12/f20 [0,4194304] 0 2024-09-13T23:06:19.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/315: read - d4/de/f63 zero size 2024-09-13T23:06:19.881 INFO:tasks.workunit.client.0.smithi115.stdout:0/979: mknod d6/da0/dd9/d12f/c154 0 2024-09-13T23:06:19.881 INFO:tasks.workunit.client.0.smithi115.stdout:0/980: read d6/d24/d25/d2b/d82/d44/f56 [2981033,77539] 0 2024-09-13T23:06:19.881 INFO:tasks.workunit.client.0.smithi115.stdout:0/981: read - d6/d24/d25/d2b/d82/d44/d5c/d87/da4/f10a zero size 2024-09-13T23:06:19.883 INFO:tasks.workunit.client.1.smithi152.stdout:7/335: rename d17/d4f/f52 to d17/d24/d2a/d2b/d4b/d4d/f6d 0 2024-09-13T23:06:19.883 INFO:tasks.workunit.client.1.smithi152.stdout:3/287: getdents de/d14/d47 0 2024-09-13T23:06:19.883 INFO:tasks.workunit.client.1.smithi152.stdout:7/336: chown d17/d24/d2a/d2b/d4b/d61 31810262 1 2024-09-13T23:06:19.884 INFO:tasks.workunit.client.0.smithi115.stdout:5/978: mkdir d8/dd/d6a/d82/d11b/d129/d12a 0 2024-09-13T23:06:19.884 INFO:tasks.workunit.client.1.smithi152.stdout:6/316: creat d4/de/d21/d5c/f67 x:0 0 0 2024-09-13T23:06:19.884 INFO:tasks.workunit.client.1.smithi152.stdout:6/317: dread - d4/de/d12/d16/d2a/d38/f4b zero size 2024-09-13T23:06:19.886 INFO:tasks.workunit.client.1.smithi152.stdout:3/288: dread de/d1f/f36 [0,4194304] 0 2024-09-13T23:06:19.886 INFO:tasks.workunit.client.1.smithi152.stdout:6/318: creat d4/de/d21/d5b/f68 x:0 0 0 2024-09-13T23:06:19.886 INFO:tasks.workunit.client.1.smithi152.stdout:6/319: creat d4/de/d12/d16/f69 x:0 0 0 2024-09-13T23:06:19.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/337: rmdir d17/d24/d2d/d46 39 2024-09-13T23:06:19.887 INFO:tasks.workunit.client.1.smithi152.stdout:8/249: dread d17/d23/f2b [0,4194304] 0 2024-09-13T23:06:19.887 INFO:tasks.workunit.client.1.smithi152.stdout:8/250: chown d17/d25/d32/d44/f49 332 1 2024-09-13T23:06:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:6/320: symlink d4/l6a 0 2024-09-13T23:06:19.888 INFO:tasks.workunit.client.1.smithi152.stdout:6/321: creat d4/de/d1d/f6b x:0 0 0 2024-09-13T23:06:19.889 INFO:tasks.workunit.client.1.smithi152.stdout:8/251: unlink d17/d23/f30 0 2024-09-13T23:06:19.896 INFO:tasks.workunit.client.1.smithi152.stdout:6/322: rename d4/de/d12/f66 to d4/de/f6c 0 2024-09-13T23:06:19.898 INFO:tasks.workunit.client.1.smithi152.stdout:6/323: creat d4/de/d21/d5c/f6d x:0 0 0 2024-09-13T23:06:19.898 INFO:tasks.workunit.client.1.smithi152.stdout:6/324: creat d4/de/d21/f6e x:0 0 0 2024-09-13T23:06:19.903 INFO:tasks.workunit.client.0.smithi115.stdout:5/979: dread d8/dd/d6a/d82/d63/f8b [0,4194304] 0 2024-09-13T23:06:19.906 INFO:tasks.workunit.client.0.smithi115.stdout:5/980: mknod d8/dd/d4c/c12b 0 2024-09-13T23:06:19.908 INFO:tasks.workunit.client.0.smithi115.stdout:5/981: unlink d8/dd/d20/d27/fb2 0 2024-09-13T23:06:19.910 INFO:tasks.workunit.client.0.smithi115.stdout:0/982: write d6/d24/d25/d2b/d82/d6b/d9f/f83 [5850814,119976] 0 2024-09-13T23:06:19.911 INFO:tasks.workunit.client.1.smithi152.stdout:7/338: write f16 [330690,101346] 0 2024-09-13T23:06:19.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/321: write d4/d9/d1a/d22/f29 [86320,72186] 0 2024-09-13T23:06:19.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/322: readlink d4/l2c 0 2024-09-13T23:06:19.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/323: stat d4/f26 0 2024-09-13T23:06:19.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/390: dwrite d3/d4/d6/d66/d1c/f2c [0,4194304] 0 2024-09-13T23:06:19.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/391: fdatasync d3/d4/d6/d66/f6f 0 2024-09-13T23:06:19.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/324: symlink d4/d47/l67 0 2024-09-13T23:06:19.915 INFO:tasks.workunit.client.1.smithi152.stdout:1/325: symlink d4/d9/d1a/d22/d24/d48/l68 0 2024-09-13T23:06:19.927 INFO:tasks.workunit.client.1.smithi152.stdout:8/252: dwrite d17/d25/f2a [0,4194304] 0 2024-09-13T23:06:19.927 INFO:tasks.workunit.client.1.smithi152.stdout:8/253: fsync d17/d19/f28 0 2024-09-13T23:06:19.928 INFO:tasks.workunit.client.0.smithi115.stdout:5/982: write d8/d9e/dcd/ff9 [592288,23957] 0 2024-09-13T23:06:19.930 INFO:tasks.workunit.client.1.smithi152.stdout:8/254: unlink d17/d25/d32/d44/f49 0 2024-09-13T23:06:19.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/326: dread d4/d9/d1a/d22/d24/f52 [4194304,4194304] 0 2024-09-13T23:06:19.931 INFO:tasks.workunit.client.1.smithi152.stdout:8/255: symlink d17/d19/l55 0 2024-09-13T23:06:19.931 INFO:tasks.workunit.client.1.smithi152.stdout:8/256: write f3 [1362297,111986] 0 2024-09-13T23:06:19.931 INFO:tasks.workunit.client.1.smithi152.stdout:8/257: write d17/d25/d32/f4e [868672,94602] 0 2024-09-13T23:06:19.932 INFO:tasks.workunit.client.0.smithi115.stdout:0/983: dread d6/d24/d25/d2b/f31 [0,4194304] 0 2024-09-13T23:06:19.933 INFO:tasks.workunit.client.0.smithi115.stdout:0/984: unlink d6/f81 0 2024-09-13T23:06:19.934 INFO:tasks.workunit.client.1.smithi152.stdout:6/325: dwrite d4/de/d12/d16/f69 [0,4194304] 0 2024-09-13T23:06:19.936 INFO:tasks.workunit.client.1.smithi152.stdout:6/326: link d4/de/d1d/f6b d4/de/d12/f6f 0 2024-09-13T23:06:19.937 INFO:tasks.workunit.client.1.smithi152.stdout:6/327: truncate d4/de/f6c 2668246 0 2024-09-13T23:06:19.937 INFO:tasks.workunit.client.1.smithi152.stdout:6/328: fdatasync d4/de/d1d/f6b 0 2024-09-13T23:06:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:1/327: write d4/d9/d1a/f49 [92584,6132] 0 2024-09-13T23:06:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:1/328: chown d4/d9/d1a/d22/d24/d48/l68 685 1 2024-09-13T23:06:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:1/329: truncate d4/d4c/f5e 773585 0 2024-09-13T23:06:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:0/282: dwrite d18/d1f/d29/d3f/f56 [0,4194304] 0 2024-09-13T23:06:19.943 INFO:tasks.workunit.client.1.smithi152.stdout:0/283: dread - d18/d19/d2c/f54 zero size 2024-09-13T23:06:19.944 INFO:tasks.workunit.client.0.smithi115.stdout:5/983: write d8/f26 [1757044,60533] 0 2024-09-13T23:06:19.944 INFO:tasks.workunit.client.0.smithi115.stdout:5/984: chown d8/dd/d64/fb0 167 1 2024-09-13T23:06:19.944 INFO:tasks.workunit.client.1.smithi152.stdout:1/330: symlink d4/l69 0 2024-09-13T23:06:19.944 INFO:tasks.workunit.client.1.smithi152.stdout:1/331: fdatasync d4/d9/d1a/f19 0 2024-09-13T23:06:19.945 INFO:tasks.workunit.client.0.smithi115.stdout:5/985: symlink d8/dd/d20/dbb/deb/d10d/l12c 0 2024-09-13T23:06:19.946 INFO:tasks.workunit.client.1.smithi152.stdout:1/332: getdents d4/d9/d1a/d22/d24 0 2024-09-13T23:06:19.946 INFO:tasks.workunit.client.1.smithi152.stdout:6/329: dread d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:19.946 INFO:tasks.workunit.client.0.smithi115.stdout:5/986: creat d8/f12d x:0 0 0 2024-09-13T23:06:19.948 INFO:tasks.workunit.client.1.smithi152.stdout:7/339: dwrite d17/f1a [0,4194304] 0 2024-09-13T23:06:19.948 INFO:tasks.workunit.client.1.smithi152.stdout:1/333: getdents d4/d9 0 2024-09-13T23:06:19.948 INFO:tasks.workunit.client.1.smithi152.stdout:2/355: dwrite d0/d4/d9/d16/d2b/f46 [4194304,4194304] 0 2024-09-13T23:06:19.948 INFO:tasks.workunit.client.0.smithi115.stdout:5/987: mkdir d8/d9e/d12e 0 2024-09-13T23:06:19.949 INFO:tasks.workunit.client.1.smithi152.stdout:6/330: symlink d4/de/l70 0 2024-09-13T23:06:19.949 INFO:tasks.workunit.client.1.smithi152.stdout:6/331: truncate d4/de/d12/d16/d2a/f4f 1504049 0 2024-09-13T23:06:19.949 INFO:tasks.workunit.client.0.smithi115.stdout:5/988: creat d8/d9e/dcd/d122/f12f x:0 0 0 2024-09-13T23:06:19.950 INFO:tasks.workunit.client.0.smithi115.stdout:5/989: creat d8/dd/d5d/d9b/de1/f130 x:0 0 0 2024-09-13T23:06:19.950 INFO:tasks.workunit.client.1.smithi152.stdout:4/392: dwrite d3/d4/d6/d66/f49 [4194304,4194304] 0 2024-09-13T23:06:19.950 INFO:tasks.workunit.client.1.smithi152.stdout:4/393: truncate d3/d4/d6/f20 2297201 0 2024-09-13T23:06:19.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/340: creat d17/d24/d2d/d51/d5b/f6e x:0 0 0 2024-09-13T23:06:19.952 INFO:tasks.workunit.client.1.smithi152.stdout:2/356: link d0/d4/d9/d18/d1e/d3c/c3d d0/d4/d9/d14/c80 0 2024-09-13T23:06:19.954 INFO:tasks.workunit.client.1.smithi152.stdout:1/334: creat d4/d9/d1a/d22/d24/f6a x:0 0 0 2024-09-13T23:06:19.955 INFO:tasks.workunit.client.1.smithi152.stdout:6/332: link d4/de/d12/d16/d2a/d3d/d57/f60 d4/de/d12/d16/d2a/f71 0 2024-09-13T23:06:19.958 INFO:tasks.workunit.client.1.smithi152.stdout:2/357: write d0/f2e [1774707,17346] 0 2024-09-13T23:06:19.958 INFO:tasks.workunit.client.1.smithi152.stdout:2/358: fdatasync d0/d4/d9/d16/d30/f5c 0 2024-09-13T23:06:19.958 INFO:tasks.workunit.client.1.smithi152.stdout:4/394: symlink d3/d4/d6/d63/l75 0 2024-09-13T23:06:19.958 INFO:tasks.workunit.client.1.smithi152.stdout:4/395: fsync d3/d4/d6/d66/d1c/f2c 0 2024-09-13T23:06:19.959 INFO:tasks.workunit.client.1.smithi152.stdout:7/341: mknod d17/d24/d2a/d2b/c6f 0 2024-09-13T23:06:19.959 INFO:tasks.workunit.client.1.smithi152.stdout:7/342: fdatasync f6 0 2024-09-13T23:06:19.959 INFO:tasks.workunit.client.0.smithi115.stdout:0/985: dwrite d6/d24/d25/d2b/d82/d6b/d9f/dab/fbe [0,4194304] 0 2024-09-13T23:06:19.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/986: chown d6/d24/d25/d2b/d103/fea 398 1 2024-09-13T23:06:19.960 INFO:tasks.workunit.client.0.smithi115.stdout:0/987: symlink d6/d24/d25/d2b/d82/d6b/d9f/dab/d118/d149/l155 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:6/333: mknod d4/de/d21/d5b/c72 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:6/334: write d4/de/d12/d16/f58 [1528571,7677] 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:6/335: fdatasync d4/de/d12/d16/d2a/f2d 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:2/359: link d0/d4/d9/d16/d30/f3e d0/d4/d9/d16/f81 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:7/343: getdents d17/d4f 0 2024-09-13T23:06:19.962 INFO:tasks.workunit.client.1.smithi152.stdout:7/344: read - d17/d24/d2a/d2b/f47 zero size 2024-09-13T23:06:19.963 INFO:tasks.workunit.client.1.smithi152.stdout:4/396: dread d3/d4/d6/d66/d62/f64 [0,4194304] 0 2024-09-13T23:06:19.963 INFO:tasks.workunit.client.1.smithi152.stdout:6/336: mknod d4/de/d12/d16/d2a/d3d/d57/c73 0 2024-09-13T23:06:19.963 INFO:tasks.workunit.client.1.smithi152.stdout:6/337: write d4/de/d12/d16/d2a/d38/d3c/f54 [1095532,26914] 0 2024-09-13T23:06:19.964 INFO:tasks.workunit.client.1.smithi152.stdout:6/338: truncate d4/de/f63 854851 0 2024-09-13T23:06:19.970 INFO:tasks.workunit.client.0.smithi115.stdout:5/990: rename d8/dd/d5d to d8/d9e/dcd/d122/d131 0 2024-09-13T23:06:19.970 INFO:tasks.workunit.client.0.smithi115.stdout:5/991: creat d8/d9e/dcd/f132 x:0 0 0 2024-09-13T23:06:19.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/360: dread d0/d4/d9/d14/f28 [4194304,4194304] 0 2024-09-13T23:06:19.973 INFO:tasks.workunit.client.0.smithi115.stdout:5/992: symlink d8/d9e/dcd/d122/d131/d9b/de1/l133 0 2024-09-13T23:06:19.973 INFO:tasks.workunit.client.0.smithi115.stdout:5/993: stat d8/d7a/f7e 0 2024-09-13T23:06:19.974 INFO:tasks.workunit.client.1.smithi152.stdout:2/361: stat d0/d4/d9/d14/l7e 0 2024-09-13T23:06:19.976 INFO:tasks.workunit.client.0.smithi115.stdout:5/994: creat d8/dd/d4c/d119/f134 x:0 0 0 2024-09-13T23:06:19.976 INFO:tasks.workunit.client.0.smithi115.stdout:5/995: fsync d8/dd/f5f 0 2024-09-13T23:06:19.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/339: dread d4/de/d12/d16/f69 [0,4194304] 0 2024-09-13T23:06:19.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/340: creat d4/de/d21/d5b/f74 x:0 0 0 2024-09-13T23:06:19.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/341: truncate d4/de/d21/d5c/f67 842410 0 2024-09-13T23:06:19.979 INFO:tasks.workunit.client.0.smithi115.stdout:5/996: mknod d8/dd/d64/dc5/c135 0 2024-09-13T23:06:19.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/397: read d3/d4/d6/d8/f1b [537661,7679] 0 2024-09-13T23:06:19.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/398: unlink d3/f52 0 2024-09-13T23:06:19.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/399: mkdir d3/d4/d6/d8/d17/d5d/d76 0 2024-09-13T23:06:19.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/400: dread d3/d4/d6/d66/d62/f64 [0,4194304] 0 2024-09-13T23:06:19.986 INFO:tasks.workunit.client.1.smithi152.stdout:4/401: creat d3/d4/d6/d8/d17/d3a/f77 x:0 0 0 2024-09-13T23:06:19.996 INFO:tasks.workunit.client.0.smithi115.stdout:0/988: dwrite d6/d24/f3b [0,4194304] 0 2024-09-13T23:06:19.998 INFO:tasks.workunit.client.1.smithi152.stdout:7/345: dwrite d17/d24/d2a/d2b/f3a [0,4194304] 0 2024-09-13T23:06:19.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/362: dwrite d0/d4/d9/d16/f21 [0,4194304] 0 2024-09-13T23:06:20.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/997: getdents d8/dd/d64/dc5 0 2024-09-13T23:06:20.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/998: creat d8/d7a/f136 x:0 0 0 2024-09-13T23:06:20.000 INFO:tasks.workunit.client.0.smithi115.stdout:5/999: chown d8/d9e/dcd/d122/d131/c86 383675577 1 2024-09-13T23:06:20.002 INFO:tasks.workunit.client.1.smithi152.stdout:7/346: creat d17/d24/d2d/d51/f70 x:0 0 0 2024-09-13T23:06:20.002 INFO:tasks.workunit.client.1.smithi152.stdout:7/347: chown d17/d24/d2a/d2e/d59/l5a 404 1 2024-09-13T23:06:20.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/363: symlink d0/d4/d9/d16/d2b/l82 0 2024-09-13T23:06:20.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/364: write d0/f77 [1043686,118954] 0 2024-09-13T23:06:20.008 INFO:tasks.workunit.client.1.smithi152.stdout:4/402: dwrite d3/d4/d33/f48 [0,4194304] 0 2024-09-13T23:06:20.010 INFO:tasks.workunit.client.1.smithi152.stdout:4/403: symlink d3/d4/d6/d8/d17/l78 0 2024-09-13T23:06:20.010 INFO:tasks.workunit.client.1.smithi152.stdout:4/404: write d3/d4/d6/d66/d1c/f41 [634915,60461] 0 2024-09-13T23:06:20.011 INFO:tasks.workunit.client.1.smithi152.stdout:4/405: write d3/d4/d6/f4c [1827080,100511] 0 2024-09-13T23:06:20.012 INFO:tasks.workunit.client.1.smithi152.stdout:4/406: mkdir d3/d4/d6/d63/d79 0 2024-09-13T23:06:20.014 INFO:tasks.workunit.client.1.smithi152.stdout:4/407: rmdir d3/d34 39 2024-09-13T23:06:20.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/408: getdents d3/d4/d6/d63/d79 0 2024-09-13T23:06:20.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/409: truncate d3/d4/d6/d66/d62/f6a 8984385 0 2024-09-13T23:06:20.016 INFO:tasks.workunit.client.0.smithi115.stdout:9/983: sync 2024-09-13T23:06:20.017 INFO:tasks.workunit.client.0.smithi115.stdout:7/894: sync 2024-09-13T23:06:20.017 INFO:tasks.workunit.client.0.smithi115.stdout:7/895: dread - da/dd/d1c/d2d/d41/de1/df8/f122 zero size 2024-09-13T23:06:20.017 INFO:tasks.workunit.client.0.smithi115.stdout:1/883: sync 2024-09-13T23:06:20.017 INFO:tasks.workunit.client.0.smithi115.stdout:0/989: write d6/d24/d25/da3/dad/f11e [197562,62331] 0 2024-09-13T23:06:20.017 INFO:tasks.workunit.client.0.smithi115.stdout:4/950: sync 2024-09-13T23:06:20.018 INFO:tasks.workunit.client.1.smithi152.stdout:4/410: symlink d3/d4/d6/d66/d1c/d59/d60/d74/l7a 0 2024-09-13T23:06:20.019 INFO:tasks.workunit.client.0.smithi115.stdout:7/896: getdents da/dd/d1c/d2d/d60/d82 0 2024-09-13T23:06:20.019 INFO:tasks.workunit.client.0.smithi115.stdout:7/897: stat da/dd/d1c/d84/dde 0 2024-09-13T23:06:20.019 INFO:tasks.workunit.client.1.smithi152.stdout:4/411: creat d3/d4/d6/d63/f7b x:0 0 0 2024-09-13T23:06:20.020 INFO:tasks.workunit.client.0.smithi115.stdout:4/951: symlink db/d16/d3f/d66/l122 0 2024-09-13T23:06:20.022 INFO:tasks.workunit.client.0.smithi115.stdout:4/952: dread db/d11/d2e/d33/d36/d7f/f53 [0,4194304] 0 2024-09-13T23:06:20.025 INFO:tasks.workunit.client.0.smithi115.stdout:9/984: write d0/d13/d17/d36/dd1/f117 [1180962,92582] 0 2024-09-13T23:06:20.028 INFO:tasks.workunit.client.0.smithi115.stdout:9/985: creat d0/f143 x:0 0 0 2024-09-13T23:06:20.029 INFO:tasks.workunit.client.1.smithi152.stdout:4/412: truncate d3/d4/d6/f4c 340674 0 2024-09-13T23:06:20.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/348: dwrite d17/d24/d2a/d2b/d4b/f6b [0,4194304] 0 2024-09-13T23:06:20.030 INFO:tasks.workunit.client.0.smithi115.stdout:1/884: rename d0/de/d66 to d0/de/df8/d10c/d11e 0 2024-09-13T23:06:20.032 INFO:tasks.workunit.client.1.smithi152.stdout:7/349: dread d17/f23 [0,4194304] 0 2024-09-13T23:06:20.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/885: creat d0/de/df8/d10c/d25/d4d/d51/d23/f11f x:0 0 0 2024-09-13T23:06:20.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/886: write d0/de/df8/d10c/d25/d4d/d51/d31/d37/dc8/fef [797262,52761] 0 2024-09-13T23:06:20.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/887: fdatasync d0/de/d62/f6c 0 2024-09-13T23:06:20.033 INFO:tasks.workunit.client.0.smithi115.stdout:1/888: stat d0/de/f115 0 2024-09-13T23:06:20.037 INFO:tasks.workunit.client.0.smithi115.stdout:1/889: creat d0/de/d62/d11a/d11d/f120 x:0 0 0 2024-09-13T23:06:20.037 INFO:tasks.workunit.client.0.smithi115.stdout:9/986: rename d0/d13/d17/d36/d80 to d0/d13/d17/d1f/d35/d62/d144 0 2024-09-13T23:06:20.038 INFO:tasks.workunit.client.0.smithi115.stdout:1/890: creat d0/de/df8/d10c/d25/d4d/d51/f121 x:0 0 0 2024-09-13T23:06:20.038 INFO:tasks.workunit.client.0.smithi115.stdout:1/891: creat d0/de/df8/d10c/d25/d4d/d51/d23/f122 x:0 0 0 2024-09-13T23:06:20.039 INFO:tasks.workunit.client.0.smithi115.stdout:9/987: creat d0/d13/d17/f145 x:0 0 0 2024-09-13T23:06:20.041 INFO:tasks.workunit.client.0.smithi115.stdout:1/892: unlink d0/c1c 0 2024-09-13T23:06:20.042 INFO:tasks.workunit.client.0.smithi115.stdout:9/988: symlink d0/d43/df8/l146 0 2024-09-13T23:06:20.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/989: getdents d0/d13/d17/dc5 0 2024-09-13T23:06:20.044 INFO:tasks.workunit.client.0.smithi115.stdout:9/990: truncate d0/d13/d17/f145 993173 0 2024-09-13T23:06:20.044 INFO:tasks.workunit.client.0.smithi115.stdout:1/893: symlink d0/de/df8/d10c/d11e/d8f/d29/l123 0 2024-09-13T23:06:20.046 INFO:tasks.workunit.client.0.smithi115.stdout:9/991: symlink d0/d13/d17/d1f/d28/d76/d81/d107/l147 0 2024-09-13T23:06:20.046 INFO:tasks.workunit.client.0.smithi115.stdout:1/894: creat d0/de/df8/d10c/d11e/d8f/d29/d9c/f124 x:0 0 0 2024-09-13T23:06:20.047 INFO:tasks.workunit.client.0.smithi115.stdout:9/992: link d0/d13/d17/d1f/d4e/d61/d7d/l8e d0/d13/d17/d1f/d28/d76/d81/dd0/l148 0 2024-09-13T23:06:20.048 INFO:tasks.workunit.client.0.smithi115.stdout:9/993: creat d0/d13/d17/d19/dc8/f149 x:0 0 0 2024-09-13T23:06:20.048 INFO:tasks.workunit.client.0.smithi115.stdout:9/994: fdatasync d0/d13/d17/d1f/d28/d12d/f132 0 2024-09-13T23:06:20.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/995: creat d0/d43/df8/f14a x:0 0 0 2024-09-13T23:06:20.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/996: chown d0/d43/c102 265332980 1 2024-09-13T23:06:20.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/997: chown d0/d13/d17/d1f/d4e/d90/fe5 401439 1 2024-09-13T23:06:20.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/998: getdents d0/d13/d17/dc5 0 2024-09-13T23:06:20.050 INFO:tasks.workunit.client.0.smithi115.stdout:9/999: chown d0/d13/d17/dc5/cce 90 1 2024-09-13T23:06:20.054 INFO:tasks.workunit.client.1.smithi152.stdout:2/365: dwrite d0/d4/d9/d14/f6b [0,4194304] 0 2024-09-13T23:06:20.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/366: unlink d0/d4/d9/cd 0 2024-09-13T23:06:20.075 INFO:tasks.workunit.client.1.smithi152.stdout:4/413: dwrite d3/f40 [0,4194304] 0 2024-09-13T23:06:20.076 INFO:tasks.workunit.client.0.smithi115.stdout:0/990: dwrite d6/d24/d25/da3/dad/f80 [0,4194304] 0 2024-09-13T23:06:20.077 INFO:tasks.workunit.client.1.smithi152.stdout:4/414: mkdir d3/d4/d6/d66/d2b/d7c 0 2024-09-13T23:06:20.079 INFO:tasks.workunit.client.0.smithi115.stdout:0/991: mkdir d6/d24/d25/da3/dad/de4/d156 0 2024-09-13T23:06:20.086 INFO:tasks.workunit.client.0.smithi115.stdout:4/953: dwrite db/f56 [0,4194304] 0 2024-09-13T23:06:20.087 INFO:tasks.workunit.client.1.smithi152.stdout:7/350: dwrite d17/f25 [0,4194304] 0 2024-09-13T23:06:20.087 INFO:tasks.workunit.client.0.smithi115.stdout:1/895: dwrite d0/de/d62/f6c [0,4194304] 0 2024-09-13T23:06:20.088 INFO:tasks.workunit.client.1.smithi152.stdout:2/367: dwrite d0/d4/d9/d16/d30/f5c [0,4194304] 0 2024-09-13T23:06:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:4/954: dread db/d11/f70 [0,4194304] 0 2024-09-13T23:06:20.088 INFO:tasks.workunit.client.0.smithi115.stdout:4/955: fdatasync db/d11/d2e/d33/d36/d51/f7d 0 2024-09-13T23:06:20.090 INFO:tasks.workunit.client.0.smithi115.stdout:1/896: creat d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7/f125 x:0 0 0 2024-09-13T23:06:20.090 INFO:tasks.workunit.client.1.smithi152.stdout:7/351: mkdir d17/d24/d2a/d2e/d71 0 2024-09-13T23:06:20.090 INFO:tasks.workunit.client.1.smithi152.stdout:7/352: creat d17/d24/d2a/d2b/f72 x:0 0 0 2024-09-13T23:06:20.090 INFO:tasks.workunit.client.1.smithi152.stdout:7/353: chown d17/d24/d2a/d2b/l2c 16540 1 2024-09-13T23:06:20.091 INFO:tasks.workunit.client.0.smithi115.stdout:0/992: dread d6/d24/d25/d10c/f11a [0,4194304] 0 2024-09-13T23:06:20.091 INFO:tasks.workunit.client.0.smithi115.stdout:0/993: fdatasync d6/d24/d25/d2b/d82/d6b/d9f/dab/fef 0 2024-09-13T23:06:20.092 INFO:tasks.workunit.client.0.smithi115.stdout:4/956: rename db/d11/d54/l6e to db/d16/d3f/d66/d68/d6a/l123 0 2024-09-13T23:06:20.093 INFO:tasks.workunit.client.0.smithi115.stdout:4/957: unlink db/d19/d34/f55 0 2024-09-13T23:06:20.093 INFO:tasks.workunit.client.0.smithi115.stdout:4/958: dread - db/d11/d2e/d33/d36/d51/d57/f97 zero size 2024-09-13T23:06:20.094 INFO:tasks.workunit.client.0.smithi115.stdout:0/994: dread d6/d24/d25/d58/fec [0,4194304] 0 2024-09-13T23:06:20.094 INFO:tasks.workunit.client.1.smithi152.stdout:2/368: unlink d0/d8/f78 0 2024-09-13T23:06:20.099 INFO:tasks.workunit.client.1.smithi152.stdout:7/354: symlink d17/d24/d2a/d2b/d4b/d61/l73 0 2024-09-13T23:06:20.100 INFO:tasks.workunit.client.1.smithi152.stdout:2/369: rename d0/d4/d9/f3a to d0/d4/d9/d18/d1e/d3c/f83 0 2024-09-13T23:06:20.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/355: rename d17/d24/d2d/f4e to d17/d24/d2d/d46/f74 0 2024-09-13T23:06:20.103 INFO:tasks.workunit.client.1.smithi152.stdout:7/356: write d17/d24/d2a/d2e/d30/f53 [3266387,73095] 0 2024-09-13T23:06:20.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/357: read d17/f27 [487321,36302] 0 2024-09-13T23:06:20.104 INFO:tasks.workunit.client.1.smithi152.stdout:2/370: symlink d0/d8/d43/l84 0 2024-09-13T23:06:20.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/995: dread d6/d24/d25/d2b/d103/dd4/d107/f8f [0,4194304] 0 2024-09-13T23:06:20.104 INFO:tasks.workunit.client.0.smithi115.stdout:0/996: truncate d6/d24/d25/d2b/d82/d6b/fa1 100270 0 2024-09-13T23:06:20.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/371: creat d0/d4/f85 x:0 0 0 2024-09-13T23:06:20.109 INFO:tasks.workunit.client.1.smithi152.stdout:2/372: mknod d0/d4/d9/c86 0 2024-09-13T23:06:20.111 INFO:tasks.workunit.client.1.smithi152.stdout:2/373: symlink d0/d4/d9/d14/d48/d4a/l87 0 2024-09-13T23:06:20.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/374: mkdir d0/d4/d9/d18/d1e/d3c/d88 0 2024-09-13T23:06:20.119 INFO:tasks.workunit.client.1.smithi152.stdout:2/375: write d0/d4/d9/d16/d2b/f46 [4841524,31814] 0 2024-09-13T23:06:20.120 INFO:tasks.workunit.client.1.smithi152.stdout:2/376: stat d0/f2e 0 2024-09-13T23:06:20.120 INFO:tasks.workunit.client.1.smithi152.stdout:2/377: chown d0/d4/d9/d18/d1e/d3c/d4d 278844 1 2024-09-13T23:06:20.125 INFO:tasks.workunit.client.0.smithi115.stdout:1/897: dwrite d0/de/df8/d10c/d25/d67/fc3 [4194304,4194304] 0 2024-09-13T23:06:20.125 INFO:tasks.workunit.client.0.smithi115.stdout:1/898: stat d0/de/df8/d10c/c90 0 2024-09-13T23:06:20.125 INFO:tasks.workunit.client.0.smithi115.stdout:1/899: read - d0/de/df8/d10c/d11e/d8f/d29/d9c/fa1 zero size 2024-09-13T23:06:20.126 INFO:tasks.workunit.client.0.smithi115.stdout:4/959: dwrite db/d11/d2e/d33/f90 [0,4194304] 0 2024-09-13T23:06:20.126 INFO:tasks.workunit.client.0.smithi115.stdout:4/960: fsync db/d11/d2e/d33/f6d 0 2024-09-13T23:06:20.126 INFO:tasks.workunit.client.0.smithi115.stdout:0/997: dwrite d6/f10 [0,4194304] 0 2024-09-13T23:06:20.127 INFO:tasks.workunit.client.0.smithi115.stdout:0/998: readlink d6/d24/d25/da3/dad/lf5 0 2024-09-13T23:06:20.127 INFO:tasks.workunit.client.0.smithi115.stdout:0/999: fdatasync d6/da0/f14b 0 2024-09-13T23:06:20.127 INFO:tasks.workunit.client.0.smithi115.stdout:1/900: mkdir d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/da3/d126 0 2024-09-13T23:06:20.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/378: dwrite d0/d4/d9/d16/f17 [0,4194304] 0 2024-09-13T23:06:20.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/379: stat d0/d4/d9/d18/d1e/l61 0 2024-09-13T23:06:20.154 INFO:tasks.workunit.client.1.smithi152.stdout:2/380: read d0/d4/f1a [434152,43819] 0 2024-09-13T23:06:20.154 INFO:tasks.workunit.client.0.smithi115.stdout:1/901: dwrite d0/de/df8/d10c/d25/d67/f6e [4194304,4194304] 0 2024-09-13T23:06:20.154 INFO:tasks.workunit.client.0.smithi115.stdout:1/902: fdatasync d0/de/df8/d10c/d11e/d8f/f61 0 2024-09-13T23:06:20.155 INFO:tasks.workunit.client.0.smithi115.stdout:4/961: dwrite db/d16/d3f/d66/da6/ddb/f11c [0,4194304] 0 2024-09-13T23:06:20.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/903: dread d0/de/df8/d10c/f2f [0,4194304] 0 2024-09-13T23:06:20.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/904: chown d0/de/df8/d10c/d25/d4d/d51/lea 1 1 2024-09-13T23:06:20.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/905: dread - d0/de/df8/d10c/d11e/d8f/d29/d47/d63/fe3 zero size 2024-09-13T23:06:20.164 INFO:tasks.workunit.client.0.smithi115.stdout:1/906: readlink d0/de/df8/d10c/d25/d4d/d51/d31/l44 0 2024-09-13T23:06:20.166 INFO:tasks.workunit.client.0.smithi115.stdout:4/962: dread db/d16/d3f/f72 [0,4194304] 0 2024-09-13T23:06:20.191 INFO:tasks.workunit.client.0.smithi115.stdout:4/963: dwrite db/d11/d2e/d33/d36/f3c [0,4194304] 0 2024-09-13T23:06:20.191 INFO:tasks.workunit.client.0.smithi115.stdout:4/964: fsync db/d11/d54/fc1 0 2024-09-13T23:06:20.192 INFO:tasks.workunit.client.0.smithi115.stdout:1/907: dwrite d0/de/df8/d10c/f2f [0,4194304] 0 2024-09-13T23:06:20.192 INFO:tasks.workunit.client.0.smithi115.stdout:1/908: write d0/de/df8/d10c/d11e/d8f/d29/d47/d63/fe3 [776561,48228] 0 2024-09-13T23:06:20.193 INFO:tasks.workunit.client.0.smithi115.stdout:4/965: creat db/d16/d3f/d66/d68/d71/d75/f124 x:0 0 0 2024-09-13T23:06:20.223 INFO:tasks.workunit.client.0.smithi115.stdout:1/909: dwrite d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/f102 [0,4194304] 0 2024-09-13T23:06:20.224 INFO:tasks.workunit.client.0.smithi115.stdout:4/966: dwrite db/d16/d3f/dae/fca [0,4194304] 0 2024-09-13T23:06:20.225 INFO:tasks.workunit.client.0.smithi115.stdout:1/910: mknod d0/de/df8/c127 0 2024-09-13T23:06:20.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/967: rename db/d11/d2e/d33/d36/d7f/f3e to db/d11/d117/f125 0 2024-09-13T23:06:20.228 INFO:tasks.workunit.client.0.smithi115.stdout:4/968: chown db/d11/d117 1 1 2024-09-13T23:06:20.229 INFO:tasks.workunit.client.0.smithi115.stdout:1/911: mkdir d0/de/df8/d10c/d25/d4d/d51/d23/d65/d128 0 2024-09-13T23:06:20.237 INFO:tasks.workunit.client.0.smithi115.stdout:7/898: sync 2024-09-13T23:06:20.262 INFO:tasks.workunit.client.0.smithi115.stdout:7/899: dwrite da/dd/d13/d36/d5a/d6d/ff2 [0,4194304] 0 2024-09-13T23:06:20.262 INFO:tasks.workunit.client.0.smithi115.stdout:7/900: write da/dd/d1c/f124 [1160664,82882] 0 2024-09-13T23:06:20.262 INFO:tasks.workunit.client.0.smithi115.stdout:7/901: write da/dd/d1c/d2d/d41/d98/fd5 [409029,92401] 0 2024-09-13T23:06:20.262 INFO:tasks.workunit.client.0.smithi115.stdout:7/902: chown da/dd/d1c/d2d/d41/l7b 4086 1 2024-09-13T23:06:20.281 INFO:tasks.workunit.client.0.smithi115.stdout:7/903: dwrite da/dd/d13/fda [0,4194304] 0 2024-09-13T23:06:20.283 INFO:tasks.workunit.client.0.smithi115.stdout:7/904: creat da/dd/d13/d24/d52/d7c/da7/dea/f137 x:0 0 0 2024-09-13T23:06:20.284 INFO:tasks.workunit.client.0.smithi115.stdout:7/905: mkdir da/dd/d16/d29/d138 0 2024-09-13T23:06:20.285 INFO:tasks.workunit.client.0.smithi115.stdout:7/906: rmdir da/dd/d13/d36/d5a/d99/ddd/d92 39 2024-09-13T23:06:20.327 INFO:tasks.workunit.client.0.smithi115.stdout:4/969: dwrite db/d11/d54/fc1 [0,4194304] 0 2024-09-13T23:06:20.327 INFO:tasks.workunit.client.0.smithi115.stdout:4/970: stat db/d16/d3f/d66/d68/d71/d75/f124 0 2024-09-13T23:06:20.328 INFO:tasks.workunit.client.0.smithi115.stdout:1/912: dwrite d0/f83 [0,4194304] 0 2024-09-13T23:06:20.328 INFO:tasks.workunit.client.0.smithi115.stdout:4/971: symlink db/d19/d1d/l126 0 2024-09-13T23:06:20.331 INFO:tasks.workunit.client.0.smithi115.stdout:1/913: mkdir d0/de/df8/d10c/d25/d4d/d51/d31/d37/dc8/d129 0 2024-09-13T23:06:20.331 INFO:tasks.workunit.client.0.smithi115.stdout:1/914: write d0/de/df8/d10c/d11e/d8f/d29/d9c/f124 [1045747,35621] 0 2024-09-13T23:06:20.332 INFO:tasks.workunit.client.0.smithi115.stdout:4/972: symlink db/d16/d3f/d66/d68/d71/d75/l127 0 2024-09-13T23:06:20.333 INFO:tasks.workunit.client.0.smithi115.stdout:4/973: mknod db/d19/d4e/c128 0 2024-09-13T23:06:20.334 INFO:tasks.workunit.client.0.smithi115.stdout:1/915: mknod d0/de/df8/d10c/d11e/d8f/c12a 0 2024-09-13T23:06:20.335 INFO:tasks.workunit.client.0.smithi115.stdout:7/907: dwrite da/dd/d13/d36/d5a/d99/ddd/d92/db1/ff1 [0,4194304] 0 2024-09-13T23:06:20.337 INFO:tasks.workunit.client.0.smithi115.stdout:7/908: unlink da/dd/d1c/d2d/d41/d98/l129 0 2024-09-13T23:06:20.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/909: truncate da/dd/d1c/f20 6840813 0 2024-09-13T23:06:20.338 INFO:tasks.workunit.client.0.smithi115.stdout:7/910: truncate da/dd/d13/d36/d5a/d99/ddd/fed 588818 0 2024-09-13T23:06:20.339 INFO:tasks.workunit.client.0.smithi115.stdout:7/911: rmdir da/dd/d13/d36/d5a/d6d/d8f 39 2024-09-13T23:06:20.344 INFO:tasks.workunit.client.0.smithi115.stdout:1/916: dread d0/de/df8/d10c/d11e/d8f/d29/f4c [0,4194304] 0 2024-09-13T23:06:20.351 INFO:tasks.workunit.client.0.smithi115.stdout:4/974: dwrite db/d11/d2e/d33/d36/d51/d57/f97 [0,4194304] 0 2024-09-13T23:06:20.353 INFO:tasks.workunit.client.0.smithi115.stdout:4/975: unlink db/d11/d2e/d33/fc9 0 2024-09-13T23:06:20.355 INFO:tasks.workunit.client.0.smithi115.stdout:4/976: mknod db/d16/d3f/d66/d68/c129 0 2024-09-13T23:06:20.355 INFO:tasks.workunit.client.0.smithi115.stdout:4/977: chown db/fb3 29 1 2024-09-13T23:06:20.358 INFO:tasks.workunit.client.0.smithi115.stdout:1/917: dwrite d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/da3/f114 [0,4194304] 0 2024-09-13T23:06:20.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/317: sync 2024-09-13T23:06:20.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/318: fdatasync d3/f23 0 2024-09-13T23:06:20.360 INFO:tasks.workunit.client.0.smithi115.stdout:4/978: dread db/d16/d3f/f72 [0,4194304] 0 2024-09-13T23:06:20.360 INFO:tasks.workunit.client.0.smithi115.stdout:4/979: read - db/d16/d3f/d66/d68/d71/d84/d96/de6/ffe zero size 2024-09-13T23:06:20.360 INFO:tasks.workunit.client.1.smithi152.stdout:9/319: creat d3/d24/d67/f6d x:0 0 0 2024-09-13T23:06:20.361 INFO:tasks.workunit.client.1.smithi152.stdout:9/320: read d3/d24/f36 [758777,85426] 0 2024-09-13T23:06:20.361 INFO:tasks.workunit.client.1.smithi152.stdout:9/321: dread - d3/d24/d34/d45/f5f zero size 2024-09-13T23:06:20.361 INFO:tasks.workunit.client.1.smithi152.stdout:9/322: symlink d3/d52/l6e 0 2024-09-13T23:06:20.362 INFO:tasks.workunit.client.1.smithi152.stdout:9/323: write d3/d24/d67/d60/f69 [859117,12002] 0 2024-09-13T23:06:20.362 INFO:tasks.workunit.client.1.smithi152.stdout:9/324: readlink d3/l2d 0 2024-09-13T23:06:20.367 INFO:tasks.workunit.client.1.smithi152.stdout:9/325: dread d3/d24/d67/d60/f69 [0,4194304] 0 2024-09-13T23:06:20.367 INFO:tasks.workunit.client.0.smithi115.stdout:1/918: dread d0/de/df8/d10c/d11e/d8f/d29/f42 [0,4194304] 0 2024-09-13T23:06:20.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/919: fsync d0/de/df8/d10c/d25/d4d/d51/d31/d37/f3b 0 2024-09-13T23:06:20.368 INFO:tasks.workunit.client.1.smithi152.stdout:9/326: rmdir d3/d24/d67/d47 39 2024-09-13T23:06:20.368 INFO:tasks.workunit.client.0.smithi115.stdout:1/920: creat d0/de/df8/d10c/d25/f12b x:0 0 0 2024-09-13T23:06:20.369 INFO:tasks.workunit.client.1.smithi152.stdout:9/327: dread d3/d1e/d30/f32 [0,4194304] 0 2024-09-13T23:06:20.369 INFO:tasks.workunit.client.0.smithi115.stdout:1/921: mkdir d0/de/df8/d10c/d25/d4d/d51/d31/d37/d106/d12c 0 2024-09-13T23:06:20.370 INFO:tasks.workunit.client.0.smithi115.stdout:1/922: write d0/de/d62/f84 [1436746,96481] 0 2024-09-13T23:06:20.371 INFO:tasks.workunit.client.0.smithi115.stdout:1/923: mknod d0/de/df8/d10c/d25/d4d/d51/d31/d79/c12d 0 2024-09-13T23:06:20.376 INFO:tasks.workunit.client.0.smithi115.stdout:4/980: dwrite db/d19/d34/f108 [0,4194304] 0 2024-09-13T23:06:20.376 INFO:tasks.workunit.client.0.smithi115.stdout:4/981: write db/d19/d4e/f65 [364075,94762] 0 2024-09-13T23:06:20.385 INFO:tasks.workunit.client.0.smithi115.stdout:1/924: getdents d0/de/df8/d10c/d25/d4d/d51/d31/d79 0 2024-09-13T23:06:20.386 INFO:tasks.workunit.client.0.smithi115.stdout:4/982: write db/d19/d1d/f59 [72137,71513] 0 2024-09-13T23:06:20.387 INFO:tasks.workunit.client.0.smithi115.stdout:1/925: mknod d0/de/df8/d10c/d25/d4d/d51/d31/c12e 0 2024-09-13T23:06:20.388 INFO:tasks.workunit.client.0.smithi115.stdout:1/926: dread - d0/de/df8/d10c/d25/d67/f119 zero size 2024-09-13T23:06:20.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/328: dwrite d3/f9 [0,4194304] 0 2024-09-13T23:06:20.397 INFO:tasks.workunit.client.0.smithi115.stdout:1/927: dread d0/de/d62/f6c [0,4194304] 0 2024-09-13T23:06:20.398 INFO:tasks.workunit.client.0.smithi115.stdout:1/928: mknod d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/da3/d126/c12f 0 2024-09-13T23:06:20.400 INFO:tasks.workunit.client.0.smithi115.stdout:1/929: link d0/fb0 d0/de/df8/d10c/d11e/d8f/d29/d47/d74/dcb/f130 0 2024-09-13T23:06:20.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/329: dwrite d3/d24/d34/f49 [0,4194304] 0 2024-09-13T23:06:20.412 INFO:tasks.workunit.client.0.smithi115.stdout:4/983: dwrite db/d11/f70 [0,4194304] 0 2024-09-13T23:06:20.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/330: mknod d3/d24/d67/c6f 0 2024-09-13T23:06:20.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/984: mkdir db/d109/d12a 0 2024-09-13T23:06:20.414 INFO:tasks.workunit.client.0.smithi115.stdout:4/985: truncate db/d16/fe5 441948 0 2024-09-13T23:06:20.415 INFO:tasks.workunit.client.1.smithi152.stdout:9/331: unlink d3/d24/fb 0 2024-09-13T23:06:20.415 INFO:tasks.workunit.client.1.smithi152.stdout:9/332: chown d3/d24/d34/f49 535 1 2024-09-13T23:06:20.416 INFO:tasks.workunit.client.1.smithi152.stdout:9/333: getdents d3/d24/d34 0 2024-09-13T23:06:20.417 INFO:tasks.workunit.client.1.smithi152.stdout:9/334: write d3/d24/d67/d47/f51 [324540,21396] 0 2024-09-13T23:06:20.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/335: symlink d3/d1e/d30/l70 0 2024-09-13T23:06:20.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/336: chown d3/d24/d67/d4a/l65 0 1 2024-09-13T23:06:20.419 INFO:tasks.workunit.client.0.smithi115.stdout:1/930: dwrite d0/de/f60 [0,4194304] 0 2024-09-13T23:06:20.420 INFO:tasks.workunit.client.1.smithi152.stdout:9/337: mkdir d3/d24/d67/d4a/d71 0 2024-09-13T23:06:20.421 INFO:tasks.workunit.client.1.smithi152.stdout:9/338: rename d3/f6b to d3/d1e/f72 0 2024-09-13T23:06:20.422 INFO:tasks.workunit.client.1.smithi152.stdout:9/339: creat d3/d24/d67/d4a/d71/f73 x:0 0 0 2024-09-13T23:06:20.423 INFO:tasks.workunit.client.0.smithi115.stdout:1/931: mkdir d0/de/df8/d10c/d11e/d8f/d29/d131 0 2024-09-13T23:06:20.424 INFO:tasks.workunit.client.0.smithi115.stdout:1/932: symlink d0/de/df8/d10c/d25/d4d/d51/d31/d37/dc8/d129/l132 0 2024-09-13T23:06:20.426 INFO:tasks.workunit.client.1.smithi152.stdout:9/340: dread d3/ff [4194304,4194304] 0 2024-09-13T23:06:20.429 INFO:tasks.workunit.client.0.smithi115.stdout:4/986: dwrite db/d11/d54/d17/f9a [0,4194304] 0 2024-09-13T23:06:20.429 INFO:tasks.workunit.client.0.smithi115.stdout:4/987: chown db/f56 5 1 2024-09-13T23:06:20.431 INFO:tasks.workunit.client.1.smithi152.stdout:9/341: getdents d3 0 2024-09-13T23:06:20.431 INFO:tasks.workunit.client.1.smithi152.stdout:9/342: write d3/d1e/d30/f6c [916483,19523] 0 2024-09-13T23:06:20.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/343: symlink d3/d24/d34/l74 0 2024-09-13T23:06:20.435 INFO:tasks.workunit.client.1.smithi152.stdout:9/344: dread d3/d24/d67/d60/f69 [0,4194304] 0 2024-09-13T23:06:20.436 INFO:tasks.workunit.client.1.smithi152.stdout:9/345: symlink d3/d24/l75 0 2024-09-13T23:06:20.438 INFO:tasks.workunit.client.0.smithi115.stdout:4/988: write db/ffb [1894598,114282] 0 2024-09-13T23:06:20.438 INFO:tasks.workunit.client.0.smithi115.stdout:4/989: readlink db/d11/d54/d17/dd1/l107 0 2024-09-13T23:06:20.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/990: dwrite db/d16/f47 [0,4194304] 0 2024-09-13T23:06:20.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/991: fsync db/d16/d3f/dae/fcb 0 2024-09-13T23:06:20.451 INFO:tasks.workunit.client.0.smithi115.stdout:4/992: rmdir db/d16/d3f/d66/d68/d71/d84/d96 39 2024-09-13T23:06:20.477 INFO:tasks.workunit.client.1.smithi152.stdout:5/258: sync 2024-09-13T23:06:20.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/289: sync 2024-09-13T23:06:20.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/290: dread - de/f45 zero size 2024-09-13T23:06:20.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/291: mknod de/d14/d38/c65 0 2024-09-13T23:06:20.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/292: chown de/d14/f4f 530436 1 2024-09-13T23:06:20.478 INFO:tasks.workunit.client.0.smithi115.stdout:4/993: mkdir db/d16/d3f/d66/da6/d12b 0 2024-09-13T23:06:20.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/293: unlink de/d14/d38/l2f 0 2024-09-13T23:06:20.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/294: rename fd to de/d1f/f66 0 2024-09-13T23:06:20.480 INFO:tasks.workunit.client.1.smithi152.stdout:3/295: rename de/d1f/f3d to de/d1f/f67 0 2024-09-13T23:06:20.484 INFO:tasks.workunit.client.1.smithi152.stdout:5/259: dread d5/dc/d19/d20/d2e/d28/f2f [0,4194304] 0 2024-09-13T23:06:20.495 INFO:tasks.workunit.client.1.smithi152.stdout:5/260: dread d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:20.495 INFO:tasks.workunit.client.1.smithi152.stdout:5/261: fdatasync d5/f3f 0 2024-09-13T23:06:20.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/296: dwrite de/f3e [0,4194304] 0 2024-09-13T23:06:20.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/262: creat d5/dc/d19/d20/d2e/d27/f56 x:0 0 0 2024-09-13T23:06:20.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/263: readlink d5/ld 0 2024-09-13T23:06:20.498 INFO:tasks.workunit.client.1.smithi152.stdout:3/297: creat de/d14/d47/d57/d5d/f68 x:0 0 0 2024-09-13T23:06:20.498 INFO:tasks.workunit.client.1.smithi152.stdout:3/298: write de/d14/f55 [654480,122165] 0 2024-09-13T23:06:20.499 INFO:tasks.workunit.client.1.smithi152.stdout:3/299: readlink de/d14/d38/l33 0 2024-09-13T23:06:20.500 INFO:tasks.workunit.client.1.smithi152.stdout:5/264: unlink d5/dc/d19/d20/d2e/d27/c46 0 2024-09-13T23:06:20.507 INFO:tasks.workunit.client.1.smithi152.stdout:3/300: dread de/f17 [0,4194304] 0 2024-09-13T23:06:20.508 INFO:tasks.workunit.client.1.smithi152.stdout:5/265: dread d5/dc/d19/d20/d2e/f34 [0,4194304] 0 2024-09-13T23:06:20.509 INFO:tasks.workunit.client.1.smithi152.stdout:5/266: truncate d5/dc/d19/d20/f32 1455609 0 2024-09-13T23:06:20.511 INFO:tasks.workunit.client.1.smithi152.stdout:5/267: link d5/l4a d5/dc/l57 0 2024-09-13T23:06:20.511 INFO:tasks.workunit.client.1.smithi152.stdout:5/268: fdatasync d5/f6 0 2024-09-13T23:06:20.512 INFO:tasks.workunit.client.1.smithi152.stdout:5/269: write d5/dc/d35/f4b [245631,27745] 0 2024-09-13T23:06:20.512 INFO:tasks.workunit.client.1.smithi152.stdout:5/270: truncate d5/da/f3d 829660 0 2024-09-13T23:06:20.516 INFO:tasks.workunit.client.1.smithi152.stdout:5/271: dread d5/dc/d19/d20/d2e/d28/f2f [0,4194304] 0 2024-09-13T23:06:20.517 INFO:tasks.workunit.client.1.smithi152.stdout:3/301: read de/d14/d47/d57/f64 [670873,61941] 0 2024-09-13T23:06:20.518 INFO:tasks.workunit.client.1.smithi152.stdout:3/302: creat de/d14/d47/d57/f69 x:0 0 0 2024-09-13T23:06:20.519 INFO:tasks.workunit.client.1.smithi152.stdout:3/303: getdents de/d14 0 2024-09-13T23:06:20.520 INFO:tasks.workunit.client.1.smithi152.stdout:3/304: chown de/l61 5 1 2024-09-13T23:06:20.520 INFO:tasks.workunit.client.1.smithi152.stdout:3/305: mknod de/d1f/c6a 0 2024-09-13T23:06:20.522 INFO:tasks.workunit.client.1.smithi152.stdout:3/306: mknod de/d14/d47/d57/c6b 0 2024-09-13T23:06:20.522 INFO:tasks.workunit.client.1.smithi152.stdout:3/307: write de/f39 [379456,124331] 0 2024-09-13T23:06:20.524 INFO:tasks.workunit.client.1.smithi152.stdout:3/308: link de/d14/c4a de/d63/c6c 0 2024-09-13T23:06:20.544 INFO:tasks.workunit.client.1.smithi152.stdout:5/272: dwrite d5/dc/d19/d20/d2e/f34 [0,4194304] 0 2024-09-13T23:06:20.545 INFO:tasks.workunit.client.0.smithi115.stdout:4/994: creat db/d11/d2e/d33/f12c x:0 0 0 2024-09-13T23:06:20.545 INFO:tasks.workunit.client.1.smithi152.stdout:5/273: rmdir d5/dc/d19/d20/d2e 39 2024-09-13T23:06:20.546 INFO:tasks.workunit.client.0.smithi115.stdout:4/995: truncate db/d11/d2e/d33/d36/f3b 1364373 0 2024-09-13T23:06:20.546 INFO:tasks.workunit.client.0.smithi115.stdout:4/996: chown db/d11/c4d 741 1 2024-09-13T23:06:20.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/309: dwrite de/d14/d38/f25 [0,4194304] 0 2024-09-13T23:06:20.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/310: chown de/d14/d47/d57/d5d 15 1 2024-09-13T23:06:20.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/311: write de/d14/d38/f1a [1454911,54429] 0 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: Standby manager daemon smithi115.eqesbc started 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/crt"}]: dispatch 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/key"}]: dispatch 2024-09-13T23:06:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:20 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:06:20.553 INFO:tasks.workunit.client.1.smithi152.stdout:3/312: rename de/d14/d38/f37 to de/d14/f6d 0 2024-09-13T23:06:20.557 INFO:tasks.workunit.client.1.smithi152.stdout:3/313: getdents de/d14/d47/d57 0 2024-09-13T23:06:20.558 INFO:tasks.workunit.client.1.smithi152.stdout:3/314: mkdir de/d14/d47/d57/d5d/d6e 0 2024-09-13T23:06:20.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/274: dwrite d5/f22 [0,4194304] 0 2024-09-13T23:06:20.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/275: chown d5/dc/d35/l3e 43125586 1 2024-09-13T23:06:20.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/276: dread - d5/dc/f54 zero size 2024-09-13T23:06:20.569 INFO:tasks.workunit.client.1.smithi152.stdout:3/315: write de/f5c [1514935,105963] 0 2024-09-13T23:06:20.571 INFO:tasks.workunit.client.1.smithi152.stdout:3/316: symlink de/d1f/l6f 0 2024-09-13T23:06:20.572 INFO:tasks.workunit.client.1.smithi152.stdout:3/317: mkdir de/d14/d47/d70 0 2024-09-13T23:06:20.582 INFO:tasks.workunit.client.0.smithi115.stdout:4/997: dwrite db/d11/d2e/d33/d36/d51/d57/f121 [0,4194304] 0 2024-09-13T23:06:20.582 INFO:tasks.workunit.client.1.smithi152.stdout:5/277: dwrite d5/da/f3d [0,4194304] 0 2024-09-13T23:06:20.584 INFO:tasks.workunit.client.1.smithi152.stdout:5/278: stat d5/dc/d19/d20/d2e/c3c 0 2024-09-13T23:06:20.586 INFO:tasks.workunit.client.1.smithi152.stdout:3/318: write de/d14/d47/d57/d5d/f56 [1286047,87449] 0 2024-09-13T23:06:20.586 INFO:tasks.workunit.client.1.smithi152.stdout:5/279: truncate d5/dc/f30 1882821 0 2024-09-13T23:06:20.586 INFO:tasks.workunit.client.1.smithi152.stdout:5/280: creat d5/da/f58 x:0 0 0 2024-09-13T23:06:20.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/319: truncate de/f40 1393232 0 2024-09-13T23:06:20.590 INFO:tasks.workunit.client.1.smithi152.stdout:5/281: rename d5/l16 to d5/dc/l59 0 2024-09-13T23:06:20.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/282: creat d5/f5a x:0 0 0 2024-09-13T23:06:20.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/283: creat d5/dc/f5b x:0 0 0 2024-09-13T23:06:20.594 INFO:tasks.workunit.client.1.smithi152.stdout:3/320: dread de/d14/d47/f48 [0,4194304] 0 2024-09-13T23:06:20.595 INFO:tasks.workunit.client.1.smithi152.stdout:5/284: truncate d5/dc/d19/f1a 3838800 0 2024-09-13T23:06:20.600 INFO:tasks.workunit.client.0.smithi115.stdout:4/998: dwrite db/d16/d3f/f6c [0,4194304] 0 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:8/258: sync 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:0/284: sync 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:2/381: sync 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:2/382: write d0/d4/d9/d14/f7c [5719,67485] 0 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:1/335: sync 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:7/358: sync 2024-09-13T23:06:20.603 INFO:tasks.workunit.client.1.smithi152.stdout:7/359: fdatasync d17/f22 0 2024-09-13T23:06:20.604 INFO:tasks.workunit.client.1.smithi152.stdout:7/360: fdatasync d17/f23 0 2024-09-13T23:06:20.604 INFO:tasks.workunit.client.0.smithi115.stdout:4/999: creat db/d16/d3f/d66/d68/d10d/f12d x:0 0 0 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:9/346: sync 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/342: sync 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/343: fsync d4/de/d21/f15 0 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/415: sync 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:4/416: chown d3/d4/d6/d37/l47 3616 1 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/344: creat d4/f75 x:0 0 0 2024-09-13T23:06:20.605 INFO:tasks.workunit.client.1.smithi152.stdout:1/336: creat d4/f6b x:0 0 0 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:4/417: mkdir d3/d4/d6/d63/d79/d7d 0 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:4/418: creat d3/d4/d6/d63/f7e x:0 0 0 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:6/345: creat d4/de/d21/d5c/f76 x:0 0 0 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:6/346: chown d4/de/d12/f6f 104642 1 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:1/337: symlink d4/d4c/l6c 0 2024-09-13T23:06:20.609 INFO:tasks.workunit.client.1.smithi152.stdout:6/347: write d4/de/f63 [36019,13896] 0 2024-09-13T23:06:20.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/347: rmdir d3/d24/d67/d47 39 2024-09-13T23:06:20.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/348: read d3/f17 [3991417,106928] 0 2024-09-13T23:06:20.612 INFO:tasks.workunit.client.1.smithi152.stdout:4/419: mknod d3/d4/d6/d37/c7f 0 2024-09-13T23:06:20.613 INFO:tasks.workunit.client.1.smithi152.stdout:4/420: write d3/d4/d6/d8/f1b [1171011,112176] 0 2024-09-13T23:06:20.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/421: mknod d3/d4/d6/d66/d1c/c80 0 2024-09-13T23:06:20.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/338: getdents d4 0 2024-09-13T23:06:20.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/339: fdatasync d4/d4c/f54 0 2024-09-13T23:06:20.618 INFO:tasks.workunit.client.1.smithi152.stdout:4/422: truncate d3/f40 3926832 0 2024-09-13T23:06:20.618 INFO:tasks.workunit.client.1.smithi152.stdout:6/348: dread d4/de/d21/f47 [0,4194304] 0 2024-09-13T23:06:20.619 INFO:tasks.workunit.client.1.smithi152.stdout:4/423: rmdir d3/d4/d6/d8/d17/d5d 39 2024-09-13T23:06:20.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/259: dread d17/f1d [0,4194304] 0 2024-09-13T23:06:20.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/260: dread - d17/d25/d32/f4c zero size 2024-09-13T23:06:20.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/261: creat d17/d19/f56 x:0 0 0 2024-09-13T23:06:20.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/424: rename d3/d4/d6/d8/d17/c2a to d3/d4/d6/d66/c81 0 2024-09-13T23:06:20.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/425: mkdir d3/d4/d32/d82 0 2024-09-13T23:06:20.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/285: dwrite d5/f7 [4194304,4194304] 0 2024-09-13T23:06:20.624 INFO:tasks.workunit.client.1.smithi152.stdout:5/286: write d5/f3f [191391,73591] 0 2024-09-13T23:06:20.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/426: creat d3/f83 x:0 0 0 2024-09-13T23:06:20.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/361: dread d17/d24/f3c [0,4194304] 0 2024-09-13T23:06:20.626 INFO:tasks.workunit.client.1.smithi152.stdout:5/287: getdents d5/dc/d19 0 2024-09-13T23:06:20.627 INFO:tasks.workunit.client.1.smithi152.stdout:5/288: creat d5/dc/d35/f5c x:0 0 0 2024-09-13T23:06:20.628 INFO:tasks.workunit.client.1.smithi152.stdout:4/427: rename d3/d4/d33 to d3/d4/d6/d66/d2b/d84 0 2024-09-13T23:06:20.629 INFO:tasks.workunit.client.1.smithi152.stdout:4/428: dread - d3/d4/d6/d63/f7b zero size 2024-09-13T23:06:20.630 INFO:tasks.workunit.client.1.smithi152.stdout:6/349: dread d4/de/f39 [0,4194304] 0 2024-09-13T23:06:20.630 INFO:tasks.workunit.client.1.smithi152.stdout:6/350: dread - d4/de/d21/f6e zero size 2024-09-13T23:06:20.631 INFO:tasks.workunit.client.0.smithi115.stdout:7/912: sync 2024-09-13T23:06:20.632 INFO:tasks.workunit.client.1.smithi152.stdout:6/351: read d4/de/d12/d16/d2a/d38/f42 [177384,51105] 0 2024-09-13T23:06:20.632 INFO:tasks.workunit.client.1.smithi152.stdout:6/352: creat d4/de/d21/d5b/f77 x:0 0 0 2024-09-13T23:06:20.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/285: dwrite d18/d19/d2c/f30 [0,4194304] 0 2024-09-13T23:06:20.633 INFO:tasks.workunit.client.1.smithi152.stdout:0/286: creat d18/d1f/d29/d4e/f64 x:0 0 0 2024-09-13T23:06:20.633 INFO:tasks.workunit.client.1.smithi152.stdout:4/429: creat d3/d4/d6/d66/f85 x:0 0 0 2024-09-13T23:06:20.634 INFO:tasks.workunit.client.1.smithi152.stdout:6/353: truncate d4/de/d12/d16/f58 295913 0 2024-09-13T23:06:20.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/913: symlink da/dd/d13/d24/d52/da1/d117/l139 0 2024-09-13T23:06:20.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/914: chown da 79 1 2024-09-13T23:06:20.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/915: truncate da/dd/d13/d36/d85/f110 532795 0 2024-09-13T23:06:20.634 INFO:tasks.workunit.client.0.smithi115.stdout:7/916: stat da 0 2024-09-13T23:06:20.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/917: rmdir da/dd/d1c/d84/dde 0 2024-09-13T23:06:20.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/918: write da/dd/d1c/d2d/d45/d4d/f6f [4875287,15238] 0 2024-09-13T23:06:20.635 INFO:tasks.workunit.client.0.smithi115.stdout:7/919: fsync da/dd/d1c/d2d/f54 0 2024-09-13T23:06:20.636 INFO:tasks.workunit.client.0.smithi115.stdout:7/920: truncate da/dd/d13/fda 3481834 0 2024-09-13T23:06:20.636 INFO:tasks.workunit.client.1.smithi152.stdout:6/354: symlink d4/de/d21/l78 0 2024-09-13T23:06:20.637 INFO:tasks.workunit.client.1.smithi152.stdout:7/362: dread d17/f25 [0,4194304] 0 2024-09-13T23:06:20.638 INFO:tasks.workunit.client.1.smithi152.stdout:6/355: getdents d4/de/d1d 0 2024-09-13T23:06:20.638 INFO:tasks.workunit.client.1.smithi152.stdout:6/356: write d4/de/d21/f15 [3219253,91153] 0 2024-09-13T23:06:20.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/357: fsync d4/de/f2c 0 2024-09-13T23:06:20.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/358: mkdir d4/de/d1d/d79 0 2024-09-13T23:06:20.641 INFO:tasks.workunit.client.1.smithi152.stdout:1/340: dwrite d4/d9/d1a/d22/d24/d48/f66 [0,4194304] 0 2024-09-13T23:06:20.646 INFO:tasks.workunit.client.1.smithi152.stdout:1/341: link d4/d9/d1a/c42 d4/d9/d1a/c6d 0 2024-09-13T23:06:20.647 INFO:tasks.workunit.client.1.smithi152.stdout:6/359: dread d4/de/d12/d16/d2a/f2d [0,4194304] 0 2024-09-13T23:06:20.647 INFO:tasks.workunit.client.1.smithi152.stdout:6/360: stat d4/de/d12/d3e/c59 0 2024-09-13T23:06:20.647 INFO:tasks.workunit.client.1.smithi152.stdout:6/361: write d4/de/d12/f5f [996908,117947] 0 2024-09-13T23:06:20.647 INFO:tasks.workunit.client.1.smithi152.stdout:1/342: unlink d4/d4c/l59 0 2024-09-13T23:06:20.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/362: symlink d4/de/d21/d5b/l7a 0 2024-09-13T23:06:20.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/363: creat d4/de/d21/d5b/f7b x:0 0 0 2024-09-13T23:06:20.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/364: creat d4/de/d21/f7c x:0 0 0 2024-09-13T23:06:20.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/289: write d5/dc/d19/d20/d2e/f34 [2160496,127617] 0 2024-09-13T23:06:20.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/290: chown d5 86572164 1 2024-09-13T23:06:20.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/291: chown d5/dc/d19/d20/d2e/d28/l37 72923 1 2024-09-13T23:06:20.654 INFO:tasks.workunit.client.1.smithi152.stdout:5/292: creat d5/d26/f5d x:0 0 0 2024-09-13T23:06:20.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/287: read d18/d19/d2c/f30 [2586409,98750] 0 2024-09-13T23:06:20.654 INFO:tasks.workunit.client.1.smithi152.stdout:4/430: dread d3/d4/d6/f20 [0,4194304] 0 2024-09-13T23:06:20.655 INFO:tasks.workunit.client.1.smithi152.stdout:5/293: mkdir d5/dc/d5e 0 2024-09-13T23:06:20.655 INFO:tasks.workunit.client.1.smithi152.stdout:5/294: creat d5/dc/f5f x:0 0 0 2024-09-13T23:06:20.656 INFO:tasks.workunit.client.1.smithi152.stdout:0/288: mkdir d18/d1f/d33/d65 0 2024-09-13T23:06:20.657 INFO:tasks.workunit.client.1.smithi152.stdout:0/289: dread - d18/d1f/d29/d2f/d3d/f5e zero size 2024-09-13T23:06:20.657 INFO:tasks.workunit.client.1.smithi152.stdout:4/431: mkdir d3/d4/d32/d86 0 2024-09-13T23:06:20.658 INFO:tasks.workunit.client.1.smithi152.stdout:5/295: mknod d5/dc/d19/d20/d2e/c60 0 2024-09-13T23:06:20.659 INFO:tasks.workunit.client.1.smithi152.stdout:0/290: mkdir d18/d1f/d29/d3f/d4b/d66 0 2024-09-13T23:06:20.660 INFO:tasks.workunit.client.1.smithi152.stdout:5/296: rmdir d5/dc/d19/d20/d2e/d28 39 2024-09-13T23:06:20.662 INFO:tasks.workunit.client.1.smithi152.stdout:1/343: read d4/d9/f13 [2348150,82733] 0 2024-09-13T23:06:20.662 INFO:tasks.workunit.client.1.smithi152.stdout:1/344: chown d4/d9/d1a/f49 4030 1 2024-09-13T23:06:20.662 INFO:tasks.workunit.client.1.smithi152.stdout:0/291: rmdir d18/d5b 0 2024-09-13T23:06:20.662 INFO:tasks.workunit.client.1.smithi152.stdout:0/292: write d18/d1f/d29/d4e/f64 [367993,123678] 0 2024-09-13T23:06:20.663 INFO:tasks.workunit.client.1.smithi152.stdout:1/345: truncate d4/d9/d1a/d22/f29 3482065 0 2024-09-13T23:06:20.663 INFO:tasks.workunit.client.1.smithi152.stdout:1/346: chown d4/d9/f64 104 1 2024-09-13T23:06:20.664 INFO:tasks.workunit.client.1.smithi152.stdout:0/293: creat d18/d19/f67 x:0 0 0 2024-09-13T23:06:20.664 INFO:tasks.workunit.client.1.smithi152.stdout:0/294: creat d18/d1f/d33/f68 x:0 0 0 2024-09-13T23:06:20.664 INFO:tasks.workunit.client.1.smithi152.stdout:0/295: creat d18/d19/f69 x:0 0 0 2024-09-13T23:06:20.665 INFO:tasks.workunit.client.1.smithi152.stdout:1/347: mknod d4/d9/c6e 0 2024-09-13T23:06:20.665 INFO:tasks.workunit.client.1.smithi152.stdout:0/296: dread d18/d1f/d33/f36 [0,4194304] 0 2024-09-13T23:06:20.665 INFO:tasks.workunit.client.1.smithi152.stdout:0/297: truncate d18/d19/f67 551597 0 2024-09-13T23:06:20.665 INFO:tasks.workunit.client.1.smithi152.stdout:0/298: dread - d18/d1f/d33/f5a zero size 2024-09-13T23:06:20.667 INFO:tasks.workunit.client.1.smithi152.stdout:1/348: mknod d4/d9/d1a/c6f 0 2024-09-13T23:06:20.667 INFO:tasks.workunit.client.1.smithi152.stdout:4/432: write d3/f40 [995094,125405] 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/363: dwrite d17/d24/d2a/d2e/d30/f44 [4194304,4194304] 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/364: dread - d17/d24/d2a/d2b/f47 zero size 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/365: creat d17/d24/d2d/d51/d5b/f75 x:0 0 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/366: fdatasync d17/f1c 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/367: fsync d17/d24/d2a/d2b/f49 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/368: write d17/d24/d2a/d2b/d4b/f62 [2271869,71231] 0 2024-09-13T23:06:20.673 INFO:tasks.workunit.client.1.smithi152.stdout:7/369: creat d17/d24/d2a/d2e/f76 x:0 0 0 2024-09-13T23:06:20.675 INFO:tasks.workunit.client.1.smithi152.stdout:5/297: write d5/f22 [1859820,86783] 0 2024-09-13T23:06:20.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/370: getdents d17/d24/d2a/d2e/d59 0 2024-09-13T23:06:20.677 INFO:tasks.workunit.client.0.smithi115.stdout:7/921: dwrite da/dd/d1c/d2d/d45/f5f [0,4194304] 0 2024-09-13T23:06:20.677 INFO:tasks.workunit.client.0.smithi115.stdout:7/922: dread - da/dd/d13/d36/d5a/f102 zero size 2024-09-13T23:06:20.680 INFO:tasks.workunit.client.0.smithi115.stdout:7/923: mknod da/dd/c13a 0 2024-09-13T23:06:20.680 INFO:tasks.workunit.client.0.smithi115.stdout:7/924: fsync da/df/d3b/f119 0 2024-09-13T23:06:20.680 INFO:tasks.workunit.client.0.smithi115.stdout:7/925: dread - da/df/d3b/f119 zero size 2024-09-13T23:06:20.680 INFO:tasks.workunit.client.0.smithi115.stdout:7/926: getdents da/dd/d1c/d2d/d45/d4d/d133 0 2024-09-13T23:06:20.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/298: getdents d5/dc/d35 0 2024-09-13T23:06:20.693 INFO:tasks.workunit.client.0.smithi115.stdout:1/933: sync 2024-09-13T23:06:20.693 INFO:tasks.workunit.client.1.smithi152.stdout:4/433: dwrite d3/d4/d6/d66/f6f [0,4194304] 0 2024-09-13T23:06:20.694 INFO:tasks.workunit.client.0.smithi115.stdout:7/927: dread da/dd/d1c/d2d/d45/d4d/f6f [0,4194304] 0 2024-09-13T23:06:20.694 INFO:tasks.workunit.client.0.smithi115.stdout:1/934: link d0/de/df8/d10c/d25/d4d/d51/d31/d79/fc2 d0/de/df8/d10c/d25/d4d/f133 0 2024-09-13T23:06:20.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/299: dwrite f0 [0,4194304] 0 2024-09-13T23:06:20.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/300: stat d18/f26 0 2024-09-13T23:06:20.695 INFO:tasks.workunit.client.0.smithi115.stdout:7/928: mkdir da/dd/d1c/d2d/d41/d98/ddf/d13b 0 2024-09-13T23:06:20.695 INFO:tasks.workunit.client.0.smithi115.stdout:7/929: chown da/dd/d1c/d2d/d60/d82/de6 0 1 2024-09-13T23:06:20.695 INFO:tasks.workunit.client.0.smithi115.stdout:7/930: fdatasync da/dd/d1c/fad 0 2024-09-13T23:06:20.697 INFO:tasks.workunit.client.1.smithi152.stdout:0/301: dread d18/d1f/d33/f36 [0,4194304] 0 2024-09-13T23:06:20.697 INFO:tasks.workunit.client.1.smithi152.stdout:0/302: chown d18/d1f/d39/l3a 584 1 2024-09-13T23:06:20.697 INFO:tasks.workunit.client.1.smithi152.stdout:0/303: mkdir d18/d1f/d29/d3f/d4b/d66/d6a 0 2024-09-13T23:06:20.697 INFO:tasks.workunit.client.1.smithi152.stdout:7/371: dwrite d17/d24/d2a/f54 [0,4194304] 0 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.1.smithi152.stdout:0/304: creat d18/d1f/d29/d3f/d4b/d66/d6a/f6b x:0 0 0 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.1.smithi152.stdout:0/305: chown d18/d1f/d29/d3f/f59 1652 1 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.0.smithi115.stdout:1/935: rename d0/de/df8/d10c/d11e/d8f/d29/f39 to d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/f134 0 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.0.smithi115.stdout:1/936: chown d0/de/df8/d10c/d25/d4d 25264 1 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.0.smithi115.stdout:7/931: creat da/d53/f13c x:0 0 0 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.0.smithi115.stdout:7/932: stat da/dd/d13/d36/d5a/c5c 0 2024-09-13T23:06:20.698 INFO:tasks.workunit.client.0.smithi115.stdout:7/933: chown da/dd/d13/d36/d5a/d99/ddd/d92 23 1 2024-09-13T23:06:20.700 INFO:tasks.workunit.client.0.smithi115.stdout:7/934: creat da/dd/d13/d36/d5a/d99/ddd/d92/db1/dd8/f13d x:0 0 0 2024-09-13T23:06:20.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/372: mkdir d17/d24/d77 0 2024-09-13T23:06:20.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/306: rename d18/d1f/d33/c58 to d18/d1f/d33/c6c 0 2024-09-13T23:06:20.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/307: chown d18/d1f/d33 0 1 2024-09-13T23:06:20.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/308: creat d18/d19/d2c/f6d x:0 0 0 2024-09-13T23:06:20.702 INFO:tasks.workunit.client.1.smithi152.stdout:7/373: creat d17/d4f/f78 x:0 0 0 2024-09-13T23:06:20.702 INFO:tasks.workunit.client.1.smithi152.stdout:7/374: dread - d17/d24/d2a/d2e/f76 zero size 2024-09-13T23:06:20.703 INFO:tasks.workunit.client.1.smithi152.stdout:4/434: dread d3/d4/d6/d66/d1c/f27 [0,4194304] 0 2024-09-13T23:06:20.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/935: rename da/dd/d13/d36/d85/cf3 to da/dd/d13/d36/d5a/d6d/d8f/c13e 0 2024-09-13T23:06:20.704 INFO:tasks.workunit.client.0.smithi115.stdout:7/936: creat da/dd/d13/d36/d85/f13f x:0 0 0 2024-09-13T23:06:20.704 INFO:tasks.workunit.client.1.smithi152.stdout:7/375: mkdir d17/d24/d2a/d2e/d79 0 2024-09-13T23:06:20.704 INFO:tasks.workunit.client.1.smithi152.stdout:0/309: write d18/f2d [98135,79163] 0 2024-09-13T23:06:20.705 INFO:tasks.workunit.client.1.smithi152.stdout:4/435: dread d3/d4/d6/f20 [0,4194304] 0 2024-09-13T23:06:20.705 INFO:tasks.workunit.client.1.smithi152.stdout:4/436: fdatasync d3/f40 0 2024-09-13T23:06:20.705 INFO:tasks.workunit.client.0.smithi115.stdout:7/937: rmdir da/dd/d13/d24/d67/d81 39 2024-09-13T23:06:20.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/310: unlink d18/d1f/d33/c3c 0 2024-09-13T23:06:20.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/311: write d18/d19/f69 [657307,91546] 0 2024-09-13T23:06:20.706 INFO:tasks.workunit.client.1.smithi152.stdout:4/437: mknod d3/d4/d6/d8/d17/c87 0 2024-09-13T23:06:20.707 INFO:tasks.workunit.client.1.smithi152.stdout:0/312: mkdir d18/d1f/d33/d6e 0 2024-09-13T23:06:20.707 INFO:tasks.workunit.client.1.smithi152.stdout:4/438: getdents d3/d4/d6/d66/d1c/d59 0 2024-09-13T23:06:20.708 INFO:tasks.workunit.client.1.smithi152.stdout:4/439: truncate d3/d4/d6/d66/d1c/d59/f68 393047 0 2024-09-13T23:06:20.708 INFO:tasks.workunit.client.1.smithi152.stdout:4/440: stat d3/f83 0 2024-09-13T23:06:20.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/313: rmdir d18/d1f/d29/d3f 39 2024-09-13T23:06:20.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/314: dread - d18/d1f/f48 zero size 2024-09-13T23:06:20.711 INFO:tasks.workunit.client.1.smithi152.stdout:4/441: dread d3/d4/d6/d66/d1c/f41 [0,4194304] 0 2024-09-13T23:06:20.713 INFO:tasks.workunit.client.0.smithi115.stdout:7/938: write da/dd/d1c/d2d/d45/f5f [2436969,92478] 0 2024-09-13T23:06:20.713 INFO:tasks.workunit.client.0.smithi115.stdout:7/939: write da/dd/d1c/d2d/f70 [2015001,125357] 0 2024-09-13T23:06:20.715 INFO:tasks.workunit.client.0.smithi115.stdout:7/940: symlink da/dd/d13/d36/d5a/d99/ddd/d92/db1/l140 0 2024-09-13T23:06:20.715 INFO:tasks.workunit.client.1.smithi152.stdout:4/442: rename d3/d4/d6/f67 to d3/d4/d6/d66/f88 0 2024-09-13T23:06:20.716 INFO:tasks.workunit.client.0.smithi115.stdout:7/941: symlink da/l141 0 2024-09-13T23:06:20.716 INFO:tasks.workunit.client.0.smithi115.stdout:7/942: dread - da/dd/d13/d24/d52/d7c/da7/fef zero size 2024-09-13T23:06:20.716 INFO:tasks.workunit.client.0.smithi115.stdout:7/943: creat da/dd/f142 x:0 0 0 2024-09-13T23:06:20.717 INFO:tasks.workunit.client.0.smithi115.stdout:1/937: dwrite d0/de/d71/fe7 [0,4194304] 0 2024-09-13T23:06:20.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail 2024-09-13T23:06:20.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: Standby manager daemon smithi115.eqesbc started 2024-09-13T23:06:20.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/crt"}]: dispatch 2024-09-13T23:06:20.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:06:20.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/key"}]: dispatch 2024-09-13T23:06:20.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:20 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/2286684825' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:06:20.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/443: dread d3/d4/d6/d66/f42 [0,4194304] 0 2024-09-13T23:06:20.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/444: dread - d3/f83 zero size 2024-09-13T23:06:20.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/445: rename d3/d4/d6/d66/d1c/d59/l73 to d3/d4/d6/d63/d79/l89 0 2024-09-13T23:06:20.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/446: fsync d3/d4/d6/d66/d1c/f27 0 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:4/447: mkdir d3/d4/d6/d63/d79/d7d/d8a 0 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:4/448: truncate d3/d4/d6/d63/f7b 636731 0 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:4/449: chown d3/d4/d6/d8/d17/d5d 224376466 1 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:4/450: fsync d3/d4/d32/f45 0 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.1.smithi152.stdout:4/451: chown d3/d34/l46 68938850 1 2024-09-13T23:06:20.731 INFO:tasks.workunit.client.0.smithi115.stdout:1/938: dread d0/de/df8/d10c/d11e/d8f/d29/f4e [0,4194304] 0 2024-09-13T23:06:20.732 INFO:tasks.workunit.client.0.smithi115.stdout:1/939: mkdir d0/de/df8/d10c/d25/d4d/d51/d31/d135 0 2024-09-13T23:06:20.733 INFO:tasks.workunit.client.0.smithi115.stdout:1/940: symlink d0/de/df8/d10c/d25/d4d/d51/d23/d65/l136 0 2024-09-13T23:06:20.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/315: dwrite d18/d1f/d29/d3f/d4b/f57 [0,4194304] 0 2024-09-13T23:06:20.737 INFO:tasks.workunit.client.0.smithi115.stdout:7/944: dwrite da/dd/d13/d36/fa9 [0,4194304] 0 2024-09-13T23:06:20.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/316: creat d18/d1f/d29/f6f x:0 0 0 2024-09-13T23:06:20.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/317: dread - f13 zero size 2024-09-13T23:06:20.739 INFO:tasks.workunit.client.0.smithi115.stdout:7/945: rename da/dd/d1c/f124 to da/dd/d1c/d2d/d45/d4d/f143 0 2024-09-13T23:06:20.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/452: write d3/d4/d6/f14 [1456994,43320] 0 2024-09-13T23:06:20.742 INFO:tasks.workunit.client.1.smithi152.stdout:4/453: mkdir d3/d4/d6/d66/d1c/d5f/d8b 0 2024-09-13T23:06:20.745 INFO:tasks.workunit.client.0.smithi115.stdout:7/946: rename da/d53 to da/dd/d1c/d2d/d41/d144 0 2024-09-13T23:06:20.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/454: rename d3/d4/l30 to d3/d4/d6/d66/d1c/l8c 0 2024-09-13T23:06:20.747 INFO:tasks.workunit.client.0.smithi115.stdout:7/947: rename da/dd/d13/d24/d67/d81/f127 to da/df/f145 0 2024-09-13T23:06:20.751 INFO:tasks.workunit.client.0.smithi115.stdout:7/948: dread da/dd/d13/d36/fc4 [0,4194304] 0 2024-09-13T23:06:20.752 INFO:tasks.workunit.client.0.smithi115.stdout:7/949: symlink da/dd/d13/d24/d52/d7c/da7/dea/l146 0 2024-09-13T23:06:20.753 INFO:tasks.workunit.client.0.smithi115.stdout:7/950: dread - da/dd/d13/d36/d85/f13f zero size 2024-09-13T23:06:20.753 INFO:tasks.workunit.client.0.smithi115.stdout:7/951: stat da/dd/d1c/d2d/fd9 0 2024-09-13T23:06:20.753 INFO:tasks.workunit.client.0.smithi115.stdout:7/952: fdatasync da/ff7 0 2024-09-13T23:06:20.753 INFO:tasks.workunit.client.0.smithi115.stdout:7/953: symlink da/dd/d1c/d2d/l147 0 2024-09-13T23:06:20.754 INFO:tasks.workunit.client.0.smithi115.stdout:7/954: truncate da/dd/d1c/d2d/d45/d4d/f143 855016 0 2024-09-13T23:06:20.769 INFO:tasks.workunit.client.0.smithi115.stdout:7/955: read da/dd/d13/d36/f42 [1785,7902] 0 2024-09-13T23:06:20.769 INFO:tasks.workunit.client.0.smithi115.stdout:7/956: mknod da/dd/d1c/d84/c148 0 2024-09-13T23:06:20.769 INFO:tasks.workunit.client.0.smithi115.stdout:7/957: readlink da/l141 0 2024-09-13T23:06:20.774 INFO:tasks.workunit.client.1.smithi152.stdout:0/318: dwrite d18/d19/d2c/f6d [0,4194304] 0 2024-09-13T23:06:20.774 INFO:tasks.workunit.client.0.smithi115.stdout:1/941: dwrite d0/fb0 [4194304,4194304] 0 2024-09-13T23:06:20.774 INFO:tasks.workunit.client.0.smithi115.stdout:1/942: stat d0/de/df8/d10c/d25/d67/f6e 0 2024-09-13T23:06:20.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/455: dwrite d3/d4/d6/d66/d1c/f41 [0,4194304] 0 2024-09-13T23:06:20.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/456: fsync d3/d4/d6/d66/f49 0 2024-09-13T23:06:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/319: mkdir d18/d1f/d29/d3f/d4b/d66/d70 0 2024-09-13T23:06:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/320: dread - d18/d1f/d39/f43 zero size 2024-09-13T23:06:20.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/321: dread - d18/d1f/d29/d3f/f59 zero size 2024-09-13T23:06:20.783 INFO:tasks.workunit.client.1.smithi152.stdout:4/457: rename d3/d4/d6/d37 to d3/d4/d8d 0 2024-09-13T23:06:20.783 INFO:tasks.workunit.client.1.smithi152.stdout:0/322: mknod d18/d1f/d29/c71 0 2024-09-13T23:06:20.784 INFO:tasks.workunit.client.0.smithi115.stdout:7/958: dwrite da/dd/d13/d36/d5a/d6d/d8f/fcd [0,4194304] 0 2024-09-13T23:06:20.784 INFO:tasks.workunit.client.0.smithi115.stdout:7/959: dread - da/dd/d13/d24/f12f zero size 2024-09-13T23:06:20.785 INFO:tasks.workunit.client.1.smithi152.stdout:0/323: rename d18/d1f/d29/d3f/f56 to d18/d1f/f72 0 2024-09-13T23:06:20.785 INFO:tasks.workunit.client.1.smithi152.stdout:0/324: truncate d18/f1b 5210562 0 2024-09-13T23:06:20.787 INFO:tasks.workunit.client.0.smithi115.stdout:1/943: truncate d0/de/df8/d10c/d11e/d8f/d29/d47/d74/dcb/f130 1611009 0 2024-09-13T23:06:20.787 INFO:tasks.workunit.client.0.smithi115.stdout:1/944: write d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/f11b [915947,95608] 0 2024-09-13T23:06:20.788 INFO:tasks.workunit.client.0.smithi115.stdout:7/960: symlink da/dd/d16/d11c/l149 0 2024-09-13T23:06:20.788 INFO:tasks.workunit.client.0.smithi115.stdout:7/961: truncate da/dd/d13/d24/d52/ff6 593312 0 2024-09-13T23:06:20.789 INFO:tasks.workunit.client.0.smithi115.stdout:1/945: truncate d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/da3/f114 3613165 0 2024-09-13T23:06:20.791 INFO:tasks.workunit.client.0.smithi115.stdout:7/962: truncate da/dd/d13/d36/d5a/d99/ddd/fed 34722 0 2024-09-13T23:06:20.792 INFO:tasks.workunit.client.0.smithi115.stdout:1/946: rename d0/de/df8/d10c/f99 to d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/f137 0 2024-09-13T23:06:20.795 INFO:tasks.workunit.client.0.smithi115.stdout:7/963: creat da/dd/d1c/d2d/d45/d121/f14a x:0 0 0 2024-09-13T23:06:20.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/325: dwrite d18/f26 [4194304,4194304] 0 2024-09-13T23:06:20.807 INFO:tasks.workunit.client.1.smithi152.stdout:0/326: link d18/d1f/d33/c4a d18/d1f/d39/c73 0 2024-09-13T23:06:20.808 INFO:tasks.workunit.client.1.smithi152.stdout:0/327: mkdir d18/d19/d74 0 2024-09-13T23:06:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:0/328: mknod d18/d19/c75 0 2024-09-13T23:06:20.809 INFO:tasks.workunit.client.1.smithi152.stdout:0/329: dread - d18/d1f/d29/d3f/f59 zero size 2024-09-13T23:06:20.852 INFO:tasks.workunit.client.1.smithi152.stdout:4/458: dwrite d3/d4/d6/d66/d1c/f1e [4194304,4194304] 0 2024-09-13T23:06:20.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/459: rename d3/d4/d6/d63/d79/d7d/d8a to d3/d4/d6/d66/d2b/d8e 0 2024-09-13T23:06:20.856 INFO:tasks.workunit.client.1.smithi152.stdout:4/460: unlink d3/d4/d6/d66/f3d 0 2024-09-13T23:06:20.856 INFO:tasks.workunit.client.1.smithi152.stdout:4/461: write d3/d4/d6/f1a [1933738,106335] 0 2024-09-13T23:06:20.856 INFO:tasks.workunit.client.1.smithi152.stdout:4/462: fsync d3/d4/d6/f35 0 2024-09-13T23:06:20.857 INFO:tasks.workunit.client.1.smithi152.stdout:4/463: creat d3/d4/d6/d8/f8f x:0 0 0 2024-09-13T23:06:20.859 INFO:tasks.workunit.client.1.smithi152.stdout:0/330: dwrite d18/d1f/d29/d4e/f62 [0,4194304] 0 2024-09-13T23:06:20.859 INFO:tasks.workunit.client.1.smithi152.stdout:4/464: link d3/f40 d3/d4/d6/d8/d17/d5d/f90 0 2024-09-13T23:06:20.861 INFO:tasks.workunit.client.1.smithi152.stdout:0/331: link d18/d19/d2c/f30 d18/d1f/d39/f76 0 2024-09-13T23:06:20.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/332: stat d18/d1f/d29/d2f/l38 0 2024-09-13T23:06:20.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/465: symlink d3/d4/d32/l91 0 2024-09-13T23:06:20.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/466: read d3/d4/d6/f20 [243796,44993] 0 2024-09-13T23:06:20.864 INFO:tasks.workunit.client.1.smithi152.stdout:0/333: mknod d18/d1f/d29/d2f/c77 0 2024-09-13T23:06:20.864 INFO:tasks.workunit.client.1.smithi152.stdout:0/334: mknod d18/d1f/d29/d3f/d4b/d66/c78 0 2024-09-13T23:06:20.866 INFO:tasks.workunit.client.1.smithi152.stdout:0/335: creat d18/d1f/f79 x:0 0 0 2024-09-13T23:06:20.871 INFO:tasks.workunit.client.1.smithi152.stdout:4/467: dread d3/d4/f22 [0,4194304] 0 2024-09-13T23:06:20.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/468: unlink d3/d4/d6/d66/l72 0 2024-09-13T23:06:20.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/469: fdatasync d3/d4/d6/d66/d1c/f1e 0 2024-09-13T23:06:20.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/470: link d3/d4/d6/d66/d1c/d59/c5e d3/d4/d6/d8/d17/d5d/c92 0 2024-09-13T23:06:20.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/336: dwrite d18/d1f/d29/d2f/d3d/f4c [0,4194304] 0 2024-09-13T23:06:20.883 INFO:tasks.workunit.client.1.smithi152.stdout:0/337: mkdir d18/d1f/d33/d65/d7a 0 2024-09-13T23:06:20.883 INFO:tasks.workunit.client.1.smithi152.stdout:0/338: chown d18 450076 1 2024-09-13T23:06:20.884 INFO:tasks.workunit.client.1.smithi152.stdout:0/339: creat d18/d1f/d33/d65/f7b x:0 0 0 2024-09-13T23:06:20.889 INFO:tasks.workunit.client.1.smithi152.stdout:0/340: mkdir d18/d1f/d39/d7c 0 2024-09-13T23:06:20.889 INFO:tasks.workunit.client.1.smithi152.stdout:0/341: chown f0 157376798 1 2024-09-13T23:06:20.889 INFO:tasks.workunit.client.1.smithi152.stdout:0/342: truncate d18/d1f/d39/f43 728566 0 2024-09-13T23:06:20.889 INFO:tasks.workunit.client.1.smithi152.stdout:0/343: chown d18/d1f/d29/d3f/d4b/f57 1 1 2024-09-13T23:06:20.889 INFO:tasks.workunit.client.1.smithi152.stdout:4/471: write d3/d4/d6/d66/d62/f6a [4431180,91853] 0 2024-09-13T23:06:20.893 INFO:tasks.workunit.client.1.smithi152.stdout:4/472: write d3/f4f [433435,119534] 0 2024-09-13T23:06:20.893 INFO:tasks.workunit.client.1.smithi152.stdout:4/473: chown d3/d4/d6/f20 65337 1 2024-09-13T23:06:20.896 INFO:tasks.workunit.client.1.smithi152.stdout:4/474: mkdir d3/d4/d8d/d93 0 2024-09-13T23:06:20.901 INFO:tasks.workunit.client.1.smithi152.stdout:4/475: dread d3/d4/d6/d66/f42 [0,4194304] 0 2024-09-13T23:06:20.901 INFO:tasks.workunit.client.1.smithi152.stdout:4/476: truncate d3/d4/d6/d8/d17/d3a/f77 239915 0 2024-09-13T23:06:20.901 INFO:tasks.workunit.client.1.smithi152.stdout:4/477: write d3/d4/d6/d8/f1b [120039,94483] 0 2024-09-13T23:06:20.904 INFO:tasks.workunit.client.1.smithi152.stdout:0/344: dwrite d18/d19/d2c/f6d [4194304,4194304] 0 2024-09-13T23:06:20.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/345: getdents d18/d1f/d33/d65/d7a 0 2024-09-13T23:06:20.907 INFO:tasks.workunit.client.1.smithi152.stdout:0/346: link d18/d1f/f48 d18/d1f/f7d 0 2024-09-13T23:06:20.908 INFO:tasks.workunit.client.1.smithi152.stdout:0/347: write d18/f2d [120422,38372] 0 2024-09-13T23:06:20.908 INFO:tasks.workunit.client.1.smithi152.stdout:0/348: readlink d18/d19/l61 0 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/349: creat d18/d1f/d33/d6e/f7e x:0 0 0 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/350: fsync d18/d1f/d29/d2f/d3d/f49 0 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/351: chown d18/d1f/d33/f36 9146 1 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/352: dread - d18/d1f/d29/d3f/d4b/d66/d6a/f6b zero size 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/353: truncate d18/d1f/d29/d2f/d3d/f4c 5206425 0 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/354: creat d18/d1f/d33/f7f x:0 0 0 2024-09-13T23:06:20.913 INFO:tasks.workunit.client.1.smithi152.stdout:0/355: readlink d18/d19/l24 0 2024-09-13T23:06:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/356: dwrite f13 [0,4194304] 0 2024-09-13T23:06:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:4/478: dwrite d3/d4/d6/d66/d1c/f27 [0,4194304] 0 2024-09-13T23:06:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:4/479: write d3/d4/d6/d66/f42 [5219221,30959] 0 2024-09-13T23:06:20.933 INFO:tasks.workunit.client.1.smithi152.stdout:4/480: stat d3/d4/d32/l6b 0 2024-09-13T23:06:20.934 INFO:tasks.workunit.client.1.smithi152.stdout:4/481: write d3/d4/d8d/f55 [155964,64091] 0 2024-09-13T23:06:20.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/357: rename d18/d1f/d29/c71 to d18/d1f/d33/d6e/c80 0 2024-09-13T23:06:20.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/358: creat d18/d19/f81 x:0 0 0 2024-09-13T23:06:20.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/359: fdatasync d18/d1f/d33/f7f 0 2024-09-13T23:06:20.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/360: write d18/d1f/f20 [510465,31293] 0 2024-09-13T23:06:20.937 INFO:tasks.workunit.client.1.smithi152.stdout:4/482: dread d3/d4/d6/d66/f7 [0,4194304] 0 2024-09-13T23:06:20.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/361: creat d18/d1f/d29/d3f/d4b/d66/d6a/f82 x:0 0 0 2024-09-13T23:06:20.941 INFO:tasks.workunit.client.1.smithi152.stdout:4/483: mkdir d3/d4/d6/d8/d17/d5d/d94 0 2024-09-13T23:06:20.941 INFO:tasks.workunit.client.1.smithi152.stdout:4/484: truncate d3/d4/d6/d66/d62/f6a 9751695 0 2024-09-13T23:06:20.941 INFO:tasks.workunit.client.1.smithi152.stdout:4/485: truncate d3/d4/d6/d66/f6f 4932465 0 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/349: sync 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:2/383: sync 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/321: sync 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/350: stat d3/d1e/d30/l70 0 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/351: stat d3/d24/c22 0 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:0/362: mkdir d18/d1f/d33/d65/d7a/d83 0 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:0/363: dread - d18/d1f/f48 zero size 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:0/364: stat d18/d1f/d29/d3f/d4b/d66/c78 0 2024-09-13T23:06:20.944 INFO:tasks.workunit.client.1.smithi152.stdout:4/486: dread d3/d4/d6/f35 [0,4194304] 0 2024-09-13T23:06:20.945 INFO:tasks.workunit.client.1.smithi152.stdout:3/322: unlink de/d1f/l53 0 2024-09-13T23:06:20.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/365: fsync d18/d1f/f20 0 2024-09-13T23:06:20.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/366: chown d18/d19/l61 92 1 2024-09-13T23:06:20.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/367: readlink d18/d19/l2e 0 2024-09-13T23:06:20.946 INFO:tasks.workunit.client.1.smithi152.stdout:2/384: symlink d0/d4/d9/d14/l89 0 2024-09-13T23:06:20.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/323: mknod de/d14/d47/d70/c71 0 2024-09-13T23:06:20.948 INFO:tasks.workunit.client.1.smithi152.stdout:0/368: dread d18/d1f/d29/d4e/f64 [0,4194304] 0 2024-09-13T23:06:20.948 INFO:tasks.workunit.client.1.smithi152.stdout:9/352: getdents d3/d24 0 2024-09-13T23:06:20.950 INFO:tasks.workunit.client.1.smithi152.stdout:9/353: dread d3/d24/f20 [0,4194304] 0 2024-09-13T23:06:20.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/385: unlink d0/d4/d9/d18/d1e/d3c/l76 0 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:0/369: mknod d18/d1f/d39/c84 0 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/376: sync 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:1/349: sync 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:5/299: sync 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:8/262: sync 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/365: sync 2024-09-13T23:06:20.951 INFO:tasks.workunit.client.1.smithi152.stdout:5/300: fdatasync d5/f22 0 2024-09-13T23:06:20.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/354: symlink d3/l76 0 2024-09-13T23:06:20.954 INFO:tasks.workunit.client.1.smithi152.stdout:8/263: dread d17/d19/f28 [0,4194304] 0 2024-09-13T23:06:20.956 INFO:tasks.workunit.client.1.smithi152.stdout:6/366: dread d4/de/d1d/f2f [0,4194304] 0 2024-09-13T23:06:20.956 INFO:tasks.workunit.client.1.smithi152.stdout:2/386: mkdir d0/d4/d8a 0 2024-09-13T23:06:20.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/387: creat d0/d8/f8b x:0 0 0 2024-09-13T23:06:20.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/388: fdatasync d0/d4/f1a 0 2024-09-13T23:06:20.957 INFO:tasks.workunit.client.1.smithi152.stdout:0/370: creat d18/d1f/d39/f85 x:0 0 0 2024-09-13T23:06:20.957 INFO:tasks.workunit.client.1.smithi152.stdout:0/371: write d18/d1f/d29/d3f/f59 [213793,46923] 0 2024-09-13T23:06:20.958 INFO:tasks.workunit.client.1.smithi152.stdout:3/324: dread de/f1c [0,4194304] 0 2024-09-13T23:06:20.958 INFO:tasks.workunit.client.1.smithi152.stdout:1/350: rmdir d4/d47 39 2024-09-13T23:06:20.959 INFO:tasks.workunit.client.1.smithi152.stdout:9/355: mknod d3/d52/c77 0 2024-09-13T23:06:20.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/389: dread d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:20.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/487: dwrite d3/d4/d6/f14 [0,4194304] 0 2024-09-13T23:06:20.961 INFO:tasks.workunit.client.0.smithi115.stdout:7/964: sync 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.0.smithi115.stdout:1/947: sync 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.0.smithi115.stdout:7/965: write da/ff7 [589169,55228] 0 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.0.smithi115.stdout:7/966: stat da/dd/d13/d36 0 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.0.smithi115.stdout:7/967: stat da/dd/d1c/d2d/d41/de1/df8/f11a 0 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.1.smithi152.stdout:8/264: rename f3 to d17/d25/d32/d50/f57 0 2024-09-13T23:06:20.962 INFO:tasks.workunit.client.1.smithi152.stdout:8/265: read - d17/d23/f4f zero size 2024-09-13T23:06:20.963 INFO:tasks.workunit.client.0.smithi115.stdout:7/968: dread da/df/f96 [0,4194304] 0 2024-09-13T23:06:20.963 INFO:tasks.workunit.client.0.smithi115.stdout:7/969: chown da/dd/d1c/d2d/d60/d82 30 1 2024-09-13T23:06:20.963 INFO:tasks.workunit.client.0.smithi115.stdout:7/970: creat da/dd/d1c/d84/f14b x:0 0 0 2024-09-13T23:06:20.966 INFO:tasks.workunit.client.1.smithi152.stdout:6/367: mknod d4/de/d21/d5b/c7d 0 2024-09-13T23:06:20.966 INFO:tasks.workunit.client.1.smithi152.stdout:6/368: creat d4/de/d12/d16/f7e x:0 0 0 2024-09-13T23:06:20.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/325: mkdir de/d14/d47/d70/d72 0 2024-09-13T23:06:20.970 INFO:tasks.workunit.client.1.smithi152.stdout:1/351: symlink d4/d9/d1a/l70 0 2024-09-13T23:06:20.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/372: write d18/d1f/d29/d2f/d3d/f49 [3711049,38717] 0 2024-09-13T23:06:20.972 INFO:tasks.workunit.client.1.smithi152.stdout:0/373: readlink d18/d19/l37 0 2024-09-13T23:06:20.973 INFO:tasks.workunit.client.1.smithi152.stdout:7/377: rmdir d17/d24/d2d/d51 39 2024-09-13T23:06:20.976 INFO:tasks.workunit.client.1.smithi152.stdout:4/488: mkdir d3/d4/d32/d86/d95 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/369: mknod d4/de/d12/d16/d2a/d38/c7f 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/370: fsync d4/de/d12/d16/d2a/f71 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/371: fdatasync d4/de/d21/d5c/f67 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/372: fdatasync d4/de/d21/d5c/f6d 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/373: write d4/de/d21/d5b/f77 [893260,39546] 0 2024-09-13T23:06:20.977 INFO:tasks.workunit.client.1.smithi152.stdout:3/326: creat de/d14/d47/d70/f73 x:0 0 0 2024-09-13T23:06:20.978 INFO:tasks.workunit.client.1.smithi152.stdout:4/489: dread d3/f13 [0,4194304] 0 2024-09-13T23:06:20.978 INFO:tasks.workunit.client.1.smithi152.stdout:1/352: mkdir d4/d9/d71 0 2024-09-13T23:06:20.979 INFO:tasks.workunit.client.1.smithi152.stdout:0/374: creat d18/d1f/d33/d65/d7a/d83/f86 x:0 0 0 2024-09-13T23:06:20.980 INFO:tasks.workunit.client.1.smithi152.stdout:7/378: creat d17/d24/d2d/d46/f7a x:0 0 0 2024-09-13T23:06:20.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/379: chown d17/d24/l40 3912544 1 2024-09-13T23:06:20.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/380: fsync d17/f1e 0 2024-09-13T23:06:20.982 INFO:tasks.workunit.client.1.smithi152.stdout:9/356: unlink d3/d24/d67/d4a/l65 0 2024-09-13T23:06:20.982 INFO:tasks.workunit.client.0.smithi115.stdout:7/971: dread da/dd/d1c/d2d/d45/d4d/f73 [0,4194304] 0 2024-09-13T23:06:20.982 INFO:tasks.workunit.client.0.smithi115.stdout:7/972: chown da/dd/d13/d36/d5a/d99/ddd/d92/db1/dd8/lf9 333 1 2024-09-13T23:06:20.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/374: mknod d4/de/d12/c80 0 2024-09-13T23:06:20.983 INFO:tasks.workunit.client.1.smithi152.stdout:3/327: truncate de/d14/d47/d57/d5d/f2b 1349002 0 2024-09-13T23:06:20.984 INFO:tasks.workunit.client.0.smithi115.stdout:7/973: creat da/dd/d1c/d2d/d41/d98/ddf/d13b/f14c x:0 0 0 2024-09-13T23:06:20.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/375: symlink d18/d1f/d33/d65/l87 0 2024-09-13T23:06:20.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/376: chown d18/d1f/d39/f43 6 1 2024-09-13T23:06:20.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/381: rename d17/d24/d2d/d46/f7a to d17/d24/d2a/d2b/d4b/d4d/f7b 0 2024-09-13T23:06:20.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/382: fdatasync d17/d24/d2d/d46/f48 0 2024-09-13T23:06:20.988 INFO:tasks.workunit.client.1.smithi152.stdout:5/301: dwrite d5/dc/d35/f4b [0,4194304] 0 2024-09-13T23:06:20.988 INFO:tasks.workunit.client.1.smithi152.stdout:5/302: write d5/f3f [1574871,120829] 0 2024-09-13T23:06:20.988 INFO:tasks.workunit.client.1.smithi152.stdout:9/357: symlink d3/d24/l78 0 2024-09-13T23:06:20.988 INFO:tasks.workunit.client.1.smithi152.stdout:9/358: truncate d3/d1e/d30/f6c 1887890 0 2024-09-13T23:06:20.988 INFO:tasks.workunit.client.1.smithi152.stdout:9/359: chown d3/f28 4069755 1 2024-09-13T23:06:20.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/383: symlink d17/d24/d2a/l7c 0 2024-09-13T23:06:20.989 INFO:tasks.workunit.client.1.smithi152.stdout:0/377: mknod d18/d1f/d33/d65/d7a/d83/c88 0 2024-09-13T23:06:20.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/384: truncate d17/d24/d2a/d2b/d4b/d4d/f7b 447032 0 2024-09-13T23:06:20.991 INFO:tasks.workunit.client.1.smithi152.stdout:5/303: mkdir d5/d26/d61 0 2024-09-13T23:06:20.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/360: dread d3/d24/d67/d47/f51 [0,4194304] 0 2024-09-13T23:06:20.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/361: chown d3/d24/d67/d60/f69 2615 1 2024-09-13T23:06:20.994 INFO:tasks.workunit.client.1.smithi152.stdout:1/353: dread d4/d9/d1a/d22/f3b [0,4194304] 0 2024-09-13T23:06:20.996 INFO:tasks.workunit.client.1.smithi152.stdout:9/362: creat d3/d24/d67/d4a/f79 x:0 0 0 2024-09-13T23:06:20.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/304: rmdir d5/dc/d19/d20/d2e/d27 39 2024-09-13T23:06:20.997 INFO:tasks.workunit.client.1.smithi152.stdout:9/363: truncate d3/f17 1702757 0 2024-09-13T23:06:20.998 INFO:tasks.workunit.client.1.smithi152.stdout:9/364: chown d3/f28 8415030 1 2024-09-13T23:06:20.998 INFO:tasks.workunit.client.0.smithi115.stdout:1/948: dwrite d0/de/df8/d10c/d11e/d8f/dad/ddb/de5/f9a [4194304,4194304] 0 2024-09-13T23:06:20.998 INFO:tasks.workunit.client.0.smithi115.stdout:1/949: dread - d0/de/fd2 zero size 2024-09-13T23:06:21.000 INFO:tasks.workunit.client.1.smithi152.stdout:9/365: mknod d3/c7a 0 2024-09-13T23:06:21.001 INFO:tasks.workunit.client.0.smithi115.stdout:1/950: creat d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/f138 x:0 0 0 2024-09-13T23:06:21.003 INFO:tasks.workunit.client.0.smithi115.stdout:1/951: mkdir d0/de/df8/d10c/d11e/d8f/d29/d47/d74/dcb/d110/d139 0 2024-09-13T23:06:21.005 INFO:tasks.workunit.client.0.smithi115.stdout:1/952: mknod d0/de/df8/d10c/d25/d4d/d51/c13a 0 2024-09-13T23:06:21.007 INFO:tasks.workunit.client.0.smithi115.stdout:7/974: dread da/dd/fe5 [0,4194304] 0 2024-09-13T23:06:21.007 INFO:tasks.workunit.client.0.smithi115.stdout:7/975: readlink da/dd/d13/d36/d5a/d99/ddd/d92/db1/l140 0 2024-09-13T23:06:21.008 INFO:tasks.workunit.client.0.smithi115.stdout:1/953: creat d0/de/df8/d10c/d25/d67/f13b x:0 0 0 2024-09-13T23:06:21.010 INFO:tasks.workunit.client.0.smithi115.stdout:1/954: mkdir d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7/d13c 0 2024-09-13T23:06:21.010 INFO:tasks.workunit.client.0.smithi115.stdout:1/955: chown d0/de/d62/f84 72498983 1 2024-09-13T23:06:21.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/266: dwrite d17/d19/f33 [0,4194304] 0 2024-09-13T23:06:21.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/267: stat d17/d25/d32/f4c 0 2024-09-13T23:06:21.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/268: fsync fd 0 2024-09-13T23:06:21.011 INFO:tasks.workunit.client.0.smithi115.stdout:1/956: mknod d0/de/df8/d10c/d11e/d8f/d29/d47/c13d 0 2024-09-13T23:06:21.013 INFO:tasks.workunit.client.1.smithi152.stdout:8/269: mknod d17/d25/d32/c58 0 2024-09-13T23:06:21.018 INFO:tasks.workunit.client.1.smithi152.stdout:8/270: symlink d17/d19/l59 0 2024-09-13T23:06:21.021 INFO:tasks.workunit.client.1.smithi152.stdout:5/305: dread d5/dc/d35/f4b [0,4194304] 0 2024-09-13T23:06:21.021 INFO:tasks.workunit.client.1.smithi152.stdout:5/306: truncate d5/d26/f47 5089332 0 2024-09-13T23:06:21.028 INFO:tasks.workunit.client.1.smithi152.stdout:2/390: dwrite d0/d4/d9/f63 [0,4194304] 0 2024-09-13T23:06:21.033 INFO:tasks.workunit.client.1.smithi152.stdout:5/307: dread d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:21.045 INFO:tasks.workunit.client.1.smithi152.stdout:5/308: write d5/dc/d19/d20/f32 [832372,75452] 0 2024-09-13T23:06:21.046 INFO:tasks.workunit.client.1.smithi152.stdout:5/309: dread - d5/dc/f5b zero size 2024-09-13T23:06:21.046 INFO:tasks.workunit.client.1.smithi152.stdout:4/490: dwrite d3/f83 [0,4194304] 0 2024-09-13T23:06:21.047 INFO:tasks.workunit.client.1.smithi152.stdout:7/385: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:21.047 INFO:tasks.workunit.client.1.smithi152.stdout:6/375: dwrite d4/de/d21/f7c [0,4194304] 0 2024-09-13T23:06:21.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/391: write d0/d4/d9/d18/f6f [1184830,57537] 0 2024-09-13T23:06:21.050 INFO:tasks.workunit.client.1.smithi152.stdout:4/491: link d3/d4/d6/d8/d17/d3a/f56 d3/d4/d6/d63/d79/f96 0 2024-09-13T23:06:21.051 INFO:tasks.workunit.client.0.smithi115.stdout:1/957: rmdir d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7 39 2024-09-13T23:06:21.051 INFO:tasks.workunit.client.0.smithi115.stdout:1/958: chown d0/de/df8/d10c/d25/d4d/d51/d23/d65/l136 104995 1 2024-09-13T23:06:21.052 INFO:tasks.workunit.client.0.smithi115.stdout:1/959: unlink d0/de/df8/d10c/d25/d67/fe1 0 2024-09-13T23:06:21.054 INFO:tasks.workunit.client.1.smithi152.stdout:9/366: dwrite d3/d52/f5e [0,4194304] 0 2024-09-13T23:06:21.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/328: dwrite de/d14/f4b [0,4194304] 0 2024-09-13T23:06:21.055 INFO:tasks.workunit.client.1.smithi152.stdout:1/354: dwrite d4/d9/d1a/d22/d24/d48/f66 [0,4194304] 0 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:7/386: mkdir d17/d24/d2d/d51/d5b/d63/d7d 0 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:8/271: dwrite d17/d25/f35 [0,4194304] 0 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:8/272: dread - d17/f4a zero size 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/376: rename d4/de/d12/d16/d2a/d3d/f4d to d4/de/d12/d16/d2a/d3d/d57/f81 0 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/377: creat d4/de/d12/d16/d2a/d3d/d57/f82 x:0 0 0 2024-09-13T23:06:21.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/378: fsync d4/de/f63 0 2024-09-13T23:06:21.057 INFO:tasks.workunit.client.0.smithi115.stdout:1/960: rename d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/f102 to d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7/d13c/f13e 0 2024-09-13T23:06:21.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/367: dread d3/d24/d34/f40 [0,4194304] 0 2024-09-13T23:06:21.057 INFO:tasks.workunit.client.0.smithi115.stdout:1/961: symlink d0/de/df8/d10c/d25/d4d/d51/d31/d37/d72/l13f 0 2024-09-13T23:06:21.059 INFO:tasks.workunit.client.1.smithi152.stdout:9/368: read d3/f4f [257679,20980] 0 2024-09-13T23:06:21.059 INFO:tasks.workunit.client.1.smithi152.stdout:9/369: write d3/f48 [23052,61004] 0 2024-09-13T23:06:21.059 INFO:tasks.workunit.client.0.smithi115.stdout:1/962: write d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/f11b [80269,102036] 0 2024-09-13T23:06:21.059 INFO:tasks.workunit.client.0.smithi115.stdout:1/963: readlink d0/de/df8/d10c/d11e/d8f/l9b 0 2024-09-13T23:06:21.061 INFO:tasks.workunit.client.1.smithi152.stdout:3/329: link de/d14/d47/d57/d5d/f41 de/d1f/f74 0 2024-09-13T23:06:21.064 INFO:tasks.workunit.client.1.smithi152.stdout:1/355: dread d4/d9/d1a/d22/d24/f52 [0,4194304] 0 2024-09-13T23:06:21.066 INFO:tasks.workunit.client.1.smithi152.stdout:4/492: dwrite d3/d4/d6/d8/f8f [0,4194304] 0 2024-09-13T23:06:21.066 INFO:tasks.workunit.client.1.smithi152.stdout:4/493: readlink d3/d4/d6/d8/d17/d39/l3e 0 2024-09-13T23:06:21.066 INFO:tasks.workunit.client.1.smithi152.stdout:4/494: write d3/d4/d6/d66/d1c/d59/f68 [1197213,31660] 0 2024-09-13T23:06:21.069 INFO:tasks.workunit.client.1.smithi152.stdout:1/356: dread d4/d9/d1a/f2e [0,4194304] 0 2024-09-13T23:06:21.069 INFO:tasks.workunit.client.1.smithi152.stdout:1/357: write d4/f32 [200994,86635] 0 2024-09-13T23:06:21.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/273: mknod d17/d25/d32/c5a 0 2024-09-13T23:06:21.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/274: chown d17/c18 83055832 1 2024-09-13T23:06:21.073 INFO:tasks.workunit.client.1.smithi152.stdout:6/379: rename d4/de/d12/d16/c33 to d4/de/d12/d3e/c83 0 2024-09-13T23:06:21.074 INFO:tasks.workunit.client.1.smithi152.stdout:9/370: creat d3/d24/d67/f7b x:0 0 0 2024-09-13T23:06:21.075 INFO:tasks.workunit.client.1.smithi152.stdout:9/371: readlink d3/d24/d34/l74 0 2024-09-13T23:06:21.078 INFO:tasks.workunit.client.0.smithi115.stdout:1/964: dwrite d0/de/df8/d10c/f7b [0,4194304] 0 2024-09-13T23:06:21.079 INFO:tasks.workunit.client.1.smithi152.stdout:1/358: link d4/d9/d1a/d22/f5b d4/f72 0 2024-09-13T23:06:21.080 INFO:tasks.workunit.client.1.smithi152.stdout:8/275: link f15 d17/d25/d32/d4b/f5b 0 2024-09-13T23:06:21.083 INFO:tasks.workunit.client.1.smithi152.stdout:4/495: dread d3/d4/d6/d66/d2b/d84/f48 [0,4194304] 0 2024-09-13T23:06:21.085 INFO:tasks.workunit.client.1.smithi152.stdout:6/380: link d4/de/d12/d16/d2a/d38/c5a d4/de/d12/c84 0 2024-09-13T23:06:21.085 INFO:tasks.workunit.client.1.smithi152.stdout:6/381: read d4/de/d12/d16/d2a/f2d [1349512,4493] 0 2024-09-13T23:06:21.085 INFO:tasks.workunit.client.1.smithi152.stdout:6/382: creat d4/de/d12/d16/d2a/d3d/d57/f85 x:0 0 0 2024-09-13T23:06:21.085 INFO:tasks.workunit.client.1.smithi152.stdout:9/372: mkdir d3/d24/d67/d4a/d71/d7c 0 2024-09-13T23:06:21.086 INFO:tasks.workunit.client.1.smithi152.stdout:3/330: unlink c7 0 2024-09-13T23:06:21.087 INFO:tasks.workunit.client.1.smithi152.stdout:7/387: truncate d17/d24/d2d/d46/f50 1177784 0 2024-09-13T23:06:21.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/359: creat d4/d47/f73 x:0 0 0 2024-09-13T23:06:21.089 INFO:tasks.workunit.client.1.smithi152.stdout:8/276: truncate d17/f22 3743892 0 2024-09-13T23:06:21.094 INFO:tasks.workunit.client.1.smithi152.stdout:4/496: creat d3/d34/f97 x:0 0 0 2024-09-13T23:06:21.094 INFO:tasks.workunit.client.1.smithi152.stdout:4/497: chown d3/d4/d6/d8/d17/d5d 2 1 2024-09-13T23:06:21.095 INFO:tasks.workunit.client.1.smithi152.stdout:4/498: write d3/d4/d6/d8/d17/d5d/f90 [2023779,68979] 0 2024-09-13T23:06:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/383: creat d4/de/d1d/f86 x:0 0 0 2024-09-13T23:06:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/384: chown d4/l44 356 1 2024-09-13T23:06:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/385: chown d4/de/d12/d16/d2a/f4f 776713 1 2024-09-13T23:06:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/386: creat d4/de/d12/f87 x:0 0 0 2024-09-13T23:06:21.097 INFO:tasks.workunit.client.1.smithi152.stdout:6/387: chown d4/de/c1e 8155 1 2024-09-13T23:06:21.098 INFO:tasks.workunit.client.1.smithi152.stdout:7/388: unlink d17/d24/d2a/f54 0 2024-09-13T23:06:21.099 INFO:tasks.workunit.client.1.smithi152.stdout:8/277: creat d17/d25/d32/f5c x:0 0 0 2024-09-13T23:06:21.100 INFO:tasks.workunit.client.1.smithi152.stdout:2/392: rename d0/d8/d43 to d0/d4/d9/d18/d1e/d8c 0 2024-09-13T23:06:21.100 INFO:tasks.workunit.client.1.smithi152.stdout:2/393: getdents d0/d4/d8a 0 2024-09-13T23:06:21.101 INFO:tasks.workunit.client.0.smithi115.stdout:1/965: dwrite d0/de/df8/d10c/d25/d4d/d51/d23/fc5 [0,4194304] 0 2024-09-13T23:06:21.101 INFO:tasks.workunit.client.0.smithi115.stdout:1/966: write d0/de/df8/d10c/d25/f3d [892669,107551] 0 2024-09-13T23:06:21.103 INFO:tasks.workunit.client.1.smithi152.stdout:4/499: creat d3/d4/d6/d8/d17/f98 x:0 0 0 2024-09-13T23:06:21.103 INFO:tasks.workunit.client.1.smithi152.stdout:4/500: fsync d3/d4/d6/d66/d62/f6a 0 2024-09-13T23:06:21.109 INFO:tasks.workunit.client.1.smithi152.stdout:6/388: rename d4/de/d12/d16/l41 to d4/de/d12/d16/d2a/l88 0 2024-09-13T23:06:21.113 INFO:tasks.workunit.client.1.smithi152.stdout:2/394: dread d0/d4/d9/f40 [0,4194304] 0 2024-09-13T23:06:21.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/501: link d3/d4/d6/d66/d62/f64 d3/d4/d6/d63/f99 0 2024-09-13T23:06:21.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/502: chown d3/d4/d6/d66/c1d 1 1 2024-09-13T23:06:21.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/503: chown d3/d4/d6/d63/f99 903888674 1 2024-09-13T23:06:21.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/395: unlink d0/d4/d9/d16/f17 0 2024-09-13T23:06:21.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/396: write d0/d4/d9/d16/d30/f59 [3193215,82374] 0 2024-09-13T23:06:21.115 INFO:tasks.workunit.client.1.smithi152.stdout:4/504: rename d3/d4/d6/f20 to d3/d4/d6/d66/d2b/f9a 0 2024-09-13T23:06:21.116 INFO:tasks.workunit.client.1.smithi152.stdout:2/397: rmdir d0/d4/d9/d14/d48/d49 39 2024-09-13T23:06:21.116 INFO:tasks.workunit.client.1.smithi152.stdout:4/505: mkdir d3/d4/d6/d8/d17/d5d/d94/d9b 0 2024-09-13T23:06:21.117 INFO:tasks.workunit.client.1.smithi152.stdout:4/506: symlink d3/d4/d6/d63/d79/l9c 0 2024-09-13T23:06:21.118 INFO:tasks.workunit.client.1.smithi152.stdout:4/507: fdatasync d3/d34/f6c 0 2024-09-13T23:06:21.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/508: unlink d3/d4/d6/d8/d17/c2d 0 2024-09-13T23:06:21.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/373: rmdir d3/d24/d67 39 2024-09-13T23:06:21.122 INFO:tasks.workunit.client.1.smithi152.stdout:1/360: dwrite d4/d9/fd [0,4194304] 0 2024-09-13T23:06:21.131 INFO:tasks.workunit.client.1.smithi152.stdout:8/278: write d17/f22 [695320,116570] 0 2024-09-13T23:06:21.131 INFO:tasks.workunit.client.1.smithi152.stdout:8/279: creat d17/d25/d32/f5d x:0 0 0 2024-09-13T23:06:21.131 INFO:tasks.workunit.client.1.smithi152.stdout:8/280: truncate d17/d25/d32/f5c 196299 0 2024-09-13T23:06:21.131 INFO:tasks.workunit.client.1.smithi152.stdout:2/398: read d0/d4/d9/f63 [2807915,72622] 0 2024-09-13T23:06:21.134 INFO:tasks.workunit.client.1.smithi152.stdout:2/399: link d0/d4/d9/d18/d1e/d8c/l84 d0/d4/d9/d16/d2b/l8d 0 2024-09-13T23:06:21.134 INFO:tasks.workunit.client.1.smithi152.stdout:2/400: readlink d0/d4/d9/d16/d2b/l82 0 2024-09-13T23:06:21.135 INFO:tasks.workunit.client.0.smithi115.stdout:1/967: write d0/de/df8/d10c/d25/d4d/d51/d23/fc5 [4337196,86044] 0 2024-09-13T23:06:21.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/401: rename d0/d4/d9/d14/f6b to d0/d4/d9/d18/d1e/d3c/f8e 0 2024-09-13T23:06:21.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/402: stat d0/d4/d9/f25 0 2024-09-13T23:06:21.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/403: getdents d0/d4/d9/d14/d48 0 2024-09-13T23:06:21.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/404: mkdir d0/d4/d9/d55/d8f 0 2024-09-13T23:06:21.139 INFO:tasks.workunit.client.0.smithi115.stdout:1/968: mknod d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7/c140 0 2024-09-13T23:06:21.141 INFO:tasks.workunit.client.0.smithi115.stdout:1/969: rename d0/de/d62/f84 to d0/f141 0 2024-09-13T23:06:21.142 INFO:tasks.workunit.client.1.smithi152.stdout:3/331: dwrite de/d14/f55 [0,4194304] 0 2024-09-13T23:06:21.145 INFO:tasks.workunit.client.1.smithi152.stdout:3/332: truncate de/f40 868923 0 2024-09-13T23:06:21.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/389: write d4/f6 [1084719,19382] 0 2024-09-13T23:06:21.150 INFO:tasks.workunit.client.1.smithi152.stdout:6/390: mknod d4/de/c89 0 2024-09-13T23:06:21.155 INFO:tasks.workunit.client.1.smithi152.stdout:6/391: rename d4/de/d21/d5b to d4/de/d12/d8a 0 2024-09-13T23:06:21.172 INFO:tasks.workunit.client.1.smithi152.stdout:4/509: dwrite d3/d4/d6/d66/d1c/d59/f68 [0,4194304] 0 2024-09-13T23:06:21.172 INFO:tasks.workunit.client.1.smithi152.stdout:4/510: read - d3/d34/f6c zero size 2024-09-13T23:06:21.172 INFO:tasks.workunit.client.1.smithi152.stdout:4/511: readlink d3/d4/d32/l5c 0 2024-09-13T23:06:21.172 INFO:tasks.workunit.client.1.smithi152.stdout:1/361: dwrite d4/d9/d1a/d22/f5b [0,4194304] 0 2024-09-13T23:06:21.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/512: unlink d3/d34/f6c 0 2024-09-13T23:06:21.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/513: mkdir d3/d4/d6/d66/d62/d9d 0 2024-09-13T23:06:21.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/514: fsync d3/d4/d6/d66/d2b/f9a 0 2024-09-13T23:06:21.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/515: fdatasync d3/d4/d6/f1a 0 2024-09-13T23:06:21.177 INFO:tasks.workunit.client.1.smithi152.stdout:4/516: unlink d3/d4/d6/d66/d1c/c80 0 2024-09-13T23:06:21.182 INFO:tasks.workunit.client.1.smithi152.stdout:3/333: dwrite de/f45 [0,4194304] 0 2024-09-13T23:06:21.182 INFO:tasks.workunit.client.1.smithi152.stdout:8/281: dwrite d17/f4a [0,4194304] 0 2024-09-13T23:06:21.183 INFO:tasks.workunit.client.0.smithi115.stdout:1/970: dwrite d0/de/df8/d10c/d11e/d8f/d29/f4e [0,4194304] 0 2024-09-13T23:06:21.185 INFO:tasks.workunit.client.1.smithi152.stdout:9/374: dwrite d3/d24/d67/d60/f58 [0,4194304] 0 2024-09-13T23:06:21.191 INFO:tasks.workunit.client.1.smithi152.stdout:9/375: mknod d3/d24/c7d 0 2024-09-13T23:06:21.191 INFO:tasks.workunit.client.1.smithi152.stdout:9/376: chown d3/d24/d67/d4a 313498509 1 2024-09-13T23:06:21.195 INFO:tasks.workunit.client.1.smithi152.stdout:9/377: unlink d3/d24/d34/f49 0 2024-09-13T23:06:21.195 INFO:tasks.workunit.client.1.smithi152.stdout:3/334: write de/ff [4172992,75950] 0 2024-09-13T23:06:21.195 INFO:tasks.workunit.client.1.smithi152.stdout:3/335: write de/d14/f62 [5216871,11631] 0 2024-09-13T23:06:21.196 INFO:tasks.workunit.client.1.smithi152.stdout:9/378: symlink d3/d1e/d30/d5d/l7e 0 2024-09-13T23:06:21.198 INFO:tasks.workunit.client.1.smithi152.stdout:3/336: mkdir de/d14/d47/d75 0 2024-09-13T23:06:21.198 INFO:tasks.workunit.client.1.smithi152.stdout:3/337: fdatasync de/d14/f6d 0 2024-09-13T23:06:21.199 INFO:tasks.workunit.client.1.smithi152.stdout:9/379: symlink d3/l7f 0 2024-09-13T23:06:21.200 INFO:tasks.workunit.client.1.smithi152.stdout:3/338: rmdir de/d14/d47/d75 0 2024-09-13T23:06:21.202 INFO:tasks.workunit.client.1.smithi152.stdout:9/380: creat d3/d1e/d30/d5d/f80 x:0 0 0 2024-09-13T23:06:21.202 INFO:tasks.workunit.client.1.smithi152.stdout:9/381: fdatasync d3/d24/d67/d4a/f79 0 2024-09-13T23:06:21.202 INFO:tasks.workunit.client.1.smithi152.stdout:9/382: read - d3/d1e/d30/f39 zero size 2024-09-13T23:06:21.204 INFO:tasks.workunit.client.1.smithi152.stdout:9/383: link d3/d1e/f72 d3/f81 0 2024-09-13T23:06:21.206 INFO:tasks.workunit.client.1.smithi152.stdout:9/384: unlink d3/d24/d67/d4a/l53 0 2024-09-13T23:06:21.206 INFO:tasks.workunit.client.1.smithi152.stdout:9/385: chown d3/l7f 40928217 1 2024-09-13T23:06:21.206 INFO:tasks.workunit.client.1.smithi152.stdout:9/386: creat d3/d24/d34/d45/f82 x:0 0 0 2024-09-13T23:06:21.208 INFO:tasks.workunit.client.1.smithi152.stdout:9/387: creat d3/d52/f83 x:0 0 0 2024-09-13T23:06:21.208 INFO:tasks.workunit.client.1.smithi152.stdout:9/388: read d3/ff [1381164,11701] 0 2024-09-13T23:06:21.208 INFO:tasks.workunit.client.1.smithi152.stdout:9/389: creat d3/d24/d67/d60/f84 x:0 0 0 2024-09-13T23:06:21.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/390: fdatasync d3/d24/d67/f50 0 2024-09-13T23:06:21.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/391: chown d3/d24/d34/d45/l54 38991054 1 2024-09-13T23:06:21.212 INFO:tasks.workunit.client.1.smithi152.stdout:4/517: dwrite d3/f4f [0,4194304] 0 2024-09-13T23:06:21.213 INFO:tasks.workunit.client.1.smithi152.stdout:9/392: link d3/d24/d67/c6f d3/d1e/d30/c85 0 2024-09-13T23:06:21.213 INFO:tasks.workunit.client.1.smithi152.stdout:1/362: dwrite f1 [0,4194304] 0 2024-09-13T23:06:21.213 INFO:tasks.workunit.client.0.smithi115.stdout:1/971: dwrite d0/de/df8/d10c/d11e/d8f/d29/d47/d74/d9d/da3/fcd [0,4194304] 0 2024-09-13T23:06:21.213 INFO:tasks.workunit.client.0.smithi115.stdout:1/972: stat d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/lfb 0 2024-09-13T23:06:21.214 INFO:tasks.workunit.client.1.smithi152.stdout:2/405: dwrite d0/d4/d9/d16/d30/f59 [4194304,4194304] 0 2024-09-13T23:06:21.215 INFO:tasks.workunit.client.1.smithi152.stdout:9/393: symlink d3/l86 0 2024-09-13T23:06:21.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/363: creat d4/f74 x:0 0 0 2024-09-13T23:06:21.221 INFO:tasks.workunit.client.1.smithi152.stdout:3/339: dread de/ff [0,4194304] 0 2024-09-13T23:06:21.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/394: mknod d3/d1e/c87 0 2024-09-13T23:06:21.225 INFO:tasks.workunit.client.0.smithi115.stdout:7/976: sync 2024-09-13T23:06:21.228 INFO:tasks.workunit.client.1.smithi152.stdout:9/395: rename d3/l7f to d3/d24/d67/d60/l88 0 2024-09-13T23:06:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:5/310: sync 2024-09-13T23:06:21.259 INFO:tasks.workunit.client.1.smithi152.stdout:0/378: sync 2024-09-13T23:06:21.260 INFO:tasks.workunit.client.1.smithi152.stdout:5/311: rename d5/dc/d19/d20/d2e/d27 to d5/da/d62 0 2024-09-13T23:06:21.260 INFO:tasks.workunit.client.1.smithi152.stdout:5/312: creat d5/dc/f63 x:0 0 0 2024-09-13T23:06:21.260 INFO:tasks.workunit.client.1.smithi152.stdout:5/313: fsync d5/dc/d19/d20/d2e/d28/f2f 0 2024-09-13T23:06:21.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/379: getdents d18/d1f/d29/d3f/d4b 0 2024-09-13T23:06:21.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/380: read - d18/d1f/d29/f6f zero size 2024-09-13T23:06:21.262 INFO:tasks.workunit.client.1.smithi152.stdout:5/314: symlink d5/da/d62/l64 0 2024-09-13T23:06:21.264 INFO:tasks.workunit.client.1.smithi152.stdout:4/518: dwrite d3/d4/d6/f54 [0,4194304] 0 2024-09-13T23:06:21.265 INFO:tasks.workunit.client.0.smithi115.stdout:1/973: dwrite d0/de/df8/d10c/d11e/d8f/dad/ddb/de5/f9a [4194304,4194304] 0 2024-09-13T23:06:21.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/396: dwrite d3/d1e/f72 [0,4194304] 0 2024-09-13T23:06:21.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/397: dread - d3/d24/d67/d4a/f55 zero size 2024-09-13T23:06:21.265 INFO:tasks.workunit.client.1.smithi152.stdout:2/406: dwrite d0/d4/d9/d18/d32/f65 [0,4194304] 0 2024-09-13T23:06:21.265 INFO:tasks.workunit.client.1.smithi152.stdout:1/364: dwrite d4/f5d [0,4194304] 0 2024-09-13T23:06:21.266 INFO:tasks.workunit.client.0.smithi115.stdout:7/977: dwrite da/dd/d13/d36/d5a/f102 [0,4194304] 0 2024-09-13T23:06:21.266 INFO:tasks.workunit.client.0.smithi115.stdout:1/974: unlink d0/de/df8/d10c/d11e/d8f/c81 0 2024-09-13T23:06:21.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/398: creat d3/d24/d67/d4a/d71/f89 x:0 0 0 2024-09-13T23:06:21.272 INFO:tasks.workunit.client.0.smithi115.stdout:7/978: dread da/dd/d13/d36/f3a [0,4194304] 0 2024-09-13T23:06:21.273 INFO:tasks.workunit.client.1.smithi152.stdout:5/315: getdents d5/da 0 2024-09-13T23:06:21.274 INFO:tasks.workunit.client.0.smithi115.stdout:7/979: symlink da/dd/d13/d36/d85/l14d 0 2024-09-13T23:06:21.275 INFO:tasks.workunit.client.0.smithi115.stdout:7/980: rename da/dd/d1c/d2d/d60/fd6 to da/dd/d1c/d2d/d41/f14e 0 2024-09-13T23:06:21.276 INFO:tasks.workunit.client.0.smithi115.stdout:7/981: stat da/dd/d16/d29/f55 0 2024-09-13T23:06:21.276 INFO:tasks.workunit.client.0.smithi115.stdout:7/982: chown da/dd/d13/d24/d52 0 1 2024-09-13T23:06:21.276 INFO:tasks.workunit.client.0.smithi115.stdout:7/983: chown da/df/f96 2998006 1 2024-09-13T23:06:21.277 INFO:tasks.workunit.client.1.smithi152.stdout:4/519: dread d3/f40 [0,4194304] 0 2024-09-13T23:06:21.277 INFO:tasks.workunit.client.1.smithi152.stdout:4/520: fsync d3/d4/d32/f45 0 2024-09-13T23:06:21.282 INFO:tasks.workunit.client.1.smithi152.stdout:0/381: dwrite d18/d1f/d29/d2f/d3d/f49 [0,4194304] 0 2024-09-13T23:06:21.289 INFO:tasks.workunit.client.1.smithi152.stdout:2/407: unlink d0/d4/d9/d14/l1f 0 2024-09-13T23:06:21.291 INFO:tasks.workunit.client.0.smithi115.stdout:7/984: dread da/df/d3b/ff5 [0,4194304] 0 2024-09-13T23:06:21.291 INFO:tasks.workunit.client.0.smithi115.stdout:7/985: dread - da/dd/d13/d24/d52/da1/f11f zero size 2024-09-13T23:06:21.291 INFO:tasks.workunit.client.0.smithi115.stdout:7/986: write da/dd/d1c/d2d/d60/d82/fd7 [366243,45398] 0 2024-09-13T23:06:21.292 INFO:tasks.workunit.client.0.smithi115.stdout:7/987: chown da/dd/d13 10929567 1 2024-09-13T23:06:21.292 INFO:tasks.workunit.client.1.smithi152.stdout:1/365: truncate d4/d9/f13 7162683 0 2024-09-13T23:06:21.298 INFO:tasks.workunit.client.1.smithi152.stdout:5/316: truncate d5/da/f1b 1920288 0 2024-09-13T23:06:21.298 INFO:tasks.workunit.client.1.smithi152.stdout:4/521: link d3/d4/d6/d66/d1c/d59/d60/d74/l7a d3/d4/d6/d66/d2b/d84/l9e 0 2024-09-13T23:06:21.298 INFO:tasks.workunit.client.1.smithi152.stdout:2/408: truncate d0/d4/d9/f63 1401442 0 2024-09-13T23:06:21.298 INFO:tasks.workunit.client.1.smithi152.stdout:4/522: dread d3/d4/d6/d63/f7b [0,4194304] 0 2024-09-13T23:06:21.298 INFO:tasks.workunit.client.1.smithi152.stdout:9/399: rename d3/d52/f5e to d3/d24/d67/f8a 0 2024-09-13T23:06:21.299 INFO:tasks.workunit.client.1.smithi152.stdout:4/523: symlink d3/d4/d8d/l9f 0 2024-09-13T23:06:21.299 INFO:tasks.workunit.client.0.smithi115.stdout:7/988: rename da/dd/d13/d24/d11e to da/dd/d13/d24/d52/d7c/da7/d14f 0 2024-09-13T23:06:21.299 INFO:tasks.workunit.client.0.smithi115.stdout:7/989: creat da/df/dcc/f150 x:0 0 0 2024-09-13T23:06:21.300 INFO:tasks.workunit.client.0.smithi115.stdout:7/990: truncate da/dd/d1c/d2d/d41/f14e 414831 0 2024-09-13T23:06:21.302 INFO:tasks.workunit.client.1.smithi152.stdout:5/317: rename d5/dc/d35 to d5/dc/d19/d65 0 2024-09-13T23:06:21.303 INFO:tasks.workunit.client.1.smithi152.stdout:9/400: symlink d3/d24/d67/d4a/l8b 0 2024-09-13T23:06:21.305 INFO:tasks.workunit.client.1.smithi152.stdout:5/318: link d5/dc/d19/d20/d2e/c52 d5/dc/d19/d20/c66 0 2024-09-13T23:06:21.309 INFO:tasks.workunit.client.1.smithi152.stdout:0/382: dwrite d18/d1f/d29/f60 [0,4194304] 0 2024-09-13T23:06:21.311 INFO:tasks.workunit.client.1.smithi152.stdout:0/383: rmdir d18/d1f/d29/d3f/d4b/d66 39 2024-09-13T23:06:21.335 INFO:tasks.workunit.client.1.smithi152.stdout:1/366: dwrite d4/d9/d1a/d22/d24/d48/f66 [0,4194304] 0 2024-09-13T23:06:21.335 INFO:tasks.workunit.client.1.smithi152.stdout:1/367: creat d4/f75 x:0 0 0 2024-09-13T23:06:21.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/368: creat d4/d9/d1a/d22/d24/d48/f76 x:0 0 0 2024-09-13T23:06:21.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/369: truncate d4/f5f 611576 0 2024-09-13T23:06:21.347 INFO:tasks.workunit.client.1.smithi152.stdout:9/401: dwrite d3/d1e/d30/d5d/f80 [0,4194304] 0 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:9/402: readlink d3/d52/l6e 0 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:2/409: dwrite d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/370: write d4/f32 [236209,57679] 0 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:4/524: dwrite d3/d4/d6/d66/f7 [0,4194304] 0 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:4/525: chown d3/d34/l46 182827 1 2024-09-13T23:06:21.348 INFO:tasks.workunit.client.1.smithi152.stdout:5/319: dwrite d5/da/f1b [0,4194304] 0 2024-09-13T23:06:21.349 INFO:tasks.workunit.client.1.smithi152.stdout:0/384: dwrite f0 [0,4194304] 0 2024-09-13T23:06:21.350 INFO:tasks.workunit.client.1.smithi152.stdout:9/403: mkdir d3/d52/d8c 0 2024-09-13T23:06:21.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/371: link d4/d9/f12 d4/d47/f77 0 2024-09-13T23:06:21.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/372: chown d4/d9/d1a/d22/d24/d48/f66 1758728568 1 2024-09-13T23:06:21.357 INFO:tasks.workunit.client.1.smithi152.stdout:0/385: link d18/d1f/d29/d2f/c77 d18/d1f/d29/d3f/d4b/d66/d6a/c89 0 2024-09-13T23:06:21.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/386: truncate d18/d1f/f34 696586 0 2024-09-13T23:06:21.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/410: write d0/d4/d9/d18/d1e/d8c/f51 [2552615,94115] 0 2024-09-13T23:06:21.361 INFO:tasks.workunit.client.1.smithi152.stdout:2/411: readlink d0/d4/d9/d18/d1e/d8c/l84 0 2024-09-13T23:06:21.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/387: mknod d18/d19/d74/c8a 0 2024-09-13T23:06:21.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/388: fsync d18/d1f/d39/f85 0 2024-09-13T23:06:21.363 INFO:tasks.workunit.client.1.smithi152.stdout:4/526: read d3/f4f [1684000,86762] 0 2024-09-13T23:06:21.363 INFO:tasks.workunit.client.1.smithi152.stdout:2/412: link d0/d4/d9/d14/l89 d0/d4/d9/d16/d2b/l90 0 2024-09-13T23:06:21.364 INFO:tasks.workunit.client.1.smithi152.stdout:0/389: creat d18/d1f/d29/d3f/d40/f8b x:0 0 0 2024-09-13T23:06:21.365 INFO:tasks.workunit.client.1.smithi152.stdout:9/404: dread d3/f23 [0,4194304] 0 2024-09-13T23:06:21.365 INFO:tasks.workunit.client.1.smithi152.stdout:9/405: fsync d3/f28 0 2024-09-13T23:06:21.365 INFO:tasks.workunit.client.1.smithi152.stdout:9/406: chown d3/d1e/d30/d5d/l7e 953 1 2024-09-13T23:06:21.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/320: dwrite d5/f22 [0,4194304] 0 2024-09-13T23:06:21.366 INFO:tasks.workunit.client.1.smithi152.stdout:4/527: rename d3/d4/d6/d8/d4a to d3/d4/d6/d8/d17/d5d/d94/d9b/da0 0 2024-09-13T23:06:21.367 INFO:tasks.workunit.client.1.smithi152.stdout:9/407: creat d3/d24/d67/d4a/f8d x:0 0 0 2024-09-13T23:06:21.367 INFO:tasks.workunit.client.1.smithi152.stdout:9/408: write d3/f4 [213756,34925] 0 2024-09-13T23:06:21.368 INFO:tasks.workunit.client.1.smithi152.stdout:0/390: rename d18/d1f/d29/l51 to d18/d1f/d29/d3f/d4b/l8c 0 2024-09-13T23:06:21.368 INFO:tasks.workunit.client.1.smithi152.stdout:0/391: chown d18/d1f/d33/d6e/f7e 356 1 2024-09-13T23:06:21.369 INFO:tasks.workunit.client.1.smithi152.stdout:4/528: mknod d3/d4/d6/d8/d17/ca1 0 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/321: write d5/d26/f47 [3955512,56881] 0 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/322: dread - d5/da/f58 zero size 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/529: chown d3/d4/d6/d8/d17/d5d/d94/d9b/da0 1855 1 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/323: creat d5/f67 x:0 0 0 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/530: write d3/d4/d6/f35 [5017441,86702] 0 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/531: chown d3/d4/d6/d66/f85 27147609 1 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/532: chown d3/d4/d6/d66/d2b/d84/l9e 15089 1 2024-09-13T23:06:21.370 INFO:tasks.workunit.client.1.smithi152.stdout:4/533: chown d3/d4/d8d/f44 498701214 1 2024-09-13T23:06:21.371 INFO:tasks.workunit.client.1.smithi152.stdout:1/373: rmdir d4 39 2024-09-13T23:06:21.371 INFO:tasks.workunit.client.1.smithi152.stdout:1/374: read - d4/d47/f73 zero size 2024-09-13T23:06:21.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/389: sync 2024-09-13T23:06:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:6/392: sync 2024-09-13T23:06:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/340: sync 2024-09-13T23:06:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:8/282: sync 2024-09-13T23:06:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:7/390: fsync d17/d24/d2a/f42 0 2024-09-13T23:06:21.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/392: symlink d18/l8d 0 2024-09-13T23:06:21.374 INFO:tasks.workunit.client.1.smithi152.stdout:5/324: mkdir d5/d26/d61/d68 0 2024-09-13T23:06:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/325: dread d5/dc/d19/f1d [0,4194304] 0 2024-09-13T23:06:21.376 INFO:tasks.workunit.client.1.smithi152.stdout:4/534: mknod d3/ca2 0 2024-09-13T23:06:21.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/375: symlink d4/d9/d71/l78 0 2024-09-13T23:06:21.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/409: rmdir d3/d52 39 2024-09-13T23:06:21.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/410: dread d3/d24/f41 [0,4194304] 0 2024-09-13T23:06:21.380 INFO:tasks.workunit.client.1.smithi152.stdout:9/411: stat d3/d1e 0 2024-09-13T23:06:21.381 INFO:tasks.workunit.client.1.smithi152.stdout:6/393: creat d4/de/d12/d3e/f8b x:0 0 0 2024-09-13T23:06:21.383 INFO:tasks.workunit.client.1.smithi152.stdout:7/391: mknod d17/d24/d2a/d2e/d30/c7e 0 2024-09-13T23:06:21.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/393: link l7 d18/d1f/l8e 0 2024-09-13T23:06:21.386 INFO:tasks.workunit.client.1.smithi152.stdout:7/392: dread d17/f1d [0,4194304] 0 2024-09-13T23:06:21.386 INFO:tasks.workunit.client.1.smithi152.stdout:4/535: symlink d3/la3 0 2024-09-13T23:06:21.387 INFO:tasks.workunit.client.1.smithi152.stdout:1/376: rmdir d4/d9/d1a 39 2024-09-13T23:06:21.388 INFO:tasks.workunit.client.1.smithi152.stdout:3/341: getdents de/d14/d38 0 2024-09-13T23:06:21.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/283: getdents d17/d19 0 2024-09-13T23:06:21.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/284: chown cf 18413247 1 2024-09-13T23:06:21.391 INFO:tasks.workunit.client.1.smithi152.stdout:0/394: mkdir d18/d8f 0 2024-09-13T23:06:21.391 INFO:tasks.workunit.client.1.smithi152.stdout:0/395: fsync d18/d1f/f34 0 2024-09-13T23:06:21.391 INFO:tasks.workunit.client.1.smithi152.stdout:7/393: mknod d17/d24/d2a/d2e/d71/c7f 0 2024-09-13T23:06:21.392 INFO:tasks.workunit.client.1.smithi152.stdout:7/394: chown d17/d24/d2a/d2e/d30 497 1 2024-09-13T23:06:21.392 INFO:tasks.workunit.client.1.smithi152.stdout:4/536: creat d3/d4/d6/d66/d1c/fa4 x:0 0 0 2024-09-13T23:06:21.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/342: mkdir de/d14/d76 0 2024-09-13T23:06:21.394 INFO:tasks.workunit.client.1.smithi152.stdout:9/412: getdents d3/d1e/d30/d5d 0 2024-09-13T23:06:21.394 INFO:tasks.workunit.client.1.smithi152.stdout:9/413: chown d3/d1e/d30/l70 0 1 2024-09-13T23:06:21.395 INFO:tasks.workunit.client.1.smithi152.stdout:5/326: dwrite d5/f22 [4194304,4194304] 0 2024-09-13T23:06:21.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/394: getdents d4/de/d12/d16 0 2024-09-13T23:06:21.396 INFO:tasks.workunit.client.1.smithi152.stdout:8/285: rename d17/c46 to d17/d19/c5e 0 2024-09-13T23:06:21.398 INFO:tasks.workunit.client.1.smithi152.stdout:7/395: creat d17/d24/d2a/d2b/d4b/d61/f80 x:0 0 0 2024-09-13T23:06:21.398 INFO:tasks.workunit.client.1.smithi152.stdout:4/537: truncate d3/d4/d6/f14 3519773 0 2024-09-13T23:06:21.398 INFO:tasks.workunit.client.1.smithi152.stdout:9/414: dread d3/d1e/d30/f6c [0,4194304] 0 2024-09-13T23:06:21.399 INFO:tasks.workunit.client.1.smithi152.stdout:3/343: mknod de/d14/d47/d57/c77 0 2024-09-13T23:06:21.399 INFO:tasks.workunit.client.1.smithi152.stdout:6/395: dread d4/de/f6c [0,4194304] 0 2024-09-13T23:06:21.400 INFO:tasks.workunit.client.1.smithi152.stdout:5/327: rmdir d5/da/d62 39 2024-09-13T23:06:21.401 INFO:tasks.workunit.client.1.smithi152.stdout:8/286: link d17/d25/d32/d44/f48 d17/d25/d32/d44/f5f 0 2024-09-13T23:06:21.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/396: truncate d17/f22 44327 0 2024-09-13T23:06:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:4/538: rename d3/d4/d6/d66/d1c/f41 to d3/d4/fa5 0 2024-09-13T23:06:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/415: mkdir d3/d24/d67/d4a/d8e 0 2024-09-13T23:06:21.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/416: chown d3/d1e/d30 0 1 2024-09-13T23:06:21.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/396: write f14 [298088,29119] 0 2024-09-13T23:06:21.407 INFO:tasks.workunit.client.1.smithi152.stdout:3/344: dread de/ff [0,4194304] 0 2024-09-13T23:06:21.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/397: dread - d18/d1f/d29/d3f/d40/f8b zero size 2024-09-13T23:06:21.408 INFO:tasks.workunit.client.1.smithi152.stdout:6/396: symlink d4/de/d21/l8c 0 2024-09-13T23:06:21.408 INFO:tasks.workunit.client.1.smithi152.stdout:5/328: creat d5/dc/d4c/f69 x:0 0 0 2024-09-13T23:06:21.408 INFO:tasks.workunit.client.1.smithi152.stdout:8/287: symlink d17/d25/d32/l60 0 2024-09-13T23:06:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:0/398: mkdir d18/d1f/d33/d90 0 2024-09-13T23:06:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/345: dread de/d1f/f52 [0,4194304] 0 2024-09-13T23:06:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/346: fdatasync de/d14/d47/d57/d5d/f41 0 2024-09-13T23:06:21.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/347: creat de/d14/d47/d70/f78 x:0 0 0 2024-09-13T23:06:21.411 INFO:tasks.workunit.client.1.smithi152.stdout:6/397: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d 0 2024-09-13T23:06:21.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/348: dread de/d1f/f74 [0,4194304] 0 2024-09-13T23:06:21.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/349: getdents de/d14/d38 0 2024-09-13T23:06:21.413 INFO:tasks.workunit.client.1.smithi152.stdout:8/288: dread fd [0,4194304] 0 2024-09-13T23:06:21.414 INFO:tasks.workunit.client.1.smithi152.stdout:6/398: mknod d4/de/d12/d16/d2a/d3d/d57/d8d/c8e 0 2024-09-13T23:06:21.414 INFO:tasks.workunit.client.1.smithi152.stdout:6/399: dread - d4/f75 zero size 2024-09-13T23:06:21.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/377: dwrite d4/f6b [0,4194304] 0 2024-09-13T23:06:21.419 INFO:tasks.workunit.client.1.smithi152.stdout:3/350: creat de/d14/d47/d57/d5d/d6e/f79 x:0 0 0 2024-09-13T23:06:21.421 INFO:tasks.workunit.client.1.smithi152.stdout:8/289: creat d17/f61 x:0 0 0 2024-09-13T23:06:21.423 INFO:tasks.workunit.client.1.smithi152.stdout:5/329: dread d5/da/f3d [0,4194304] 0 2024-09-13T23:06:21.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/351: mknod de/d63/c7a 0 2024-09-13T23:06:21.426 INFO:tasks.workunit.client.1.smithi152.stdout:5/330: creat d5/dc/d5e/f6a x:0 0 0 2024-09-13T23:06:21.427 INFO:tasks.workunit.client.1.smithi152.stdout:5/331: chown d5 5915 1 2024-09-13T23:06:21.428 INFO:tasks.workunit.client.1.smithi152.stdout:5/332: mknod d5/d26/d61/c6b 0 2024-09-13T23:06:21.431 INFO:tasks.workunit.client.1.smithi152.stdout:5/333: mkdir d5/da/d62/d6c 0 2024-09-13T23:06:21.432 INFO:tasks.workunit.client.1.smithi152.stdout:8/290: write d17/f4a [2252855,69221] 0 2024-09-13T23:06:21.433 INFO:tasks.workunit.client.1.smithi152.stdout:5/334: mkdir d5/d26/d6d 0 2024-09-13T23:06:21.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/335: symlink d5/da/d62/d6c/l6e 0 2024-09-13T23:06:21.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/336: truncate d5/da/d62/f56 815698 0 2024-09-13T23:06:21.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/291: rmdir d17/d23 39 2024-09-13T23:06:21.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/292: read - d17/f61 zero size 2024-09-13T23:06:21.436 INFO:tasks.workunit.client.1.smithi152.stdout:5/337: rename d5/dc/d4c/f69 to d5/da/f6f 0 2024-09-13T23:06:21.436 INFO:tasks.workunit.client.1.smithi152.stdout:1/378: dread d4/f6b [0,4194304] 0 2024-09-13T23:06:21.445 INFO:tasks.workunit.client.1.smithi152.stdout:3/352: write de/f13 [6925474,72234] 0 2024-09-13T23:06:21.445 INFO:tasks.workunit.client.1.smithi152.stdout:3/353: write de/d14/f4b [4512005,14414] 0 2024-09-13T23:06:21.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/397: dwrite f14 [0,4194304] 0 2024-09-13T23:06:21.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/398: dread - d17/d24/d2a/d2b/f47 zero size 2024-09-13T23:06:21.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/399: dread - d17/d24/d2d/d51/d5b/f75 zero size 2024-09-13T23:06:21.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/400: creat d17/d24/d2d/d46/f81 x:0 0 0 2024-09-13T23:06:21.473 INFO:tasks.workunit.client.1.smithi152.stdout:9/417: dwrite d3/d24/d67/d4a/d71/f89 [0,4194304] 0 2024-09-13T23:06:21.473 INFO:tasks.workunit.client.1.smithi152.stdout:4/539: dwrite d3/d4/d6/f14 [0,4194304] 0 2024-09-13T23:06:21.473 INFO:tasks.workunit.client.1.smithi152.stdout:0/399: dwrite d18/d1f/d29/d3f/f59 [0,4194304] 0 2024-09-13T23:06:21.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/400: dwrite d4/de/d12/f55 [0,4194304] 0 2024-09-13T23:06:21.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/293: dwrite d17/d25/d32/f38 [0,4194304] 0 2024-09-13T23:06:21.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/294: write d17/d23/f2b [4439373,100911] 0 2024-09-13T23:06:21.476 INFO:tasks.workunit.client.1.smithi152.stdout:9/418: dread d3/f4f [0,4194304] 0 2024-09-13T23:06:21.476 INFO:tasks.workunit.client.1.smithi152.stdout:3/354: dwrite de/f40 [0,4194304] 0 2024-09-13T23:06:21.476 INFO:tasks.workunit.client.1.smithi152.stdout:3/355: chown de/d14/f55 354662041 1 2024-09-13T23:06:21.476 INFO:tasks.workunit.client.1.smithi152.stdout:3/356: creat de/d14/d47/d70/f7b x:0 0 0 2024-09-13T23:06:21.477 INFO:tasks.workunit.client.1.smithi152.stdout:5/338: dwrite d5/dc/d19/d65/f4b [0,4194304] 0 2024-09-13T23:06:21.477 INFO:tasks.workunit.client.1.smithi152.stdout:5/339: dread - d5/dc/d19/d65/f50 zero size 2024-09-13T23:06:21.479 INFO:tasks.workunit.client.1.smithi152.stdout:7/401: dread d17/d24/d2a/d2b/f3a [0,4194304] 0 2024-09-13T23:06:21.484 INFO:tasks.workunit.client.1.smithi152.stdout:0/400: write d18/f25 [458262,3654] 0 2024-09-13T23:06:21.484 INFO:tasks.workunit.client.1.smithi152.stdout:0/401: chown d18/d1f/d39/f45 908 1 2024-09-13T23:06:21.484 INFO:tasks.workunit.client.1.smithi152.stdout:0/402: chown d18/d19/c75 1 1 2024-09-13T23:06:21.492 INFO:tasks.workunit.client.1.smithi152.stdout:9/419: dwrite d3/f28 [4194304,4194304] 0 2024-09-13T23:06:21.493 INFO:tasks.workunit.client.1.smithi152.stdout:9/420: stat d3/l2d 0 2024-09-13T23:06:21.507 INFO:tasks.workunit.client.1.smithi152.stdout:0/403: dwrite d18/d1f/d29/d4e/f62 [0,4194304] 0 2024-09-13T23:06:21.520 INFO:tasks.workunit.client.1.smithi152.stdout:4/540: mknod d3/d4/d6/ca6 0 2024-09-13T23:06:21.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/404: dwrite d18/d1f/d29/d2f/d3d/f5e [0,4194304] 0 2024-09-13T23:06:21.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/295: symlink d17/d23/l62 0 2024-09-13T23:06:21.539 INFO:tasks.workunit.client.1.smithi152.stdout:4/541: dwrite d3/d4/f22 [0,4194304] 0 2024-09-13T23:06:21.541 INFO:tasks.workunit.client.1.smithi152.stdout:3/357: creat de/d14/d47/f7c x:0 0 0 2024-09-13T23:06:21.542 INFO:tasks.workunit.client.1.smithi152.stdout:5/340: mkdir d5/dc/d19/d65/d70 0 2024-09-13T23:06:21.543 INFO:tasks.workunit.client.1.smithi152.stdout:7/402: mkdir d17/d24/d2a/d2b/d4b/d61/d82 0 2024-09-13T23:06:21.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/405: creat d18/d1f/d33/d90/f91 x:0 0 0 2024-09-13T23:06:21.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/401: rename l1 to d4/de/l8f 0 2024-09-13T23:06:21.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/402: chown d4/de/d12/d8a/c64 264 1 2024-09-13T23:06:21.559 INFO:tasks.workunit.client.0.smithi115.stdout:1/975: sync 2024-09-13T23:06:21.560 INFO:tasks.workunit.client.0.smithi115.stdout:7/991: sync 2024-09-13T23:06:21.560 INFO:tasks.workunit.client.0.smithi115.stdout:7/992: getdents da/dd/d1c/d2d/d60/d82/de6 0 2024-09-13T23:06:21.561 INFO:tasks.workunit.client.0.smithi115.stdout:7/993: link da/la8 da/dd/l151 0 2024-09-13T23:06:21.562 INFO:tasks.workunit.client.0.smithi115.stdout:7/994: mkdir da/dd/d1c/d2d/d41/d152 0 2024-09-13T23:06:21.563 INFO:tasks.workunit.client.0.smithi115.stdout:7/995: link da/dd/d16/c31 da/dd/d13/d36/d5a/d99/ddd/d92/db1/c153 0 2024-09-13T23:06:21.563 INFO:tasks.workunit.client.0.smithi115.stdout:7/996: chown da/dd/d1c/d2d/d60 0 1 2024-09-13T23:06:21.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/997: rmdir da/dd/d13/d24/d52/d7c/da7/dea 39 2024-09-13T23:06:21.564 INFO:tasks.workunit.client.0.smithi115.stdout:7/998: write da/dd/d1c/d2d/d41/d100/f106 [34547,70359] 0 2024-09-13T23:06:21.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/358: creat de/d63/f7d x:0 0 0 2024-09-13T23:06:21.574 INFO:tasks.workunit.client.1.smithi152.stdout:5/341: mkdir d5/dc/d19/d71 0 2024-09-13T23:06:21.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/421: getdents d3/d24/d67/d4a/d71 0 2024-09-13T23:06:21.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/422: chown d3/d24/d67/d4a/c62 531998225 1 2024-09-13T23:06:21.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/423: chown d3/d24/d67/d4a/d8e 504779 1 2024-09-13T23:06:21.577 INFO:tasks.workunit.client.1.smithi152.stdout:0/406: symlink d18/d1f/d33/d65/l92 0 2024-09-13T23:06:21.577 INFO:tasks.workunit.client.0.smithi115.stdout:1/976: dwrite d0/de/df8/d10c/d25/d4d/d51/d23/f122 [0,4194304] 0 2024-09-13T23:06:21.578 INFO:tasks.workunit.client.0.smithi115.stdout:1/977: truncate d0/de/df8/d10c/d11e/d8f/d29/f109 888904 0 2024-09-13T23:06:21.578 INFO:tasks.workunit.client.0.smithi115.stdout:1/978: chown d0/de/df8/d10c/d11e/d8f/d29/d47/d74/lf5 472367024 1 2024-09-13T23:06:21.578 INFO:tasks.workunit.client.1.smithi152.stdout:8/296: rename d17/f4a to d17/d25/d32/f63 0 2024-09-13T23:06:21.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/403: truncate d4/de/f49 261523 0 2024-09-13T23:06:21.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/404: write d4/de/d12/f87 [892830,125115] 0 2024-09-13T23:06:21.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/405: creat d4/de/d12/d16/d2a/f90 x:0 0 0 2024-09-13T23:06:21.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/406: creat d4/de/d12/d3e/f91 x:0 0 0 2024-09-13T23:06:21.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/407: dread d18/f26 [0,4194304] 0 2024-09-13T23:06:21.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/408: fsync d18/d1f/d33/f68 0 2024-09-13T23:06:21.588 INFO:tasks.workunit.client.1.smithi152.stdout:0/409: creat d18/d1f/d39/f93 x:0 0 0 2024-09-13T23:06:21.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/407: dread d4/de/d12/d16/f3f [0,4194304] 0 2024-09-13T23:06:21.664 INFO:tasks.workunit.client.1.smithi152.stdout:5/342: mkdir d5/da/d62/d72 0 2024-09-13T23:06:21.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/403: rmdir d17/d24 39 2024-09-13T23:06:21.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/404: write d17/d24/f3c [2381597,119305] 0 2024-09-13T23:06:21.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/405: write d17/d24/d2a/d2e/f5f [405024,103456] 0 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 -- 172.21.15.115:0/1087778248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fdb70 msgr2=0x7f40600fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 --2- 172.21.15.115:0/1087778248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fdb70 0x7f40600fdf80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f405c0048d0 tx=0x7f405c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 -- 172.21.15.115:0/1087778248 shutdown_connections 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 --2- 172.21.15.115:0/1087778248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fe4c0 0x7f40600fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 --2- 172.21.15.115:0/1087778248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fdb70 0x7f40600fdf80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 -- 172.21.15.115:0/1087778248 >> 172.21.15.115:0/1087778248 conn(0x7f40600f6390 msgr2=0x7f40600f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 -- 172.21.15.115:0/1087778248 shutdown_connections 2024-09-13T23:06:21.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 -- 172.21.15.115:0/1087778248 wait complete. 2024-09-13T23:06:21.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:21 smithi115 ceph-mon[27601]: mgrmap e25: smithi152.ntylos(active, since 7s), standbys: smithi115.eqesbc 2024-09-13T23:06:21.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:21 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.681+0000 7f4068211640 1 Processor -- start 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4068211640 1 -- start start 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4068211640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4068211640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fe4c0 0x7f406010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4068211640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406010dc50 con 0x7f40600fdb70 2024-09-13T23:06:21.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4068211640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406010e470 con 0x7f40600fe4c0 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56650/0 (socket says 172.21.15.115:56650) 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 -- 172.21.15.115:0/1672378987 learned_addr learned my addr 172.21.15.115:0/1672378987 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f40657ac640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fe4c0 0x7f406010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 -- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fe4c0 msgr2=0x7f406010d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fe4c0 0x7f406010d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 -- 172.21.15.115:0/1672378987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c005040 con 0x7f40600fdb70 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.682+0000 7f4065fad640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f405c0048a0 tx=0x7f405c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.683+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c038070 con 0x7f40600fdb70 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.683+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406010e6a0 con 0x7f40600fdb70 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.683+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f405c004290 con 0x7f40600fdb70 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.683+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c033660 con 0x7f40600fdb70 2024-09-13T23:06:21.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.683+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406010ec40 con 0x7f40600fdb70 2024-09-13T23:06:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.684+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f405c030020 con 0x7f40600fdb70 2024-09-13T23:06:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.685+0000 7f40567fc640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 0x7f404c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.685+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40600fa010 con 0x7f40600fdb70 2024-09-13T23:06:21.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.685+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f405c0adee0 con 0x7f40600fdb70 2024-09-13T23:06:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.685+0000 7f40657ac640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 0x7f404c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:21.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.686+0000 7f40657ac640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 0x7f404c070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f406010ce70 tx=0x7f405000b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:21.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:21.690+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f405c0779a0 con 0x7f40600fdb70 2024-09-13T23:06:21.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/359: rename de/c46 to de/d63/c7e 0 2024-09-13T23:06:21.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/360: creat de/d14/d47/d57/d5d/f7f x:0 0 0 2024-09-13T23:06:21.706 INFO:tasks.workunit.client.0.smithi115.stdout:1/979: write d0/de/df8/d10c/d25/d4d/d51/d31/d79/f96 [700619,110666] 0 2024-09-13T23:06:21.715 INFO:tasks.workunit.client.0.smithi115.stdout:1/980: write d0/de/df8/d10c/d11e/d8f/d29/d47/ff6 [2804831,35917] 0 2024-09-13T23:06:21.717 INFO:tasks.workunit.client.0.smithi115.stdout:1/981: rename d0/de/df8/d10c/d25/d4d/d51/d31/dfc to d0/de/df8/d10c/d11e/d8f/dad/ddb/d142 0 2024-09-13T23:06:21.718 INFO:tasks.workunit.client.0.smithi115.stdout:1/982: fdatasync d0/de/df8/d10c/d11e/d8f/d29/d47/d6a/f137 0 2024-09-13T23:06:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:21 smithi152 ceph-mon[34465]: mgrmap e25: smithi152.ntylos(active, since 7s), standbys: smithi115.eqesbc 2024-09-13T23:06:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:21 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:06:21.722 INFO:tasks.workunit.client.1.smithi152.stdout:0/410: mkdir d18/d1f/d29/d3f/d40/d94 0 2024-09-13T23:06:21.723 INFO:tasks.workunit.client.1.smithi152.stdout:6/408: rmdir d4/de/d12/d16 39 2024-09-13T23:06:21.725 INFO:tasks.workunit.client.1.smithi152.stdout:5/343: creat d5/dc/d19/d65/d70/f73 x:0 0 0 2024-09-13T23:06:21.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/406: symlink d17/d24/d2a/d2e/d59/l83 0 2024-09-13T23:06:21.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/407: dread - d17/d24/d2d/d51/d5b/f75 zero size 2024-09-13T23:06:21.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/408: chown d17/d24/d2a/d2b/f49 80 1 2024-09-13T23:06:21.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/409: chown d17/d24/d2a/d2b/d4b/d61/l73 6910505 1 2024-09-13T23:06:21.729 INFO:tasks.workunit.client.1.smithi152.stdout:3/361: creat de/d14/d47/d57/f80 x:0 0 0 2024-09-13T23:06:21.730 INFO:tasks.workunit.client.1.smithi152.stdout:8/297: symlink d17/d19/l64 0 2024-09-13T23:06:21.730 INFO:tasks.workunit.client.1.smithi152.stdout:8/298: chown d17/d25/d32/d50/f57 333062 1 2024-09-13T23:06:21.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/411: mknod d18/d1f/d29/d3f/d40/d94/c95 0 2024-09-13T23:06:21.733 INFO:tasks.workunit.client.1.smithi152.stdout:6/409: truncate d4/de/d12/f1a 3798890 0 2024-09-13T23:06:21.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/412: write d18/d1f/d29/d3f/f5c [550779,29081] 0 2024-09-13T23:06:21.733 INFO:tasks.workunit.client.1.smithi152.stdout:6/410: dread - d4/de/d12/d8a/f7b zero size 2024-09-13T23:06:21.734 INFO:tasks.workunit.client.1.smithi152.stdout:7/410: rmdir d17/d24/d2a 39 2024-09-13T23:06:21.735 INFO:tasks.workunit.client.1.smithi152.stdout:6/411: rmdir d4/de/d12/d16/d2a/d3d 39 2024-09-13T23:06:21.735 INFO:tasks.workunit.client.1.smithi152.stdout:6/412: stat d4/de/d12/d16/d2a/f48 0 2024-09-13T23:06:21.737 INFO:tasks.workunit.client.1.smithi152.stdout:7/411: mkdir d17/d4f/d84 0 2024-09-13T23:06:21.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/413: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/d92 0 2024-09-13T23:06:21.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/414: write d4/de/d12/d8a/f7b [350874,17931] 0 2024-09-13T23:06:21.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/542: sync 2024-09-13T23:06:21.743 INFO:tasks.workunit.client.1.smithi152.stdout:1/379: sync 2024-09-13T23:06:21.743 INFO:tasks.workunit.client.1.smithi152.stdout:2/413: sync 2024-09-13T23:06:21.745 INFO:tasks.workunit.client.1.smithi152.stdout:8/299: read d17/f1c [7103502,52402] 0 2024-09-13T23:06:21.745 INFO:tasks.workunit.client.1.smithi152.stdout:8/300: write d17/f61 [591021,108793] 0 2024-09-13T23:06:21.747 INFO:tasks.workunit.client.1.smithi152.stdout:7/412: dread d17/d24/d2a/d2e/f32 [0,4194304] 0 2024-09-13T23:06:21.755 INFO:tasks.workunit.client.1.smithi152.stdout:6/415: mknod d4/de/c93 0 2024-09-13T23:06:21.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/344: dwrite d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:21.757 INFO:tasks.workunit.client.1.smithi152.stdout:1/380: unlink d4/f5f 0 2024-09-13T23:06:21.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/424: sync 2024-09-13T23:06:21.763 INFO:tasks.workunit.client.1.smithi152.stdout:9/425: chown d3/d1e/l29 55411852 1 2024-09-13T23:06:21.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/416: dread d4/de/f49 [0,4194304] 0 2024-09-13T23:06:21.763 INFO:tasks.workunit.client.1.smithi152.stdout:2/414: truncate d0/d4/f1d 2189017 0 2024-09-13T23:06:21.763 INFO:tasks.workunit.client.1.smithi152.stdout:2/415: write d0/d4/d9/f25 [4533729,60849] 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/416: fsync d0/d4/d9/d16/d30/f38 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/417: creat d0/d4/d9/d16/f91 x:0 0 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/543: symlink d3/d4/d32/d86/d95/la7 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/544: chown d3/d4/d8d/c7f 8054 1 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/545: truncate d3/d4/d6/f1a 4303845 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:5/345: rename d5/dc/d19/d20/d2e/c60 to d5/dc/d19/d65/d70/c74 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:6/417: mknod d4/de/d21/d5c/c94 0 2024-09-13T23:06:21.764 INFO:tasks.workunit.client.1.smithi152.stdout:7/413: dread d17/d24/d2a/f42 [0,4194304] 0 2024-09-13T23:06:21.765 INFO:tasks.workunit.client.1.smithi152.stdout:6/418: link d4/c17 d4/de/d12/d16/d2a/d3d/c95 0 2024-09-13T23:06:21.766 INFO:tasks.workunit.client.1.smithi152.stdout:7/414: mkdir d17/d24/d2a/d2e/d59/d85 0 2024-09-13T23:06:21.768 INFO:tasks.workunit.client.1.smithi152.stdout:6/419: unlink d4/de/c89 0 2024-09-13T23:06:21.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/420: truncate d4/de/d12/d8a/f5e 1993994 0 2024-09-13T23:06:21.770 INFO:tasks.workunit.client.1.smithi152.stdout:5/346: dread d5/da/f3d [0,4194304] 0 2024-09-13T23:06:21.775 INFO:tasks.workunit.client.1.smithi152.stdout:6/421: rename d4/de/d12/d16/d2a/d3d/c95 to d4/de/d21/d5c/c96 0 2024-09-13T23:06:21.775 INFO:tasks.workunit.client.1.smithi152.stdout:6/422: read d4/de/d12/f28 [610046,87828] 0 2024-09-13T23:06:21.775 INFO:tasks.workunit.client.1.smithi152.stdout:6/423: chown d4/de/f49 1155250 1 2024-09-13T23:06:21.775 INFO:tasks.workunit.client.1.smithi152.stdout:6/424: write d4/de/d12/f55 [4866306,122824] 0 2024-09-13T23:06:21.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/301: dwrite d17/d25/f41 [0,4194304] 0 2024-09-13T23:06:21.776 INFO:tasks.workunit.client.1.smithi152.stdout:5/347: dread d5/da/d62/f56 [0,4194304] 0 2024-09-13T23:06:21.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/302: link d17/f61 d17/d25/d32/d50/f65 0 2024-09-13T23:06:21.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/303: dread - d17/f43 zero size 2024-09-13T23:06:21.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/362: dwrite de/d63/f7d [0,4194304] 0 2024-09-13T23:06:21.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/348: creat d5/dc/d19/d20/d55/f75 x:0 0 0 2024-09-13T23:06:21.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/363: creat de/d14/d47/d70/f81 x:0 0 0 2024-09-13T23:06:21.784 INFO:tasks.workunit.client.1.smithi152.stdout:8/304: read d17/f2c [4491930,56101] 0 2024-09-13T23:06:21.786 INFO:tasks.workunit.client.1.smithi152.stdout:8/305: mknod d17/d25/d32/c66 0 2024-09-13T23:06:21.786 INFO:tasks.workunit.client.1.smithi152.stdout:6/425: dread d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:21.789 INFO:tasks.workunit.client.1.smithi152.stdout:8/306: creat d17/d23/f67 x:0 0 0 2024-09-13T23:06:21.792 INFO:tasks.workunit.client.1.smithi152.stdout:0/413: dwrite d18/d1f/f20 [0,4194304] 0 2024-09-13T23:06:21.792 INFO:tasks.workunit.client.1.smithi152.stdout:0/414: write d18/d1f/d33/f4d [631410,10344] 0 2024-09-13T23:06:21.794 INFO:tasks.workunit.client.1.smithi152.stdout:3/364: dread de/ff [0,4194304] 0 2024-09-13T23:06:21.794 INFO:tasks.workunit.client.1.smithi152.stdout:3/365: write de/d14/d47/d70/f81 [767704,13526] 0 2024-09-13T23:06:21.797 INFO:tasks.workunit.client.1.smithi152.stdout:0/415: symlink d18/d1f/d29/d3f/l96 0 2024-09-13T23:06:21.800 INFO:tasks.workunit.client.1.smithi152.stdout:7/415: dwrite d17/d24/d2a/d2b/f49 [0,4194304] 0 2024-09-13T23:06:21.804 INFO:tasks.workunit.client.1.smithi152.stdout:1/381: dwrite d4/d9/d1a/f58 [4194304,4194304] 0 2024-09-13T23:06:21.805 INFO:tasks.workunit.client.1.smithi152.stdout:2/418: dwrite d0/d4/d9/d16/d30/f3e [0,4194304] 0 2024-09-13T23:06:21.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/416: symlink d18/d1f/d33/d65/l97 0 2024-09-13T23:06:21.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/417: readlink d18/d1f/d33/d65/l97 0 2024-09-13T23:06:21.806 INFO:tasks.workunit.client.1.smithi152.stdout:5/349: dwrite d5/dc/d19/d20/d2e/d28/f2f [0,4194304] 0 2024-09-13T23:06:21.806 INFO:tasks.workunit.client.1.smithi152.stdout:5/350: fsync d5/dc/f30 0 2024-09-13T23:06:21.813 INFO:tasks.workunit.client.1.smithi152.stdout:7/416: dread d17/d24/d2a/d2e/f5f [0,4194304] 0 2024-09-13T23:06:21.817 INFO:tasks.workunit.client.1.smithi152.stdout:7/417: symlink d17/l86 0 2024-09-13T23:06:21.820 INFO:tasks.workunit.client.1.smithi152.stdout:8/307: dwrite d17/d23/f45 [0,4194304] 0 2024-09-13T23:06:21.825 INFO:tasks.workunit.client.1.smithi152.stdout:3/366: dwrite de/f39 [0,4194304] 0 2024-09-13T23:06:21.830 INFO:tasks.workunit.client.1.smithi152.stdout:5/351: dwrite d5/da/f3d [0,4194304] 0 2024-09-13T23:06:21.830 INFO:tasks.workunit.client.1.smithi152.stdout:5/352: truncate d5/dc/d19/d65/f5c 183494 0 2024-09-13T23:06:21.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/382: dwrite d4/d9/d1a/d22/f3b [0,4194304] 0 2024-09-13T23:06:21.831 INFO:tasks.workunit.client.1.smithi152.stdout:1/383: fsync d4/d9/fd 0 2024-09-13T23:06:21.844 INFO:tasks.workunit.client.1.smithi152.stdout:2/419: mknod d0/c92 0 2024-09-13T23:06:21.847 INFO:tasks.workunit.client.1.smithi152.stdout:7/418: mkdir d17/d24/d2d/d51/d5b/d87 0 2024-09-13T23:06:21.847 INFO:tasks.workunit.client.1.smithi152.stdout:7/419: stat d17/d24/d2d/d51/d5b/f75 0 2024-09-13T23:06:21.858 INFO:tasks.workunit.client.1.smithi152.stdout:3/367: truncate de/d14/f55 1932634 0 2024-09-13T23:06:21.859 INFO:tasks.workunit.client.1.smithi152.stdout:5/353: symlink d5/da/d62/l76 0 2024-09-13T23:06:21.859 INFO:tasks.workunit.client.1.smithi152.stdout:5/354: write d5/dc/d19/f1d [787506,22378] 0 2024-09-13T23:06:21.860 INFO:tasks.workunit.client.1.smithi152.stdout:5/355: dread - d5/da/f43 zero size 2024-09-13T23:06:21.860 INFO:tasks.workunit.client.1.smithi152.stdout:5/356: fdatasync d5/da/f1b 0 2024-09-13T23:06:21.861 INFO:tasks.workunit.client.1.smithi152.stdout:1/384: creat d4/d9/d1a/d22/d24/d48/f79 x:0 0 0 2024-09-13T23:06:21.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/368: dread de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:21.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/369: chown de/d14/d47/d70/f73 145763 1 2024-09-13T23:06:21.865 INFO:tasks.workunit.client.1.smithi152.stdout:2/420: rename d0/d4/d9/f25 to d0/d4/f93 0 2024-09-13T23:06:21.867 INFO:tasks.workunit.client.1.smithi152.stdout:7/420: unlink d17/d24/d2a/d2e/f5f 0 2024-09-13T23:06:21.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/357: creat d5/d26/d61/f77 x:0 0 0 2024-09-13T23:06:21.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/358: chown d5/da/d62/f44 19 1 2024-09-13T23:06:21.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/359: chown d5/dc/d19/d65/f5c 5123119 1 2024-09-13T23:06:21.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/385: creat d4/d9/d71/f7a x:0 0 0 2024-09-13T23:06:21.871 INFO:tasks.workunit.client.1.smithi152.stdout:3/370: rename de/d14/d38/l33 to de/d14/d47/d57/l82 0 2024-09-13T23:06:21.871 INFO:tasks.workunit.client.1.smithi152.stdout:5/360: mkdir d5/d26/d78 0 2024-09-13T23:06:21.871 INFO:tasks.workunit.client.1.smithi152.stdout:5/361: dread - d5/dc/d19/d65/d70/f73 zero size 2024-09-13T23:06:21.872 INFO:tasks.workunit.client.1.smithi152.stdout:5/362: chown d5/da/d62/l76 7 1 2024-09-13T23:06:21.872 INFO:tasks.workunit.client.1.smithi152.stdout:5/363: write d5/f22 [9342080,63380] 0 2024-09-13T23:06:21.873 INFO:tasks.workunit.client.1.smithi152.stdout:1/386: symlink d4/d9/l7b 0 2024-09-13T23:06:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:3/371: unlink de/d14/d38/c1b 0 2024-09-13T23:06:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:3/372: fsync de/d14/d47/d57/d5d/f2b 0 2024-09-13T23:06:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:1/387: rmdir d4/d9/d1a/d22 39 2024-09-13T23:06:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/308: dwrite d17/d19/f3d [0,4194304] 0 2024-09-13T23:06:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/421: dread d0/fa [0,4194304] 0 2024-09-13T23:06:21.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/388: symlink d4/d9/d1a/d22/d24/l7c 0 2024-09-13T23:06:21.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/309: rename d17/d25/d32/f4c to d17/d19/f68 0 2024-09-13T23:06:21.881 INFO:tasks.workunit.client.1.smithi152.stdout:1/389: rename d4/d9/d1a/d22/d24/d48/l68 to d4/l7d 0 2024-09-13T23:06:21.883 INFO:tasks.workunit.client.1.smithi152.stdout:8/310: mkdir d17/d25/d69 0 2024-09-13T23:06:21.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/390: creat d4/f7e x:0 0 0 2024-09-13T23:06:21.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/421: write f0 [301293,92007] 0 2024-09-13T23:06:21.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/422: dread - d17/d24/d2a/f6a zero size 2024-09-13T23:06:21.887 INFO:tasks.workunit.client.1.smithi152.stdout:8/311: creat d17/d25/d32/d44/f6a x:0 0 0 2024-09-13T23:06:21.887 INFO:tasks.workunit.client.1.smithi152.stdout:1/391: creat d4/d9/d1a/d22/d24/f7f x:0 0 0 2024-09-13T23:06:21.887 INFO:tasks.workunit.client.1.smithi152.stdout:1/392: fdatasync d4/d9/f13 0 2024-09-13T23:06:21.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/422: write d0/d4/d9/f10 [3301713,116437] 0 2024-09-13T23:06:21.889 INFO:tasks.workunit.client.1.smithi152.stdout:1/393: rename d4/f74 to d4/d4c/f80 0 2024-09-13T23:06:21.890 INFO:tasks.workunit.client.1.smithi152.stdout:5/364: write d5/dc/d19/f1a [2456787,109375] 0 2024-09-13T23:06:21.891 INFO:tasks.workunit.client.1.smithi152.stdout:5/365: write d5/dc/d19/d20/d2e/f34 [341166,104102] 0 2024-09-13T23:06:21.891 INFO:tasks.workunit.client.1.smithi152.stdout:5/366: chown d5/f14 117752 1 2024-09-13T23:06:21.891 INFO:tasks.workunit.client.1.smithi152.stdout:2/423: mkdir d0/d4/d9/d16/d30/d94 0 2024-09-13T23:06:21.892 INFO:tasks.workunit.client.1.smithi152.stdout:1/394: symlink d4/d9/d1a/d22/d24/d48/l81 0 2024-09-13T23:06:21.894 INFO:tasks.workunit.client.1.smithi152.stdout:1/395: truncate d4/d9/d1a/f2e 1150246 0 2024-09-13T23:06:21.895 INFO:tasks.workunit.client.1.smithi152.stdout:3/373: dwrite de/d1f/f20 [0,4194304] 0 2024-09-13T23:06:21.896 INFO:tasks.workunit.client.1.smithi152.stdout:1/396: creat d4/d47/f82 x:0 0 0 2024-09-13T23:06:21.907 INFO:tasks.workunit.client.1.smithi152.stdout:7/423: dread f0 [0,4194304] 0 2024-09-13T23:06:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/424: dread d0/d4/f93 [0,4194304] 0 2024-09-13T23:06:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/425: write d0/d4/d9/d16/d2b/f50 [825038,117800] 0 2024-09-13T23:06:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/424: getdents d17/d24/d2a/d2e/d59 0 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/312: dwrite d17/d25/d32/d50/f57 [0,4194304] 0 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/313: chown d17/d25/d32/f63 783169786 1 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/314: read - d17/d25/d32/d44/f5f zero size 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/426: rename d0/d4/d9/d14/d48/d4a/f75 to d0/d4/d9/d18/d1e/d3c/d4d/f95 0 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/427: dread - d0/d4/d9/d18/d1e/d3c/f83 zero size 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/428: creat d0/d4/d9/d55/d8f/f96 x:0 0 0 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/429: dread - d0/d4/d9/d14/d48/d4a/f56 zero size 2024-09-13T23:06:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/430: mknod d0/d4/d9/d14/d48/d71/c97 0 2024-09-13T23:06:21.915 INFO:tasks.workunit.client.1.smithi152.stdout:2/431: mkdir d0/d4/d9/d18/d1e/d3c/d88/d98 0 2024-09-13T23:06:21.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/432: mkdir d0/d4/d9/d16/d99 0 2024-09-13T23:06:21.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/433: creat d0/d4/d9/d55/d8f/f9a x:0 0 0 2024-09-13T23:06:21.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/434: chown d0/d4/d9/d18/d1e/d8c/f51 24842 1 2024-09-13T23:06:21.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/435: rename d0/d4/d9 to d0/d4/d9/d16/d30/d94/d9b 22 2024-09-13T23:06:21.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/436: truncate d0/d4/d9/d14/d48/d49/f79 4365864 0 2024-09-13T23:06:21.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/437: truncate d0/d4/d9/f4b 1019050 0 2024-09-13T23:06:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/425: dread d17/f1a [0,4194304] 0 2024-09-13T23:06:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/426: write d17/d24/d2a/d2b/d4b/d4d/f6d [1122324,55323] 0 2024-09-13T23:06:21.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/427: write d17/d4f/f78 [473019,23932] 0 2024-09-13T23:06:21.923 INFO:tasks.workunit.client.1.smithi152.stdout:7/428: rmdir d17/d24/d77 0 2024-09-13T23:06:21.926 INFO:tasks.workunit.client.1.smithi152.stdout:7/429: unlink d17/d24/d2d/d46/f48 0 2024-09-13T23:06:21.926 INFO:tasks.workunit.client.1.smithi152.stdout:7/430: write d17/f27 [718832,39910] 0 2024-09-13T23:06:21.926 INFO:tasks.workunit.client.0.smithi115.stdout:7/999: sync 2024-09-13T23:06:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:7/431: creat d17/d6c/f88 x:0 0 0 2024-09-13T23:06:21.932 INFO:tasks.workunit.client.1.smithi152.stdout:7/432: dread d17/d24/d2a/d2e/f56 [0,4194304] 0 2024-09-13T23:06:21.932 INFO:tasks.workunit.client.1.smithi152.stdout:7/433: write d17/d24/d2d/d51/d5b/f75 [407910,63850] 0 2024-09-13T23:06:21.933 INFO:tasks.workunit.client.1.smithi152.stdout:7/434: creat d17/d24/d2d/d51/d5b/d87/f89 x:0 0 0 2024-09-13T23:06:21.933 INFO:tasks.workunit.client.1.smithi152.stdout:7/435: creat d17/d24/d2d/d51/d5b/d87/f8a x:0 0 0 2024-09-13T23:06:21.935 INFO:tasks.workunit.client.1.smithi152.stdout:8/315: read d17/d25/d32/f38 [3685405,59453] 0 2024-09-13T23:06:21.935 INFO:tasks.workunit.client.1.smithi152.stdout:7/436: rename d17/f22 to d17/d24/d2d/f8b 0 2024-09-13T23:06:21.935 INFO:tasks.workunit.client.1.smithi152.stdout:7/437: symlink d17/d24/d2a/d2e/d30/l8c 0 2024-09-13T23:06:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/316: unlink d17/d19/c31 0 2024-09-13T23:06:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/317: write d17/d19/f68 [470822,17447] 0 2024-09-13T23:06:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:7/438: creat d17/d24/d2a/d2b/f8d x:0 0 0 2024-09-13T23:06:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:7/439: write f16 [1456135,35948] 0 2024-09-13T23:06:21.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/374: dwrite de/d14/f5b [0,4194304] 0 2024-09-13T23:06:21.940 INFO:tasks.workunit.client.1.smithi152.stdout:3/375: truncate de/d1f/f20 4911847 0 2024-09-13T23:06:21.941 INFO:tasks.workunit.client.0.smithi115.stdout:1/983: sync 2024-09-13T23:06:21.941 INFO:tasks.workunit.client.0.smithi115.stdout:1/984: creat d0/de/df8/d10c/d25/d4d/d51/d23/f143 x:0 0 0 2024-09-13T23:06:21.941 INFO:tasks.workunit.client.0.smithi115.stdout:1/985: fsync d0/de/df8/d10c/d25/d4d/d51/d31/d37/f3b 0 2024-09-13T23:06:21.941 INFO:tasks.workunit.client.0.smithi115.stdout:1/986: creat d0/de/df8/d10c/d25/d4d/d51/f144 x:0 0 0 2024-09-13T23:06:21.942 INFO:tasks.workunit.client.0.smithi115.stdout:1/987: write d0/de/df8/d10c/d25/d4d/d51/d23/f122 [4464190,87175] 0 2024-09-13T23:06:21.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/397: dwrite d4/d9/d1a/f58 [0,4194304] 0 2024-09-13T23:06:21.945 INFO:tasks.workunit.client.1.smithi152.stdout:5/367: dwrite d5/dc/fe [0,4194304] 0 2024-09-13T23:06:21.948 INFO:tasks.workunit.client.1.smithi152.stdout:5/368: mkdir d5/dc/d19/d20/d55/d79 0 2024-09-13T23:06:21.948 INFO:tasks.workunit.client.1.smithi152.stdout:2/438: dwrite d0/d8/f8b [0,4194304] 0 2024-09-13T23:06:21.954 INFO:tasks.workunit.client.1.smithi152.stdout:1/398: dread d4/f72 [0,4194304] 0 2024-09-13T23:06:21.965 INFO:tasks.workunit.client.1.smithi152.stdout:8/318: dwrite d17/d19/f28 [0,4194304] 0 2024-09-13T23:06:21.968 INFO:tasks.workunit.client.0.smithi115.stdout:1/988: dwrite d0/de/df8/d10c/d11e/faa [4194304,4194304] 0 2024-09-13T23:06:21.969 INFO:tasks.workunit.client.1.smithi152.stdout:7/440: dread d17/f1b [0,4194304] 0 2024-09-13T23:06:21.971 INFO:tasks.workunit.client.0.smithi115.stdout:1/989: rename d0/de/df8/d10c/d11e/d8f/d29/d47/d63/dac/dc7 to d0/de/d62/d11a/d145 0 2024-09-13T23:06:21.971 INFO:tasks.workunit.client.0.smithi115.stdout:1/990: dread - d0/de/df8/d10c/d25/d67/f119 zero size 2024-09-13T23:06:21.971 INFO:tasks.workunit.client.1.smithi152.stdout:2/439: creat d0/d4/d9/f9c x:0 0 0 2024-09-13T23:06:21.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/399: symlink d4/l83 0 2024-09-13T23:06:21.973 INFO:tasks.workunit.client.1.smithi152.stdout:7/441: mkdir d17/d24/d2a/d8e 0 2024-09-13T23:06:21.973 INFO:tasks.workunit.client.1.smithi152.stdout:7/442: creat d17/f8f x:0 0 0 2024-09-13T23:06:21.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/400: rename d4/l83 to d4/d9/d71/l84 0 2024-09-13T23:06:21.975 INFO:tasks.workunit.client.1.smithi152.stdout:1/401: write d4/f72 [1989186,120291] 0 2024-09-13T23:06:21.976 INFO:tasks.workunit.client.1.smithi152.stdout:8/319: unlink d17/d19/l59 0 2024-09-13T23:06:21.976 INFO:tasks.workunit.client.1.smithi152.stdout:8/320: creat d17/d25/d32/d44/f6b x:0 0 0 2024-09-13T23:06:21.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/402: symlink d4/d47/l85 0 2024-09-13T23:06:21.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/403: truncate d4/d9/d1a/d22/f3d 366601 0 2024-09-13T23:06:21.980 INFO:tasks.workunit.client.1.smithi152.stdout:2/440: dread d0/d4/d9/d14/f2f [0,4194304] 0 2024-09-13T23:06:21.982 INFO:tasks.workunit.client.1.smithi152.stdout:1/404: symlink d4/l86 0 2024-09-13T23:06:21.983 INFO:tasks.workunit.client.1.smithi152.stdout:2/441: mknod d0/d4/d9/d55/c9d 0 2024-09-13T23:06:21.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/405: symlink d4/d9/d1a/d22/l87 0 2024-09-13T23:06:21.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/406: write d4/d9/d1a/d22/d24/d48/f66 [5223696,18099] 0 2024-09-13T23:06:21.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/407: creat d4/d47/f88 x:0 0 0 2024-09-13T23:06:21.986 INFO:tasks.workunit.client.1.smithi152.stdout:8/321: write d17/d25/f35 [2342369,25290] 0 2024-09-13T23:06:21.990 INFO:tasks.workunit.client.1.smithi152.stdout:8/322: rmdir d17/d25/d32/d50 39 2024-09-13T23:06:21.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/323: readlink d17/d23/l37 0 2024-09-13T23:06:21.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/426: sync 2024-09-13T23:06:21.993 INFO:tasks.workunit.client.1.smithi152.stdout:6/426: sync 2024-09-13T23:06:21.993 INFO:tasks.workunit.client.1.smithi152.stdout:9/427: chown d3/d24/d67/f50 3184 1 2024-09-13T23:06:21.993 INFO:tasks.workunit.client.1.smithi152.stdout:0/418: sync 2024-09-13T23:06:21.993 INFO:tasks.workunit.client.1.smithi152.stdout:4/546: sync 2024-09-13T23:06:21.994 INFO:tasks.workunit.client.1.smithi152.stdout:4/547: write d3/d4/d6/d8/d17/f98 [304876,47892] 0 2024-09-13T23:06:21.994 INFO:tasks.workunit.client.1.smithi152.stdout:5/369: dwrite d5/d26/d61/f77 [0,4194304] 0 2024-09-13T23:06:21.995 INFO:tasks.workunit.client.0.smithi115.stdout:1/991: dwrite d0/dd/f13 [0,4194304] 0 2024-09-13T23:06:21.995 INFO:tasks.workunit.client.1.smithi152.stdout:8/324: write d17/d23/f2b [4052,127920] 0 2024-09-13T23:06:21.995 INFO:tasks.workunit.client.1.smithi152.stdout:8/325: stat d17/d23/l62 0 2024-09-13T23:06:21.995 INFO:tasks.workunit.client.1.smithi152.stdout:9/428: rmdir d3/d24/d67/d4a/d71 39 2024-09-13T23:06:21.996 INFO:tasks.workunit.client.1.smithi152.stdout:8/326: creat d17/d25/d32/d44/f6c x:0 0 0 2024-09-13T23:06:21.996 INFO:tasks.workunit.client.1.smithi152.stdout:0/419: link la d18/d19/d74/l98 0 2024-09-13T23:06:21.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/376: dwrite de/d14/d47/d70/f81 [0,4194304] 0 2024-09-13T23:06:21.999 INFO:tasks.workunit.client.1.smithi152.stdout:5/370: rmdir d5/dc/d19/d20/d55 39 2024-09-13T23:06:22.000 INFO:tasks.workunit.client.0.smithi115.stdout:1/992: rename d0/de/df8/d10c/d25/d4d/d51 to d0/de/d71/d146 0 2024-09-13T23:06:22.002 INFO:tasks.workunit.client.0.smithi115.stdout:1/993: link d0/de/df8/d10c/d11e/d8f/d29/f42 d0/de/d62/d11a/d145/d13c/f147 0 2024-09-13T23:06:22.002 INFO:tasks.workunit.client.0.smithi115.stdout:1/994: readlink d0/de/d71/d146/l45 0 2024-09-13T23:06:22.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/443: rename d17/d24/d2a to d17/d24/d2d/d51/d5b/d90 0 2024-09-13T23:06:22.004 INFO:tasks.workunit.client.0.smithi115.stdout:1/995: mkdir d0/de/d71/d146/d31/d37/d72/d148 0 2024-09-13T23:06:22.006 INFO:tasks.workunit.client.1.smithi152.stdout:8/327: dread d17/d25/f41 [0,4194304] 0 2024-09-13T23:06:22.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/377: mknod de/d14/d38/c83 0 2024-09-13T23:06:22.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/378: readlink de/d1f/l23 0 2024-09-13T23:06:22.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/371: rmdir d5/dc/d19/d20/d55 39 2024-09-13T23:06:22.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/372: readlink d5/dc/l57 0 2024-09-13T23:06:22.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/442: dwrite d0/d4/d9/d18/d32/f35 [0,4194304] 0 2024-09-13T23:06:22.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.008+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f406010ef20 con 0x7f404c06e6e0 2024-09-13T23:06:22.011 INFO:tasks.workunit.client.1.smithi152.stdout:6/427: rename d4/de/d12/d16/d2a/d38/c7f to d4/de/d12/d16/d2a/d3d/d57/d8d/d92/c97 0 2024-09-13T23:06:22.011 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.011+0000 7f40567fc640 1 -- 172.21.15.115:0/1672378987 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f406010ef20 con 0x7f404c06e6e0 2024-09-13T23:06:22.012 INFO:tasks.workunit.client.1.smithi152.stdout:6/428: dread d4/de/d12/d16/d2a/f4f [0,4194304] 0 2024-09-13T23:06:22.012 INFO:tasks.workunit.client.1.smithi152.stdout:6/429: creat d4/de/d12/f98 x:0 0 0 2024-09-13T23:06:22.012 INFO:tasks.workunit.client.1.smithi152.stdout:7/444: link d17/d24/d2d/d3f/l5c d17/d24/d2d/d51/d5b/d87/l91 0 2024-09-13T23:06:22.013 INFO:tasks.workunit.client.1.smithi152.stdout:8/328: unlink c14 0 2024-09-13T23:06:22.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/379: link de/d14/d47/d57/l82 de/d14/l84 0 2024-09-13T23:06:22.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/380: read de/d14/d47/d57/f64 [887621,82607] 0 2024-09-13T23:06:22.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 msgr2=0x7f404c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 0x7f404c070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f406010ce70 tx=0x7f405000b040 comp rx=0 tx=0).stop 2024-09-13T23:06:22.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 msgr2=0x7f406010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f405c0048a0 tx=0x7f405c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 shutdown_connections 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f404c06e6e0 0x7f404c070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40600fe4c0 0x7f406010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 --2- 172.21.15.115:0/1672378987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40600fdb70 0x7f406010d0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 >> 172.21.15.115:0/1672378987 conn(0x7f40600f6390 msgr2=0x7f40600f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:22.017 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 shutdown_connections 2024-09-13T23:06:22.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.014+0000 7f4068211640 1 -- 172.21.15.115:0/1672378987 wait complete. 2024-09-13T23:06:22.018 INFO:tasks.workunit.client.1.smithi152.stdout:5/373: rmdir d5/dc/d19/d71 0 2024-09-13T23:06:22.020 INFO:tasks.workunit.client.1.smithi152.stdout:2/443: mkdir d0/d4/d9/d16/d30/d9e 0 2024-09-13T23:06:22.020 INFO:tasks.workunit.client.0.smithi115.stdout:1/996: dwrite d0/de/df8/d10c/f7b [0,4194304] 0 2024-09-13T23:06:22.022 INFO:tasks.workunit.client.1.smithi152.stdout:9/429: rename d3/l86 to d3/d24/l8f 0 2024-09-13T23:06:22.022 INFO:tasks.workunit.client.1.smithi152.stdout:9/430: truncate d3/d24/d67/f50 445184 0 2024-09-13T23:06:22.024 INFO:tasks.workunit.client.1.smithi152.stdout:6/430: symlink d4/de/d12/l99 0 2024-09-13T23:06:22.025 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:06:22.025 INFO:tasks.workunit.client.1.smithi152.stdout:8/329: symlink d17/d25/d32/l6d 0 2024-09-13T23:06:22.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/381: mknod de/d14/d47/d70/d72/c85 0 2024-09-13T23:06:22.027 INFO:tasks.workunit.client.1.smithi152.stdout:2/444: getdents d0/d4/d9/d18/d1e/d8c 0 2024-09-13T23:06:22.027 INFO:tasks.workunit.client.1.smithi152.stdout:2/445: stat d0/d4/d9/f10 0 2024-09-13T23:06:22.027 INFO:tasks.workunit.client.1.smithi152.stdout:2/446: truncate d0/fa 4751666 0 2024-09-13T23:06:22.029 INFO:tasks.workunit.client.1.smithi152.stdout:7/445: rename d17/d24/d2d/d51/l57 to d17/d24/d2d/d51/d5b/d90/d2e/d59/l92 0 2024-09-13T23:06:22.031 INFO:tasks.workunit.client.1.smithi152.stdout:8/330: unlink l12 0 2024-09-13T23:06:22.031 INFO:tasks.workunit.client.1.smithi152.stdout:8/331: fsync d17/d25/d32/f63 0 2024-09-13T23:06:22.031 INFO:tasks.workunit.client.1.smithi152.stdout:8/332: write f15 [3772219,85846] 0 2024-09-13T23:06:22.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/431: dread d3/d1e/f1f [0,4194304] 0 2024-09-13T23:06:22.033 INFO:tasks.workunit.client.1.smithi152.stdout:2/447: mkdir d0/d4/d9/d16/d9f 0 2024-09-13T23:06:22.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/448: chown d0/d4/d9/d18/d1e/l61 21371603 1 2024-09-13T23:06:22.036 INFO:tasks.workunit.client.1.smithi152.stdout:3/382: dread de/f40 [0,4194304] 0 2024-09-13T23:06:22.036 INFO:tasks.workunit.client.1.smithi152.stdout:3/383: dread - de/d14/d47/f7c zero size 2024-09-13T23:06:22.036 INFO:tasks.workunit.client.1.smithi152.stdout:2/449: mknod d0/d4/d9/d18/ca0 0 2024-09-13T23:06:22.043 INFO:tasks.workunit.client.1.smithi152.stdout:3/384: rename de/d14/d47/d57/d5d/f68 to de/d14/d47/f86 0 2024-09-13T23:06:22.044 INFO:tasks.workunit.client.1.smithi152.stdout:3/385: mkdir de/d14/d47/d70/d87 0 2024-09-13T23:06:22.046 INFO:tasks.workunit.client.1.smithi152.stdout:3/386: creat de/d14/d76/f88 x:0 0 0 2024-09-13T23:06:22.049 INFO:tasks.workunit.client.1.smithi152.stdout:3/387: mknod de/d14/d47/c89 0 2024-09-13T23:06:22.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/450: dread d0/f2e [0,4194304] 0 2024-09-13T23:06:22.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/451: readlink d0/d4/d9/d16/d2b/l82 0 2024-09-13T23:06:22.050 INFO:tasks.workunit.client.1.smithi152.stdout:2/452: dread d0/d4/d9/f40 [0,4194304] 0 2024-09-13T23:06:22.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/431: dwrite d4/de/d12/d16/d2a/d3d/d57/f60 [0,4194304] 0 2024-09-13T23:06:22.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/432: write d4/de/d12/d16/f7e [767602,81643] 0 2024-09-13T23:06:22.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/433: unlink d4/de/d12/f20 0 2024-09-13T23:06:22.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/453: unlink d0/d4/d9/l27 0 2024-09-13T23:06:22.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/454: creat d0/d4/d9/d55/fa1 x:0 0 0 2024-09-13T23:06:22.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/455: write d0/d4/d9/d18/f6f [594861,67956] 0 2024-09-13T23:06:22.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/434: getdents d4/de/d21/d5c 0 2024-09-13T23:06:22.058 INFO:tasks.workunit.client.1.smithi152.stdout:9/432: dwrite d3/d24/f2e [0,4194304] 0 2024-09-13T23:06:22.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/456: mknod d0/d4/d9/d55/d8f/ca2 0 2024-09-13T23:06:22.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/435: rename d4/de/d12/d16/d2a/c65 to d4/de/d1d/c9a 0 2024-09-13T23:06:22.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/436: read - d4/de/d12/d16/d2a/d38/f4b zero size 2024-09-13T23:06:22.061 INFO:tasks.workunit.client.1.smithi152.stdout:2/457: dread d0/d4/d9/d16/d2b/f50 [0,4194304] 0 2024-09-13T23:06:22.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/458: write d0/d4/d9/f10 [1345982,25663] 0 2024-09-13T23:06:22.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/459: dread - d0/d4/d9/d18/d32/f5a zero size 2024-09-13T23:06:22.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/460: fsync d0/d4/d9/d18/d1e/d3c/f8e 0 2024-09-13T23:06:22.064 INFO:tasks.workunit.client.0.smithi115.stdout:1/997: write d0/de/d62/d11a/d145/d13c/f147 [4968422,25155] 0 2024-09-13T23:06:22.064 INFO:tasks.workunit.client.1.smithi152.stdout:6/437: truncate d4/de/f2c 2158692 0 2024-09-13T23:06:22.065 INFO:tasks.workunit.client.1.smithi152.stdout:6/438: fdatasync d4/de/f6c 0 2024-09-13T23:06:22.065 INFO:tasks.workunit.client.1.smithi152.stdout:6/439: creat d4/de/d12/f9b x:0 0 0 2024-09-13T23:06:22.065 INFO:tasks.workunit.client.1.smithi152.stdout:8/333: truncate d17/d25/d32/d4b/f5b 2255204 0 2024-09-13T23:06:22.066 INFO:tasks.workunit.client.1.smithi152.stdout:2/461: truncate d0/d4/d9/d16/d2b/f46 4861664 0 2024-09-13T23:06:22.067 INFO:tasks.workunit.client.0.smithi115.stdout:1/998: mknod d0/de/d71/d146/d31/d37/dc8/c149 0 2024-09-13T23:06:22.069 INFO:tasks.workunit.client.1.smithi152.stdout:8/334: creat d17/d25/d32/d4b/f6e x:0 0 0 2024-09-13T23:06:22.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/335: link d17/d19/l64 d17/d25/d32/d4b/l6f 0 2024-09-13T23:06:22.071 INFO:tasks.workunit.client.1.smithi152.stdout:8/336: rmdir d17/d25 39 2024-09-13T23:06:22.072 INFO:tasks.workunit.client.0.smithi115.stdout:1/999: rmdir d0/de/d62/d11a/d11d 39 2024-09-13T23:06:22.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/420: dwrite d18/d1f/d39/f45 [0,4194304] 0 2024-09-13T23:06:22.078 INFO:tasks.workunit.client.0.smithi115.stderr:+ rm -rf -- ./tmp.2gYYhn6UjO 2024-09-13T23:06:22.083 INFO:tasks.workunit.client.1.smithi152.stdout:9/433: write d3/f23 [4099763,96415] 0 2024-09-13T23:06:22.083 INFO:tasks.workunit.client.1.smithi152.stdout:9/434: read d3/f4f [731811,25509] 0 2024-09-13T23:06:22.090 INFO:tasks.workunit.client.1.smithi152.stdout:0/421: write d18/d1f/d29/d2f/d3d/f49 [1851201,108104] 0 2024-09-13T23:06:22.090 INFO:tasks.workunit.client.1.smithi152.stdout:0/422: chown f13 1654734887 1 2024-09-13T23:06:22.100 INFO:tasks.workunit.client.1.smithi152.stdout:9/435: dread d3/d1e/d30/d5d/f80 [0,4194304] 0 2024-09-13T23:06:22.101 INFO:tasks.workunit.client.1.smithi152.stdout:9/436: symlink d3/d52/d8c/l90 0 2024-09-13T23:06:22.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/437: mknod d3/c91 0 2024-09-13T23:06:22.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/438: stat d3/d24/l44 0 2024-09-13T23:06:22.103 INFO:tasks.workunit.client.1.smithi152.stdout:9/439: creat d3/d1e/f92 x:0 0 0 2024-09-13T23:06:22.104 INFO:tasks.workunit.client.1.smithi152.stdout:9/440: creat d3/d24/d67/d4a/d8e/f93 x:0 0 0 2024-09-13T23:06:22.105 INFO:tasks.workunit.client.1.smithi152.stdout:5/374: dwrite d5/d26/f5d [0,4194304] 0 2024-09-13T23:06:22.106 INFO:tasks.workunit.client.1.smithi152.stdout:7/446: dwrite d17/d24/d2d/d51/d5b/d90/d2e/d30/f44 [0,4194304] 0 2024-09-13T23:06:22.108 INFO:tasks.workunit.client.1.smithi152.stdout:7/447: symlink d17/d24/d2d/d51/d5b/d63/l93 0 2024-09-13T23:06:22.108 INFO:tasks.workunit.client.1.smithi152.stdout:7/448: rmdir d17/d24/d2d/d51/d5b/d90/d2e/d71 39 2024-09-13T23:06:22.110 INFO:tasks.workunit.client.1.smithi152.stdout:7/449: read d17/d4f/f78 [221246,61514] 0 2024-09-13T23:06:22.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/462: dwrite d0/d4/f1a [0,4194304] 0 2024-09-13T23:06:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:2/463: creat d0/d4/d9/d16/d30/fa3 x:0 0 0 2024-09-13T23:06:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:6/440: dwrite d4/de/d12/d3e/f91 [0,4194304] 0 2024-09-13T23:06:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/337: dwrite d17/d25/f35 [0,4194304] 0 2024-09-13T23:06:22.118 INFO:tasks.workunit.client.1.smithi152.stdout:0/423: dwrite d18/d1f/d29/d2f/d3d/f5e [0,4194304] 0 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/450: dread d17/d24/d2d/d51/d5b/d90/d2e/d30/f53 [0,4194304] 0 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/451: dread - d17/d24/d2d/d51/d5b/d87/f8a zero size 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/452: write f5 [4137658,16991] 0 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/453: dread - d17/d24/d2d/d46/f81 zero size 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/454: dread - d17/d24/d2d/d51/d5b/d90/d2b/f8d zero size 2024-09-13T23:06:22.124 INFO:tasks.workunit.client.1.smithi152.stdout:7/455: creat d17/d24/d2d/d51/d5b/d87/f94 x:0 0 0 2024-09-13T23:06:22.125 INFO:tasks.workunit.client.1.smithi152.stdout:6/441: truncate d4/de/f39 2887216 0 2024-09-13T23:06:22.126 INFO:tasks.workunit.client.1.smithi152.stdout:8/338: write d17/d19/f20 [3660989,129655] 0 2024-09-13T23:06:22.127 INFO:tasks.workunit.client.1.smithi152.stdout:8/339: chown d17/f29 236 1 2024-09-13T23:06:22.127 INFO:tasks.workunit.client.1.smithi152.stdout:2/464: read d0/d4/d9/d16/d30/f3e [2738385,98924] 0 2024-09-13T23:06:22.128 INFO:tasks.workunit.client.1.smithi152.stdout:0/424: rename fd to d18/d1f/d29/d4e/f99 0 2024-09-13T23:06:22.128 INFO:tasks.workunit.client.1.smithi152.stdout:0/425: write d18/d1f/d39/f76 [3675803,61145] 0 2024-09-13T23:06:22.129 INFO:tasks.workunit.client.1.smithi152.stdout:7/456: creat d17/d24/d2d/d51/d5b/d90/d2e/d71/f95 x:0 0 0 2024-09-13T23:06:22.130 INFO:tasks.workunit.client.1.smithi152.stdout:8/340: mknod d17/d23/c70 0 2024-09-13T23:06:22.131 INFO:tasks.workunit.client.1.smithi152.stdout:9/441: dwrite d3/d1e/d30/d5d/f80 [0,4194304] 0 2024-09-13T23:06:22.132 INFO:tasks.workunit.client.1.smithi152.stdout:7/457: symlink d17/d24/d2d/d51/d5b/d63/d7d/l96 0 2024-09-13T23:06:22.132 INFO:tasks.workunit.client.1.smithi152.stdout:7/458: chown d17/d24/d2d/d51/d5b/d90/l7c 3 1 2024-09-13T23:06:22.133 INFO:tasks.workunit.client.1.smithi152.stdout:8/341: symlink d17/l71 0 2024-09-13T23:06:22.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/465: rename d0/d4/d9/d18/d1e/d3c/c3d to d0/ca4 0 2024-09-13T23:06:22.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/466: write d0/d4/d9/d16/d30/f59 [1788131,4255] 0 2024-09-13T23:06:22.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/375: dwrite d5/dc/d19/d65/d70/f73 [0,4194304] 0 2024-09-13T23:06:22.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/376: dread - d5/f5a zero size 2024-09-13T23:06:22.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/377: chown d5/dc/d19/d65/d70/c74 6841 1 2024-09-13T23:06:22.138 INFO:tasks.workunit.client.1.smithi152.stdout:7/459: dread f5 [4194304,4194304] 0 2024-09-13T23:06:22.138 INFO:tasks.workunit.client.1.smithi152.stdout:7/460: readlink d17/d24/d2d/d51/d5b/d90/d2e/d59/l83 0 2024-09-13T23:06:22.138 INFO:tasks.workunit.client.1.smithi152.stdout:9/442: unlink d3/d52/l6e 0 2024-09-13T23:06:22.139 INFO:tasks.workunit.client.1.smithi152.stdout:8/342: truncate d17/d25/f2a 1373797 0 2024-09-13T23:06:22.139 INFO:tasks.workunit.client.1.smithi152.stdout:8/343: stat d17/d25/d32/f4e 0 2024-09-13T23:06:22.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.141+0000 7f47889e1640 1 -- 172.21.15.115:0/3810071702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fb8a0 msgr2=0x7f47840fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.141+0000 7f47889e1640 1 --2- 172.21.15.115:0/3810071702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fb8a0 0x7f47840fbcb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f477c0048d0 tx=0x7f477c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.142 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 -- 172.21.15.115:0/3810071702 shutdown_connections 2024-09-13T23:06:22.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 --2- 172.21.15.115:0/3810071702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fc1f0 0x7f47840fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 --2- 172.21.15.115:0/3810071702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fb8a0 0x7f47840fbcb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 -- 172.21.15.115:0/3810071702 >> 172.21.15.115:0/3810071702 conn(0x7f47840f6390 msgr2=0x7f47840f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:22.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 -- 172.21.15.115:0/3810071702 shutdown_connections 2024-09-13T23:06:22.143 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.142+0000 7f47889e1640 1 -- 172.21.15.115:0/3810071702 wait complete. 2024-09-13T23:06:22.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 Processor -- start 2024-09-13T23:06:22.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 -- start start 2024-09-13T23:06:22.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fc1f0 0x7f4784113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841141b0 con 0x7f47840fc1f0 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.143+0000 7f47889e1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841149d0 con 0x7f47840fb8a0 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.144+0000 7f478259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.144+0000 7f478259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:33570/0 (socket says 172.21.15.115:33570) 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.144+0000 7f478259c640 1 -- 172.21.15.115:0/3627420472 learned_addr learned my addr 172.21.15.115:0/3627420472 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:22.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.144+0000 7f4781d9b640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fc1f0 0x7f4784113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:22.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.145+0000 7f478259c640 1 -- 172.21.15.115:0/3627420472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fc1f0 msgr2=0x7f4784113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.145+0000 7f478259c640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fc1f0 0x7f4784113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.145+0000 7f478259c640 1 -- 172.21.15.115:0/3627420472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c005040 con 0x7f47840fb8a0 2024-09-13T23:06:22.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.145+0000 7f478259c640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f477c000c00 tx=0x7f477c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:22.147 INFO:tasks.workunit.client.1.smithi152.stdout:7/461: creat d17/d24/d2d/d51/f97 x:0 0 0 2024-09-13T23:06:22.147 INFO:tasks.workunit.client.1.smithi152.stdout:9/443: rmdir d3/d24 39 2024-09-13T23:06:22.147 INFO:tasks.workunit.client.1.smithi152.stdout:8/344: dread d17/d25/d32/f63 [0,4194304] 0 2024-09-13T23:06:22.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.146+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f477c038070 con 0x7f47840fb8a0 2024-09-13T23:06:22.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.146+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f477c02ad60 con 0x7f47840fb8a0 2024-09-13T23:06:22.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.147+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f477c02a9f0 con 0x7f47840fb8a0 2024-09-13T23:06:22.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.147+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4784114bd0 con 0x7f47840fb8a0 2024-09-13T23:06:22.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.147+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784115040 con 0x7f47840fb8a0 2024-09-13T23:06:22.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.148+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47840fa010 con 0x7f47840fb8a0 2024-09-13T23:06:22.149 INFO:tasks.workunit.client.1.smithi152.stdout:5/378: dread d5/f3f [0,4194304] 0 2024-09-13T23:06:22.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.150+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f477c03b020 con 0x7f47840fb8a0 2024-09-13T23:06:22.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.150+0000 7f4772ffd640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 0x7f476c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.150+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f477c0adc90 con 0x7f47840fb8a0 2024-09-13T23:06:22.151 INFO:tasks.workunit.client.1.smithi152.stdout:6/442: dwrite d4/de/d12/d3e/f91 [0,4194304] 0 2024-09-13T23:06:22.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.151+0000 7f4781d9b640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 0x7f476c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:22.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.151+0000 7f4781d9b640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 0x7f476c070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47841133d0 tx=0x7f4774009040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:22.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/444: dread d3/f4 [0,4194304] 0 2024-09-13T23:06:22.154 INFO:tasks.workunit.client.1.smithi152.stdout:7/462: rmdir d17/d24/d2d/d51/d5b/d63 39 2024-09-13T23:06:22.156 INFO:tasks.workunit.client.1.smithi152.stdout:8/345: unlink d17/d25/f41 0 2024-09-13T23:06:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.157+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f477c0776a0 con 0x7f47840fb8a0 2024-09-13T23:06:22.157 INFO:tasks.workunit.client.1.smithi152.stdout:5/379: creat d5/da/d62/f7a x:0 0 0 2024-09-13T23:06:22.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/467: dwrite d0/f2e [0,4194304] 0 2024-09-13T23:06:22.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/468: chown d0/f77 2239 1 2024-09-13T23:06:22.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/469: fdatasync d0/d4/d9/d18/d1e/f1c 0 2024-09-13T23:06:22.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/443: creat d4/de/d12/d16/f9c x:0 0 0 2024-09-13T23:06:22.164 INFO:tasks.workunit.client.1.smithi152.stdout:7/463: link d17/f27 d17/f98 0 2024-09-13T23:06:22.166 INFO:tasks.workunit.client.1.smithi152.stdout:8/346: link d17/l1f d17/d25/l72 0 2024-09-13T23:06:22.166 INFO:tasks.workunit.client.1.smithi152.stdout:8/347: write d17/d25/d32/d44/f48 [407247,15082] 0 2024-09-13T23:06:22.166 INFO:tasks.workunit.client.1.smithi152.stdout:8/348: write d17/f22 [744330,22070] 0 2024-09-13T23:06:22.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/470: link d0/d4/d9/d55/l70 d0/d4/d9/d16/d30/d94/la5 0 2024-09-13T23:06:22.170 INFO:tasks.workunit.client.1.smithi152.stdout:7/464: mknod d17/d24/d2d/d51/d5b/c99 0 2024-09-13T23:06:22.173 INFO:tasks.workunit.client.1.smithi152.stdout:7/465: creat d17/d24/d2d/d51/d5b/d63/d7d/f9a x:0 0 0 2024-09-13T23:06:22.174 INFO:tasks.workunit.client.1.smithi152.stdout:7/466: chown d17/d24/d2d/d51/d5b/d90/d2b/f3b 172564 1 2024-09-13T23:06:22.175 INFO:tasks.workunit.client.1.smithi152.stdout:8/349: getdents d17/d25/d32 0 2024-09-13T23:06:22.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/444: dread d4/de/ff [0,4194304] 0 2024-09-13T23:06:22.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/445: chown d4/de/d12/d8a 5962698 1 2024-09-13T23:06:22.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/446: fdatasync d4/f75 0 2024-09-13T23:06:22.177 INFO:tasks.workunit.client.1.smithi152.stdout:6/447: stat d4/de/d1d/f37 0 2024-09-13T23:06:22.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/467: getdents d17/d24/d2d/d51/d5b/d90/d2b/d4b/d61 0 2024-09-13T23:06:22.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/468: fdatasync d17/d24/d2d/d51/d5b/d90/d2b/f47 0 2024-09-13T23:06:22.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/469: readlink d17/l86 0 2024-09-13T23:06:22.178 INFO:tasks.workunit.client.1.smithi152.stdout:9/445: dwrite d3/d24/d67/d60/f58 [0,4194304] 0 2024-09-13T23:06:22.180 INFO:tasks.workunit.client.1.smithi152.stdout:5/380: dwrite d5/da/f1b [4194304,4194304] 0 2024-09-13T23:06:22.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/350: link l13 d17/d25/d32/d4b/l73 0 2024-09-13T23:06:22.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/351: chown d17/c18 23 1 2024-09-13T23:06:22.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/352: creat d17/d25/d32/d4b/f74 x:0 0 0 2024-09-13T23:06:22.183 INFO:tasks.workunit.client.1.smithi152.stdout:9/446: link d3/d24/f20 d3/d1e/d30/f94 0 2024-09-13T23:06:22.183 INFO:tasks.workunit.client.1.smithi152.stdout:9/447: fsync d3/f4 0 2024-09-13T23:06:22.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/381: creat d5/d26/d61/d68/f7b x:0 0 0 2024-09-13T23:06:22.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/382: creat d5/da/d62/f7c x:0 0 0 2024-09-13T23:06:22.188 INFO:tasks.workunit.client.1.smithi152.stdout:8/353: creat d17/d25/d32/f75 x:0 0 0 2024-09-13T23:06:22.188 INFO:tasks.workunit.client.1.smithi152.stdout:9/448: symlink d3/d24/d34/d45/l95 0 2024-09-13T23:06:22.191 INFO:tasks.workunit.client.1.smithi152.stdout:5/383: link d5/d26/f33 d5/da/d62/d72/f7d 0 2024-09-13T23:06:22.191 INFO:tasks.workunit.client.1.smithi152.stdout:5/384: chown d5/dc/c4f 12 1 2024-09-13T23:06:22.199 INFO:tasks.workunit.client.1.smithi152.stdout:7/470: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:22.199 INFO:tasks.workunit.client.1.smithi152.stdout:7/471: truncate d17/d24/d2d/d51/d5b/d90/d2e/f76 204851 0 2024-09-13T23:06:22.199 INFO:tasks.workunit.client.1.smithi152.stdout:2/471: dwrite d0/d4/f1d [0,4194304] 0 2024-09-13T23:06:22.200 INFO:tasks.workunit.client.1.smithi152.stdout:7/472: mknod d17/d24/d2d/d51/d5b/d90/d2b/d4b/d61/d82/c9b 0 2024-09-13T23:06:22.201 INFO:tasks.workunit.client.1.smithi152.stdout:2/472: link d0/d4/d9/d55/d8f/f9a d0/d4/d9/d18/d1e/d3c/fa6 0 2024-09-13T23:06:22.209 INFO:tasks.workunit.client.1.smithi152.stdout:2/473: symlink d0/d4/d9/d18/d1e/d3c/la7 0 2024-09-13T23:06:22.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/449: write d3/d24/d67/f8a [1916492,23869] 0 2024-09-13T23:06:22.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/450: creat d3/d24/d67/d4a/f96 x:0 0 0 2024-09-13T23:06:22.209 INFO:tasks.workunit.client.1.smithi152.stdout:2/474: dread d0/d4/d9/f4b [0,4194304] 0 2024-09-13T23:06:22.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/451: creat d3/d24/d67/d47/f97 x:0 0 0 2024-09-13T23:06:22.212 INFO:tasks.workunit.client.1.smithi152.stdout:9/452: mknod d3/d52/d8c/c98 0 2024-09-13T23:06:22.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/453: rename d3/d24/l18 to d3/l99 0 2024-09-13T23:06:22.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/454: fdatasync d3/d24/d67/d47/f51 0 2024-09-13T23:06:22.215 INFO:tasks.workunit.client.1.smithi152.stdout:9/455: truncate d3/d1e/d30/f94 145753 0 2024-09-13T23:06:22.217 INFO:tasks.workunit.client.1.smithi152.stdout:9/456: truncate d3/d24/d67/f50 357097 0 2024-09-13T23:06:22.217 INFO:tasks.workunit.client.1.smithi152.stdout:9/457: creat d3/d24/d34/d45/f9a x:0 0 0 2024-09-13T23:06:22.219 INFO:tasks.workunit.client.1.smithi152.stdout:5/385: dwrite d5/dc/d19/d65/f50 [0,4194304] 0 2024-09-13T23:06:22.220 INFO:tasks.workunit.client.1.smithi152.stdout:9/458: link d3/d24/d67/f8a d3/f9b 0 2024-09-13T23:06:22.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/475: dread d0/d4/d9/d14/f2f [0,4194304] 0 2024-09-13T23:06:22.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/386: creat d5/dc/d19/f7e x:0 0 0 2024-09-13T23:06:22.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/387: readlink d5/dc/l10 0 2024-09-13T23:06:22.223 INFO:tasks.workunit.client.1.smithi152.stdout:2/476: link d0/d4/d9/d16/l5d d0/d4/d9/d18/d32/la8 0 2024-09-13T23:06:22.223 INFO:tasks.workunit.client.1.smithi152.stdout:2/477: fdatasync d0/d4/d9/f63 0 2024-09-13T23:06:22.224 INFO:tasks.workunit.client.1.smithi152.stdout:2/478: creat d0/d4/d9/d16/d30/fa9 x:0 0 0 2024-09-13T23:06:22.224 INFO:tasks.workunit.client.1.smithi152.stdout:5/388: mkdir d5/da/d62/d72/d7f 0 2024-09-13T23:06:22.226 INFO:tasks.workunit.client.1.smithi152.stdout:5/389: mkdir d5/dc/d4c/d80 0 2024-09-13T23:06:22.227 INFO:tasks.workunit.client.1.smithi152.stdout:5/390: rmdir d5/dc/d19/d20/d55/d79 0 2024-09-13T23:06:22.227 INFO:tasks.workunit.client.1.smithi152.stdout:5/391: fdatasync d5/da/d62/f56 0 2024-09-13T23:06:22.228 INFO:tasks.workunit.client.1.smithi152.stdout:5/392: dread - d5/da/f6f zero size 2024-09-13T23:06:22.232 INFO:tasks.workunit.client.1.smithi152.stdout:5/393: dread d5/f3f [0,4194304] 0 2024-09-13T23:06:22.232 INFO:tasks.workunit.client.1.smithi152.stdout:5/394: stat d5/dc/d19/f1a 0 2024-09-13T23:06:22.233 INFO:tasks.workunit.client.1.smithi152.stdout:5/395: mknod d5/da/d62/d6c/c81 0 2024-09-13T23:06:22.234 INFO:tasks.workunit.client.1.smithi152.stdout:5/396: mkdir d5/dc/d4c/d82 0 2024-09-13T23:06:22.235 INFO:tasks.workunit.client.1.smithi152.stdout:5/397: truncate d5/dc/d19/f1a 1141951 0 2024-09-13T23:06:22.235 INFO:tasks.workunit.client.1.smithi152.stdout:5/398: read - d5/f5a zero size 2024-09-13T23:06:22.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/479: read d0/d4/d9/d18/d1e/f1c [2667528,33757] 0 2024-09-13T23:06:22.242 INFO:tasks.workunit.client.1.smithi152.stdout:2/480: write d0/d4/d9/d14/f28 [4391957,16356] 0 2024-09-13T23:06:22.244 INFO:tasks.workunit.client.1.smithi152.stdout:2/481: link d0/d4/d9/d18/d32/f5a d0/d4/d9/d16/d2b/faa 0 2024-09-13T23:06:22.246 INFO:tasks.workunit.client.1.smithi152.stdout:9/459: dwrite d3/d24/d67/f6d [0,4194304] 0 2024-09-13T23:06:22.246 INFO:tasks.workunit.client.1.smithi152.stdout:7/473: dwrite d17/d24/d2d/d51/d5b/f6e [0,4194304] 0 2024-09-13T23:06:22.246 INFO:tasks.workunit.client.1.smithi152.stdout:7/474: fsync d17/f27 0 2024-09-13T23:06:22.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/460: mknod d3/d24/d67/d4a/c9c 0 2024-09-13T23:06:22.250 INFO:tasks.workunit.client.1.smithi152.stdout:7/475: symlink d17/d24/d2d/d51/d5b/d90/d2e/d79/l9c 0 2024-09-13T23:06:22.251 INFO:tasks.workunit.client.1.smithi152.stdout:9/461: mknod d3/d24/d34/d45/c9d 0 2024-09-13T23:06:22.252 INFO:tasks.workunit.client.1.smithi152.stdout:7/476: mkdir d17/d24/d2d/d51/d5b/d90/d2e/d9d 0 2024-09-13T23:06:22.253 INFO:tasks.workunit.client.1.smithi152.stdout:9/462: creat d3/d24/d67/d4a/d71/f9e x:0 0 0 2024-09-13T23:06:22.253 INFO:tasks.workunit.client.1.smithi152.stdout:9/463: truncate d3/d24/d67/d4a/f55 693143 0 2024-09-13T23:06:22.254 INFO:tasks.workunit.client.1.smithi152.stdout:7/477: mknod d17/d24/d2d/d51/d5b/d90/d2e/d59/c9e 0 2024-09-13T23:06:22.260 INFO:tasks.workunit.client.1.smithi152.stdout:7/478: dread f0 [0,4194304] 0 2024-09-13T23:06:22.276 INFO:tasks.workunit.client.1.smithi152.stdout:9/464: dwrite d3/d24/d67/f7b [0,4194304] 0 2024-09-13T23:06:22.278 INFO:tasks.workunit.client.1.smithi152.stdout:9/465: rename d3/d24/f2e to d3/d52/f9f 0 2024-09-13T23:06:22.278 INFO:tasks.workunit.client.1.smithi152.stdout:9/466: write d3/d1e/f33 [1723351,62900] 0 2024-09-13T23:06:22.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/467: unlink d3/d1e/d30/c85 0 2024-09-13T23:06:22.280 INFO:tasks.workunit.client.1.smithi152.stdout:9/468: mknod d3/d24/d67/d4a/d71/ca0 0 2024-09-13T23:06:22.288 INFO:tasks.workunit.client.1.smithi152.stdout:5/399: dwrite d5/da/f1b [4194304,4194304] 0 2024-09-13T23:06:22.288 INFO:tasks.workunit.client.1.smithi152.stdout:2/482: dwrite d0/d4/d9/f40 [0,4194304] 0 2024-09-13T23:06:22.288 INFO:tasks.workunit.client.1.smithi152.stdout:7/479: dwrite d17/f98 [0,4194304] 0 2024-09-13T23:06:22.289 INFO:tasks.workunit.client.1.smithi152.stdout:5/400: rename d5/l1c to d5/dc/d19/d20/d55/l83 0 2024-09-13T23:06:22.289 INFO:tasks.workunit.client.1.smithi152.stdout:5/401: creat d5/dc/f84 x:0 0 0 2024-09-13T23:06:22.292 INFO:tasks.workunit.client.1.smithi152.stdout:9/469: dread d3/d1e/f21 [0,4194304] 0 2024-09-13T23:06:22.293 INFO:tasks.workunit.client.1.smithi152.stdout:2/483: creat d0/d4/d9/fab x:0 0 0 2024-09-13T23:06:22.295 INFO:tasks.workunit.client.1.smithi152.stdout:7/480: unlink d17/d24/d2d/l60 0 2024-09-13T23:06:22.299 INFO:tasks.workunit.client.1.smithi152.stdout:2/484: creat d0/d4/d8a/fac x:0 0 0 2024-09-13T23:06:22.299 INFO:tasks.workunit.client.1.smithi152.stdout:2/485: fdatasync d0/d4/d9/d16/d2b/f46 0 2024-09-13T23:06:22.299 INFO:tasks.workunit.client.1.smithi152.stdout:2/486: chown d0/d4/d9/d14/f7c 21850 1 2024-09-13T23:06:22.301 INFO:tasks.workunit.client.1.smithi152.stdout:2/487: dread d0/d4/d9/d55/f57 [0,4194304] 0 2024-09-13T23:06:22.301 INFO:tasks.workunit.client.1.smithi152.stdout:9/470: write d3/d1e/d30/d5d/f80 [638422,94798] 0 2024-09-13T23:06:22.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/402: getdents d5/d26/d61 0 2024-09-13T23:06:22.306 INFO:tasks.workunit.client.1.smithi152.stdout:9/471: truncate d3/f28 5314935 0 2024-09-13T23:06:22.307 INFO:tasks.workunit.client.1.smithi152.stdout:9/472: write d3/d24/f2a [4315816,62903] 0 2024-09-13T23:06:22.307 INFO:tasks.workunit.client.1.smithi152.stdout:5/403: symlink d5/dc/d19/d20/d55/l85 0 2024-09-13T23:06:22.308 INFO:tasks.workunit.client.1.smithi152.stdout:2/488: read d0/d4/f53 [4075805,40478] 0 2024-09-13T23:06:22.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/489: creat d0/d4/d9/d18/fad x:0 0 0 2024-09-13T23:06:22.310 INFO:tasks.workunit.client.1.smithi152.stdout:5/404: mkdir d5/da/d86 0 2024-09-13T23:06:22.311 INFO:tasks.workunit.client.1.smithi152.stdout:5/405: chown d5/da/cb 11900 1 2024-09-13T23:06:22.312 INFO:tasks.workunit.client.1.smithi152.stdout:7/481: rename d17/d24/d2d to d17/d24/d9f 0 2024-09-13T23:06:22.322 INFO:tasks.workunit.client.1.smithi152.stdout:9/473: rmdir d3/d24/d34/d45 39 2024-09-13T23:06:22.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/490: mknod d0/d4/d9/cae 0 2024-09-13T23:06:22.322 INFO:tasks.workunit.client.1.smithi152.stdout:5/406: write d5/dc/d19/d20/f4e [997265,84206] 0 2024-09-13T23:06:22.322 INFO:tasks.workunit.client.1.smithi152.stdout:5/407: write d5/da/f43 [67884,22989] 0 2024-09-13T23:06:22.322 INFO:tasks.workunit.client.1.smithi152.stdout:7/482: dread d17/f1d [0,4194304] 0 2024-09-13T23:06:22.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/483: rmdir d17/d24/d9f/d51/d5b/d90/d2e 39 2024-09-13T23:06:22.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/484: symlink d17/d4f/la0 0 2024-09-13T23:06:22.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/485: chown d17/d24/d9f/d51/d5b/d63/d7d/l96 2828 1 2024-09-13T23:06:22.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/486: mkdir d17/d24/d9f/d51/d5b/d90/d2e/d79/da1 0 2024-09-13T23:06:22.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/408: dread d5/f14 [0,4194304] 0 2024-09-13T23:06:22.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/409: write d5/dc/d19/d20/f4e [1274603,43691] 0 2024-09-13T23:06:22.334 INFO:tasks.workunit.client.1.smithi152.stdout:2/491: write d0/d4/d9/d16/d30/f59 [5807489,125542] 0 2024-09-13T23:06:22.334 INFO:tasks.workunit.client.1.smithi152.stdout:5/410: write d5/d26/f33 [29694,29231] 0 2024-09-13T23:06:22.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/492: symlink d0/d4/d9/d16/d9f/laf 0 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/474: dread d3/d24/d67/f5c [0,4194304] 0 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:2/493: truncate d0/d4/d8a/fac 474045 0 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/475: read - d3/d52/f83 zero size 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/476: readlink d3/d1e/d30/d5d/l7e 0 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:2/494: dread - d0/d4/d9/d14/d48/d4a/f56 zero size 2024-09-13T23:06:22.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/477: creat d3/d1e/fa1 x:0 0 0 2024-09-13T23:06:22.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/411: dread d5/f3f [0,4194304] 0 2024-09-13T23:06:22.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/412: chown d5/d26/d61/f77 462867 1 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/413: creat d5/d26/d6d/f87 x:0 0 0 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/414: chown d5/dc/d19/d65/l42 471273132 1 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/415: readlink d5/dc/d19/l2b 0 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/416: truncate d5/da/f58 908519 0 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:1/408: sync 2024-09-13T23:06:22.342 INFO:tasks.workunit.client.1.smithi152.stdout:1/409: creat d4/d9/d71/f89 x:0 0 0 2024-09-13T23:06:22.344 INFO:tasks.workunit.client.1.smithi152.stdout:5/417: mknod d5/da/c88 0 2024-09-13T23:06:22.371 INFO:tasks.workunit.client.1.smithi152.stdout:9/478: dwrite d3/d24/d67/f6d [0,4194304] 0 2024-09-13T23:06:22.373 INFO:tasks.workunit.client.1.smithi152.stdout:2/495: dwrite d0/d4/d9/d14/f7c [0,4194304] 0 2024-09-13T23:06:22.373 INFO:tasks.workunit.client.1.smithi152.stdout:9/479: rename d3/d1e/d30/f32 to d3/d52/d8c/fa2 0 2024-09-13T23:06:22.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/418: dwrite d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:22.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/419: dread - d5/d26/d6d/f87 zero size 2024-09-13T23:06:22.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/420: write d5/d26/d6d/f87 [383307,28533] 0 2024-09-13T23:06:22.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/421: creat d5/dc/f89 x:0 0 0 2024-09-13T23:06:22.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/422: fsync d5/da/d62/f56 0 2024-09-13T23:06:22.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/423: chown d5/dc/d19/d65/l3a 17614586 1 2024-09-13T23:06:22.376 INFO:tasks.workunit.client.1.smithi152.stdout:1/410: dwrite d4/d9/d1a/f4e [0,4194304] 0 2024-09-13T23:06:22.376 INFO:tasks.workunit.client.1.smithi152.stdout:2/496: creat d0/d4/d9/d18/d1e/d3c/d88/d98/fb0 x:0 0 0 2024-09-13T23:06:22.377 INFO:tasks.workunit.client.1.smithi152.stdout:9/480: mkdir d3/d1e/d30/d5d/da3 0 2024-09-13T23:06:22.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/481: write d3/d1e/d30/d5d/f80 [3718269,102387] 0 2024-09-13T23:06:22.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/424: symlink d5/da/d62/d6c/l8a 0 2024-09-13T23:06:22.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/425: creat d5/da/d62/f8b x:0 0 0 2024-09-13T23:06:22.381 INFO:tasks.workunit.client.1.smithi152.stdout:1/411: rename d4/d9/d1a/d22/d24/d48/f79 to d4/d9/f8a 0 2024-09-13T23:06:22.381 INFO:tasks.workunit.client.1.smithi152.stdout:1/412: stat d4/d4c/l6c 0 2024-09-13T23:06:22.381 INFO:tasks.workunit.client.1.smithi152.stdout:5/426: dread d5/f22 [0,4194304] 0 2024-09-13T23:06:22.384 INFO:tasks.workunit.client.1.smithi152.stdout:1/413: mkdir d4/d47/d8b 0 2024-09-13T23:06:22.386 INFO:tasks.workunit.client.1.smithi152.stdout:2/497: mknod d0/cb1 0 2024-09-13T23:06:22.386 INFO:tasks.workunit.client.1.smithi152.stdout:2/498: truncate d0/d4/d9/d14/d48/d49/f79 4732524 0 2024-09-13T23:06:22.386 INFO:tasks.workunit.client.1.smithi152.stdout:2/499: creat d0/d4/d9/d16/d2b/fb2 x:0 0 0 2024-09-13T23:06:22.388 INFO:tasks.workunit.client.1.smithi152.stdout:1/414: rename d4/d47/c62 to d4/c8c 0 2024-09-13T23:06:22.388 INFO:tasks.workunit.client.1.smithi152.stdout:1/415: chown d4/d47/c65 0 1 2024-09-13T23:06:22.390 INFO:tasks.workunit.client.1.smithi152.stdout:2/500: creat d0/d4/d9/d14/d48/fb3 x:0 0 0 2024-09-13T23:06:22.390 INFO:tasks.workunit.client.1.smithi152.stdout:2/501: readlink d0/d4/d9/d18/l68 0 2024-09-13T23:06:22.390 INFO:tasks.workunit.client.1.smithi152.stdout:2/502: stat d0/d4/d9/d55/d8f/f96 0 2024-09-13T23:06:22.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/427: write d5/dc/d19/d65/f50 [4187914,58295] 0 2024-09-13T23:06:22.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/482: dwrite d3/d24/d67/d47/f64 [0,4194304] 0 2024-09-13T23:06:22.396 INFO:tasks.workunit.client.1.smithi152.stdout:9/483: chown d3/d24/c31 35689 1 2024-09-13T23:06:22.397 INFO:tasks.workunit.client.1.smithi152.stdout:9/484: mknod d3/d24/d67/d4a/d71/ca4 0 2024-09-13T23:06:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:1/416: dwrite d4/d9/d1a/d22/d24/f6a [0,4194304] 0 2024-09-13T23:06:22.409 INFO:tasks.workunit.client.1.smithi152.stdout:1/417: chown d4/d9/d1a/c6f 251957229 1 2024-09-13T23:06:22.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/418: mkdir d4/d4c/d8d 0 2024-09-13T23:06:22.434 INFO:tasks.workunit.client.1.smithi152.stdout:5/428: dwrite d5/f3f [0,4194304] 0 2024-09-13T23:06:22.445 INFO:tasks.workunit.client.1.smithi152.stdout:5/429: dread d5/f7 [4194304,4194304] 0 2024-09-13T23:06:22.445 INFO:tasks.workunit.client.1.smithi152.stdout:9/485: dwrite d3/d1e/d30/f94 [0,4194304] 0 2024-09-13T23:06:22.445 INFO:tasks.workunit.client.1.smithi152.stdout:9/486: chown d3/f17 0 1 2024-09-13T23:06:22.445 INFO:tasks.workunit.client.1.smithi152.stdout:2/503: dwrite d0/d4/f1a [4194304,4194304] 0 2024-09-13T23:06:22.447 INFO:tasks.workunit.client.1.smithi152.stdout:1/419: dwrite d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:22.447 INFO:tasks.workunit.client.1.smithi152.stdout:1/420: creat d4/d47/f8e x:0 0 0 2024-09-13T23:06:22.447 INFO:tasks.workunit.client.1.smithi152.stdout:5/430: symlink d5/da/d62/d72/d7f/l8c 0 2024-09-13T23:06:22.448 INFO:tasks.workunit.client.1.smithi152.stdout:5/431: chown d5/da/d62/c3b 0 1 2024-09-13T23:06:22.457 INFO:tasks.workunit.client.1.smithi152.stdout:1/421: creat d4/d47/d8b/f8f x:0 0 0 2024-09-13T23:06:22.458 INFO:tasks.workunit.client.1.smithi152.stdout:5/432: mknod d5/da/d62/d72/d7f/c8d 0 2024-09-13T23:06:22.458 INFO:tasks.workunit.client.1.smithi152.stdout:2/504: rmdir d0/d4/d9/d55/d8f 39 2024-09-13T23:06:22.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/422: link f1 d4/f90 0 2024-09-13T23:06:22.459 INFO:tasks.workunit.client.1.smithi152.stdout:5/433: mknod d5/da/d62/d6c/c8e 0 2024-09-13T23:06:22.460 INFO:tasks.workunit.client.1.smithi152.stdout:5/434: mknod d5/dc/d19/c8f 0 2024-09-13T23:06:22.461 INFO:tasks.workunit.client.1.smithi152.stdout:5/435: symlink d5/l90 0 2024-09-13T23:06:22.468 INFO:tasks.workunit.client.1.smithi152.stdout:2/505: write d0/d4/d9/d14/f28 [3235110,33772] 0 2024-09-13T23:06:22.468 INFO:tasks.workunit.client.1.smithi152.stdout:2/506: stat d0/d4/d9/d55/d8f/f9a 0 2024-09-13T23:06:22.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/487: dwrite d3/f4f [0,4194304] 0 2024-09-13T23:06:22.469 INFO:tasks.workunit.client.1.smithi152.stdout:2/507: unlink d0/d4/d9/d16/c26 0 2024-09-13T23:06:22.472 INFO:tasks.workunit.client.1.smithi152.stdout:1/423: dread d4/d9/d1a/f49 [0,4194304] 0 2024-09-13T23:06:22.473 INFO:tasks.workunit.client.1.smithi152.stdout:2/508: rename d0/l2c to d0/d4/d9/d55/lb4 0 2024-09-13T23:06:22.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.472+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4784115430 con 0x7f476c06e6e0 2024-09-13T23:06:22.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.474+0000 7f4772ffd640 1 -- 172.21.15.115:0/3627420472 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4784115430 con 0x7f476c06e6e0 2024-09-13T23:06:22.476 INFO:tasks.workunit.client.1.smithi152.stdout:1/424: unlink d4/d9/d1a/d22/d24/l7c 0 2024-09-13T23:06:22.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/509: mkdir d0/d4/d9/d16/d30/d9e/db5 0 2024-09-13T23:06:22.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/510: readlink d0/d4/l11 0 2024-09-13T23:06:22.478 INFO:tasks.workunit.client.1.smithi152.stdout:9/488: dread d3/f15 [0,4194304] 0 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.477+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 msgr2=0x7f476c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.477+0000 7f47889e1640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 0x7f476c070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47841133d0 tx=0x7f4774009040 comp rx=0 tx=0).stop 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 msgr2=0x7f4784113620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f477c000c00 tx=0x7f477c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 shutdown_connections 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f476c06e6e0 0x7f476c070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47840fc1f0 0x7f4784113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 --2- 172.21.15.115:0/3627420472 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47840fb8a0 0x7f4784113620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 >> 172.21.15.115:0/3627420472 conn(0x7f47840f6390 msgr2=0x7f47840f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 shutdown_connections 2024-09-13T23:06:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.478+0000 7f47889e1640 1 -- 172.21.15.115:0/3627420472 wait complete. 2024-09-13T23:06:22.480 INFO:tasks.workunit.client.1.smithi152.stdout:2/511: rename d0/fa to d0/d4/d9/d18/d32/fb6 0 2024-09-13T23:06:22.481 INFO:tasks.workunit.client.1.smithi152.stdout:2/512: symlink d0/d4/d9/d16/d30/d9e/db5/lb7 0 2024-09-13T23:06:22.482 INFO:tasks.workunit.client.1.smithi152.stdout:5/436: rmdir d5/da/d62 39 2024-09-13T23:06:22.486 INFO:tasks.workunit.client.1.smithi152.stdout:1/425: dread d4/f28 [0,4194304] 0 2024-09-13T23:06:22.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/426: read d4/d9/fb [4078820,118902] 0 2024-09-13T23:06:22.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/427: write d4/d47/f8e [314933,48461] 0 2024-09-13T23:06:22.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/428: readlink d4/d9/d71/l84 0 2024-09-13T23:06:22.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/429: truncate d4/f7e 204287 0 2024-09-13T23:06:22.487 INFO:tasks.workunit.client.1.smithi152.stdout:2/513: dread d0/d4/d9/d16/d2b/f50 [0,4194304] 0 2024-09-13T23:06:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/430: mknod d4/d9/d71/c91 0 2024-09-13T23:06:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/431: chown d4/d9/d1a/d22/f63 287 1 2024-09-13T23:06:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/432: readlink d4/d9/d1a/l39 0 2024-09-13T23:06:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:2/514: mknod d0/d4/d9/d16/d9f/cb8 0 2024-09-13T23:06:22.489 INFO:tasks.workunit.client.1.smithi152.stdout:2/515: write d0/d4/d9/d55/d8f/f9a [223343,69547] 0 2024-09-13T23:06:22.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/548: sync 2024-09-13T23:06:22.490 INFO:tasks.workunit.client.1.smithi152.stdout:6/448: sync 2024-09-13T23:06:22.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/549: fsync d3/d4/d6/d8/f8f 0 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:3/388: sync 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:8/354: sync 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/487: sync 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:8/355: readlink d17/d23/l36 0 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/488: write d17/d24/d9f/d46/f5e [263673,3131] 0 2024-09-13T23:06:22.491 INFO:tasks.workunit.client.1.smithi152.stdout:2/516: mkdir d0/d4/d9/d18/d1e/d3c/d88/db9 0 2024-09-13T23:06:22.492 INFO:tasks.workunit.client.1.smithi152.stdout:0/426: sync 2024-09-13T23:06:22.493 INFO:tasks.workunit.client.1.smithi152.stdout:3/389: symlink de/d14/d47/l8a 0 2024-09-13T23:06:22.493 INFO:tasks.workunit.client.1.smithi152.stdout:3/390: write de/d1f/f74 [1930277,82608] 0 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/489: rmdir d17/d24/d9f/d51/d5b/d90 39 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/490: chown d17/d24/d9f/d3f/l5c 2554393 1 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/491: chown d17/d24/d9f/d51/f97 25326 1 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/492: read - d17/d24/d9f/d51/d5b/d90/d2b/f8d zero size 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/433: dread d4/f28 [0,4194304] 0 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/434: fsync d4/d9/f27 0 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/435: dread - d4/d9/d1a/d22/d24/d48/f76 zero size 2024-09-13T23:06:22.494 INFO:tasks.workunit.client.1.smithi152.stdout:2/517: mkdir d0/d4/d9/d16/d30/dba 0 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/550: dread d3/d4/d6/f4c [0,4194304] 0 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/551: chown d3/d4/d6/d66/d2b/d84 21 1 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:2/518: read - d0/d4/d9/d16/d30/fa9 zero size 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:2/519: dread - d0/d4/d9/d55/d8f/f96 zero size 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:2/520: chown d0/d4/d9/f4b 15225010 1 2024-09-13T23:06:22.495 INFO:tasks.workunit.client.1.smithi152.stdout:0/427: dread d18/d1f/d29/d4e/f64 [0,4194304] 0 2024-09-13T23:06:22.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/391: symlink de/d14/l8b 0 2024-09-13T23:06:22.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/392: chown de/d14/d38/c65 15085426 1 2024-09-13T23:06:22.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/393: fsync de/d14/d47/d57/f64 0 2024-09-13T23:06:22.497 INFO:tasks.workunit.client.1.smithi152.stdout:7/493: link d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/l73 d17/d24/d9f/d51/d5b/d90/d8e/la2 0 2024-09-13T23:06:22.498 INFO:tasks.workunit.client.1.smithi152.stdout:1/436: symlink d4/d9/l92 0 2024-09-13T23:06:22.500 INFO:tasks.workunit.client.1.smithi152.stdout:9/489: dwrite d3/d24/d34/d45/f82 [0,4194304] 0 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/552: creat d3/d4/d6/d66/d1c/d59/d60/d74/fa8 x:0 0 0 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/553: rename d3/d4/d6/d8/d17/d5d/d94/d9b to d3/d4/d6/d8/d17/d5d/d94/d9b/da0/da9 22 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/554: readlink d3/d4/d6/d66/d2b/d84/l9e 0 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:0/428: getdents d18/d1f/d33/d65/d7a 0 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:0/429: creat d18/d1f/d33/f9a x:0 0 0 2024-09-13T23:06:22.501 INFO:tasks.workunit.client.1.smithi152.stdout:0/430: getdents d18/d1f/d29/d3f/d4b/d66/d70 0 2024-09-13T23:06:22.502 INFO:tasks.workunit.client.1.smithi152.stdout:8/356: dread f15 [0,4194304] 0 2024-09-13T23:06:22.502 INFO:tasks.workunit.client.1.smithi152.stdout:8/357: chown d17/f29 2405 1 2024-09-13T23:06:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:1/437: getdents d4/d4c 0 2024-09-13T23:06:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:1/438: readlink d4/d9/d1a/d22/l3e 0 2024-09-13T23:06:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:1/439: write d4/d9/d1a/f19 [5003764,68571] 0 2024-09-13T23:06:22.503 INFO:tasks.workunit.client.1.smithi152.stdout:1/440: creat d4/f93 x:0 0 0 2024-09-13T23:06:22.505 INFO:tasks.workunit.client.1.smithi152.stdout:9/490: mknod d3/d24/d67/d4a/d8e/ca5 0 2024-09-13T23:06:22.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/555: symlink d3/d4/d8d/d93/laa 0 2024-09-13T23:06:22.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/556: creat d3/fab x:0 0 0 2024-09-13T23:06:22.508 INFO:tasks.workunit.client.1.smithi152.stdout:0/431: creat d18/f9b x:0 0 0 2024-09-13T23:06:22.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/358: unlink d17/d25/f2a 0 2024-09-13T23:06:22.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/359: dread - d17/d23/f67 zero size 2024-09-13T23:06:22.511 INFO:tasks.workunit.client.1.smithi152.stdout:2/521: read d0/d4/d9/d16/f21 [715793,40595] 0 2024-09-13T23:06:22.511 INFO:tasks.workunit.client.1.smithi152.stdout:2/522: dread - d0/d4/d9/d55/d8f/f96 zero size 2024-09-13T23:06:22.512 INFO:tasks.workunit.client.1.smithi152.stdout:9/491: truncate d3/d24/d67/f4d 67246 0 2024-09-13T23:06:22.513 INFO:tasks.workunit.client.1.smithi152.stdout:7/494: dread f6 [0,4194304] 0 2024-09-13T23:06:22.515 INFO:tasks.workunit.client.1.smithi152.stdout:0/432: link d18/d19/d74/c8a d18/d1f/d29/d3f/d4b/d66/d6a/c9c 0 2024-09-13T23:06:22.516 INFO:tasks.workunit.client.1.smithi152.stdout:8/360: mkdir d17/d25/d32/d4b/d76 0 2024-09-13T23:06:22.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/492: truncate d3/d24/d67/d47/f64 852460 0 2024-09-13T23:06:22.519 INFO:tasks.workunit.client.1.smithi152.stdout:4/557: write d3/d4/d6/d66/d1c/f2c [1286862,74166] 0 2024-09-13T23:06:22.519 INFO:tasks.workunit.client.1.smithi152.stdout:4/558: stat d3/d4/d6/d8/d17/d5d/d94/d9b/da0 0 2024-09-13T23:06:22.520 INFO:tasks.workunit.client.1.smithi152.stdout:8/361: truncate d17/d19/f33 1782246 0 2024-09-13T23:06:22.525 INFO:tasks.workunit.client.1.smithi152.stdout:4/559: read d3/d4/d6/d63/f99 [879677,35734] 0 2024-09-13T23:06:22.525 INFO:tasks.workunit.client.1.smithi152.stdout:9/493: rename d3/d24/d67/c3d to d3/d24/d67/d4a/ca6 0 2024-09-13T23:06:22.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/362: rename d17/d23/f45 to d17/f77 0 2024-09-13T23:06:22.527 INFO:tasks.workunit.client.1.smithi152.stdout:7/495: write d17/f25 [603042,67552] 0 2024-09-13T23:06:22.527 INFO:tasks.workunit.client.1.smithi152.stdout:9/494: getdents d3/d24/d67/d60 0 2024-09-13T23:06:22.529 INFO:tasks.workunit.client.1.smithi152.stdout:7/496: mknod d17/d24/d9f/d51/d5b/d63/d7d/ca3 0 2024-09-13T23:06:22.532 INFO:tasks.workunit.client.1.smithi152.stdout:6/449: dwrite d4/de/d21/f24 [0,4194304] 0 2024-09-13T23:06:22.532 INFO:tasks.workunit.client.1.smithi152.stdout:6/450: dread - d4/de/d12/f9b zero size 2024-09-13T23:06:22.532 INFO:tasks.workunit.client.1.smithi152.stdout:6/451: readlink d4/de/d12/d16/d2a/d38/d3c/l46 0 2024-09-13T23:06:22.533 INFO:tasks.workunit.client.1.smithi152.stdout:5/437: dwrite d5/dc/d19/d20/d55/f75 [0,4194304] 0 2024-09-13T23:06:22.533 INFO:tasks.workunit.client.1.smithi152.stdout:6/452: write d4/de/d1d/f2f [604165,36579] 0 2024-09-13T23:06:22.533 INFO:tasks.workunit.client.1.smithi152.stdout:2/523: dwrite d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:22.533 INFO:tasks.workunit.client.1.smithi152.stdout:7/497: creat d17/d24/d9f/d51/d5b/d90/fa4 x:0 0 0 2024-09-13T23:06:22.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/394: dwrite de/f39 [4194304,4194304] 0 2024-09-13T23:06:22.535 INFO:tasks.workunit.client.1.smithi152.stdout:5/438: symlink d5/dc/d19/d20/d2e/d28/l91 0 2024-09-13T23:06:22.538 INFO:tasks.workunit.client.1.smithi152.stdout:6/453: dread d4/de/d12/d16/f7e [0,4194304] 0 2024-09-13T23:06:22.538 INFO:tasks.workunit.client.1.smithi152.stdout:6/454: stat d4/de/d12/d16/c40 0 2024-09-13T23:06:22.542 INFO:tasks.workunit.client.1.smithi152.stdout:2/524: link d0/d4/d9/d55/d8f/f96 d0/d4/d9/d18/d1e/d8c/fbb 0 2024-09-13T23:06:22.544 INFO:tasks.workunit.client.1.smithi152.stdout:7/498: rename d17/d24/d9f/d51/d5b/d90/d2b/d4b/f6b to d17/d24/d9f/d51/d5b/d90/d2e/d71/fa5 0 2024-09-13T23:06:22.545 INFO:tasks.workunit.client.1.smithi152.stdout:4/560: dwrite d3/d4/d6/d8/f8f [0,4194304] 0 2024-09-13T23:06:22.547 INFO:tasks.workunit.client.1.smithi152.stdout:6/455: link d4/de/d12/d16/c40 d4/de/d1d/d79/c9d 0 2024-09-13T23:06:22.549 INFO:tasks.workunit.client.1.smithi152.stdout:2/525: truncate d0/d4/d9/d14/f28 2575159 0 2024-09-13T23:06:22.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/499: mknod d17/d4f/d84/ca6 0 2024-09-13T23:06:22.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/363: dwrite d17/d23/f2b [0,4194304] 0 2024-09-13T23:06:22.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/364: readlink d17/d19/l64 0 2024-09-13T23:06:22.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/365: chown c16 119 1 2024-09-13T23:06:22.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/366: write d17/d25/d32/f75 [773510,122823] 0 2024-09-13T23:06:22.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/367: readlink l6 0 2024-09-13T23:06:22.556 INFO:tasks.workunit.client.1.smithi152.stdout:9/495: dwrite d3/d24/d67/d4a/d71/f89 [0,4194304] 0 2024-09-13T23:06:22.556 INFO:tasks.workunit.client.1.smithi152.stdout:9/496: read - d3/d1e/fa1 zero size 2024-09-13T23:06:22.556 INFO:tasks.workunit.client.1.smithi152.stdout:6/456: truncate d4/de/d12/d16/d2a/d38/d3c/f45 3357335 0 2024-09-13T23:06:22.557 INFO:tasks.workunit.client.1.smithi152.stdout:2/526: dread d0/d4/d9/d16/d30/f59 [4194304,4194304] 0 2024-09-13T23:06:22.559 INFO:tasks.workunit.client.1.smithi152.stdout:7/500: mknod d17/d4f/d84/ca7 0 2024-09-13T23:06:22.559 INFO:tasks.workunit.client.1.smithi152.stdout:4/561: write d3/d4/d6/d66/f7 [4048243,11922] 0 2024-09-13T23:06:22.560 INFO:tasks.workunit.client.1.smithi152.stdout:8/368: write d17/d19/f56 [487619,96477] 0 2024-09-13T23:06:22.562 INFO:tasks.workunit.client.1.smithi152.stdout:9/497: creat d3/d24/fa7 x:0 0 0 2024-09-13T23:06:22.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/441: truncate d4/f32 762908 0 2024-09-13T23:06:22.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/442: chown d4/d9/d1a/f58 836 1 2024-09-13T23:06:22.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/443: chown d4/d4c/d8d 2843 1 2024-09-13T23:06:22.565 INFO:tasks.workunit.client.1.smithi152.stdout:6/457: symlink d4/l9e 0 2024-09-13T23:06:22.567 INFO:tasks.workunit.client.1.smithi152.stdout:5/439: rename d5/d26/d6d to d5/dc/d19/d20/d2e/d28/d92 0 2024-09-13T23:06:22.569 INFO:tasks.workunit.client.1.smithi152.stdout:2/527: creat d0/d4/d9/d14/d48/d49/fbc x:0 0 0 2024-09-13T23:06:22.570 INFO:tasks.workunit.client.1.smithi152.stdout:7/501: mkdir d17/d24/d9f/d51/d5b/d90/d8e/da8 0 2024-09-13T23:06:22.573 INFO:tasks.workunit.client.1.smithi152.stdout:4/562: mkdir d3/d4/d6/d66/d2b/d84/dac 0 2024-09-13T23:06:22.576 INFO:tasks.workunit.client.1.smithi152.stdout:8/369: creat d17/d25/d32/d50/f78 x:0 0 0 2024-09-13T23:06:22.576 INFO:tasks.workunit.client.1.smithi152.stdout:8/370: chown d17/d23/f2b 1161 1 2024-09-13T23:06:22.576 INFO:tasks.workunit.client.1.smithi152.stdout:8/371: write d17/d25/d32/f75 [1424543,112256] 0 2024-09-13T23:06:22.576 INFO:tasks.workunit.client.1.smithi152.stdout:8/372: read d17/d25/d32/d50/f65 [177877,97507] 0 2024-09-13T23:06:22.577 INFO:tasks.workunit.client.1.smithi152.stdout:8/373: write d17/d23/f67 [59744,12933] 0 2024-09-13T23:06:22.577 INFO:tasks.workunit.client.1.smithi152.stdout:5/440: rename d5/da/f3d to d5/d26/d61/d68/f93 0 2024-09-13T23:06:22.579 INFO:tasks.workunit.client.1.smithi152.stdout:1/444: dwrite d4/d9/f64 [0,4194304] 0 2024-09-13T23:06:22.579 INFO:tasks.workunit.client.1.smithi152.stdout:2/528: truncate d0/d4/d9/d16/f21 3387844 0 2024-09-13T23:06:22.581 INFO:tasks.workunit.client.1.smithi152.stdout:7/502: symlink d17/d24/d9f/d51/d5b/d90/d2b/la9 0 2024-09-13T23:06:22.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/563: mkdir d3/d4/d6/d8/dad 0 2024-09-13T23:06:22.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/564: creat d3/d34/fae x:0 0 0 2024-09-13T23:06:22.583 INFO:tasks.workunit.client.1.smithi152.stdout:8/374: creat d17/d25/f79 x:0 0 0 2024-09-13T23:06:22.585 INFO:tasks.workunit.client.1.smithi152.stdout:9/498: rename d3/d24/d67/d60/l88 to d3/d1e/d30/la8 0 2024-09-13T23:06:22.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/445: mknod d4/d47/c94 0 2024-09-13T23:06:22.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/446: write d4/d9/fb [6845475,62363] 0 2024-09-13T23:06:22.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/529: mknod d0/d4/d9/d16/d9f/cbd 0 2024-09-13T23:06:22.592 INFO:tasks.workunit.client.1.smithi152.stdout:7/503: creat d17/d24/d9f/d51/d5b/d63/faa x:0 0 0 2024-09-13T23:06:22.592 INFO:tasks.workunit.client.1.smithi152.stdout:7/504: write d17/d24/d9f/d51/d5b/d90/d2e/d71/f95 [957482,7535] 0 2024-09-13T23:06:22.595 INFO:tasks.workunit.client.1.smithi152.stdout:4/565: mkdir d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf 0 2024-09-13T23:06:22.595 INFO:tasks.workunit.client.1.smithi152.stdout:7/505: dread d17/f19 [0,4194304] 0 2024-09-13T23:06:22.596 INFO:tasks.workunit.client.1.smithi152.stdout:8/375: creat d17/d19/f7a x:0 0 0 2024-09-13T23:06:22.596 INFO:tasks.workunit.client.1.smithi152.stdout:8/376: write d17/d25/d32/d4b/f5b [2299230,16102] 0 2024-09-13T23:06:22.596 INFO:tasks.workunit.client.1.smithi152.stdout:5/441: dwrite d5/f6 [4194304,4194304] 0 2024-09-13T23:06:22.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/530: creat d0/d4/d9/d16/d30/d9e/db5/fbe x:0 0 0 2024-09-13T23:06:22.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/531: creat d0/d4/d9/d14/d48/fbf x:0 0 0 2024-09-13T23:06:22.603 INFO:tasks.workunit.client.1.smithi152.stdout:2/532: mkdir d0/d4/d9/d18/d1e/dc0 0 2024-09-13T23:06:22.605 INFO:tasks.workunit.client.1.smithi152.stdout:2/533: mkdir d0/d4/d9/d18/dc1 0 2024-09-13T23:06:22.605 INFO:tasks.workunit.client.1.smithi152.stdout:2/534: chown d0/d4/d9/d16/d99 157781045 1 2024-09-13T23:06:22.606 INFO:tasks.workunit.client.1.smithi152.stdout:4/566: dread d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:8/377: write d17/d19/f3d [977323,54016] 0 2024-09-13T23:06:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:8/378: truncate d17/d25/d32/f5c 469960 0 2024-09-13T23:06:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:8/379: read - d17/d25/d32/f54 zero size 2024-09-13T23:06:22.609 INFO:tasks.workunit.client.1.smithi152.stdout:9/499: dwrite d3/d24/d67/f8a [0,4194304] 0 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.608+0000 7f876c9a6640 1 -- 172.21.15.115:0/3631935968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fc1f0 msgr2=0x7f87680fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.608+0000 7f876c9a6640 1 --2- 172.21.15.115:0/3631935968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fc1f0 0x7f87680fa620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f875c0048d0 tx=0x7f875c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.609+0000 7f876c9a6640 1 -- 172.21.15.115:0/3631935968 shutdown_connections 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.609+0000 7f876c9a6640 1 --2- 172.21.15.115:0/3631935968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fc1f0 0x7f87680fa620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.609+0000 7f876c9a6640 1 --2- 172.21.15.115:0/3631935968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87680fb8a0 0x7f87680fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.609+0000 7f876c9a6640 1 -- 172.21.15.115:0/3631935968 >> 172.21.15.115:0/3631935968 conn(0x7f87680f6390 msgr2=0x7f87680f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:22.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.609+0000 7f876c9a6640 1 -- 172.21.15.115:0/3631935968 shutdown_connections 2024-09-13T23:06:22.611 INFO:tasks.workunit.client.1.smithi152.stdout:2/535: unlink d0/d4/d9/d18/l33 0 2024-09-13T23:06:22.611 INFO:tasks.workunit.client.1.smithi152.stdout:2/536: stat d0/d4/d9/d16/d30/d9e/db5 0 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 -- 172.21.15.115:0/3631935968 wait complete. 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 Processor -- start 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 -- start start 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87680fc1f0 0x7f8768108d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876810a3b0 con 0x7f87680fb8a0 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.610+0000 7f876c9a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768109260 con 0x7f87680fc1f0 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56692/0 (socket says 172.21.15.115:56692) 2024-09-13T23:06:22.612 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 -- 172.21.15.115:0/2057912238 learned_addr learned my addr 172.21.15.115:0/2057912238 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 -- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87680fc1f0 msgr2=0x7f8768108d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87680fc1f0 0x7f8768108d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.611+0000 7f876659c640 1 -- 172.21.15.115:0/2057912238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c005040 con 0x7f87680fb8a0 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f876659c640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f875800c810 tx=0x7f87580043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875800a820 con 0x7f87680fb8a0 2024-09-13T23:06:22.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f875800ae20 con 0x7f87680fb8a0 2024-09-13T23:06:22.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87580115c0 con 0x7f87680fb8a0 2024-09-13T23:06:22.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8768109540 con 0x7f87680fb8a0 2024-09-13T23:06:22.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.612+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8768121c40 con 0x7f87680fb8a0 2024-09-13T23:06:22.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.614+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680fa010 con 0x7f87680fb8a0 2024-09-13T23:06:22.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.615+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f8758012840 con 0x7f87680fb8a0 2024-09-13T23:06:22.616 INFO:tasks.workunit.client.1.smithi152.stdout:9/500: truncate d3/d1e/f3c 181827 0 2024-09-13T23:06:22.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.616+0000 7f8756ffd640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 0x7f8750070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:22.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.616+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f875808e2e0 con 0x7f87680fb8a0 2024-09-13T23:06:22.618 INFO:tasks.workunit.client.1.smithi152.stdout:9/501: symlink d3/d1e/d30/la9 0 2024-09-13T23:06:22.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.619+0000 7f8765d9b640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 0x7f8750070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:22.620 INFO:tasks.workunit.client.1.smithi152.stdout:4/567: write d3/d4/d6/f35 [3117515,30365] 0 2024-09-13T23:06:22.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.623+0000 7f8765d9b640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 0x7f8750070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f875c02a550 tx=0x7f875c009da0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:22.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/506: dwrite d17/d24/d9f/d51/d5b/d90/fa4 [0,4194304] 0 2024-09-13T23:06:22.626 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.625+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f875805b820 con 0x7f87680fb8a0 2024-09-13T23:06:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/568: rmdir d3/d4/d8d/d93 39 2024-09-13T23:06:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/569: write d3/d4/d6/d66/f85 [298549,52512] 0 2024-09-13T23:06:22.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/570: stat d3/ca2 0 2024-09-13T23:06:22.629 INFO:tasks.workunit.client.1.smithi152.stdout:7/507: mknod d17/d24/d9f/d3f/cab 0 2024-09-13T23:06:22.629 INFO:tasks.workunit.client.1.smithi152.stdout:7/508: readlink d17/d24/d9f/d51/d5b/d63/l93 0 2024-09-13T23:06:22.630 INFO:tasks.workunit.client.1.smithi152.stdout:4/571: creat d3/d4/d6/fb0 x:0 0 0 2024-09-13T23:06:22.630 INFO:tasks.workunit.client.1.smithi152.stdout:4/572: chown d3/d4/d6/d66/d2b/d7c 45305 1 2024-09-13T23:06:22.630 INFO:tasks.workunit.client.1.smithi152.stdout:4/573: write d3/d4/d6/d66/f7 [1706558,59838] 0 2024-09-13T23:06:22.635 INFO:tasks.workunit.client.1.smithi152.stdout:5/442: dwrite d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:22.637 INFO:tasks.workunit.client.1.smithi152.stdout:8/380: dwrite d17/d25/d32/f63 [0,4194304] 0 2024-09-13T23:06:22.637 INFO:tasks.workunit.client.1.smithi152.stdout:8/381: fsync d17/f1c 0 2024-09-13T23:06:22.637 INFO:tasks.workunit.client.1.smithi152.stdout:2/537: dwrite d0/d4/d9/d16/d2b/fb2 [0,4194304] 0 2024-09-13T23:06:22.638 INFO:tasks.workunit.client.1.smithi152.stdout:2/538: fsync d0/d4/d9/d16/d2b/f46 0 2024-09-13T23:06:22.638 INFO:tasks.workunit.client.1.smithi152.stdout:2/539: readlink d0/d4/d9/d16/l5d 0 2024-09-13T23:06:22.639 INFO:tasks.workunit.client.1.smithi152.stdout:8/382: mknod d17/d23/c7b 0 2024-09-13T23:06:22.640 INFO:tasks.workunit.client.1.smithi152.stdout:8/383: write d17/d25/d32/f54 [342319,41301] 0 2024-09-13T23:06:22.648 INFO:tasks.workunit.client.1.smithi152.stdout:8/384: link d17/d25/d32/f5c d17/d25/d32/f7c 0 2024-09-13T23:06:22.648 INFO:tasks.workunit.client.1.smithi152.stdout:8/385: creat d17/d25/d32/d4b/f7d x:0 0 0 2024-09-13T23:06:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:2/540: getdents d0/d4/d9 0 2024-09-13T23:06:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:2/541: creat d0/d4/d9/d14/d48/d4a/fc2 x:0 0 0 2024-09-13T23:06:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:2/542: creat d0/d4/fc3 x:0 0 0 2024-09-13T23:06:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:2/543: chown d0/d4/d9/d14 205 1 2024-09-13T23:06:22.650 INFO:tasks.workunit.client.1.smithi152.stdout:2/544: truncate d0/d4/d9/d18/d1e/d3c/d88/d98/fb0 293067 0 2024-09-13T23:06:22.655 INFO:tasks.workunit.client.1.smithi152.stdout:8/386: rename d17/d25/d32/d44/f48 to d17/d25/f7e 0 2024-09-13T23:06:22.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/387: write d17/d19/f4d [212468,82697] 0 2024-09-13T23:06:22.665 INFO:tasks.workunit.client.1.smithi152.stdout:2/545: rename d0/d4/d9/d18/d1e/d8c/l84 to d0/lc4 0 2024-09-13T23:06:22.666 INFO:tasks.workunit.client.1.smithi152.stdout:8/388: mknod d17/d25/c7f 0 2024-09-13T23:06:22.666 INFO:tasks.workunit.client.1.smithi152.stdout:2/546: truncate d0/d4/f1a 3446529 0 2024-09-13T23:06:22.667 INFO:tasks.workunit.client.1.smithi152.stdout:8/389: mkdir d17/d25/d80 0 2024-09-13T23:06:22.669 INFO:tasks.workunit.client.1.smithi152.stdout:8/390: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:22.670 INFO:tasks.workunit.client.1.smithi152.stdout:8/391: write d17/f1d [561697,93696] 0 2024-09-13T23:06:22.671 INFO:tasks.workunit.client.1.smithi152.stdout:8/392: rename d17/d25/d32/f5c to d17/d25/f81 0 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:8/393: chown c8 62269463 1 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:8/394: fdatasync d17/d19/f28 0 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/509: dwrite d17/d24/d9f/d51/d5b/d90/d2b/f47 [0,4194304] 0 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/510: getdents d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61 0 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:7/511: getdents d17/d24/d9f/d51/d5b/d90/d8e/da8 0 2024-09-13T23:06:22.672 INFO:tasks.workunit.client.1.smithi152.stdout:4/574: dwrite d3/d4/d6/f4c [0,4194304] 0 2024-09-13T23:06:22.673 INFO:tasks.workunit.client.1.smithi152.stdout:8/395: unlink d17/d23/f34 0 2024-09-13T23:06:22.673 INFO:tasks.workunit.client.1.smithi152.stdout:8/396: creat d17/d25/d32/d44/f82 x:0 0 0 2024-09-13T23:06:22.674 INFO:tasks.workunit.client.1.smithi152.stdout:2/547: dread d0/d4/d9/f40 [0,4194304] 0 2024-09-13T23:06:22.674 INFO:tasks.workunit.client.1.smithi152.stdout:2/548: fdatasync d0/d4/d9/d18/d1e/d3c/f58 0 2024-09-13T23:06:22.674 INFO:tasks.workunit.client.1.smithi152.stdout:8/397: write d17/d25/d32/f75 [1100545,37628] 0 2024-09-13T23:06:22.674 INFO:tasks.workunit.client.1.smithi152.stdout:5/443: dwrite d5/d26/d61/d68/f93 [0,4194304] 0 2024-09-13T23:06:22.676 INFO:tasks.workunit.client.1.smithi152.stdout:7/512: mkdir d17/d24/d9f/dac 0 2024-09-13T23:06:22.677 INFO:tasks.workunit.client.1.smithi152.stdout:4/575: symlink d3/d4/d6/d66/d2b/d8e/lb1 0 2024-09-13T23:06:22.679 INFO:tasks.workunit.client.1.smithi152.stdout:2/549: mknod d0/d4/d9/d14/d48/cc5 0 2024-09-13T23:06:22.681 INFO:tasks.workunit.client.1.smithi152.stdout:4/576: mknod d3/d4/d6/d8/d4b/cb2 0 2024-09-13T23:06:22.682 INFO:tasks.workunit.client.1.smithi152.stdout:2/550: creat d0/d4/d9/d18/dc1/fc6 x:0 0 0 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/444: dread d5/da/f1b [0,4194304] 0 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/445: readlink d5/dc/d19/d20/d2e/d28/l91 0 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:4/577: mknod d3/d34/cb3 0 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:4/578: read - d3/d4/d32/f45 zero size 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:4/579: chown d3/d4/d6/d63/d79/l9c 1249192 1 2024-09-13T23:06:22.684 INFO:tasks.workunit.client.1.smithi152.stdout:4/580: write d3/d4/d6/d63/f7e [341007,52665] 0 2024-09-13T23:06:22.685 INFO:tasks.workunit.client.1.smithi152.stdout:5/446: creat d5/da/d62/f94 x:0 0 0 2024-09-13T23:06:22.687 INFO:tasks.workunit.client.1.smithi152.stdout:5/447: rmdir d5/dc/d19/d20/d55 39 2024-09-13T23:06:22.687 INFO:tasks.workunit.client.1.smithi152.stdout:5/448: getdents d5/dc/d4c/d82 0 2024-09-13T23:06:22.688 INFO:tasks.workunit.client.1.smithi152.stdout:2/551: dread d0/f77 [0,4194304] 0 2024-09-13T23:06:22.688 INFO:tasks.workunit.client.1.smithi152.stdout:2/552: fdatasync d0/d4/d9/f40 0 2024-09-13T23:06:22.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/449: link d5/da/d62/l40 d5/dc/d5e/l95 0 2024-09-13T23:06:22.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/553: mkdir d0/d4/d9/d16/d30/dc7 0 2024-09-13T23:06:22.691 INFO:tasks.workunit.client.1.smithi152.stdout:2/554: chown d0/d4/d9/d14/d48/d4a 12 1 2024-09-13T23:06:22.692 INFO:tasks.workunit.client.1.smithi152.stdout:5/450: symlink d5/da/l96 0 2024-09-13T23:06:22.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/555: mknod d0/d4/cc8 0 2024-09-13T23:06:22.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/556: chown d0/d4/d9/d16/d30/d94 1 1 2024-09-13T23:06:22.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/557: fsync d0/d4/d9/d16/d2b/f50 0 2024-09-13T23:06:22.702 INFO:tasks.workunit.client.1.smithi152.stdout:8/398: dwrite d17/d19/f28 [0,4194304] 0 2024-09-13T23:06:22.705 INFO:tasks.workunit.client.1.smithi152.stdout:4/581: dread d3/d4/d6/d66/d2b/f9a [0,4194304] 0 2024-09-13T23:06:22.705 INFO:tasks.workunit.client.1.smithi152.stdout:2/558: dread d0/d4/d9/d18/d1e/d3c/fa6 [0,4194304] 0 2024-09-13T23:06:22.705 INFO:tasks.workunit.client.1.smithi152.stdout:8/399: symlink d17/d25/d69/l83 0 2024-09-13T23:06:22.705 INFO:tasks.workunit.client.1.smithi152.stdout:7/513: dwrite d17/d24/d9f/d46/f74 [0,4194304] 0 2024-09-13T23:06:22.705 INFO:tasks.workunit.client.1.smithi152.stdout:2/559: write d0/d4/d9/f9c [513101,99795] 0 2024-09-13T23:06:22.706 INFO:tasks.workunit.client.1.smithi152.stdout:4/582: symlink d3/d4/d6/d8/d4b/lb4 0 2024-09-13T23:06:22.706 INFO:tasks.workunit.client.1.smithi152.stdout:5/451: read d5/dc/d19/d65/d70/f73 [3287719,88548] 0 2024-09-13T23:06:22.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/514: unlink f6 0 2024-09-13T23:06:22.709 INFO:tasks.workunit.client.1.smithi152.stdout:2/560: creat d0/d4/d9/d14/d48/d71/fc9 x:0 0 0 2024-09-13T23:06:22.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/583: symlink d3/d4/d6/d66/d1c/lb5 0 2024-09-13T23:06:22.711 INFO:tasks.workunit.client.1.smithi152.stdout:5/452: getdents d5/dc/d19/d20 0 2024-09-13T23:06:22.711 INFO:tasks.workunit.client.1.smithi152.stdout:5/453: write d5/dc/f89 [508776,28405] 0 2024-09-13T23:06:22.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/400: rmdir d17/d25/d32 39 2024-09-13T23:06:22.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/401: readlink d17/d25/l51 0 2024-09-13T23:06:22.716 INFO:tasks.workunit.client.1.smithi152.stdout:7/515: unlink d17/f27 0 2024-09-13T23:06:22.717 INFO:tasks.workunit.client.1.smithi152.stdout:2/561: mkdir d0/d4/dca 0 2024-09-13T23:06:22.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/516: write d17/d24/d9f/d51/d5b/d90/d2e/d71/f95 [284315,70919] 0 2024-09-13T23:06:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:22 smithi152 ceph-mon[34465]: pgmap v7: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 224 MiB/s rd, 295 MiB/s wr, 399 op/s 2024-09-13T23:06:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:22 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:06:22.718 INFO:tasks.workunit.client.1.smithi152.stdout:4/584: truncate d3/d4/d8d/f55 178240 0 2024-09-13T23:06:22.719 INFO:tasks.workunit.client.1.smithi152.stdout:5/454: symlink d5/da/d86/l97 0 2024-09-13T23:06:22.720 INFO:tasks.workunit.client.1.smithi152.stdout:8/402: mkdir d17/d25/d32/d4b/d84 0 2024-09-13T23:06:22.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/585: dread d3/d4/d6/d66/d62/f64 [0,4194304] 0 2024-09-13T23:06:22.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/517: creat d17/d24/d9f/d46/fad x:0 0 0 2024-09-13T23:06:22.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/455: mkdir d5/da/d62/d6c/d98 0 2024-09-13T23:06:22.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/456: write d5/dc/f89 [1497176,109663] 0 2024-09-13T23:06:22.723 INFO:tasks.workunit.client.1.smithi152.stdout:2/562: getdents d0/d4/d9/d14/d48 0 2024-09-13T23:06:22.725 INFO:tasks.workunit.client.1.smithi152.stdout:4/586: rmdir d3/d4/d6/d66/d1c/d59 39 2024-09-13T23:06:22.726 INFO:tasks.workunit.client.1.smithi152.stdout:2/563: rmdir d0/d4/d9/d16/d30/d94 39 2024-09-13T23:06:22.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/587: creat d3/d4/d32/fb6 x:0 0 0 2024-09-13T23:06:22.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/588: chown d3/d4/d6/d8/c16 1895846 1 2024-09-13T23:06:22.729 INFO:tasks.workunit.client.1.smithi152.stdout:4/589: dread - d3/d4/d32/fb6 zero size 2024-09-13T23:06:22.732 INFO:tasks.workunit.client.1.smithi152.stdout:4/590: mknod d3/d4/d6/d66/cb7 0 2024-09-13T23:06:22.732 INFO:tasks.workunit.client.1.smithi152.stdout:7/518: dread d17/d24/d9f/d46/f74 [0,4194304] 0 2024-09-13T23:06:22.733 INFO:tasks.workunit.client.1.smithi152.stdout:5/457: dread d5/dc/fe [4194304,4194304] 0 2024-09-13T23:06:22.738 INFO:tasks.workunit.client.1.smithi152.stdout:7/519: link d17/d24/d9f/d46/f74 d17/d24/d9f/d51/d5b/d63/fae 0 2024-09-13T23:06:22.738 INFO:tasks.workunit.client.1.smithi152.stdout:7/520: fsync d17/d24/d9f/d51/d5b/d90/d2e/f32 0 2024-09-13T23:06:22.738 INFO:tasks.workunit.client.1.smithi152.stdout:2/564: dread d0/d4/d9/d14/f34 [0,4194304] 0 2024-09-13T23:06:22.738 INFO:tasks.workunit.client.1.smithi152.stdout:8/403: dwrite d17/d25/d32/d50/f57 [0,4194304] 0 2024-09-13T23:06:22.738 INFO:tasks.workunit.client.1.smithi152.stdout:8/404: dread - d17/d19/f7a zero size 2024-09-13T23:06:22.739 INFO:tasks.workunit.client.1.smithi152.stdout:7/521: stat d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/l55 0 2024-09-13T23:06:22.739 INFO:tasks.workunit.client.1.smithi152.stdout:2/565: creat d0/d4/d9/d18/d32/fcb x:0 0 0 2024-09-13T23:06:22.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/458: rename d5/da/d62/d6c to d5/dc/d19/d65/d99 0 2024-09-13T23:06:22.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/405: unlink d17/d25/d32/f7c 0 2024-09-13T23:06:22.744 INFO:tasks.workunit.client.1.smithi152.stdout:7/522: creat d17/d24/d9f/d51/d5b/d90/d2e/d59/d85/faf x:0 0 0 2024-09-13T23:06:22.744 INFO:tasks.workunit.client.1.smithi152.stdout:7/523: creat d17/d24/d9f/d51/d5b/d90/d2e/d59/d85/fb0 x:0 0 0 2024-09-13T23:06:22.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/566: symlink d0/d4/d9/d18/d32/lcc 0 2024-09-13T23:06:22.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/567: readlink d0/d4/d9/d18/l68 0 2024-09-13T23:06:22.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/459: link d5/da/cb d5/dc/c9a 0 2024-09-13T23:06:22.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/591: dwrite d3/d4/d6/d66/d62/f64 [0,4194304] 0 2024-09-13T23:06:22.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/592: fsync d3/f83 0 2024-09-13T23:06:22.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/593: dread - d3/d4/d6/d66/d1c/fa4 zero size 2024-09-13T23:06:22.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/406: unlink f15 0 2024-09-13T23:06:22.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/407: fdatasync d17/d19/f3d 0 2024-09-13T23:06:22.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/408: creat d17/d25/f85 x:0 0 0 2024-09-13T23:06:22.762 INFO:tasks.workunit.client.1.smithi152.stdout:8/409: rmdir d17/d25/d69 39 2024-09-13T23:06:22.768 INFO:tasks.workunit.client.1.smithi152.stdout:8/410: symlink d17/d25/d32/d44/l86 0 2024-09-13T23:06:22.768 INFO:tasks.workunit.client.1.smithi152.stdout:8/411: write d17/d25/f79 [689712,89015] 0 2024-09-13T23:06:22.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:22 smithi115 ceph-mon[27601]: pgmap v7: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 224 MiB/s rd, 295 MiB/s wr, 399 op/s 2024-09-13T23:06:22.790 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:22 smithi115 ceph-mon[27601]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:06:22.792 INFO:tasks.workunit.client.1.smithi152.stdout:7/524: dwrite d17/f1b [4194304,4194304] 0 2024-09-13T23:06:22.792 INFO:tasks.workunit.client.1.smithi152.stdout:4/594: dwrite d3/d4/d6/d63/f7b [0,4194304] 0 2024-09-13T23:06:22.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/460: dwrite d5/f6 [0,4194304] 0 2024-09-13T23:06:22.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/461: fdatasync d5/d26/f33 0 2024-09-13T23:06:22.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/462: fsync d5/da/d62/f8b 0 2024-09-13T23:06:22.793 INFO:tasks.workunit.client.1.smithi152.stdout:8/412: dwrite d17/d25/d32/d4b/f74 [0,4194304] 0 2024-09-13T23:06:22.797 INFO:tasks.workunit.client.1.smithi152.stdout:7/525: mknod d17/d24/d9f/d51/cb1 0 2024-09-13T23:06:22.798 INFO:tasks.workunit.client.1.smithi152.stdout:4/595: mknod d3/d4/d6/cb8 0 2024-09-13T23:06:22.804 INFO:tasks.workunit.client.1.smithi152.stdout:4/596: mkdir d3/d4/d8d/d93/db9 0 2024-09-13T23:06:22.804 INFO:tasks.workunit.client.1.smithi152.stdout:4/597: write d3/d4/d32/fb6 [521071,13658] 0 2024-09-13T23:06:22.804 INFO:tasks.workunit.client.1.smithi152.stdout:4/598: chown d3/d4/d8d/c5b 0 1 2024-09-13T23:06:22.805 INFO:tasks.workunit.client.1.smithi152.stdout:4/599: mkdir d3/d4/d6/d66/d62/d9d/dba 0 2024-09-13T23:06:22.806 INFO:tasks.workunit.client.1.smithi152.stdout:8/413: dread d17/d19/f20 [0,4194304] 0 2024-09-13T23:06:22.806 INFO:tasks.workunit.client.1.smithi152.stdout:7/526: dread d17/f19 [0,4194304] 0 2024-09-13T23:06:22.810 INFO:tasks.workunit.client.1.smithi152.stdout:8/414: symlink d17/l87 0 2024-09-13T23:06:22.810 INFO:tasks.workunit.client.1.smithi152.stdout:8/415: readlink d17/d23/l47 0 2024-09-13T23:06:22.810 INFO:tasks.workunit.client.1.smithi152.stdout:8/416: creat d17/d19/f88 x:0 0 0 2024-09-13T23:06:22.811 INFO:tasks.workunit.client.1.smithi152.stdout:8/417: creat d17/d19/f89 x:0 0 0 2024-09-13T23:06:22.811 INFO:tasks.workunit.client.1.smithi152.stdout:8/418: mkdir d17/d25/d80/d8a 0 2024-09-13T23:06:22.815 INFO:tasks.workunit.client.1.smithi152.stdout:7/527: write d17/d24/d9f/d51/d5b/d90/f42 [2092455,8454] 0 2024-09-13T23:06:22.815 INFO:tasks.workunit.client.1.smithi152.stdout:7/528: chown d17/d24/d9f/d51/d5b/d90/d2e/f76 13748 1 2024-09-13T23:06:22.816 INFO:tasks.workunit.client.1.smithi152.stdout:7/529: mkdir d17/d24/d9f/d51/d5b/d90/db2 0 2024-09-13T23:06:22.818 INFO:tasks.workunit.client.1.smithi152.stdout:7/530: rename d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d82 to d17/d24/d9f/d51/d5b/d90/d2e/d79/db3 0 2024-09-13T23:06:22.822 INFO:tasks.workunit.client.1.smithi152.stdout:7/531: dread d17/f1e [0,4194304] 0 2024-09-13T23:06:22.829 INFO:tasks.workunit.client.1.smithi152.stdout:7/532: read d17/d24/d9f/d51/d5b/d90/fa4 [2119561,20061] 0 2024-09-13T23:06:22.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/419: dwrite d17/f2c [0,4194304] 0 2024-09-13T23:06:22.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/420: chown d17/d25/d32/l60 0 1 2024-09-13T23:06:22.830 INFO:tasks.workunit.client.1.smithi152.stdout:7/533: getdents d17/d24/d9f/d51/d5b/d90/d2e/d79/db3 0 2024-09-13T23:06:22.830 INFO:tasks.workunit.client.1.smithi152.stdout:7/534: dread - d17/d24/d9f/d51/f97 zero size 2024-09-13T23:06:22.831 INFO:tasks.workunit.client.1.smithi152.stdout:8/421: write d17/d25/f79 [427497,91973] 0 2024-09-13T23:06:22.832 INFO:tasks.workunit.client.1.smithi152.stdout:8/422: truncate d17/d25/d32/f3f 113982 0 2024-09-13T23:06:22.832 INFO:tasks.workunit.client.1.smithi152.stdout:8/423: chown d17/d23/l36 24 1 2024-09-13T23:06:22.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/424: read d17/d25/d32/f75 [362404,31201] 0 2024-09-13T23:06:22.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/425: write d17/d19/f68 [549726,102691] 0 2024-09-13T23:06:22.839 INFO:tasks.workunit.client.1.smithi152.stdout:8/426: dread d17/d19/f3d [0,4194304] 0 2024-09-13T23:06:22.839 INFO:tasks.workunit.client.1.smithi152.stdout:8/427: write d17/d25/f79 [1648806,117032] 0 2024-09-13T23:06:22.840 INFO:tasks.workunit.client.1.smithi152.stdout:8/428: readlink la 0 2024-09-13T23:06:22.857 INFO:tasks.workunit.client.1.smithi152.stdout:7/535: dwrite d17/d24/d9f/d51/d5b/d90/d2b/f72 [0,4194304] 0 2024-09-13T23:06:22.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/429: dwrite d17/d25/d32/f4e [0,4194304] 0 2024-09-13T23:06:22.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/430: write d17/d25/d32/d44/f6a [614630,14771] 0 2024-09-13T23:06:22.859 INFO:tasks.workunit.client.1.smithi152.stdout:7/536: creat d17/fb4 x:0 0 0 2024-09-13T23:06:22.859 INFO:tasks.workunit.client.1.smithi152.stdout:7/537: write d17/d24/d9f/d51/d5b/d90/fa4 [429843,86797] 0 2024-09-13T23:06:22.861 INFO:tasks.workunit.client.1.smithi152.stdout:8/431: symlink d17/d19/l8b 0 2024-09-13T23:06:22.862 INFO:tasks.workunit.client.1.smithi152.stdout:8/432: creat d17/d23/f8c x:0 0 0 2024-09-13T23:06:22.863 INFO:tasks.workunit.client.1.smithi152.stdout:8/433: link d17/d25/d32/d50/f78 d17/d25/d80/f8d 0 2024-09-13T23:06:22.876 INFO:tasks.workunit.client.1.smithi152.stdout:7/538: dwrite d17/d24/f29 [0,4194304] 0 2024-09-13T23:06:22.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/539: rename d17/f98 to d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/fb5 0 2024-09-13T23:06:22.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/540: stat d17/d24/d9f/d51/d5b/d90/d2e/d71/fa5 0 2024-09-13T23:06:22.882 INFO:tasks.workunit.client.1.smithi152.stdout:7/541: truncate d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f6d 84685 0 2024-09-13T23:06:22.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.882+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87680ff9e0 con 0x7f875006e6e0 2024-09-13T23:06:22.883 INFO:tasks.workunit.client.1.smithi152.stdout:7/542: mkdir d17/d4f/d84/db6 0 2024-09-13T23:06:22.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/543: mknod d17/d24/d9f/d51/d5b/d90/d2e/d59/cb7 0 2024-09-13T23:06:22.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/544: truncate d17/d24/d9f/d51/d5b/d90/d2b/f8d 682822 0 2024-09-13T23:06:22.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/545: symlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/lb8 0 2024-09-13T23:06:22.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/546: stat d17/d24/d9f/d51/d5b/d90/d2e/d79/da1 0 2024-09-13T23:06:22.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/547: creat d17/d4f/fb9 x:0 0 0 2024-09-13T23:06:22.886 INFO:tasks.workunit.client.1.smithi152.stdout:8/434: dwrite d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:22.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/548: rename d17/d24/d9f/d51/d5b/d90/d2e/d59 to d17/d24/d9f/dac/dba 0 2024-09-13T23:06:22.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/549: dread - d17/d24/d9f/d51/d5b/d87/f89 zero size 2024-09-13T23:06:22.896 INFO:tasks.workunit.client.1.smithi152.stdout:7/550: write d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f6d [858600,119799] 0 2024-09-13T23:06:22.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.895+0000 7f8756ffd640 1 -- 172.21.15.115:0/2057912238 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f87680ff9e0 con 0x7f875006e6e0 2024-09-13T23:06:22.896 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:06:22.896 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 2m ago 7m 25.5M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:06:22.896 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (7m) 2m ago 7m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (7m) 33s ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 2m ago 7m 86.6M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (2m) 2m ago 2m 15.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (2m) 2m ago 2m 11.8M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (2m) 33s ago 2m 20.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (2m) 33s ago 2m 20.2M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (8m) 2m ago 8m 449M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (41s) 33s ago 6m 68.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 718f6398c5ee 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (9m) 2m ago 9m 44.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (6m) 33s ago 6m 37.3M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:06:22.897 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 2m ago 7m 15.8M - 1.5.0 0da6a335fe13 f6758bd48343 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 33s ago 6m 17.2M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (6m) 2m ago 6m 44.1M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (5m) 2m ago 5m 45.0M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 2m ago 5m 44.5M 4288M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (4m) 33s ago 4m 83.2M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (4m) 33s ago 4m 73.1M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (3m) 33s ago 3m 76.2M 5312M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:06:22.898 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 2m ago 7m 55.2M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 msgr2=0x7f8750070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 0x7f8750070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f875c02a550 tx=0x7f875c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 msgr2=0x7f87681087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f875800c810 tx=0x7f87580043c0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 shutdown_connections 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f875006e6e0 0x7f8750070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87680fc1f0 0x7f8768108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 --2- 172.21.15.115:0/2057912238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87680fb8a0 0x7f87681087e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:22.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 >> 172.21.15.115:0/2057912238 conn(0x7f87680f6390 msgr2=0x7f87680f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:22.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 shutdown_connections 2024-09-13T23:06:22.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:22.898+0000 7f876c9a6640 1 -- 172.21.15.115:0/2057912238 wait complete. 2024-09-13T23:06:22.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/435: dwrite d17/d25/d80/f8d [0,4194304] 0 2024-09-13T23:06:22.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/436: read - d17/f43 zero size 2024-09-13T23:06:22.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/437: stat d17/d25/f7e 0 2024-09-13T23:06:22.911 INFO:tasks.workunit.client.1.smithi152.stdout:8/438: dread d17/d25/d32/f63 [0,4194304] 0 2024-09-13T23:06:22.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/439: mkdir d17/d19/d8e 0 2024-09-13T23:06:22.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/551: dwrite d17/f1a [4194304,4194304] 0 2024-09-13T23:06:22.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/440: mkdir d17/d23/d8f 0 2024-09-13T23:06:22.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/441: truncate d17/d19/f89 765900 0 2024-09-13T23:06:22.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/552: read d17/f1d [719403,125605] 0 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/433: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:2/568: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:3/395: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/502: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:6/458: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:2/569: fdatasync d0/d4/d8a/fac 0 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:1/447: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:4/600: sync 2024-09-13T23:06:22.927 INFO:tasks.workunit.client.1.smithi152.stdout:5/463: sync 2024-09-13T23:06:22.928 INFO:tasks.workunit.client.1.smithi152.stdout:7/553: mknod d17/d24/d9f/d51/d5b/d90/d2e/d79/cbb 0 2024-09-13T23:06:22.928 INFO:tasks.workunit.client.1.smithi152.stdout:9/503: write d3/d24/d67/d60/f69 [223538,26594] 0 2024-09-13T23:06:22.931 INFO:tasks.workunit.client.1.smithi152.stdout:6/459: unlink d4/de/f49 0 2024-09-13T23:06:22.931 INFO:tasks.workunit.client.1.smithi152.stdout:6/460: creat d4/de/d12/f9f x:0 0 0 2024-09-13T23:06:22.932 INFO:tasks.workunit.client.1.smithi152.stdout:2/570: stat d0/d4/d9/d55/l70 0 2024-09-13T23:06:22.932 INFO:tasks.workunit.client.1.smithi152.stdout:2/571: chown d0/d4/d9/d14/d48/d4a 6 1 2024-09-13T23:06:22.935 INFO:tasks.workunit.client.1.smithi152.stdout:7/554: creat d17/d24/d9f/d51/d5b/d90/d2e/d71/fbc x:0 0 0 2024-09-13T23:06:22.941 INFO:tasks.workunit.client.1.smithi152.stdout:0/434: rmdir d18/d1f/d29 39 2024-09-13T23:06:22.941 INFO:tasks.workunit.client.1.smithi152.stdout:0/435: stat d18/d1f 0 2024-09-13T23:06:22.941 INFO:tasks.workunit.client.1.smithi152.stdout:7/555: dread d17/f1e [0,4194304] 0 2024-09-13T23:06:22.941 INFO:tasks.workunit.client.1.smithi152.stdout:8/442: dwrite d17/d25/d32/d4b/f6e [0,4194304] 0 2024-09-13T23:06:22.943 INFO:tasks.workunit.client.1.smithi152.stdout:1/448: rmdir d4/d9/d71 39 2024-09-13T23:06:22.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/436: link d18/d19/c75 d18/d1f/d33/d90/c9d 0 2024-09-13T23:06:22.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/437: dread - d18/d1f/d39/f85 zero size 2024-09-13T23:06:22.946 INFO:tasks.workunit.client.1.smithi152.stdout:7/556: truncate d17/d24/f29 3689140 0 2024-09-13T23:06:22.946 INFO:tasks.workunit.client.1.smithi152.stdout:7/557: chown d17/d24/d9f/d51/d5b/d90/d2e/d71/c7f 398724533 1 2024-09-13T23:06:22.946 INFO:tasks.workunit.client.1.smithi152.stdout:7/558: chown d17/d24/d9f/d51/d5b/c99 334829 1 2024-09-13T23:06:22.946 INFO:tasks.workunit.client.1.smithi152.stdout:7/559: dread - d17/d4f/fb9 zero size 2024-09-13T23:06:22.949 INFO:tasks.workunit.client.1.smithi152.stdout:1/449: creat d4/d4c/d8d/f95 x:0 0 0 2024-09-13T23:06:22.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/560: symlink d17/d24/d9f/d51/d5b/d90/d2e/d30/lbd 0 2024-09-13T23:06:22.954 INFO:tasks.workunit.client.1.smithi152.stdout:8/443: mknod d17/d25/d32/d4b/d84/c90 0 2024-09-13T23:06:22.955 INFO:tasks.workunit.client.1.smithi152.stdout:1/450: getdents d4/d9/d1a/d22 0 2024-09-13T23:06:22.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/444: dread d17/d23/f4f [0,4194304] 0 2024-09-13T23:06:22.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/445: chown d17/d25/d32/d50/f78 117488 1 2024-09-13T23:06:22.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/446: readlink d17/l1b 0 2024-09-13T23:06:22.957 INFO:tasks.workunit.client.1.smithi152.stdout:8/447: fsync d17/d25/d32/d44/f6a 0 2024-09-13T23:06:22.957 INFO:tasks.workunit.client.1.smithi152.stdout:8/448: stat d17/d25/f7e 0 2024-09-13T23:06:22.959 INFO:tasks.workunit.client.1.smithi152.stdout:8/449: rename d17/d19/d8e to d17/d25/d32/d4b/d84/d91 0 2024-09-13T23:06:22.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/450: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:22.973 INFO:tasks.workunit.client.1.smithi152.stdout:8/451: write d17/d23/f4f [455485,3849] 0 2024-09-13T23:06:22.975 INFO:tasks.workunit.client.1.smithi152.stdout:8/452: rmdir d17/d25/d32/d4b/d76 0 2024-09-13T23:06:22.976 INFO:tasks.workunit.client.1.smithi152.stdout:8/453: symlink d17/d23/l92 0 2024-09-13T23:06:22.987 INFO:tasks.workunit.client.1.smithi152.stdout:4/601: dwrite d3/d4/d6/d66/d1c/d59/f68 [0,4194304] 0 2024-09-13T23:06:22.988 INFO:tasks.workunit.client.1.smithi152.stdout:6/461: dwrite d4/de/d1d/f86 [0,4194304] 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/561: dwrite d17/d24/d9f/d51/d5b/d63/faa [0,4194304] 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/562: truncate d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b 496169 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:2/572: dwrite d0/d4/d9/d14/d48/fb3 [0,4194304] 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:1/451: dwrite d4/f5d [0,4194304] 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:9/504: dwrite d3/f15 [4194304,4194304] 0 2024-09-13T23:06:22.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/602: link d3/d4/d6/d66/d62/f6a d3/d4/d6/d66/d1c/d59/d60/d74/fbb 0 2024-09-13T23:06:22.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/454: dwrite d17/d19/f88 [0,4194304] 0 2024-09-13T23:06:22.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/455: write d17/d19/f7a [706863,41953] 0 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/563: rename d17/d4f/fb9 to d17/d24/d9f/d51/d5b/d90/d8e/fbe 0 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:1/452: rename d4/d9/d1a to d4/d9/d1a/d22/d24/d96 22 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/564: readlink d17/d24/d9f/dac/dba/l83 0 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:1/453: fsync d4/f90 0 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:1/454: chown d4/d47/l85 1 1 2024-09-13T23:06:22.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/565: creat d17/d4f/fbf x:0 0 0 2024-09-13T23:06:22.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/573: link d0/d4/d9/d18/d1e/d3c/f58 d0/d4/d9/d55/d8f/fcd 0 2024-09-13T23:06:23.002 INFO:tasks.workunit.client.1.smithi152.stdout:9/505: mkdir d3/d24/d34/d45/daa 0 2024-09-13T23:06:23.003 INFO:tasks.workunit.client.1.smithi152.stdout:4/603: symlink d3/d4/d6/d63/d79/lbc 0 2024-09-13T23:06:23.004 INFO:tasks.workunit.client.1.smithi152.stdout:6/462: getdents d4/de/d12/d16/d2a/d3d/d57/d8d 0 2024-09-13T23:06:23.004 INFO:tasks.workunit.client.1.smithi152.stdout:6/463: creat d4/de/d12/d3e/fa0 x:0 0 0 2024-09-13T23:06:23.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.004+0000 7f539c52d640 1 -- 172.21.15.115:0/1758932815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fc520 msgr2=0x7f53940fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.004+0000 7f539c52d640 1 --2- 172.21.15.115:0/1758932815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fc520 0x7f53940fc930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f53900048d0 tx=0x7f5390009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 -- 172.21.15.115:0/1758932815 shutdown_connections 2024-09-13T23:06:23.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 --2- 172.21.15.115:0/1758932815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fd7f0 0x7f53940fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 --2- 172.21.15.115:0/1758932815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fc520 0x7f53940fc930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 -- 172.21.15.115:0/1758932815 >> 172.21.15.115:0/1758932815 conn(0x7f53940f7ce0 msgr2=0x7f53940fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:23.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 -- 172.21.15.115:0/1758932815 shutdown_connections 2024-09-13T23:06:23.006 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 -- 172.21.15.115:0/1758932815 wait complete. 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 Processor -- start 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.005+0000 7f539c52d640 1 -- start start 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539c52d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 0x7f539410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539c52d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539c52d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539410dc40 con 0x7f53940fd7f0 2024-09-13T23:06:23.007 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539c52d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539410e460 con 0x7f53940fc520 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56696/0 (socket says 172.21.15.115:56696) 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 -- 172.21.15.115:0/232474808 learned_addr learned my addr 172.21.15.115:0/232474808 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 -- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 msgr2=0x7f539410d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539a2c9640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 0x7f539410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 0x7f539410d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f5399ac8640 1 -- 172.21.15.115:0/232474808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390005040 con 0x7f53940fd7f0 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.006+0000 7f539a2c9640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 0x7f539410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:06:23.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f5399ac8640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f538400eb70 tx=0x7f538400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.009 INFO:tasks.workunit.client.1.smithi152.stdout:8/456: creat d17/d25/d80/f93 x:0 0 0 2024-09-13T23:06:23.009 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5384007c30 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f538400f040 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539410e690 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53840094e0 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.007+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539410ec30 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.008+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53940fb980 con 0x7f53940fd7f0 2024-09-13T23:06:23.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.009+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f5384009640 con 0x7f53940fd7f0 2024-09-13T23:06:23.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/455: symlink d4/l97 0 2024-09-13T23:06:23.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/456: stat d4/d4c/f54 0 2024-09-13T23:06:23.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/457: write d4/d9/d1a/d22/d24/f56 [504305,88958] 0 2024-09-13T23:06:23.011 INFO:tasks.workunit.client.1.smithi152.stdout:7/566: write d17/f8f [1031989,75728] 0 2024-09-13T23:06:23.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.010+0000 7f538affd640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 0x7f5380070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.010+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f538408dc70 con 0x7f53940fd7f0 2024-09-13T23:06:23.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.011+0000 7f539a2c9640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 0x7f5380070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.011+0000 7f539a2c9640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 0x7f5380070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f539000b020 tx=0x7f5390009da0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/574: truncate d0/d4/d9/d18/f6f 4505040 0 2024-09-13T23:06:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/575: fsync d0/d4/d9/d18/d32/f35 0 2024-09-13T23:06:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/576: dread - d0/d4/d9/d18/dc1/fc6 zero size 2024-09-13T23:06:23.013 INFO:tasks.workunit.client.1.smithi152.stdout:9/506: symlink d3/d1e/d30/d5d/lab 0 2024-09-13T23:06:23.015 INFO:tasks.workunit.client.1.smithi152.stdout:6/464: creat d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 x:0 0 0 2024-09-13T23:06:23.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/457: symlink d17/d25/d32/l94 0 2024-09-13T23:06:23.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/458: write d17/f2c [5572455,59093] 0 2024-09-13T23:06:23.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/459: dread - d17/d25/f85 zero size 2024-09-13T23:06:23.016 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.015+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5384057630 con 0x7f53940fd7f0 2024-09-13T23:06:23.017 INFO:tasks.workunit.client.1.smithi152.stdout:1/458: creat d4/d9/f98 x:0 0 0 2024-09-13T23:06:23.019 INFO:tasks.workunit.client.1.smithi152.stdout:7/567: dread - d17/d6c/f88 zero size 2024-09-13T23:06:23.019 INFO:tasks.workunit.client.1.smithi152.stdout:7/568: fdatasync d17/d24/d9f/d51/d5b/d90/d2e/f56 0 2024-09-13T23:06:23.019 INFO:tasks.workunit.client.1.smithi152.stdout:4/604: dwrite d3/f83 [0,4194304] 0 2024-09-13T23:06:23.019 INFO:tasks.workunit.client.1.smithi152.stdout:2/577: mkdir d0/d4/d9/d18/d1e/d3c/d88/db9/dce 0 2024-09-13T23:06:23.019 INFO:tasks.workunit.client.1.smithi152.stdout:2/578: chown d0/d4/d8a/fac 274599 1 2024-09-13T23:06:23.020 INFO:tasks.workunit.client.1.smithi152.stdout:7/569: write d17/d24/f3c [5229240,49331] 0 2024-09-13T23:06:23.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/507: mkdir d3/d24/dac 0 2024-09-13T23:06:23.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/465: rename d4/de/d12/d16/d2a/d3d/d57/f82 to d4/fa2 0 2024-09-13T23:06:23.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/466: dread - d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 zero size 2024-09-13T23:06:23.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/579: rmdir d0/d4/d9/d18/d1e/d3c/d88/db9/dce 0 2024-09-13T23:06:23.026 INFO:tasks.workunit.client.1.smithi152.stdout:7/570: creat d17/d24/d9f/d51/fc0 x:0 0 0 2024-09-13T23:06:23.027 INFO:tasks.workunit.client.1.smithi152.stdout:9/508: truncate d3/d24/f20 754437 0 2024-09-13T23:06:23.027 INFO:tasks.workunit.client.1.smithi152.stdout:9/509: write d3/d24/d67/d4a/f96 [883778,7181] 0 2024-09-13T23:06:23.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/580: rename d0/d4/d9/d55/l70 to d0/d4/d9/d18/d1e/dc0/lcf 0 2024-09-13T23:06:23.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/581: fsync d0/d4/d9/f9c 0 2024-09-13T23:06:23.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/582: readlink d0/lc4 0 2024-09-13T23:06:23.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/583: readlink d0/d8/l3f 0 2024-09-13T23:06:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:2/584: write d0/d4/d9/d16/d30/f3e [884651,43319] 0 2024-09-13T23:06:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:2/585: chown d0/d4/d9/d16/f21 9515441 1 2024-09-13T23:06:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:7/571: dread d17/d24/d9f/d51/d5b/d90/d2e/f76 [0,4194304] 0 2024-09-13T23:06:23.035 INFO:tasks.workunit.client.1.smithi152.stdout:1/459: getdents d4/d9 0 2024-09-13T23:06:23.038 INFO:tasks.workunit.client.1.smithi152.stdout:6/467: rmdir d4/de/d12/d3e 39 2024-09-13T23:06:23.038 INFO:tasks.workunit.client.1.smithi152.stdout:6/468: creat d4/de/d21/fa3 x:0 0 0 2024-09-13T23:06:23.041 INFO:tasks.workunit.client.1.smithi152.stdout:7/572: write d17/d24/d9f/d51/d5b/d90/d2b/f3b [461934,113157] 0 2024-09-13T23:06:23.043 INFO:tasks.workunit.client.1.smithi152.stdout:2/586: getdents d0/d4/d9/d16/d30/d9e/db5 0 2024-09-13T23:06:23.044 INFO:tasks.workunit.client.1.smithi152.stdout:2/587: symlink d0/d4/d9/d16/d99/ld0 0 2024-09-13T23:06:23.052 INFO:tasks.workunit.client.1.smithi152.stdout:2/588: dread d0/d4/d9/f63 [0,4194304] 0 2024-09-13T23:06:23.057 INFO:tasks.workunit.client.1.smithi152.stdout:1/460: dread d4/f90 [0,4194304] 0 2024-09-13T23:06:23.057 INFO:tasks.workunit.client.1.smithi152.stdout:1/461: chown f1 112711 1 2024-09-13T23:06:23.057 INFO:tasks.workunit.client.1.smithi152.stdout:1/462: readlink d4/d9/d1a/d22/d24/l57 0 2024-09-13T23:06:23.057 INFO:tasks.workunit.client.1.smithi152.stdout:1/463: truncate d4/d9/d1a/d22/f35 991178 0 2024-09-13T23:06:23.058 INFO:tasks.workunit.client.1.smithi152.stdout:7/573: dread d17/d24/d9f/d51/d5b/d90/d2e/f56 [0,4194304] 0 2024-09-13T23:06:23.058 INFO:tasks.workunit.client.1.smithi152.stdout:7/574: chown d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d 9711 1 2024-09-13T23:06:23.060 INFO:tasks.workunit.client.1.smithi152.stdout:1/464: rmdir d4/d9/d1a/d22/d24 39 2024-09-13T23:06:23.061 INFO:tasks.workunit.client.1.smithi152.stdout:7/575: creat d17/d24/d9f/d51/d5b/d63/d7d/fc1 x:0 0 0 2024-09-13T23:06:23.061 INFO:tasks.workunit.client.1.smithi152.stdout:7/576: chown d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b 25 1 2024-09-13T23:06:23.061 INFO:tasks.workunit.client.1.smithi152.stdout:7/577: readlink d17/d24/d9f/dac/dba/l83 0 2024-09-13T23:06:23.062 INFO:tasks.workunit.client.1.smithi152.stdout:1/465: truncate d4/d9/f12 105690 0 2024-09-13T23:06:23.063 INFO:tasks.workunit.client.1.smithi152.stdout:7/578: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/fc2 x:0 0 0 2024-09-13T23:06:23.063 INFO:tasks.workunit.client.1.smithi152.stdout:7/579: chown d17/d24/d9f 6 1 2024-09-13T23:06:23.064 INFO:tasks.workunit.client.1.smithi152.stdout:8/460: dwrite d17/d25/d32/d44/f5f [0,4194304] 0 2024-09-13T23:06:23.065 INFO:tasks.workunit.client.1.smithi152.stdout:7/580: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/fc3 x:0 0 0 2024-09-13T23:06:23.069 INFO:tasks.workunit.client.1.smithi152.stdout:4/605: dwrite d3/d4/d6/d8/d17/d3a/f77 [0,4194304] 0 2024-09-13T23:06:23.069 INFO:tasks.workunit.client.1.smithi152.stdout:4/606: readlink d3/d4/d6/d66/d1c/l38 0 2024-09-13T23:06:23.069 INFO:tasks.workunit.client.1.smithi152.stdout:4/607: creat d3/fbd x:0 0 0 2024-09-13T23:06:23.069 INFO:tasks.workunit.client.1.smithi152.stdout:8/461: rename d17/d25/d69 to d17/d25/d32/d4b/d95 0 2024-09-13T23:06:23.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/462: chown d17/d25/f2f 4718 1 2024-09-13T23:06:23.070 INFO:tasks.workunit.client.1.smithi152.stdout:8/463: truncate d17/d25/d32/f3f 400265 0 2024-09-13T23:06:23.073 INFO:tasks.workunit.client.1.smithi152.stdout:6/469: dwrite d4/de/d12/d16/f58 [0,4194304] 0 2024-09-13T23:06:23.077 INFO:tasks.workunit.client.1.smithi152.stdout:9/510: dwrite d3/d24/d67/d4a/d71/f89 [0,4194304] 0 2024-09-13T23:06:23.077 INFO:tasks.workunit.client.1.smithi152.stdout:9/511: rename d3/d24/d34/d45 to d3/d24/d34/d45/daa/dad 22 2024-09-13T23:06:23.080 INFO:tasks.workunit.client.1.smithi152.stdout:9/512: symlink d3/d1e/d30/d5d/da3/lae 0 2024-09-13T23:06:23.081 INFO:tasks.workunit.client.1.smithi152.stdout:2/589: dwrite d0/d4/d9/d18/d32/fcb [0,4194304] 0 2024-09-13T23:06:23.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/590: unlink d0/d4/d9/d16/d2b/f3b 0 2024-09-13T23:06:23.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/466: truncate d4/d9/d1a/d22/f35 95441 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:2/591: mkdir d0/d4/d9/d14/d48/dd1 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:4/608: dwrite d3/d4/d6/d8/f8f [0,4194304] 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:4/609: stat d3/d4/d6/d63/d79 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:2/592: creat d0/d4/d9/d55/fd2 x:0 0 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:4/610: fdatasync d3/d4/d8d/f44 0 2024-09-13T23:06:23.095 INFO:tasks.workunit.client.1.smithi152.stdout:2/593: truncate d0/d4/d9/d18/d1e/d3c/f58 514579 0 2024-09-13T23:06:23.097 INFO:tasks.workunit.client.1.smithi152.stdout:1/467: truncate d4/f32 504416 0 2024-09-13T23:06:23.097 INFO:tasks.workunit.client.1.smithi152.stdout:8/464: dwrite d17/d19/f88 [0,4194304] 0 2024-09-13T23:06:23.098 INFO:tasks.workunit.client.1.smithi152.stdout:8/465: chown d17/d19/f33 959949 1 2024-09-13T23:06:23.098 INFO:tasks.workunit.client.1.smithi152.stdout:8/466: chown d17/d25/d32/d50/f57 39241 1 2024-09-13T23:06:23.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/468: mkdir d4/d4c/d8d/d99 0 2024-09-13T23:06:23.100 INFO:tasks.workunit.client.1.smithi152.stdout:1/469: getdents d4/d9/d1a/d22/d24/d48 0 2024-09-13T23:06:23.102 INFO:tasks.workunit.client.1.smithi152.stdout:1/470: symlink d4/d4c/l9a 0 2024-09-13T23:06:23.104 INFO:tasks.workunit.client.1.smithi152.stdout:9/513: dwrite d3/d52/f9f [0,4194304] 0 2024-09-13T23:06:23.106 INFO:tasks.workunit.client.1.smithi152.stdout:9/514: creat d3/d24/d34/d45/faf x:0 0 0 2024-09-13T23:06:23.107 INFO:tasks.workunit.client.1.smithi152.stdout:9/515: write d3/d1e/d30/f6c [1875335,18147] 0 2024-09-13T23:06:23.109 INFO:tasks.workunit.client.1.smithi152.stdout:9/516: mkdir d3/db0 0 2024-09-13T23:06:23.123 INFO:tasks.workunit.client.1.smithi152.stdout:4/611: dwrite d3/d4/f22 [4194304,4194304] 0 2024-09-13T23:06:23.123 INFO:tasks.workunit.client.1.smithi152.stdout:2/594: dwrite d0/d4/d9/d18/dc1/fc6 [0,4194304] 0 2024-09-13T23:06:23.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/517: dread d3/f9 [0,4194304] 0 2024-09-13T23:06:23.125 INFO:tasks.workunit.client.1.smithi152.stdout:4/612: rmdir d3/d4/d6/d66/d1c/d59 39 2024-09-13T23:06:23.125 INFO:tasks.workunit.client.1.smithi152.stdout:4/613: write d3/d4/d6/d66/d1c/f28 [798580,50214] 0 2024-09-13T23:06:23.134 INFO:tasks.workunit.client.1.smithi152.stdout:9/518: mkdir d3/d1e/db1 0 2024-09-13T23:06:23.136 INFO:tasks.workunit.client.1.smithi152.stdout:9/519: dread d3/f4 [0,4194304] 0 2024-09-13T23:06:23.137 INFO:tasks.workunit.client.1.smithi152.stdout:9/520: creat d3/db0/fb2 x:0 0 0 2024-09-13T23:06:23.138 INFO:tasks.workunit.client.1.smithi152.stdout:9/521: creat d3/d52/fb3 x:0 0 0 2024-09-13T23:06:23.139 INFO:tasks.workunit.client.1.smithi152.stdout:9/522: symlink d3/d52/lb4 0 2024-09-13T23:06:23.139 INFO:tasks.workunit.client.1.smithi152.stdout:9/523: chown d3/d1e/d30/d5d/l7e 91905 1 2024-09-13T23:06:23.140 INFO:tasks.workunit.client.1.smithi152.stdout:9/524: symlink d3/d52/d8c/lb5 0 2024-09-13T23:06:23.140 INFO:tasks.workunit.client.1.smithi152.stdout:9/525: stat d3/d1e/c87 0 2024-09-13T23:06:23.141 INFO:tasks.workunit.client.1.smithi152.stdout:9/526: truncate d3/d1e/f33 1437656 0 2024-09-13T23:06:23.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/595: dwrite d0/d4/d9/d18/d32/f5a [0,4194304] 0 2024-09-13T23:06:23.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/614: dwrite d3/d4/d6/d66/d1c/f27 [0,4194304] 0 2024-09-13T23:06:23.157 INFO:tasks.workunit.client.1.smithi152.stdout:4/615: stat d3/d4/d32/l70 0 2024-09-13T23:06:23.157 INFO:tasks.workunit.client.1.smithi152.stdout:4/616: rename d3/d4/d6/d66/d1c to d3/d4/d6/d66/d1c/d59/d60/d74/dbe 22 2024-09-13T23:06:23.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/617: rmdir d3/d4/d6/d8/d17/d5d 39 2024-09-13T23:06:23.172 INFO:tasks.workunit.client.1.smithi152.stdout:4/618: dread d3/f13 [0,4194304] 0 2024-09-13T23:06:23.172 INFO:tasks.workunit.client.1.smithi152.stdout:9/527: dwrite d3/d1e/d30/f94 [0,4194304] 0 2024-09-13T23:06:23.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/619: mkdir d3/d4/d6/d66/d1c/d5f/d8b/dbf 0 2024-09-13T23:06:23.173 INFO:tasks.workunit.client.1.smithi152.stdout:4/620: dread - d3/fbd zero size 2024-09-13T23:06:23.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/621: creat d3/d4/d6/d66/d2b/d8e/fc0 x:0 0 0 2024-09-13T23:06:23.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/622: read - d3/d4/d6/d66/d1c/d59/d60/d74/fa8 zero size 2024-09-13T23:06:23.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/623: chown d3 17 1 2024-09-13T23:06:23.176 INFO:tasks.workunit.client.1.smithi152.stdout:9/528: rename d3/d24/d67/d4a/c62 to d3/d24/d67/cb6 0 2024-09-13T23:06:23.176 INFO:tasks.workunit.client.1.smithi152.stdout:9/529: readlink d3/d24/l26 0 2024-09-13T23:06:23.177 INFO:tasks.workunit.client.1.smithi152.stdout:9/530: chown d3/d1e/d30/f6c 962 1 2024-09-13T23:06:23.177 INFO:tasks.workunit.client.1.smithi152.stdout:9/531: readlink d3/d24/l4e 0 2024-09-13T23:06:23.177 INFO:tasks.workunit.client.1.smithi152.stdout:4/624: symlink d3/d4/d6/d8/lc1 0 2024-09-13T23:06:23.178 INFO:tasks.workunit.client.1.smithi152.stdout:9/532: mkdir d3/d24/d67/d4a/d71/db7 0 2024-09-13T23:06:23.178 INFO:tasks.workunit.client.1.smithi152.stdout:9/533: write d3/d24/d67/f8a [4759685,97823] 0 2024-09-13T23:06:23.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/625: dread d3/d4/d32/fb6 [0,4194304] 0 2024-09-13T23:06:23.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/534: dread d3/d24/d34/f40 [0,4194304] 0 2024-09-13T23:06:23.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/535: stat d3/d24/d67/d4a/f8d 0 2024-09-13T23:06:23.180 INFO:tasks.workunit.client.1.smithi152.stdout:9/536: symlink d3/d24/d34/d45/lb8 0 2024-09-13T23:06:23.182 INFO:tasks.workunit.client.1.smithi152.stdout:9/537: write d3/d1e/d30/f6c [304402,118043] 0 2024-09-13T23:06:23.183 INFO:tasks.workunit.client.1.smithi152.stdout:9/538: truncate d3/f4f 1950869 0 2024-09-13T23:06:23.187 INFO:tasks.workunit.client.1.smithi152.stdout:9/539: fsync d3/f4f 0 2024-09-13T23:06:23.189 INFO:tasks.workunit.client.1.smithi152.stdout:9/540: rmdir d3/d24/d67/d5b 0 2024-09-13T23:06:23.190 INFO:tasks.workunit.client.1.smithi152.stdout:9/541: chown d3/d52/fb3 0 1 2024-09-13T23:06:23.190 INFO:tasks.workunit.client.1.smithi152.stdout:9/542: dread - d3/d24/fa7 zero size 2024-09-13T23:06:23.198 INFO:tasks.workunit.client.1.smithi152.stdout:9/543: dread d3/d24/d67/d4a/d71/f89 [0,4194304] 0 2024-09-13T23:06:23.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/544: dwrite d3/d24/d67/f4d [0,4194304] 0 2024-09-13T23:06:23.231 INFO:tasks.workunit.client.1.smithi152.stdout:9/545: write d3/f9 [228004,518] 0 2024-09-13T23:06:23.241 INFO:tasks.workunit.client.1.smithi152.stdout:9/546: dread d3/d1e/d30/f6c [0,4194304] 0 2024-09-13T23:06:23.273 INFO:tasks.workunit.client.1.smithi152.stdout:3/396: sync 2024-09-13T23:06:23.276 INFO:tasks.workunit.client.1.smithi152.stdout:3/397: write de/d14/d47/d57/d5d/f2b [489558,10475] 0 2024-09-13T23:06:23.279 INFO:tasks.workunit.client.1.smithi152.stdout:3/398: dread de/d14/d47/d57/d5d/f41 [0,4194304] 0 2024-09-13T23:06:23.311 INFO:tasks.workunit.client.1.smithi152.stdout:3/399: dwrite de/d14/f55 [0,4194304] 0 2024-09-13T23:06:23.312 INFO:tasks.workunit.client.1.smithi152.stdout:3/400: mknod de/d63/c8c 0 2024-09-13T23:06:23.313 INFO:tasks.workunit.client.1.smithi152.stdout:3/401: write de/d14/d38/f19 [261744,3402] 0 2024-09-13T23:06:23.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/402: mkdir de/d1f/d8d 0 2024-09-13T23:06:23.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/403: stat de/d14/f4b 0 2024-09-13T23:06:23.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.339+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f539404b720 con 0x7f53940fd7f0 2024-09-13T23:06:23.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.339+0000 7f538affd640 1 -- 172.21.15.115:0/232474808 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f538405acf0 con 0x7f53940fd7f0 2024-09-13T23:06:23.340 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:06:23.340 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:06:23.340 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T23:06:23.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:06:23.342 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:06:23.342 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 msgr2=0x7f5380070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 0x7f5380070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f539000b020 tx=0x7f5390009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 msgr2=0x7f539410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f538400eb70 tx=0x7f538400b040 comp rx=0 tx=0).stop 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 shutdown_connections 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f538006e6e0 0x7f5380070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53940fd7f0 0x7f539410d5f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 --2- 172.21.15.115:0/232474808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53940fc520 0x7f539410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 >> 172.21.15.115:0/232474808 conn(0x7f53940f7ce0 msgr2=0x7f53940f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:23.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 shutdown_connections 2024-09-13T23:06:23.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.342+0000 7f539c52d640 1 -- 172.21.15.115:0/232474808 wait complete. 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/3985678136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 msgr2=0x7fd1c8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/3985678136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c8101a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40048d0 tx=0x7fd1b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/3985678136 shutdown_connections 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/3985678136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c8101a60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/3985678136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/3985678136 >> 172.21.15.115:0/3985678136 conn(0x7fd1c80f6c10 msgr2=0x7fd1c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:23.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/3985678136 shutdown_connections 2024-09-13T23:06:23.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/3985678136 wait complete. 2024-09-13T23:06:23.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 Processor -- start 2024-09-13T23:06:23.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.445+0000 7fd1cf1cd640 1 -- start start 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1cf1cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1cf1cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1cf1cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80fb580 con 0x7fd1c80ff680 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1cf1cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80fb6f0 con 0x7fd1c8065c40 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1ccf69640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56706/0 (socket says 172.21.15.115:56706) 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 -- 172.21.15.115:0/205209626 learned_addr learned my addr 172.21.15.115:0/205209626 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 -- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 msgr2=0x7fd1c80fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1c7fff640 1 -- 172.21.15.115:0/205209626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4005040 con 0x7fd1c80ff680 2024-09-13T23:06:23.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.446+0000 7fd1ccf69640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:06:23.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.447+0000 7fd1c7fff640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40048a0 tx=0x7fd1b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.449+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b4038070 con 0x7fd1c80ff680 2024-09-13T23:06:23.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.449+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1b4004290 con 0x7fd1c80ff680 2024-09-13T23:06:23.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.449+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c80fb970 con 0x7fd1c80ff680 2024-09-13T23:06:23.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.449+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b4033660 con 0x7fd1c80ff680 2024-09-13T23:06:23.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.449+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c80fbe90 con 0x7fd1c80ff680 2024-09-13T23:06:23.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.450+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c80fa890 con 0x7fd1c80ff680 2024-09-13T23:06:23.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.451+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd1b4030020 con 0x7fd1c80ff680 2024-09-13T23:06:23.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.451+0000 7fd1c57fa640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 0x7fd1b8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.451+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd1b40adf90 con 0x7fd1c80ff680 2024-09-13T23:06:23.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.452+0000 7fd1ccf69640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 0x7fd1b8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.452+0000 7fd1ccf69640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 0x7fd1b8070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80fc860 tx=0x7fd1bc00b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.456+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd1b40e2670 con 0x7fd1c80ff680 2024-09-13T23:06:23.549 INFO:tasks.workunit.client.1.smithi152.stdout:6/470: sync 2024-09-13T23:06:23.549 INFO:tasks.workunit.client.1.smithi152.stdout:0/438: sync 2024-09-13T23:06:23.549 INFO:tasks.workunit.client.1.smithi152.stdout:5/464: sync 2024-09-13T23:06:23.551 INFO:tasks.workunit.client.1.smithi152.stdout:0/439: symlink d18/d1f/d29/d4e/l9e 0 2024-09-13T23:06:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/465: rmdir d5/d26/d61/d68 39 2024-09-13T23:06:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/466: truncate d5/dc/d19/d65/f4b 4413531 0 2024-09-13T23:06:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/467: dread - d5/f5a zero size 2024-09-13T23:06:23.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/468: creat d5/dc/d19/f9b x:0 0 0 2024-09-13T23:06:23.554 INFO:tasks.workunit.client.1.smithi152.stdout:0/440: rename d18/d1f/d29/d3f/d4b/d66/d70 to d18/d1f/d29/d3f/d4b/d66/d6a/d9f 0 2024-09-13T23:06:23.557 INFO:tasks.workunit.client.1.smithi152.stdout:0/441: truncate f13 3359851 0 2024-09-13T23:06:23.558 INFO:tasks.workunit.client.1.smithi152.stdout:5/469: dread d5/dc/d19/d65/f50 [0,4194304] 0 2024-09-13T23:06:23.559 INFO:tasks.workunit.client.1.smithi152.stdout:5/470: creat d5/dc/d19/d65/d99/d98/f9c x:0 0 0 2024-09-13T23:06:23.560 INFO:tasks.workunit.client.1.smithi152.stdout:5/471: write d5/dc/d19/f7e [867995,32209] 0 2024-09-13T23:06:23.561 INFO:tasks.workunit.client.1.smithi152.stdout:5/472: rename d5/dc/d19/d65/f4b to d5/dc/d19/d20/d55/f9d 0 2024-09-13T23:06:23.563 INFO:tasks.workunit.client.1.smithi152.stdout:5/473: creat d5/dc/d4c/d80/f9e x:0 0 0 2024-09-13T23:06:23.563 INFO:tasks.workunit.client.1.smithi152.stdout:5/474: chown d5/dc/d19/d20/c66 126 1 2024-09-13T23:06:23.565 INFO:tasks.workunit.client.1.smithi152.stdout:6/471: write d4/de/d12/d16/d2a/d38/d3c/f45 [1092626,121004] 0 2024-09-13T23:06:23.568 INFO:tasks.workunit.client.1.smithi152.stdout:6/472: dread d4/de/f6c [0,4194304] 0 2024-09-13T23:06:23.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/473: mkdir d4/de/d12/d16/d2a/d38/da4 0 2024-09-13T23:06:23.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/474: chown d4/de/d12/d16/d2a 318 1 2024-09-13T23:06:23.572 INFO:tasks.workunit.client.1.smithi152.stdout:6/475: dread d4/de/d21/f47 [0,4194304] 0 2024-09-13T23:06:23.572 INFO:tasks.workunit.client.1.smithi152.stdout:6/476: readlink d4/de/d21/l78 0 2024-09-13T23:06:23.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/442: dwrite d18/d1f/d33/d65/f7b [0,4194304] 0 2024-09-13T23:06:23.580 INFO:tasks.workunit.client.1.smithi152.stdout:6/477: dread d4/de/d12/d16/f58 [0,4194304] 0 2024-09-13T23:06:23.581 INFO:tasks.workunit.client.1.smithi152.stdout:5/475: rmdir d5/dc/d19 39 2024-09-13T23:06:23.584 INFO:tasks.workunit.client.1.smithi152.stdout:5/476: rmdir d5/dc/d4c 39 2024-09-13T23:06:23.586 INFO:tasks.workunit.client.1.smithi152.stdout:5/477: mknod d5/dc/d19/d20/d2e/c9f 0 2024-09-13T23:06:23.590 INFO:tasks.workunit.client.1.smithi152.stdout:5/478: write d5/f6 [5943471,43451] 0 2024-09-13T23:06:23.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/478: write d4/de/d21/f7c [974479,50898] 0 2024-09-13T23:06:23.591 INFO:tasks.workunit.client.1.smithi152.stdout:5/479: mkdir d5/dc/d19/d65/d99/d98/da0 0 2024-09-13T23:06:23.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/479: symlink d4/de/d12/d3e/la5 0 2024-09-13T23:06:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/480: rename d5/da/d62/d72/d7f/c8d to d5/dc/d19/d65/d99/d98/da0/ca1 0 2024-09-13T23:06:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/481: write d5/dc/d19/f1d [204290,75929] 0 2024-09-13T23:06:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/482: dread - d5/dc/f5f zero size 2024-09-13T23:06:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/483: chown d5/dc/d19/l31 0 1 2024-09-13T23:06:23.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/484: stat d5/dc/d19/d65/d99/c81 0 2024-09-13T23:06:23.594 INFO:tasks.workunit.client.1.smithi152.stdout:0/443: dread d18/d1f/d29/d4e/f62 [0,4194304] 0 2024-09-13T23:06:23.594 INFO:tasks.workunit.client.1.smithi152.stdout:0/444: chown d18/d1f/d33/f7f 0 1 2024-09-13T23:06:23.594 INFO:tasks.workunit.client.1.smithi152.stdout:6/480: rename d4/de/d12/d16/d2a/d38/d3c/l46 to d4/de/d12/d16/d2a/d3d/d57/la6 0 2024-09-13T23:06:23.594 INFO:tasks.workunit.client.1.smithi152.stdout:6/481: chown d4/l44 251925968 1 2024-09-13T23:06:23.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/445: mkdir d18/d1f/d29/d3f/da0 0 2024-09-13T23:06:23.598 INFO:tasks.workunit.client.1.smithi152.stdout:5/485: rename d5/da/c88 to d5/dc/d19/d20/d55/ca2 0 2024-09-13T23:06:23.598 INFO:tasks.workunit.client.1.smithi152.stdout:5/486: fsync d5/d26/f5d 0 2024-09-13T23:06:23.598 INFO:tasks.workunit.client.1.smithi152.stdout:5/487: write d5/dc/d19/d65/d99/d98/f9c [900708,43510] 0 2024-09-13T23:06:23.599 INFO:tasks.workunit.client.1.smithi152.stdout:6/482: dread d4/de/d21/f47 [0,4194304] 0 2024-09-13T23:06:23.608 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:23 smithi115 ceph-mon[27601]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:23.608 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:23 smithi115 ceph-mon[27601]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:23.608 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:23 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/232474808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:23.638 INFO:tasks.workunit.client.1.smithi152.stdout:6/483: dwrite d4/de/d21/f1f [0,4194304] 0 2024-09-13T23:06:23.641 INFO:tasks.workunit.client.1.smithi152.stdout:0/446: dwrite d18/d1f/d29/d2f/d3d/f5e [0,4194304] 0 2024-09-13T23:06:23.641 INFO:tasks.workunit.client.1.smithi152.stdout:5/488: dwrite d5/da/d62/f8b [0,4194304] 0 2024-09-13T23:06:23.641 INFO:tasks.workunit.client.1.smithi152.stdout:5/489: write d5/f5a [261232,49671] 0 2024-09-13T23:06:23.647 INFO:tasks.workunit.client.1.smithi152.stdout:0/447: mkdir d18/d1f/d29/d2f/d3d/da1 0 2024-09-13T23:06:23.648 INFO:tasks.workunit.client.1.smithi152.stdout:5/490: mkdir d5/dc/da3 0 2024-09-13T23:06:23.650 INFO:tasks.workunit.client.1.smithi152.stdout:0/448: mknod d18/d1f/d29/d2f/d3d/da1/ca2 0 2024-09-13T23:06:23.652 INFO:tasks.workunit.client.1.smithi152.stdout:5/491: unlink d5/dc/d19/f1d 0 2024-09-13T23:06:23.654 INFO:tasks.workunit.client.1.smithi152.stdout:5/492: unlink d5/dc/d19/l12 0 2024-09-13T23:06:23.657 INFO:tasks.workunit.client.1.smithi152.stdout:7/581: sync 2024-09-13T23:06:23.658 INFO:tasks.workunit.client.1.smithi152.stdout:8/467: sync 2024-09-13T23:06:23.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/493: dread d5/da/d62/f8b [0,4194304] 0 2024-09-13T23:06:23.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/494: rmdir d5/d26/d61 39 2024-09-13T23:06:23.666 INFO:tasks.workunit.client.1.smithi152.stdout:8/468: dread d17/d25/d32/d4b/f5b [0,4194304] 0 2024-09-13T23:06:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:5/495: creat d5/da/fa4 x:0 0 0 2024-09-13T23:06:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:5/496: write d5/dc/d4c/d80/f9e [818241,37704] 0 2024-09-13T23:06:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:5/497: truncate d5/da/f6f 291865 0 2024-09-13T23:06:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:7/582: dread d17/f1b [4194304,4194304] 0 2024-09-13T23:06:23.667 INFO:tasks.workunit.client.1.smithi152.stdout:7/583: write d17/f19 [4126824,45350] 0 2024-09-13T23:06:23.668 INFO:tasks.workunit.client.1.smithi152.stdout:8/469: creat d17/d23/d8f/f96 x:0 0 0 2024-09-13T23:06:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/584: mkdir d17/d4f/d84/db6/dc4 0 2024-09-13T23:06:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/585: fdatasync d17/d24/d9f/d51/d5b/d63/faa 0 2024-09-13T23:06:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:7/586: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/fc5 x:0 0 0 2024-09-13T23:06:23.669 INFO:tasks.workunit.client.1.smithi152.stdout:8/470: dread - d17/d25/d32/d4b/f7d zero size 2024-09-13T23:06:23.671 INFO:tasks.workunit.client.1.smithi152.stdout:7/587: mknod d17/d24/d9f/d51/d5b/d90/db2/cc6 0 2024-09-13T23:06:23.671 INFO:tasks.workunit.client.1.smithi152.stdout:8/471: symlink d17/d25/d32/d44/l97 0 2024-09-13T23:06:23.675 INFO:tasks.workunit.client.1.smithi152.stdout:8/472: read d17/f29 [5815676,29054] 0 2024-09-13T23:06:23.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/473: unlink d17/d25/f7e 0 2024-09-13T23:06:23.679 INFO:tasks.workunit.client.1.smithi152.stdout:0/449: dwrite d18/d1f/d33/d65/f7b [0,4194304] 0 2024-09-13T23:06:23.680 INFO:tasks.workunit.client.1.smithi152.stdout:0/450: getdents d18/d1f/d29/d3f/d40 0 2024-09-13T23:06:23.710 INFO:tasks.workunit.client.1.smithi152.stdout:5/498: dwrite d5/dc/d19/d20/f4e [0,4194304] 0 2024-09-13T23:06:23.715 INFO:tasks.workunit.client.1.smithi152.stdout:5/499: dread d5/dc/d19/f7e [0,4194304] 0 2024-09-13T23:06:23.715 INFO:tasks.workunit.client.1.smithi152.stdout:0/451: dwrite d18/d1f/d29/d3f/d40/f8b [0,4194304] 0 2024-09-13T23:06:23.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:23 smithi152 ceph-mon[34465]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:23.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:23 smithi152 ceph-mon[34465]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:23.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:23 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/232474808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:23.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/500: symlink d5/d26/d61/la5 0 2024-09-13T23:06:23.718 INFO:tasks.workunit.client.1.smithi152.stdout:0/452: dread d18/f26 [0,4194304] 0 2024-09-13T23:06:23.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/453: creat d18/d1f/d29/d3f/da0/fa3 x:0 0 0 2024-09-13T23:06:23.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/454: chown d18/d1f/d29/d2f/d3d 1128 1 2024-09-13T23:06:23.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/455: chown d18/d19/l37 0 1 2024-09-13T23:06:23.721 INFO:tasks.workunit.client.1.smithi152.stdout:5/501: rename d5/da/d62 to d5/dc/d19/d65/d99/da6 0 2024-09-13T23:06:23.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.737+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd1c804b720 con 0x7fd1c80ff680 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.738+0000 7fd1c57fa640 1 -- 172.21.15.115:0/205209626 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7fd1b40779d0 con 0x7fd1c80ff680 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:23.739 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:06:23.740 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:23.741 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:23.742 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 msgr2=0x7fd1b8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 0x7fd1b8070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80fc860 tx=0x7fd1bc00b040 comp rx=0 tx=0).stop 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 msgr2=0x7fd1c80fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40048a0 tx=0x7fd1b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 shutdown_connections 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd1b806e6e0 0x7fd1b8070b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1c80ff680 0x7fd1c80fb040 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 --2- 172.21.15.115:0/205209626 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c8065c40 0x7fd1c80fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 >> 172.21.15.115:0/205209626 conn(0x7fd1c80f6c10 msgr2=0x7fd1c80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 shutdown_connections 2024-09-13T23:06:23.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.741+0000 7fd1cf1cd640 1 -- 172.21.15.115:0/205209626 wait complete. 2024-09-13T23:06:23.751 INFO:tasks.workunit.client.1.smithi152.stdout:5/502: dwrite d5/dc/d19/d65/d99/da6/f44 [0,4194304] 0 2024-09-13T23:06:23.761 INFO:tasks.workunit.client.1.smithi152.stdout:5/503: write d5/dc/d19/d20/f4e [1769262,12300] 0 2024-09-13T23:06:23.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/504: read d5/d26/f5d [3686374,37810] 0 2024-09-13T23:06:23.774 INFO:tasks.workunit.client.1.smithi152.stdout:5/505: write d5/dc/d4c/d80/f9e [368585,48738] 0 2024-09-13T23:06:23.776 INFO:tasks.workunit.client.1.smithi152.stdout:5/506: unlink d5/l4a 0 2024-09-13T23:06:23.778 INFO:tasks.workunit.client.1.smithi152.stdout:5/507: rename c2 to d5/dc/d19/d20/d2e/d28/d92/ca7 0 2024-09-13T23:06:23.780 INFO:tasks.workunit.client.1.smithi152.stdout:5/508: creat d5/dc/d4c/fa8 x:0 0 0 2024-09-13T23:06:23.782 INFO:tasks.workunit.client.1.smithi152.stdout:5/509: rename d5/f6 to d5/dc/d19/d65/d99/da6/d72/fa9 0 2024-09-13T23:06:23.784 INFO:tasks.workunit.client.1.smithi152.stdout:5/510: mkdir d5/da/daa 0 2024-09-13T23:06:23.785 INFO:tasks.workunit.client.1.smithi152.stdout:5/511: mkdir d5/dc/d19/d20/dab 0 2024-09-13T23:06:23.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/512: symlink d5/dc/d19/d65/d99/da6/d72/lac 0 2024-09-13T23:06:23.794 INFO:tasks.workunit.client.1.smithi152.stdout:5/513: rmdir d5/dc/d4c 39 2024-09-13T23:06:23.806 INFO:tasks.workunit.client.1.smithi152.stdout:5/514: mkdir d5/dc/d19/d65/d99/da6/dad 0 2024-09-13T23:06:23.809 INFO:tasks.workunit.client.1.smithi152.stdout:5/515: symlink d5/da/lae 0 2024-09-13T23:06:23.818 INFO:tasks.workunit.client.1.smithi152.stdout:5/516: dread d5/da/f1b [0,4194304] 0 2024-09-13T23:06:23.820 INFO:tasks.workunit.client.1.smithi152.stdout:5/517: stat d5/dc/d19/d65/d99/da6/c3b 0 2024-09-13T23:06:23.821 INFO:tasks.workunit.client.1.smithi152.stdout:5/518: link d5/f5a d5/faf 0 2024-09-13T23:06:23.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/519: creat d5/dc/d19/d65/d99/da6/dad/fb0 x:0 0 0 2024-09-13T23:06:23.850 INFO:tasks.workunit.client.1.smithi152.stdout:1/471: sync 2024-09-13T23:06:23.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/472: fdatasync d4/d4c/d8d/f95 0 2024-09-13T23:06:23.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/473: write d4/d9/d1a/f33 [697734,97521] 0 2024-09-13T23:06:23.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/474: truncate d4/d4c/d8d/f95 235941 0 2024-09-13T23:06:23.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/520: dwrite d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:23.853 INFO:tasks.workunit.client.1.smithi152.stdout:5/521: mknod d5/dc/d19/d20/d2e/d28/cb1 0 2024-09-13T23:06:23.853 INFO:tasks.workunit.client.1.smithi152.stdout:5/522: write d5/dc/d19/d20/d2e/f34 [2902145,4387] 0 2024-09-13T23:06:23.853 INFO:tasks.workunit.client.1.smithi152.stdout:5/523: chown d5/dc/d19/c18 0 1 2024-09-13T23:06:23.855 INFO:tasks.workunit.client.1.smithi152.stdout:5/524: truncate d5/dc/d19/d20/d55/f9d 1488253 0 2024-09-13T23:06:23.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 -- 172.21.15.115:0/573603883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 msgr2=0x7fdb20072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 --2- 172.21.15.115:0/573603883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 0x7fdb20072360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb100048d0 tx=0x7fdb10009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 -- 172.21.15.115:0/573603883 shutdown_connections 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 --2- 172.21.15.115:0/573603883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 --2- 172.21.15.115:0/573603883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 0x7fdb20072360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 -- 172.21.15.115:0/573603883 >> 172.21.15.115:0/573603883 conn(0x7fdb200fa060 msgr2=0x7fdb200fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 -- 172.21.15.115:0/573603883 shutdown_connections 2024-09-13T23:06:23.874 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.872+0000 7fdb284f3640 1 -- 172.21.15.115:0/573603883 wait complete. 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.873+0000 7fdb284f3640 1 Processor -- start 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.873+0000 7fdb284f3640 1 -- start start 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.874+0000 7fdb284f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 0x7fdb20113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.874+0000 7fdb284f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.874+0000 7fdb284f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20114b00 con 0x7fdb200728a0 2024-09-13T23:06:23.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.874+0000 7fdb284f3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20114c70 con 0x7fdb20071f50 2024-09-13T23:06:23.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.875+0000 7fdb25a8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.875+0000 7fdb25a8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56720/0 (socket says 172.21.15.115:56720) 2024-09-13T23:06:23.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.875+0000 7fdb25a8e640 1 -- 172.21.15.115:0/629009149 learned_addr learned my addr 172.21.15.115:0/629009149 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:23.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.876+0000 7fdb25a8e640 1 -- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 msgr2=0x7fdb20113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:23.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.876+0000 7fdb25a8e640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 0x7fdb20113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:23.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.876+0000 7fdb25a8e640 1 -- 172.21.15.115:0/629009149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10005040 con 0x7fdb200728a0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.876+0000 7fdb25a8e640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b580 tx=0x7fdb1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.877+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1c00f570 con 0x7fdb200728a0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.877+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdb1c00fb70 con 0x7fdb200728a0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.877+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb20114f50 con 0x7fdb200728a0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.877+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb20115470 con 0x7fdb200728a0 2024-09-13T23:06:23.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.877+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb1c010cb0 con 0x7fdb200728a0 2024-09-13T23:06:23.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.878+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb04005240 con 0x7fdb200728a0 2024-09-13T23:06:23.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.879+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fdb1c00fce0 con 0x7fdb200728a0 2024-09-13T23:06:23.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.880+0000 7fdb16ffd640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 0x7fdb0c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:23.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.880+0000 7fdb2628f640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 0x7fdb0c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:23.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.880+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdb1c08dc60 con 0x7fdb200728a0 2024-09-13T23:06:23.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.881+0000 7fdb2628f640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 0x7fdb0c070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009ac0 tx=0x7fdb10009da0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:23.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:23.887+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdb1c057730 con 0x7fdb200728a0 2024-09-13T23:06:23.901 INFO:tasks.workunit.client.1.smithi152.stdout:5/525: dwrite d5/dc/d19/d20/d2e/f34 [4194304,4194304] 0 2024-09-13T23:06:23.901 INFO:tasks.workunit.client.1.smithi152.stdout:5/526: stat d5/dc/d19/l31 0 2024-09-13T23:06:23.901 INFO:tasks.workunit.client.1.smithi152.stdout:5/527: dread - d5/dc/d19/d65/d99/da6/f94 zero size 2024-09-13T23:06:23.903 INFO:tasks.workunit.client.1.smithi152.stdout:5/528: creat d5/dc/d19/fb2 x:0 0 0 2024-09-13T23:06:23.903 INFO:tasks.workunit.client.1.smithi152.stdout:1/475: dwrite d4/d4c/f80 [0,4194304] 0 2024-09-13T23:06:23.903 INFO:tasks.workunit.client.1.smithi152.stdout:1/476: readlink d4/d9/d1a/d22/d24/l57 0 2024-09-13T23:06:23.903 INFO:tasks.workunit.client.1.smithi152.stdout:5/529: read - d5/dc/f5f zero size 2024-09-13T23:06:23.903 INFO:tasks.workunit.client.1.smithi152.stdout:5/530: readlink d5/dc/d19/d65/d99/da6/l76 0 2024-09-13T23:06:23.906 INFO:tasks.workunit.client.1.smithi152.stdout:1/477: creat d4/d9/d1a/d22/f9b x:0 0 0 2024-09-13T23:06:23.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/531: mkdir d5/dc/d19/d65/d99/da6/d72/db3 0 2024-09-13T23:06:23.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/532: write d5/dc/d19/d65/d99/da6/dad/fb0 [166294,53293] 0 2024-09-13T23:06:23.908 INFO:tasks.workunit.client.1.smithi152.stdout:5/533: dread - d5/dc/f5f zero size 2024-09-13T23:06:23.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/478: link d4/d4c/l9a d4/d9/d1a/d22/d24/d48/l9c 0 2024-09-13T23:06:23.911 INFO:tasks.workunit.client.1.smithi152.stdout:5/534: unlink c4 0 2024-09-13T23:06:23.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/479: mknod d4/d9/d1a/c9d 0 2024-09-13T23:06:23.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/480: chown d4/d9/d71 178016499 1 2024-09-13T23:06:23.913 INFO:tasks.workunit.client.1.smithi152.stdout:1/481: truncate d4/f7 2154722 0 2024-09-13T23:06:23.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/482: mknod d4/d9/c9e 0 2024-09-13T23:06:23.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/483: truncate d4/d47/f77 443580 0 2024-09-13T23:06:23.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/484: chown d4/d4c/d8d/f95 219 1 2024-09-13T23:06:23.918 INFO:tasks.workunit.client.1.smithi152.stdout:1/485: mknod d4/d4c/d8d/c9f 0 2024-09-13T23:06:23.918 INFO:tasks.workunit.client.1.smithi152.stdout:1/486: read d4/d9/d1a/f19 [386064,15012] 0 2024-09-13T23:06:23.920 INFO:tasks.workunit.client.1.smithi152.stdout:1/487: mknod d4/d4c/d8d/ca0 0 2024-09-13T23:06:23.921 INFO:tasks.workunit.client.1.smithi152.stdout:1/488: truncate d4/d9/d1a/f2e 2046547 0 2024-09-13T23:06:23.921 INFO:tasks.workunit.client.1.smithi152.stdout:1/489: chown d4/d9/d1a/d22/d24/f52 1009151 1 2024-09-13T23:06:23.922 INFO:tasks.workunit.client.1.smithi152.stdout:1/490: mknod d4/d47/ca1 0 2024-09-13T23:06:23.924 INFO:tasks.workunit.client.1.smithi152.stdout:5/535: rename d5/dc/d19/d65/d99/da6/d72 to d5/dc/da3/db4 0 2024-09-13T23:06:23.924 INFO:tasks.workunit.client.1.smithi152.stdout:5/536: fsync d5/dc/d19/f1a 0 2024-09-13T23:06:23.928 INFO:tasks.workunit.client.1.smithi152.stdout:5/537: mknod d5/d26/cb5 0 2024-09-13T23:06:23.939 INFO:tasks.workunit.client.1.smithi152.stdout:1/491: rename d4/d9/d1a/d22/f5b to d4/d9/d71/fa2 0 2024-09-13T23:06:23.951 INFO:tasks.workunit.client.1.smithi152.stdout:1/492: write d4/d9/d1a/d22/d24/f6a [1660357,23159] 0 2024-09-13T23:06:23.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/493: dread d4/f1c [0,4194304] 0 2024-09-13T23:06:23.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/494: write d4/d9/f13 [2391934,49582] 0 2024-09-13T23:06:23.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/495: mknod d4/d9/d71/ca3 0 2024-09-13T23:06:23.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/496: rename d4/d9/d71/f7a to d4/d9/d1a/fa4 0 2024-09-13T23:06:23.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/497: chown d4/l2c 339 1 2024-09-13T23:06:23.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/498: symlink d4/d47/d8b/la5 0 2024-09-13T23:06:23.965 INFO:tasks.workunit.client.1.smithi152.stdout:1/499: creat d4/d4c/d8d/d99/fa6 x:0 0 0 2024-09-13T23:06:23.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/500: creat d4/d9/fa7 x:0 0 0 2024-09-13T23:06:23.967 INFO:tasks.workunit.client.1.smithi152.stdout:1/501: mknod d4/d9/d71/ca8 0 2024-09-13T23:06:23.967 INFO:tasks.workunit.client.1.smithi152.stdout:1/502: dread - d4/d9/d71/f89 zero size 2024-09-13T23:06:23.967 INFO:tasks.workunit.client.1.smithi152.stdout:1/503: fdatasync d4/d9/f14 0 2024-09-13T23:06:23.968 INFO:tasks.workunit.client.1.smithi152.stdout:1/504: mknod d4/d9/d1a/ca9 0 2024-09-13T23:06:23.968 INFO:tasks.workunit.client.1.smithi152.stdout:1/505: stat d4/d9/d1a/f30 0 2024-09-13T23:06:23.968 INFO:tasks.workunit.client.1.smithi152.stdout:1/506: dread - d4/d9/d1a/fa4 zero size 2024-09-13T23:06:23.969 INFO:tasks.workunit.client.1.smithi152.stdout:1/507: mkdir d4/d9/d1a/d22/d24/daa 0 2024-09-13T23:06:23.973 INFO:tasks.workunit.client.1.smithi152.stdout:1/508: write d4/f72 [459709,26342] 0 2024-09-13T23:06:23.973 INFO:tasks.workunit.client.1.smithi152.stdout:1/509: write d4/d9/d1a/d22/f35 [649836,116553] 0 2024-09-13T23:06:23.973 INFO:tasks.workunit.client.1.smithi152.stdout:1/510: write d4/d4c/d8d/d99/fa6 [143120,119398] 0 2024-09-13T23:06:23.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/511: creat d4/d9/d1a/d22/d24/d48/fab x:0 0 0 2024-09-13T23:06:23.975 INFO:tasks.workunit.client.1.smithi152.stdout:1/512: unlink d4/cf 0 2024-09-13T23:06:23.976 INFO:tasks.workunit.client.1.smithi152.stdout:1/513: symlink d4/d4c/d8d/lac 0 2024-09-13T23:06:23.976 INFO:tasks.workunit.client.1.smithi152.stdout:1/514: write d4/d9/d71/f89 [612294,19745] 0 2024-09-13T23:06:23.977 INFO:tasks.workunit.client.1.smithi152.stdout:1/515: mknod d4/d9/d1a/d22/d24/cad 0 2024-09-13T23:06:23.977 INFO:tasks.workunit.client.1.smithi152.stdout:1/516: truncate d4/d9/d1a/f30 1238004 0 2024-09-13T23:06:23.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/517: dread d4/d9/d1a/f19 [0,4194304] 0 2024-09-13T23:06:23.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/518: creat d4/fae x:0 0 0 2024-09-13T23:06:23.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/519: fdatasync d4/d9/d1a/d22/d24/f45 0 2024-09-13T23:06:23.988 INFO:tasks.workunit.client.1.smithi152.stdout:1/520: getdents d4/d9/d1a/d22/d24 0 2024-09-13T23:06:23.989 INFO:tasks.workunit.client.1.smithi152.stdout:1/521: mknod d4/d9/d1a/caf 0 2024-09-13T23:06:23.990 INFO:tasks.workunit.client.1.smithi152.stdout:1/522: mkdir d4/d47/db0 0 2024-09-13T23:06:24.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/523: dwrite d4/d9/f12 [0,4194304] 0 2024-09-13T23:06:24.017 INFO:tasks.workunit.client.1.smithi152.stdout:1/524: mkdir d4/d4c/db1 0 2024-09-13T23:06:24.018 INFO:tasks.workunit.client.1.smithi152.stdout:1/525: dread d4/d4c/d8d/d99/fa6 [0,4194304] 0 2024-09-13T23:06:24.038 INFO:tasks.workunit.client.1.smithi152.stdout:1/526: dwrite d4/d47/f82 [0,4194304] 0 2024-09-13T23:06:24.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.114+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb04000bf0 con 0x7fdb0c06e6e0 2024-09-13T23:06:24.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.116+0000 7fdb16ffd640 1 -- 172.21.15.115:0/629009149 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fdb04000bf0 con 0x7fdb0c06e6e0 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:06:24.117 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 msgr2=0x7fdb0c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 0x7fdb0c070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009ac0 tx=0x7fdb10009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 msgr2=0x7fdb20113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00b580 tx=0x7fdb1c0091a0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 shutdown_connections 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fdb0c06e6e0 0x7fdb0c070b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb200728a0 0x7fdb20113c90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.119 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 --2- 172.21.15.115:0/629009149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb20071f50 0x7fdb20113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 >> 172.21.15.115:0/629009149 conn(0x7fdb200fa060 msgr2=0x7fdb200fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:24.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 shutdown_connections 2024-09-13T23:06:24.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.118+0000 7fdb284f3640 1 -- 172.21.15.115:0/629009149 wait complete. 2024-09-13T23:06:24.155 INFO:tasks.workunit.client.1.smithi152.stdout:2/596: sync 2024-09-13T23:06:24.164 INFO:tasks.workunit.client.1.smithi152.stdout:2/597: dread d0/d4/d9/d18/d32/f65 [0,4194304] 0 2024-09-13T23:06:24.164 INFO:tasks.workunit.client.1.smithi152.stdout:2/598: write d0/d4/d9/d18/d1e/f41 [85406,29809] 0 2024-09-13T23:06:24.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/599: write d0/d4/d9/d14/f2f [3051986,114448] 0 2024-09-13T23:06:24.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/600: creat d0/fd3 x:0 0 0 2024-09-13T23:06:24.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/601: mknod d0/d4/d9/d18/d1e/d3c/d88/db9/cd4 0 2024-09-13T23:06:24.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/602: dread - d0/d4/fc3 zero size 2024-09-13T23:06:24.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/603: stat d0/d4/d9/d14/d48/d49/c7b 0 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 -- 172.21.15.115:0/1059142992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 msgr2=0x7f31240fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 --2- 172.21.15.115:0/1059142992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fb7e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f310c0048d0 tx=0x7f310c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 -- 172.21.15.115:0/1059142992 shutdown_connections 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 --2- 172.21.15.115:0/1059142992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fb7e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 --2- 172.21.15.115:0/1059142992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 0x7f31240fce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 -- 172.21.15.115:0/1059142992 >> 172.21.15.115:0/1059142992 conn(0x7f31240f6380 msgr2=0x7f31240f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 -- 172.21.15.115:0/1059142992 shutdown_connections 2024-09-13T23:06:24.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.208+0000 7f312a572640 1 -- 172.21.15.115:0/1059142992 wait complete. 2024-09-13T23:06:24.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 Processor -- start 2024-09-13T23:06:24.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 -- start start 2024-09-13T23:06:24.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 0x7f31240ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:24.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240fe0c0 con 0x7f31240fd3b0 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f312a572640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240fe200 con 0x7f31240fca60 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56730/0 (socket says 172.21.15.115:56730) 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 -- 172.21.15.115:0/25468376 learned_addr learned my addr 172.21.15.115:0/25468376 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f3123fff640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 0x7f31240ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 -- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 msgr2=0x7f31240ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 0x7f31240ff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.209+0000 7f311bfff640 1 -- 172.21.15.115:0/25468376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c005040 con 0x7f31240fd3b0 2024-09-13T23:06:24.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f311bfff640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f310c0048a0 tx=0x7f310c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:24.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f310c038070 con 0x7f31240fd3b0 2024-09-13T23:06:24.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31240fe480 con 0x7f31240fd3b0 2024-09-13T23:06:24.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f310c004290 con 0x7f31240fd3b0 2024-09-13T23:06:24.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f310c033660 con 0x7f31240fd3b0 2024-09-13T23:06:24.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.210+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31241150d0 con 0x7f31240fd3b0 2024-09-13T23:06:24.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.212+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31240fa040 con 0x7f31240fd3b0 2024-09-13T23:06:24.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.212+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f310c030020 con 0x7f31240fd3b0 2024-09-13T23:06:24.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.213+0000 7f31217fa640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 0x7f3110070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:24.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.213+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f310c0adf60 con 0x7f31240fd3b0 2024-09-13T23:06:24.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.213+0000 7f3123fff640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 0x7f3110070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:24.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.213+0000 7f3123fff640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 0x7f3110070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31240ff3f0 tx=0x7f311400b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:24.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.218+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f310c0e2670 con 0x7f31240fd3b0 2024-09-13T23:06:24.271 INFO:tasks.workunit.client.1.smithi152.stdout:4/626: sync 2024-09-13T23:06:24.272 INFO:tasks.workunit.client.1.smithi152.stdout:4/627: chown d3/d4/d6/d66/d1c/d59 29 1 2024-09-13T23:06:24.272 INFO:tasks.workunit.client.1.smithi152.stdout:4/628: creat d3/d4/d32/fc2 x:0 0 0 2024-09-13T23:06:24.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/404: sync 2024-09-13T23:06:24.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/405: chown de/d14/d47/d70/f78 1 1 2024-09-13T23:06:24.357 INFO:tasks.workunit.client.1.smithi152.stdout:6/484: sync 2024-09-13T23:06:24.357 INFO:tasks.workunit.client.1.smithi152.stdout:6/485: dread - d4/de/d12/d16/f9c zero size 2024-09-13T23:06:24.357 INFO:tasks.workunit.client.1.smithi152.stdout:9/547: sync 2024-09-13T23:06:24.358 INFO:tasks.workunit.client.1.smithi152.stdout:6/486: rename d4/de/d1d/l22 to d4/de/d12/d16/d2a/d38/da4/la7 0 2024-09-13T23:06:24.358 INFO:tasks.workunit.client.1.smithi152.stdout:3/406: rmdir de/d14/d47/d57/d5d/d6e 39 2024-09-13T23:06:24.358 INFO:tasks.workunit.client.1.smithi152.stdout:3/407: creat de/d14/d76/f8e x:0 0 0 2024-09-13T23:06:24.359 INFO:tasks.workunit.client.1.smithi152.stdout:6/487: rename d4/de/l35 to d4/de/d12/d3e/la8 0 2024-09-13T23:06:24.365 INFO:tasks.workunit.client.1.smithi152.stdout:9/548: dread d3/d24/d67/f8a [0,4194304] 0 2024-09-13T23:06:24.368 INFO:tasks.workunit.client.1.smithi152.stdout:9/549: rename d3/d24/d67/f50 to d3/d24/d67/d4a/d71/db7/fb9 0 2024-09-13T23:06:24.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/550: unlink d3/d24/d67/d4a/ca6 0 2024-09-13T23:06:24.370 INFO:tasks.workunit.client.1.smithi152.stdout:6/488: write d4/de/d12/d16/d2a/d3d/d57/f60 [4049512,39827] 0 2024-09-13T23:06:24.373 INFO:tasks.workunit.client.1.smithi152.stdout:9/551: mknod d3/d52/d8c/cba 0 2024-09-13T23:06:24.377 INFO:tasks.workunit.client.1.smithi152.stdout:3/408: dwrite de/f45 [4194304,4194304] 0 2024-09-13T23:06:24.377 INFO:tasks.workunit.client.1.smithi152.stdout:9/552: creat d3/d24/d67/d4a/d71/db7/fbb x:0 0 0 2024-09-13T23:06:24.377 INFO:tasks.workunit.client.1.smithi152.stdout:9/553: stat d3/f48 0 2024-09-13T23:06:24.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/554: dread d3/f9 [0,4194304] 0 2024-09-13T23:06:24.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/409: dwrite de/d1f/f36 [0,4194304] 0 2024-09-13T23:06:24.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/410: chown de/f17 27 1 2024-09-13T23:06:24.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/411: creat de/d14/d47/d57/f8f x:0 0 0 2024-09-13T23:06:24.416 INFO:tasks.workunit.client.1.smithi152.stdout:3/412: link de/d14/d47/f48 de/f90 0 2024-09-13T23:06:24.416 INFO:tasks.workunit.client.1.smithi152.stdout:3/413: write de/d14/d38/f4e [657389,54438] 0 2024-09-13T23:06:24.417 INFO:tasks.workunit.client.1.smithi152.stdout:3/414: write de/d14/d47/d57/d5d/f41 [1894960,72213] 0 2024-09-13T23:06:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/415: link de/ff de/d1f/f91 0 2024-09-13T23:06:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/416: readlink de/d1f/l4c 0 2024-09-13T23:06:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/417: write de/d14/d47/f48 [2766127,68887] 0 2024-09-13T23:06:24.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/418: write de/f1e [4960070,103683] 0 2024-09-13T23:06:24.421 INFO:tasks.workunit.client.1.smithi152.stdout:9/555: dwrite d3/d24/f41 [0,4194304] 0 2024-09-13T23:06:24.422 INFO:tasks.workunit.client.1.smithi152.stdout:6/489: dwrite d4/de/d21/f7c [0,4194304] 0 2024-09-13T23:06:24.423 INFO:tasks.workunit.client.1.smithi152.stdout:9/556: symlink d3/d24/d34/d45/daa/lbc 0 2024-09-13T23:06:24.425 INFO:tasks.workunit.client.1.smithi152.stdout:9/557: mknod d3/d24/d67/d4a/d71/cbd 0 2024-09-13T23:06:24.428 INFO:tasks.workunit.client.1.smithi152.stdout:6/490: rmdir d4/de/d12/d16/d2a/d3d/d57 39 2024-09-13T23:06:24.428 INFO:tasks.workunit.client.1.smithi152.stdout:6/491: stat d4/de/d12/d16/d2a/d3d/d57/d8d 0 2024-09-13T23:06:24.431 INFO:tasks.workunit.client.1.smithi152.stdout:9/558: rmdir d3/db0 39 2024-09-13T23:06:24.431 INFO:tasks.workunit.client.1.smithi152.stdout:9/559: rename d3 to d3/d24/d67/d4a/dbe 22 2024-09-13T23:06:24.438 INFO:tasks.workunit.client.1.smithi152.stdout:3/419: dwrite de/d14/d47/d70/f78 [0,4194304] 0 2024-09-13T23:06:24.438 INFO:tasks.workunit.client.1.smithi152.stdout:3/420: dread - de/d14/d47/d70/f73 zero size 2024-09-13T23:06:24.439 INFO:tasks.workunit.client.1.smithi152.stdout:6/492: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:24.440 INFO:tasks.workunit.client.1.smithi152.stdout:3/421: mknod de/d14/d47/d57/d5d/c92 0 2024-09-13T23:06:24.440 INFO:tasks.workunit.client.1.smithi152.stdout:3/422: truncate de/d14/f49 430305 0 2024-09-13T23:06:24.442 INFO:tasks.workunit.client.1.smithi152.stdout:6/493: rename d4/de/d1d/f2f to d4/de/d12/d16/d2a/d38/da4/fa9 0 2024-09-13T23:06:24.442 INFO:tasks.workunit.client.1.smithi152.stdout:6/494: chown d4/de/d12/d16/d2a/d38/da4/fa9 617533453 1 2024-09-13T23:06:24.449 INFO:tasks.workunit.client.1.smithi152.stdout:6/495: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:24.449 INFO:tasks.workunit.client.1.smithi152.stdout:9/560: dwrite d3/d52/fb3 [0,4194304] 0 2024-09-13T23:06:24.449 INFO:tasks.workunit.client.1.smithi152.stdout:6/496: stat d4/l9e 0 2024-09-13T23:06:24.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/561: mkdir d3/d24/d34/d45/daa/dbf 0 2024-09-13T23:06:24.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/562: creat d3/d24/d67/d4a/fc0 x:0 0 0 2024-09-13T23:06:24.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/563: chown d3/d24/d34/d45 1316 1 2024-09-13T23:06:24.452 INFO:tasks.workunit.client.1.smithi152.stdout:9/564: rename d3/d24/d67/d4a/l8b to d3/lc1 0 2024-09-13T23:06:24.455 INFO:tasks.workunit.client.1.smithi152.stdout:6/497: dread d4/de/d12/d16/d2a/d38/d3c/f45 [0,4194304] 0 2024-09-13T23:06:24.455 INFO:tasks.workunit.client.1.smithi152.stdout:9/565: symlink d3/d24/d34/d45/lc2 0 2024-09-13T23:06:24.458 INFO:tasks.workunit.client.1.smithi152.stdout:9/566: creat d3/d1e/d30/d5d/da3/fc3 x:0 0 0 2024-09-13T23:06:24.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/498: dread d4/de/d12/f5f [0,4194304] 0 2024-09-13T23:06:24.461 INFO:tasks.workunit.client.1.smithi152.stdout:6/499: dread d4/de/d12/d16/d2a/d38/d3c/f45 [0,4194304] 0 2024-09-13T23:06:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/500: chown d4/de/d12/c84 1359256 1 2024-09-13T23:06:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/501: write d4/de/d21/f15 [1275865,81673] 0 2024-09-13T23:06:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/502: truncate d4/fa2 612885 0 2024-09-13T23:06:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/503: fsync d4/f6 0 2024-09-13T23:06:24.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/504: chown d4/de/d12/d16/d2a/d38/da4/la7 402 1 2024-09-13T23:06:24.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/505: mkdir d4/de/d12/d16/d2a/d3d/daa 0 2024-09-13T23:06:24.464 INFO:tasks.workunit.client.1.smithi152.stdout:6/506: stat d4/de/d12/d16/d2a/d38 0 2024-09-13T23:06:24.467 INFO:tasks.workunit.client.1.smithi152.stdout:6/507: creat d4/de/d12/d16/d2a/d3d/d57/d8d/d92/fab x:0 0 0 2024-09-13T23:06:24.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/508: link d4/de/d12/d3e/c59 d4/de/d12/d16/d2a/d3d/d57/d8d/d92/cac 0 2024-09-13T23:06:24.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/509: creat d4/de/d21/fad x:0 0 0 2024-09-13T23:06:24.471 INFO:tasks.workunit.client.1.smithi152.stdout:6/510: dread d4/de/d1d/f37 [0,4194304] 0 2024-09-13T23:06:24.471 INFO:tasks.workunit.client.1.smithi152.stdout:6/511: creat d4/de/d12/d16/d2a/d38/fae x:0 0 0 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:6/512: mkdir d4/de/d12/d16/d2a/d3d/daa/daf 0 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/423: dwrite de/f1e [0,4194304] 0 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/424: chown de/d14/d47/d57/d5d/f2b 57 1 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/425: chown de/f45 1938070 1 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/426: getdents de/d14/d47/d70/d87 0 2024-09-13T23:06:24.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/427: chown de/d14/d47/d57/d5d/l54 0 1 2024-09-13T23:06:24.475 INFO:tasks.workunit.client.1.smithi152.stdout:9/567: dwrite d3/d24/d34/f40 [0,4194304] 0 2024-09-13T23:06:24.475 INFO:tasks.workunit.client.1.smithi152.stdout:6/513: symlink d4/de/d12/d16/d2a/d3d/daa/daf/lb0 0 2024-09-13T23:06:24.475 INFO:tasks.workunit.client.1.smithi152.stdout:6/514: write d4/de/d21/fa3 [807463,93804] 0 2024-09-13T23:06:24.476 INFO:tasks.workunit.client.1.smithi152.stdout:9/568: symlink d3/d24/dac/lc4 0 2024-09-13T23:06:24.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/515: truncate d4/de/d21/f24 936253 0 2024-09-13T23:06:24.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/516: write d4/de/d12/f55 [5788534,1972] 0 2024-09-13T23:06:24.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/517: dread - d4/de/d12/f6f zero size 2024-09-13T23:06:24.478 INFO:tasks.workunit.client.1.smithi152.stdout:9/569: unlink d3/d24/f41 0 2024-09-13T23:06:24.478 INFO:tasks.workunit.client.1.smithi152.stdout:9/570: truncate d3/d24/d67/d4a/d71/db7/fbb 22336 0 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/571: symlink d3/d24/dac/lc5 0 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/572: readlink d3/lc1 0 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/573: chown d3/d24/f20 2 1 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/574: dread - d3/d1e/d30/f39 zero size 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/575: write d3/d24/d67/d4a/fc0 [385721,6139] 0 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/576: mkdir d3/d24/d34/dc6 0 2024-09-13T23:06:24.480 INFO:tasks.workunit.client.1.smithi152.stdout:9/577: creat d3/d52/fc7 x:0 0 0 2024-09-13T23:06:24.484 INFO:tasks.workunit.client.1.smithi152.stdout:9/578: rename d3/d24/d67/f6d to d3/d52/d8c/fc8 0 2024-09-13T23:06:24.486 INFO:tasks.workunit.client.1.smithi152.stdout:9/579: symlink d3/d24/d67/d4a/d8e/lc9 0 2024-09-13T23:06:24.486 INFO:tasks.workunit.client.1.smithi152.stdout:9/580: stat d3/d1e/f3e 0 2024-09-13T23:06:24.486 INFO:tasks.workunit.client.1.smithi152.stdout:3/428: write de/d14/f6d [161071,14258] 0 2024-09-13T23:06:24.499 INFO:tasks.workunit.client.1.smithi152.stdout:6/518: dwrite d4/de/d12/d16/d2a/f4f [0,4194304] 0 2024-09-13T23:06:24.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/581: dwrite d3/d24/d67/f7b [0,4194304] 0 2024-09-13T23:06:24.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/582: write d3/d24/d67/d47/f51 [4352434,88239] 0 2024-09-13T23:06:24.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/583: write d3/d1e/d30/f6c [2152500,36141] 0 2024-09-13T23:06:24.514 INFO:tasks.workunit.client.1.smithi152.stdout:9/584: read - d3/d24/d67/d47/f97 zero size 2024-09-13T23:06:24.516 INFO:tasks.workunit.client.1.smithi152.stdout:9/585: mknod d3/d24/d34/d45/daa/cca 0 2024-09-13T23:06:24.516 INFO:tasks.workunit.client.1.smithi152.stdout:9/586: chown d3/d1e/f21 1557095600 1 2024-09-13T23:06:24.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/587: chown d3/d24/d67/l66 2292206 1 2024-09-13T23:06:24.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/588: dread - d3/d52/fc7 zero size 2024-09-13T23:06:24.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/589: dread - d3/db0/fb2 zero size 2024-09-13T23:06:24.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/590: read d3/d24/d67/d4a/d71/db7/fb9 [127978,23335] 0 2024-09-13T23:06:24.519 INFO:tasks.workunit.client.1.smithi152.stdout:9/591: mknod d3/ccb 0 2024-09-13T23:06:24.519 INFO:tasks.workunit.client.1.smithi152.stdout:9/592: write d3/d52/fc7 [138363,23787] 0 2024-09-13T23:06:24.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/593: symlink d3/d24/d67/d4a/d71/lcc 0 2024-09-13T23:06:24.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/594: creat d3/d24/d67/d4a/d71/db7/fcd x:0 0 0 2024-09-13T23:06:24.523 INFO:tasks.workunit.client.1.smithi152.stdout:9/595: creat d3/d24/d34/d45/daa/dbf/fce x:0 0 0 2024-09-13T23:06:24.524 INFO:tasks.workunit.client.1.smithi152.stdout:9/596: rename d3/d1e/f3e to d3/d24/d67/d47/fcf 0 2024-09-13T23:06:24.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/429: dwrite de/d14/d47/d57/d5d/f41 [0,4194304] 0 2024-09-13T23:06:24.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/597: rename d3/d1e/d30/la8 to d3/d1e/d30/d5d/da3/ld0 0 2024-09-13T23:06:24.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/598: readlink d3/d24/d34/d45/l5a 0 2024-09-13T23:06:24.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/599: write d3/d1e/d30/d5d/f80 [1084853,43128] 0 2024-09-13T23:06:24.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/600: creat d3/d24/d67/d4a/d71/fd1 x:0 0 0 2024-09-13T23:06:24.526 INFO:tasks.workunit.client.1.smithi152.stdout:9/601: write d3/f48 [778111,111602] 0 2024-09-13T23:06:24.528 INFO:tasks.workunit.client.1.smithi152.stdout:6/519: dwrite d4/de/d12/d16/d2a/d3d/d57/f85 [0,4194304] 0 2024-09-13T23:06:24.532 INFO:tasks.workunit.client.1.smithi152.stdout:9/602: dread d3/d52/fc7 [0,4194304] 0 2024-09-13T23:06:24.532 INFO:tasks.workunit.client.1.smithi152.stdout:9/603: stat d3/d24/l27 0 2024-09-13T23:06:24.532 INFO:tasks.workunit.client.1.smithi152.stdout:3/430: dread de/d14/d38/f4e [0,4194304] 0 2024-09-13T23:06:24.534 INFO:tasks.workunit.client.1.smithi152.stdout:3/431: mkdir de/d14/d47/d57/d93 0 2024-09-13T23:06:24.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.551+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f312404b720 con 0x7f31240fd3b0 2024-09-13T23:06:24.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.552+0000 7f31217fa640 1 -- 172.21.15.115:0/25468376 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f310c0779a0 con 0x7f31240fd3b0 2024-09-13T23:06:24.553 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 msgr2=0x7f3110070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 0x7f3110070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31240ff3f0 tx=0x7f311400b040 comp rx=0 tx=0).stop 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 msgr2=0x7f31240fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f310c0048a0 tx=0x7f310c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 shutdown_connections 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f311006e6e0 0x7f3110070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31240fd3b0 0x7f31240fdb30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 --2- 172.21.15.115:0/25468376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31240fca60 0x7f31240ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:24.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 >> 172.21.15.115:0/25468376 conn(0x7f31240f6380 msgr2=0x7f31240fad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:24.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 shutdown_connections 2024-09-13T23:06:24.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:24.555+0000 7f312a572640 1 -- 172.21.15.115:0/25468376 wait complete. 2024-09-13T23:06:24.557 INFO:tasks.workunit.client.1.smithi152.stdout:3/432: dread de/d14/f55 [0,4194304] 0 2024-09-13T23:06:24.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/433: creat de/d14/d47/d57/d5d/d6e/f94 x:0 0 0 2024-09-13T23:06:24.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/434: fsync de/d14/f4b 0 2024-09-13T23:06:24.566 INFO:tasks.workunit.client.1.smithi152.stdout:9/604: dwrite d3/d52/fc7 [0,4194304] 0 2024-09-13T23:06:24.566 INFO:tasks.workunit.client.1.smithi152.stdout:9/605: chown d3/d24/d34/d45/f9a 85475591 1 2024-09-13T23:06:24.566 INFO:tasks.workunit.client.1.smithi152.stdout:9/606: stat d3/db0/fb2 0 2024-09-13T23:06:24.567 INFO:tasks.workunit.client.1.smithi152.stdout:6/520: dwrite d4/de/d12/f9b [0,4194304] 0 2024-09-13T23:06:24.577 INFO:tasks.workunit.client.1.smithi152.stdout:3/435: dwrite de/d14/f62 [0,4194304] 0 2024-09-13T23:06:24.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/521: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1 0 2024-09-13T23:06:24.580 INFO:tasks.workunit.client.1.smithi152.stdout:3/436: symlink de/d14/d47/d70/d87/l95 0 2024-09-13T23:06:24.584 INFO:tasks.workunit.client.1.smithi152.stdout:6/522: mknod d4/de/d12/d16/d2a/d3d/d57/cb2 0 2024-09-13T23:06:24.584 INFO:tasks.workunit.client.1.smithi152.stdout:6/523: write d4/f9 [1633432,83125] 0 2024-09-13T23:06:24.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/607: dread d3/d52/fb3 [0,4194304] 0 2024-09-13T23:06:24.588 INFO:tasks.workunit.client.1.smithi152.stdout:6/524: dread d4/de/f39 [0,4194304] 0 2024-09-13T23:06:24.588 INFO:tasks.workunit.client.1.smithi152.stdout:6/525: chown d4/fa2 3431 1 2024-09-13T23:06:24.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/526: dread - d4/de/d12/f98 zero size 2024-09-13T23:06:24.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/527: chown d4/de/l70 4 1 2024-09-13T23:06:24.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/528: getdents d4/de/d12/d16/d2a/d38/d3c 0 2024-09-13T23:06:24.591 INFO:tasks.workunit.client.1.smithi152.stdout:6/529: unlink d4/de/d21/c51 0 2024-09-13T23:06:24.592 INFO:tasks.workunit.client.1.smithi152.stdout:6/530: mkdir d4/de/d12/d3e/db3 0 2024-09-13T23:06:24.594 INFO:tasks.workunit.client.1.smithi152.stdout:6/531: mknod d4/de/cb4 0 2024-09-13T23:06:24.596 INFO:tasks.workunit.client.1.smithi152.stdout:3/437: dwrite de/d14/d47/f7c [0,4194304] 0 2024-09-13T23:06:24.598 INFO:tasks.workunit.client.1.smithi152.stdout:3/438: creat de/d14/f96 x:0 0 0 2024-09-13T23:06:24.602 INFO:tasks.workunit.client.1.smithi152.stdout:7/588: sync 2024-09-13T23:06:24.604 INFO:tasks.workunit.client.1.smithi152.stdout:3/439: write de/f1d [629821,19564] 0 2024-09-13T23:06:24.604 INFO:tasks.workunit.client.1.smithi152.stdout:3/440: chown de/d14/d47/d57/f64 1835856169 1 2024-09-13T23:06:24.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/441: getdents de/d63 0 2024-09-13T23:06:24.608 INFO:tasks.workunit.client.1.smithi152.stdout:3/442: creat de/d14/d47/d57/d93/f97 x:0 0 0 2024-09-13T23:06:24.609 INFO:tasks.workunit.client.1.smithi152.stdout:3/443: creat de/f98 x:0 0 0 2024-09-13T23:06:24.609 INFO:tasks.workunit.client.1.smithi152.stdout:3/444: readlink de/d14/d47/d57/d5d/l5a 0 2024-09-13T23:06:24.612 INFO:tasks.workunit.client.1.smithi152.stdout:3/445: rename de/d1f/d8d to de/d14/d47/d57/d99 0 2024-09-13T23:06:24.612 INFO:tasks.workunit.client.1.smithi152.stdout:3/446: write de/d14/f49 [1234907,568] 0 2024-09-13T23:06:24.613 INFO:tasks.workunit.client.1.smithi152.stdout:3/447: symlink de/d14/d47/l9a 0 2024-09-13T23:06:24.625 INFO:tasks.workunit.client.1.smithi152.stdout:6/532: dwrite d4/de/d12/d16/d2a/d38/d3c/f45 [4194304,4194304] 0 2024-09-13T23:06:24.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/589: dwrite d17/d24/d9f/d51/d5b/d90/d2b/f47 [0,4194304] 0 2024-09-13T23:06:24.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/590: write d17/d24/d9f/d51/d5b/d90/d2e/f56 [4132250,95894] 0 2024-09-13T23:06:24.626 INFO:tasks.workunit.client.1.smithi152.stdout:3/448: dread de/f13 [4194304,4194304] 0 2024-09-13T23:06:24.628 INFO:tasks.workunit.client.1.smithi152.stdout:7/591: mkdir d17/d24/d9f/d51/d5b/d87/dc7 0 2024-09-13T23:06:24.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/449: rename de/d14/l84 to de/d14/d47/d57/d99/l9b 0 2024-09-13T23:06:24.630 INFO:tasks.workunit.client.1.smithi152.stdout:7/592: creat d17/d24/d9f/d51/d5b/d90/d2e/fc8 x:0 0 0 2024-09-13T23:06:24.632 INFO:tasks.workunit.client.1.smithi152.stdout:7/593: symlink d17/d24/d9f/d51/d5b/d90/d2b/lc9 0 2024-09-13T23:06:24.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/594: truncate d17/d24/d9f/d51/d5b/d90/d2e/f76 632430 0 2024-09-13T23:06:24.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/595: fdatasync d17/d6c/f88 0 2024-09-13T23:06:24.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/450: rmdir de/d14/d47/d57 39 2024-09-13T23:06:24.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/451: fsync de/d14/d47/d70/f73 0 2024-09-13T23:06:24.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/452: fsync de/d14/d47/d57/d5d/f2b 0 2024-09-13T23:06:24.638 INFO:tasks.workunit.client.1.smithi152.stdout:3/453: unlink de/d14/d47/f7c 0 2024-09-13T23:06:24.648 INFO:tasks.workunit.client.1.smithi152.stdout:3/454: write de/d14/d47/d70/f81 [3578594,63395] 0 2024-09-13T23:06:24.649 INFO:tasks.workunit.client.1.smithi152.stdout:3/455: symlink de/d14/d38/l9c 0 2024-09-13T23:06:24.650 INFO:tasks.workunit.client.1.smithi152.stdout:7/596: dwrite d17/d24/d9f/d51/d5b/d90/d8e/fbe [0,4194304] 0 2024-09-13T23:06:24.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/456: rename de/d1f/f66 to de/f9d 0 2024-09-13T23:06:24.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/457: read - de/d14/f96 zero size 2024-09-13T23:06:24.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/458: symlink de/d14/d76/l9e 0 2024-09-13T23:06:24.654 INFO:tasks.workunit.client.1.smithi152.stdout:3/459: link de/d14/l59 de/l9f 0 2024-09-13T23:06:24.660 INFO:tasks.workunit.client.1.smithi152.stdout:7/597: write d17/d24/d9f/d51/d5b/d90/d2b/f49 [3467113,69662] 0 2024-09-13T23:06:24.661 INFO:tasks.workunit.client.1.smithi152.stdout:7/598: unlink d17/d24/d9f/d51/d5b/d87/l91 0 2024-09-13T23:06:24.664 INFO:tasks.workunit.client.1.smithi152.stdout:3/460: dread de/f5c [0,4194304] 0 2024-09-13T23:06:24.687 INFO:tasks.workunit.client.1.smithi152.stdout:7/599: dwrite f5 [0,4194304] 0 2024-09-13T23:06:24.687 INFO:tasks.workunit.client.1.smithi152.stdout:3/461: dwrite de/d14/f96 [0,4194304] 0 2024-09-13T23:06:24.687 INFO:tasks.workunit.client.1.smithi152.stdout:3/462: truncate de/d14/d47/f86 522001 0 2024-09-13T23:06:24.687 INFO:tasks.workunit.client.1.smithi152.stdout:7/600: getdents d17/d24/d9f 0 2024-09-13T23:06:24.688 INFO:tasks.workunit.client.1.smithi152.stdout:7/601: truncate d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/fc2 729984 0 2024-09-13T23:06:24.689 INFO:tasks.workunit.client.1.smithi152.stdout:3/463: mknod de/d14/d47/d57/d93/ca0 0 2024-09-13T23:06:24.689 INFO:tasks.workunit.client.1.smithi152.stdout:7/602: unlink d17/d24/d9f/dac/dba/l92 0 2024-09-13T23:06:24.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/464: link de/d14/d47/d57/d5d/f56 de/d14/d47/d70/fa1 0 2024-09-13T23:06:24.691 INFO:tasks.workunit.client.1.smithi152.stdout:3/465: write de/d14/d38/f4e [734665,37081] 0 2024-09-13T23:06:24.705 INFO:tasks.workunit.client.1.smithi152.stdout:7/603: truncate f0 1706786 0 2024-09-13T23:06:24.706 INFO:tasks.workunit.client.1.smithi152.stdout:3/466: mkdir de/d1f/da2 0 2024-09-13T23:06:24.716 INFO:tasks.workunit.client.1.smithi152.stdout:3/467: write de/d14/f4b [1577710,108789] 0 2024-09-13T23:06:24.716 INFO:tasks.workunit.client.1.smithi152.stdout:3/468: readlink de/d1f/l6f 0 2024-09-13T23:06:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:24 smithi152 ceph-mon[34465]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:24 smithi152 ceph-mon[34465]: pgmap v8: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 174 MiB/s rd, 229 MiB/s wr, 309 op/s 2024-09-13T23:06:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:24 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/205209626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:06:24.761 INFO:tasks.workunit.client.1.smithi152.stdout:7/604: creat d17/d4f/d84/fca x:0 0 0 2024-09-13T23:06:24.761 INFO:tasks.workunit.client.1.smithi152.stdout:7/605: creat d17/d4f/d84/fcb x:0 0 0 2024-09-13T23:06:24.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/469: link de/d14/d47/d70/f78 de/d14/d38/fa3 0 2024-09-13T23:06:24.779 INFO:tasks.workunit.client.1.smithi152.stdout:7/606: dwrite d17/f1b [4194304,4194304] 0 2024-09-13T23:06:24.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/607: mknod d17/d24/d9f/d51/d5b/d90/d2e/d9d/ccc 0 2024-09-13T23:06:24.780 INFO:tasks.workunit.client.1.smithi152.stdout:3/470: mknod de/d14/ca4 0 2024-09-13T23:06:24.780 INFO:tasks.workunit.client.1.smithi152.stdout:3/471: dread - de/d14/d47/d57/d5d/d6e/f94 zero size 2024-09-13T23:06:24.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/472: truncate de/d14/d47/d57/d5d/d6e/f94 865884 0 2024-09-13T23:06:24.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/473: symlink de/d14/d47/d57/d99/la5 0 2024-09-13T23:06:24.782 INFO:tasks.workunit.client.1.smithi152.stdout:3/474: dread de/d1f/f52 [0,4194304] 0 2024-09-13T23:06:24.784 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:24 smithi115 ceph-mon[27601]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:24.784 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:24 smithi115 ceph-mon[27601]: pgmap v8: 65 pgs: 65 active+clean; 2.7 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 174 MiB/s rd, 229 MiB/s wr, 309 op/s 2024-09-13T23:06:24.784 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:24 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/205209626' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:06:24.785 INFO:tasks.workunit.client.1.smithi152.stdout:3/475: symlink de/d14/d38/la6 0 2024-09-13T23:06:24.788 INFO:tasks.workunit.client.1.smithi152.stdout:3/476: dread de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:24.788 INFO:tasks.workunit.client.1.smithi152.stdout:3/477: readlink de/d14/d47/d57/d99/la5 0 2024-09-13T23:06:24.788 INFO:tasks.workunit.client.1.smithi152.stdout:3/478: write de/d14/f6d [5207910,60096] 0 2024-09-13T23:06:24.793 INFO:tasks.workunit.client.1.smithi152.stdout:7/608: write f16 [7863401,85288] 0 2024-09-13T23:06:24.796 INFO:tasks.workunit.client.1.smithi152.stdout:7/609: rename d17/d24/d9f/d51/d5b/d90/db2/cc6 to d17/d24/d9f/d51/d5b/d90/d2b/d4b/ccd 0 2024-09-13T23:06:24.810 INFO:tasks.workunit.client.1.smithi152.stdout:3/479: dwrite de/f98 [0,4194304] 0 2024-09-13T23:06:24.819 INFO:tasks.workunit.client.1.smithi152.stdout:3/480: dread de/d1f/f91 [0,4194304] 0 2024-09-13T23:06:24.820 INFO:tasks.workunit.client.1.smithi152.stdout:3/481: mkdir de/d14/d47/d70/d72/da7 0 2024-09-13T23:06:24.821 INFO:tasks.workunit.client.1.smithi152.stdout:3/482: mkdir de/d1f/da2/da8 0 2024-09-13T23:06:24.822 INFO:tasks.workunit.client.1.smithi152.stdout:3/483: symlink de/d14/d47/d70/d72/la9 0 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/474: sync 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/475: stat d17/d19/l8b 0 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/476: write d17/d19/f68 [812196,1705] 0 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/477: chown d17/d25/f2f 1 1 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:3/484: creat de/d14/d47/d57/faa x:0 0 0 2024-09-13T23:06:24.824 INFO:tasks.workunit.client.1.smithi152.stdout:3/485: read de/ff [2183276,51501] 0 2024-09-13T23:06:24.825 INFO:tasks.workunit.client.1.smithi152.stdout:3/486: rename de/d14/c16 to de/d14/cab 0 2024-09-13T23:06:24.827 INFO:tasks.workunit.client.1.smithi152.stdout:8/478: dread fd [0,4194304] 0 2024-09-13T23:06:24.827 INFO:tasks.workunit.client.1.smithi152.stdout:8/479: fdatasync d17/d25/d32/f3f 0 2024-09-13T23:06:24.855 INFO:tasks.workunit.client.1.smithi152.stdout:8/480: dwrite d17/d25/d32/d50/f78 [4194304,4194304] 0 2024-09-13T23:06:24.858 INFO:tasks.workunit.client.1.smithi152.stdout:8/481: write d17/d23/f67 [50655,79749] 0 2024-09-13T23:06:24.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/482: dwrite d17/d25/d80/f93 [0,4194304] 0 2024-09-13T23:06:24.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/483: dwrite d17/d25/d32/d50/f65 [0,4194304] 0 2024-09-13T23:06:24.897 INFO:tasks.workunit.client.1.smithi152.stdout:8/484: rename d17/d25/d32/f75 to d17/d19/f98 0 2024-09-13T23:06:24.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/485: rename d17/d25/d32/c66 to d17/d25/d80/c99 0 2024-09-13T23:06:24.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/486: rename d17/d23 to d17/d25/d32/d9a 0 2024-09-13T23:06:24.904 INFO:tasks.workunit.client.1.smithi152.stdout:8/487: symlink d17/d25/d32/d4b/l9b 0 2024-09-13T23:06:24.904 INFO:tasks.workunit.client.1.smithi152.stdout:8/488: readlink d17/l87 0 2024-09-13T23:06:24.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/489: write d17/d25/d32/d50/f65 [929783,71551] 0 2024-09-13T23:06:24.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/490: chown d17/d25/d32/d4b/f5b 330 1 2024-09-13T23:06:24.915 INFO:tasks.workunit.client.1.smithi152.stdout:8/491: mkdir d17/d25/d32/d4b/d84/d91/d9c 0 2024-09-13T23:06:24.940 INFO:tasks.workunit.client.1.smithi152.stdout:8/492: dwrite d17/d25/d32/d9a/d8f/f96 [0,4194304] 0 2024-09-13T23:06:24.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/493: dwrite d17/f22 [0,4194304] 0 2024-09-13T23:06:24.967 INFO:tasks.workunit.client.1.smithi152.stdout:8/494: dread d17/d25/d80/f93 [0,4194304] 0 2024-09-13T23:06:24.968 INFO:tasks.workunit.client.1.smithi152.stdout:8/495: truncate d17/d25/d32/d9a/f4f 2365013 0 2024-09-13T23:06:24.968 INFO:tasks.workunit.client.1.smithi152.stdout:8/496: chown d17/l71 3399759 1 2024-09-13T23:06:24.971 INFO:tasks.workunit.client.1.smithi152.stdout:8/497: write d17/d25/d32/f63 [3360450,792] 0 2024-09-13T23:06:24.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/498: chown d17/d19/c5e 30372918 1 2024-09-13T23:06:25.002 INFO:tasks.workunit.client.1.smithi152.stdout:1/527: sync 2024-09-13T23:06:25.002 INFO:tasks.workunit.client.1.smithi152.stdout:5/538: sync 2024-09-13T23:06:25.002 INFO:tasks.workunit.client.1.smithi152.stdout:4/629: sync 2024-09-13T23:06:25.002 INFO:tasks.workunit.client.1.smithi152.stdout:2/604: sync 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:0/456: sync 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:1/528: write d4/f1c [4981537,18089] 0 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:4/630: chown d3/d4/d6/d8/d17/d39/l3e 1 1 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:5/539: truncate d5/dc/d19/d65/d99/da6/f56 922389 0 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:1/529: fdatasync d4/d9/d1a/d22/f29 0 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:5/540: truncate d5/dc/f5f 815241 0 2024-09-13T23:06:25.003 INFO:tasks.workunit.client.1.smithi152.stdout:0/457: mkdir d18/d19/d74/da4 0 2024-09-13T23:06:25.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/631: rename d3/d4/d32/l6b to d3/d4/d6/d8/d17/d5d/d94/d9b/da0/lc3 0 2024-09-13T23:06:25.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/632: write d3/d4/d6/d66/f6f [5832861,20797] 0 2024-09-13T23:06:25.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/633: write d3/d4/d32/fc2 [437825,35803] 0 2024-09-13T23:06:25.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/605: mknod d0/d4/d9/d18/d1e/dc0/cd5 0 2024-09-13T23:06:25.005 INFO:tasks.workunit.client.1.smithi152.stdout:1/530: link d4/d47/d8b/la5 d4/d9/d71/lb2 0 2024-09-13T23:06:25.006 INFO:tasks.workunit.client.1.smithi152.stdout:5/541: creat d5/dc/d19/d20/d2e/d28/fb6 x:0 0 0 2024-09-13T23:06:25.008 INFO:tasks.workunit.client.1.smithi152.stdout:0/458: creat d18/d1f/d29/d3f/d4b/d66/d6a/fa5 x:0 0 0 2024-09-13T23:06:25.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/606: unlink d0/fd3 0 2024-09-13T23:06:25.012 INFO:tasks.workunit.client.1.smithi152.stdout:1/531: rmdir d4/d47/db0 0 2024-09-13T23:06:25.012 INFO:tasks.workunit.client.1.smithi152.stdout:1/532: write d4/f7e [414914,94540] 0 2024-09-13T23:06:25.012 INFO:tasks.workunit.client.1.smithi152.stdout:1/533: write d4/d9/d1a/f33 [339611,4820] 0 2024-09-13T23:06:25.013 INFO:tasks.workunit.client.1.smithi152.stdout:0/459: dread ff [0,4194304] 0 2024-09-13T23:06:25.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/534: rename d4/f7e to d4/d9/fb3 0 2024-09-13T23:06:25.022 INFO:tasks.workunit.client.1.smithi152.stdout:1/535: dread d4/d9/d71/f89 [0,4194304] 0 2024-09-13T23:06:25.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/536: symlink d4/d47/lb4 0 2024-09-13T23:06:25.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/537: creat d4/d4c/d8d/fb5 x:0 0 0 2024-09-13T23:06:25.026 INFO:tasks.workunit.client.1.smithi152.stdout:4/634: dwrite d3/d4/d6/d8/f71 [0,4194304] 0 2024-09-13T23:06:25.027 INFO:tasks.workunit.client.1.smithi152.stdout:1/538: mknod d4/d9/d1a/d22/d24/daa/cb6 0 2024-09-13T23:06:25.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/539: dread d4/d4c/d8d/f95 [0,4194304] 0 2024-09-13T23:06:25.029 INFO:tasks.workunit.client.1.smithi152.stdout:1/540: rename d4/d47/f82 to d4/d4c/d8d/fb7 0 2024-09-13T23:06:25.030 INFO:tasks.workunit.client.1.smithi152.stdout:1/541: creat d4/d4c/db1/fb8 x:0 0 0 2024-09-13T23:06:25.031 INFO:tasks.workunit.client.1.smithi152.stdout:1/542: rename d4/d9/d1a/d22/l87 to d4/d4c/d8d/lb9 0 2024-09-13T23:06:25.032 INFO:tasks.workunit.client.1.smithi152.stdout:1/543: truncate d4/d9/d1a/f4e 2150909 0 2024-09-13T23:06:25.032 INFO:tasks.workunit.client.1.smithi152.stdout:1/544: readlink d4/d9/d71/lb2 0 2024-09-13T23:06:25.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/545: getdents d4/d9/d1a 0 2024-09-13T23:06:25.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/546: chown d4/d9/fb 31319387 1 2024-09-13T23:06:25.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/547: symlink d4/d47/lba 0 2024-09-13T23:06:25.040 INFO:tasks.workunit.client.1.smithi152.stdout:2/607: dwrite d0/d4/d9/d14/f2f [0,4194304] 0 2024-09-13T23:06:25.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/460: dwrite d18/d1f/d29/d3f/d4b/d66/d6a/f6b [0,4194304] 0 2024-09-13T23:06:25.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/461: dread - d18/d1f/d33/f5a zero size 2024-09-13T23:06:25.042 INFO:tasks.workunit.client.1.smithi152.stdout:0/462: stat c11 0 2024-09-13T23:06:25.044 INFO:tasks.workunit.client.1.smithi152.stdout:4/635: dread d3/d4/d6/d66/d1c/d59/f68 [0,4194304] 0 2024-09-13T23:06:25.049 INFO:tasks.workunit.client.1.smithi152.stdout:4/636: rmdir d3/d4/d6/d8/d17/d5d/d94 39 2024-09-13T23:06:25.049 INFO:tasks.workunit.client.1.smithi152.stdout:4/637: stat d3/d4/d6/d66/d1c 0 2024-09-13T23:06:25.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/463: write d18/d1f/d29/f46 [1035615,99521] 0 2024-09-13T23:06:25.052 INFO:tasks.workunit.client.1.smithi152.stdout:0/464: creat d18/d1f/d39/fa6 x:0 0 0 2024-09-13T23:06:25.052 INFO:tasks.workunit.client.1.smithi152.stdout:4/638: creat d3/d4/d6/d8/dad/fc4 x:0 0 0 2024-09-13T23:06:25.055 INFO:tasks.workunit.client.1.smithi152.stdout:0/465: stat d18/d1f/d39/c73 0 2024-09-13T23:06:25.056 INFO:tasks.workunit.client.1.smithi152.stdout:2/608: write d0/d4/d9/d18/d32/f35 [2306516,101946] 0 2024-09-13T23:06:25.057 INFO:tasks.workunit.client.1.smithi152.stdout:4/639: creat d3/d4/d6/d66/d1c/d5f/d8b/fc5 x:0 0 0 2024-09-13T23:06:25.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/609: rmdir d0/d4/d9/d18/d1e 39 2024-09-13T23:06:25.060 INFO:tasks.workunit.client.1.smithi152.stdout:2/610: fsync d0/d4/fc3 0 2024-09-13T23:06:25.060 INFO:tasks.workunit.client.1.smithi152.stdout:2/611: write d0/d4/f1d [4600572,12799] 0 2024-09-13T23:06:25.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/640: unlink d3/d4/d6/d66/d1c/fa4 0 2024-09-13T23:06:25.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/612: rename d0/d8/f7d to d0/d4/d9/d18/fd6 0 2024-09-13T23:06:25.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/613: dread - d0/d4/d9/d18/fd6 zero size 2024-09-13T23:06:25.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/614: write d0/d4/d9/f63 [396747,126615] 0 2024-09-13T23:06:25.069 INFO:tasks.workunit.client.1.smithi152.stdout:2/615: mkdir d0/d4/d9/d16/dd7 0 2024-09-13T23:06:25.070 INFO:tasks.workunit.client.1.smithi152.stdout:0/466: dread d18/d1f/d29/d4e/f99 [0,4194304] 0 2024-09-13T23:06:25.073 INFO:tasks.workunit.client.1.smithi152.stdout:2/616: rename d0/d8/c19 to d0/d4/d9/d18/dc1/cd8 0 2024-09-13T23:06:25.076 INFO:tasks.workunit.client.1.smithi152.stdout:0/467: unlink d18/d1f/d33/d65/l92 0 2024-09-13T23:06:25.083 INFO:tasks.workunit.client.1.smithi152.stdout:4/641: dwrite d3/d4/d6/d66/d1c/f1e [0,4194304] 0 2024-09-13T23:06:25.087 INFO:tasks.workunit.client.1.smithi152.stdout:4/642: getdents d3/d4/d6/d63/d79 0 2024-09-13T23:06:25.088 INFO:tasks.workunit.client.1.smithi152.stdout:4/643: symlink d3/d4/d32/d86/d95/lc6 0 2024-09-13T23:06:25.088 INFO:tasks.workunit.client.1.smithi152.stdout:4/644: fdatasync d3/d4/d6/d8/f1b 0 2024-09-13T23:06:25.088 INFO:tasks.workunit.client.1.smithi152.stdout:0/468: dread d18/d1f/d39/f45 [0,4194304] 0 2024-09-13T23:06:25.103 INFO:tasks.workunit.client.1.smithi152.stdout:4/645: dread d3/d4/d6/f4c [0,4194304] 0 2024-09-13T23:06:25.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/617: dwrite d0/d4/d9/d18/d1e/d8c/f51 [0,4194304] 0 2024-09-13T23:06:25.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/618: truncate d0/d4/d9/d14/d48/d4a/f56 115214 0 2024-09-13T23:06:25.106 INFO:tasks.workunit.client.1.smithi152.stdout:2/619: readlink d0/d4/d9/d16/d2b/l8d 0 2024-09-13T23:06:25.109 INFO:tasks.workunit.client.1.smithi152.stdout:2/620: link d0/d4/d9/d18/d1e/f44 d0/d4/d8a/fd9 0 2024-09-13T23:06:25.110 INFO:tasks.workunit.client.1.smithi152.stdout:0/469: dread d18/d1f/d29/d3f/f59 [0,4194304] 0 2024-09-13T23:06:25.111 INFO:tasks.workunit.client.1.smithi152.stdout:2/621: link d0/d4/d9/d16/d9f/laf d0/d4/d9/d18/d1e/d3c/lda 0 2024-09-13T23:06:25.111 INFO:tasks.workunit.client.1.smithi152.stdout:2/622: truncate d0/d4/d9/d14/d48/d4a/f56 1016088 0 2024-09-13T23:06:25.112 INFO:tasks.workunit.client.1.smithi152.stdout:2/623: dread - d0/d4/d9/d55/f5f zero size 2024-09-13T23:06:25.112 INFO:tasks.workunit.client.1.smithi152.stdout:2/624: readlink d0/d4/d9/lc 0 2024-09-13T23:06:25.113 INFO:tasks.workunit.client.1.smithi152.stdout:2/625: creat d0/d4/d9/d55/d8f/fdb x:0 0 0 2024-09-13T23:06:25.121 INFO:tasks.workunit.client.1.smithi152.stdout:4/646: read d3/d4/d6/d63/f7b [3033901,114304] 0 2024-09-13T23:06:25.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/608: sync 2024-09-13T23:06:25.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/533: sync 2024-09-13T23:06:25.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/609: unlink d3/d1e/d30/d5d/f80 0 2024-09-13T23:06:25.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/534: link d4/de/d12/d16/d2a/d3d/d57/f85 d4/de/d1d/fb5 0 2024-09-13T23:06:25.127 INFO:tasks.workunit.client.1.smithi152.stdout:9/610: mkdir d3/d24/d34/dd2 0 2024-09-13T23:06:25.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/611: mknod d3/db0/cd3 0 2024-09-13T23:06:25.129 INFO:tasks.workunit.client.1.smithi152.stdout:9/612: symlink d3/d1e/d30/d5d/da3/ld4 0 2024-09-13T23:06:25.138 INFO:tasks.workunit.client.1.smithi152.stdout:4/647: dread d3/d4/d6/d66/f6f [0,4194304] 0 2024-09-13T23:06:25.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/626: dwrite d0/d4/d9/d16/d2b/faa [0,4194304] 0 2024-09-13T23:06:25.139 INFO:tasks.workunit.client.1.smithi152.stdout:4/648: unlink d3/d4/d6/d8/f1b 0 2024-09-13T23:06:25.145 INFO:tasks.workunit.client.1.smithi152.stdout:6/535: dread d4/de/d21/f7c [0,4194304] 0 2024-09-13T23:06:25.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/536: chown d4/de/d12/f28 1589166 1 2024-09-13T23:06:25.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/537: mknod d4/de/d12/d16/d2a/d3d/cb6 0 2024-09-13T23:06:25.148 INFO:tasks.workunit.client.1.smithi152.stdout:9/613: dwrite d3/d1e/f33 [0,4194304] 0 2024-09-13T23:06:25.148 INFO:tasks.workunit.client.1.smithi152.stdout:9/614: truncate d3/d1e/f21 4971113 0 2024-09-13T23:06:25.149 INFO:tasks.workunit.client.1.smithi152.stdout:9/615: chown d3/d52/f9f 4463472 1 2024-09-13T23:06:25.151 INFO:tasks.workunit.client.1.smithi152.stdout:9/616: link d3/d1e/f72 d3/d24/d34/fd5 0 2024-09-13T23:06:25.152 INFO:tasks.workunit.client.1.smithi152.stdout:9/617: write d3/d24/d67/d4a/f79 [922708,25384] 0 2024-09-13T23:06:25.161 INFO:tasks.workunit.client.1.smithi152.stdout:6/538: dread d4/de/d12/d16/f69 [0,4194304] 0 2024-09-13T23:06:25.161 INFO:tasks.workunit.client.1.smithi152.stdout:6/539: write d4/de/d12/d8a/f77 [994122,106635] 0 2024-09-13T23:06:25.161 INFO:tasks.workunit.client.1.smithi152.stdout:6/540: dread - d4/de/d12/f9f zero size 2024-09-13T23:06:25.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/541: creat d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fb7 x:0 0 0 2024-09-13T23:06:25.163 INFO:tasks.workunit.client.1.smithi152.stdout:6/542: rename d4/de/d1d/c56 to d4/de/d12/d16/d2a/d38/cb8 0 2024-09-13T23:06:25.163 INFO:tasks.workunit.client.1.smithi152.stdout:6/543: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 234079 0 2024-09-13T23:06:25.163 INFO:tasks.workunit.client.1.smithi152.stdout:6/544: fdatasync d4/fa2 0 2024-09-13T23:06:25.164 INFO:tasks.workunit.client.1.smithi152.stdout:6/545: symlink d4/de/lb9 0 2024-09-13T23:06:25.169 INFO:tasks.workunit.client.1.smithi152.stdout:9/618: dread d3/d24/d67/d47/fcf [0,4194304] 0 2024-09-13T23:06:25.169 INFO:tasks.workunit.client.1.smithi152.stdout:9/619: creat d3/d1e/fd6 x:0 0 0 2024-09-13T23:06:25.171 INFO:tasks.workunit.client.1.smithi152.stdout:6/546: dread d4/de/d12/d16/f3f [0,4194304] 0 2024-09-13T23:06:25.171 INFO:tasks.workunit.client.1.smithi152.stdout:9/620: write d3/d24/d67/d4a/f96 [657007,37292] 0 2024-09-13T23:06:25.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/547: creat d4/de/d12/d16/d2a/d38/d3c/fba x:0 0 0 2024-09-13T23:06:25.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/548: chown d4/de/d21/f6e 250403928 1 2024-09-13T23:06:25.173 INFO:tasks.workunit.client.1.smithi152.stdout:6/549: mknod d4/de/d12/d16/d2a/d3d/d57/d8d/cbb 0 2024-09-13T23:06:25.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/550: mknod d4/de/d12/d16/d2a/d3d/d57/d8d/db1/cbc 0 2024-09-13T23:06:25.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/551: fsync d4/de/d12/d16/d2a/d3d/d57/d8d/d92/fab 0 2024-09-13T23:06:25.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/552: rename d4/de/d12/f87 to d4/de/d12/d16/d2a/d3d/d57/d8d/fbd 0 2024-09-13T23:06:25.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/553: chown d4/de/d12/f5f 1 1 2024-09-13T23:06:25.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/554: chown d4/de/d12/d3e/la8 1001759478 1 2024-09-13T23:06:25.177 INFO:tasks.workunit.client.1.smithi152.stdout:6/555: write d4/de/d12/d16/d2a/f48 [779570,91899] 0 2024-09-13T23:06:25.179 INFO:tasks.workunit.client.1.smithi152.stdout:6/556: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:25.179 INFO:tasks.workunit.client.1.smithi152.stdout:4/649: dwrite d3/d4/d6/d63/d79/f96 [0,4194304] 0 2024-09-13T23:06:25.180 INFO:tasks.workunit.client.1.smithi152.stdout:6/557: fsync d4/de/d21/f15 0 2024-09-13T23:06:25.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/650: fdatasync d3/d4/d6/f4c 0 2024-09-13T23:06:25.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/627: dwrite d0/d4/d9/d55/d8f/f9a [0,4194304] 0 2024-09-13T23:06:25.185 INFO:tasks.workunit.client.1.smithi152.stdout:4/651: mkdir d3/d4/d6/d66/d2b/d7c/dc7 0 2024-09-13T23:06:25.186 INFO:tasks.workunit.client.1.smithi152.stdout:6/558: mknod d4/de/d12/d16/d2a/d3d/daa/cbe 0 2024-09-13T23:06:25.198 INFO:tasks.workunit.client.1.smithi152.stdout:4/652: getdents d3/d4/d6/d8/dad 0 2024-09-13T23:06:25.212 INFO:tasks.workunit.client.1.smithi152.stdout:9/621: dwrite d3/d24/d67/d4a/d71/f73 [0,4194304] 0 2024-09-13T23:06:25.273 INFO:tasks.workunit.client.1.smithi152.stdout:9/622: dwrite d3/d24/d67/d47/f97 [0,4194304] 0 2024-09-13T23:06:25.280 INFO:tasks.workunit.client.1.smithi152.stdout:9/623: rename d3/d24/c31 to d3/d24/d67/d60/cd7 0 2024-09-13T23:06:25.282 INFO:tasks.workunit.client.1.smithi152.stdout:9/624: creat d3/d24/d67/fd8 x:0 0 0 2024-09-13T23:06:25.283 INFO:tasks.workunit.client.1.smithi152.stdout:9/625: mknod d3/d24/d67/d4a/d71/cd9 0 2024-09-13T23:06:25.284 INFO:tasks.workunit.client.1.smithi152.stdout:6/559: dwrite d4/de/d12/d16/d2a/d38/fae [0,4194304] 0 2024-09-13T23:06:25.284 INFO:tasks.workunit.client.1.smithi152.stdout:6/560: fdatasync d4/de/d21/fad 0 2024-09-13T23:06:25.284 INFO:tasks.workunit.client.1.smithi152.stdout:6/561: dread - d4/de/d21/fad zero size 2024-09-13T23:06:25.284 INFO:tasks.workunit.client.1.smithi152.stdout:4/653: dwrite d3/d4/d6/d66/d1c/f27 [0,4194304] 0 2024-09-13T23:06:25.288 INFO:tasks.workunit.client.1.smithi152.stdout:4/654: mkdir d3/d4/d6/d8/d17/d5d/d94/d9b/dc8 0 2024-09-13T23:06:25.295 INFO:tasks.workunit.client.1.smithi152.stdout:4/655: write d3/d4/d6/d66/f6f [2513284,72206] 0 2024-09-13T23:06:25.295 INFO:tasks.workunit.client.1.smithi152.stdout:4/656: readlink d3/d4/d6/d66/d1c/lb5 0 2024-09-13T23:06:25.296 INFO:tasks.workunit.client.1.smithi152.stdout:9/626: dread d3/d24/d67/d60/f58 [0,4194304] 0 2024-09-13T23:06:25.296 INFO:tasks.workunit.client.1.smithi152.stdout:9/627: readlink d3/d1e/d30/d5d/lab 0 2024-09-13T23:06:25.297 INFO:tasks.workunit.client.1.smithi152.stdout:9/628: truncate d3/d1e/f21 2273278 0 2024-09-13T23:06:25.298 INFO:tasks.workunit.client.1.smithi152.stdout:9/629: symlink d3/d24/d67/d60/lda 0 2024-09-13T23:06:25.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/630: truncate d3/d24/d34/fd5 4389226 0 2024-09-13T23:06:25.300 INFO:tasks.workunit.client.1.smithi152.stdout:6/562: dwrite d4/de/f39 [0,4194304] 0 2024-09-13T23:06:25.302 INFO:tasks.workunit.client.1.smithi152.stdout:9/631: rmdir d3/d1e/d30/d5d/da3 39 2024-09-13T23:06:25.304 INFO:tasks.workunit.client.1.smithi152.stdout:9/632: symlink d3/d1e/d30/ldb 0 2024-09-13T23:06:25.304 INFO:tasks.workunit.client.1.smithi152.stdout:9/633: readlink d3/l99 0 2024-09-13T23:06:25.304 INFO:tasks.workunit.client.1.smithi152.stdout:9/634: dread - d3/d1e/fa1 zero size 2024-09-13T23:06:25.315 INFO:tasks.workunit.client.1.smithi152.stdout:9/635: write d3/d52/f9f [2923670,7752] 0 2024-09-13T23:06:25.315 INFO:tasks.workunit.client.1.smithi152.stdout:9/636: truncate d3/d24/d67/d4a/d71/f73 4536294 0 2024-09-13T23:06:25.315 INFO:tasks.workunit.client.1.smithi152.stdout:9/637: dread - d3/d24/d67/d4a/d71/f9e zero size 2024-09-13T23:06:25.325 INFO:tasks.workunit.client.1.smithi152.stdout:4/657: dwrite d3/d4/d6/f4c [0,4194304] 0 2024-09-13T23:06:25.326 INFO:tasks.workunit.client.1.smithi152.stdout:4/658: truncate d3/d4/d6/d66/d62/f64 478777 0 2024-09-13T23:06:25.327 INFO:tasks.workunit.client.1.smithi152.stdout:4/659: symlink d3/d4/d6/d66/d62/lc9 0 2024-09-13T23:06:25.328 INFO:tasks.workunit.client.1.smithi152.stdout:4/660: getdents d3/d4/d6/d66/d2b/d7c 0 2024-09-13T23:06:25.328 INFO:tasks.workunit.client.1.smithi152.stdout:4/661: creat d3/d34/fca x:0 0 0 2024-09-13T23:06:25.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/563: dwrite d4/de/f2c [0,4194304] 0 2024-09-13T23:06:25.330 INFO:tasks.workunit.client.1.smithi152.stdout:6/564: stat d4/de/c1e 0 2024-09-13T23:06:25.330 INFO:tasks.workunit.client.1.smithi152.stdout:6/565: write d4/de/d21/d5c/f76 [320468,10662] 0 2024-09-13T23:06:25.331 INFO:tasks.workunit.client.1.smithi152.stdout:6/566: rename d4/de/d1d/fb5 to d4/de/d1d/fbf 0 2024-09-13T23:06:25.332 INFO:tasks.workunit.client.1.smithi152.stdout:6/567: write d4/de/f63 [395009,41718] 0 2024-09-13T23:06:25.334 INFO:tasks.workunit.client.1.smithi152.stdout:6/568: rename d4/de/d12/d16/d2a/d38/da4 to d4/de/d12/d8a/dc0 0 2024-09-13T23:06:25.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/638: dwrite d3/d52/d8c/fc8 [0,4194304] 0 2024-09-13T23:06:25.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/639: rmdir d3/d24/d67/d47 39 2024-09-13T23:06:25.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/640: fsync d3/f17 0 2024-09-13T23:06:25.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/641: dread - d3/d24/d67/d4a/d71/fd1 zero size 2024-09-13T23:06:25.337 INFO:tasks.workunit.client.1.smithi152.stdout:9/642: creat d3/d24/d67/d4a/d8e/fdc x:0 0 0 2024-09-13T23:06:25.343 INFO:tasks.workunit.client.1.smithi152.stdout:4/662: read d3/d4/fa5 [3511738,83313] 0 2024-09-13T23:06:25.344 INFO:tasks.workunit.client.1.smithi152.stdout:4/663: truncate d3/d4/d6/d8/f8f 1076026 0 2024-09-13T23:06:25.344 INFO:tasks.workunit.client.1.smithi152.stdout:4/664: creat d3/d4/d6/d63/fcb x:0 0 0 2024-09-13T23:06:25.347 INFO:tasks.workunit.client.1.smithi152.stdout:4/665: dread d3/d4/d6/d8/d17/f98 [0,4194304] 0 2024-09-13T23:06:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/666: mknod d3/d4/d6/d66/d2b/ccc 0 2024-09-13T23:06:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/667: chown d3/d4/d6/d66/f7 6572 1 2024-09-13T23:06:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/668: stat d3/d34 0 2024-09-13T23:06:25.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/669: fdatasync d3/d4/d6/d66/d1c/d59/f68 0 2024-09-13T23:06:25.350 INFO:tasks.workunit.client.1.smithi152.stdout:6/569: write d4/de/d12/d16/d2a/d38/d3c/f45 [7629087,75898] 0 2024-09-13T23:06:25.350 INFO:tasks.workunit.client.1.smithi152.stdout:6/570: chown d4/de/l8f 8570 1 2024-09-13T23:06:25.350 INFO:tasks.workunit.client.1.smithi152.stdout:6/571: dread - d4/de/d1d/f6b zero size 2024-09-13T23:06:25.351 INFO:tasks.workunit.client.1.smithi152.stdout:9/643: rmdir d3/d24/d67/d4a/d8e 39 2024-09-13T23:06:25.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/644: creat d3/d24/d67/d4a/d8e/fdd x:0 0 0 2024-09-13T23:06:25.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/670: dread d3/d4/d6/d66/d2b/f9a [0,4194304] 0 2024-09-13T23:06:25.360 INFO:tasks.workunit.client.1.smithi152.stdout:4/671: creat d3/d4/d6/d8/dad/fcd x:0 0 0 2024-09-13T23:06:25.360 INFO:tasks.workunit.client.1.smithi152.stdout:4/672: creat d3/d4/d6/d66/fce x:0 0 0 2024-09-13T23:06:25.361 INFO:tasks.workunit.client.1.smithi152.stdout:4/673: mknod d3/d4/d6/d8/d17/d5d/d94/d9b/ccf 0 2024-09-13T23:06:25.362 INFO:tasks.workunit.client.1.smithi152.stdout:4/674: creat d3/d4/d6/d66/d2b/d84/dac/fd0 x:0 0 0 2024-09-13T23:06:25.363 INFO:tasks.workunit.client.1.smithi152.stdout:9/645: dread d3/d24/d34/fd5 [0,4194304] 0 2024-09-13T23:06:25.364 INFO:tasks.workunit.client.1.smithi152.stdout:4/675: dread d3/d4/d6/d66/d62/f6a [8388608,4194304] 0 2024-09-13T23:06:25.364 INFO:tasks.workunit.client.1.smithi152.stdout:9/646: rmdir d3/d52/d8c 39 2024-09-13T23:06:25.365 INFO:tasks.workunit.client.1.smithi152.stdout:6/572: dwrite d4/de/f63 [0,4194304] 0 2024-09-13T23:06:25.366 INFO:tasks.workunit.client.1.smithi152.stdout:4/676: rename d3/l31 to d3/d4/d6/d8/d17/d5d/d94/d9b/da0/ld1 0 2024-09-13T23:06:25.368 INFO:tasks.workunit.client.1.smithi152.stdout:9/647: unlink d3/f9 0 2024-09-13T23:06:25.368 INFO:tasks.workunit.client.1.smithi152.stdout:9/648: write d3/d52/f9f [755626,104837] 0 2024-09-13T23:06:25.375 INFO:tasks.workunit.client.1.smithi152.stdout:4/677: write d3/d4/d6/d8/d17/d3a/f56 [3564844,115997] 0 2024-09-13T23:06:25.376 INFO:tasks.workunit.client.1.smithi152.stdout:4/678: chown d3/d4/d8d/f55 827116802 1 2024-09-13T23:06:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:4/679: link d3/d4/d6/d8/d17/c1f d3/d4/d6/d66/d2b/d84/cd2 0 2024-09-13T23:06:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/649: dread d3/d24/f20 [0,4194304] 0 2024-09-13T23:06:25.378 INFO:tasks.workunit.client.1.smithi152.stdout:9/650: fsync d3/d24/d34/d45/f82 0 2024-09-13T23:06:25.379 INFO:tasks.workunit.client.1.smithi152.stdout:4/680: write d3/d4/d32/fc2 [113462,48240] 0 2024-09-13T23:06:25.379 INFO:tasks.workunit.client.1.smithi152.stdout:4/681: chown d3/d4/d6/d8/d17/d3a/f77 28 1 2024-09-13T23:06:25.380 INFO:tasks.workunit.client.1.smithi152.stdout:9/651: link d3/d24/d67/d47/f97 d3/d1e/d30/fde 0 2024-09-13T23:06:25.381 INFO:tasks.workunit.client.1.smithi152.stdout:4/682: symlink d3/d4/d6/d66/d1c/d5f/ld3 0 2024-09-13T23:06:25.381 INFO:tasks.workunit.client.1.smithi152.stdout:4/683: stat d3/d4/d6/d66/d2b/d8e/fc0 0 2024-09-13T23:06:25.384 INFO:tasks.workunit.client.1.smithi152.stdout:4/684: unlink d3/d4/d6/d63/f7b 0 2024-09-13T23:06:25.389 INFO:tasks.workunit.client.1.smithi152.stdout:6/573: dwrite d4/de/d12/d16/f7e [0,4194304] 0 2024-09-13T23:06:25.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/574: truncate d4/de/d12/f6f 864537 0 2024-09-13T23:06:25.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/575: unlink d4/de/d12/d8a/dc0/la7 0 2024-09-13T23:06:25.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/576: fsync d4/de/d12/d16/d2a/d38/d3c/f4c 0 2024-09-13T23:06:25.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/577: read - d4/de/d21/fad zero size 2024-09-13T23:06:25.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/578: creat d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fc1 x:0 0 0 2024-09-13T23:06:25.394 INFO:tasks.workunit.client.1.smithi152.stdout:4/685: dread d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:25.394 INFO:tasks.workunit.client.1.smithi152.stdout:4/686: readlink d3/d4/d6/d66/d1c/d5f/ld3 0 2024-09-13T23:06:25.398 INFO:tasks.workunit.client.1.smithi152.stdout:9/652: dwrite d3/f4 [0,4194304] 0 2024-09-13T23:06:25.398 INFO:tasks.workunit.client.1.smithi152.stdout:9/653: creat d3/d24/d34/d45/daa/dbf/fdf x:0 0 0 2024-09-13T23:06:25.398 INFO:tasks.workunit.client.1.smithi152.stdout:9/654: chown d3/f28 124800124 1 2024-09-13T23:06:25.402 INFO:tasks.workunit.client.1.smithi152.stdout:9/655: creat d3/d52/d8c/fe0 x:0 0 0 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:4/687: read d3/d4/d6/f14 [3785521,58976] 0 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:4/688: fdatasync d3/d4/d6/d66/d62/f64 0 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:4/689: dread - d3/fab zero size 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:7/610: sync 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:9/656: dread d3/d52/d8c/fa2 [0,4194304] 0 2024-09-13T23:06:25.404 INFO:tasks.workunit.client.1.smithi152.stdout:9/657: write d3/d1e/d30/f6c [1009456,123072] 0 2024-09-13T23:06:25.410 INFO:tasks.workunit.client.1.smithi152.stdout:7/611: rename d17/d24/d9f/d3f/l5c to d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/lce 0 2024-09-13T23:06:25.410 INFO:tasks.workunit.client.1.smithi152.stdout:7/612: rename d17/d24/d9f/d51/d5b/d90/d2e/d79/db3/c9b to d17/d24/d9f/d51/d5b/d90/d2e/d79/ccf 0 2024-09-13T23:06:25.410 INFO:tasks.workunit.client.1.smithi152.stdout:7/613: mkdir d17/d24/d9f/d51/d5b/d90/d2e/dd0 0 2024-09-13T23:06:25.410 INFO:tasks.workunit.client.1.smithi152.stdout:7/614: mkdir d17/d6c/dd1 0 2024-09-13T23:06:25.431 INFO:tasks.workunit.client.1.smithi152.stdout:7/615: dwrite d17/d24/d9f/d51/d5b/d87/f89 [0,4194304] 0 2024-09-13T23:06:25.431 INFO:tasks.workunit.client.1.smithi152.stdout:7/616: fsync d17/fb4 0 2024-09-13T23:06:25.431 INFO:tasks.workunit.client.1.smithi152.stdout:4/690: dwrite d3/d4/d6/d66/d2b/d8e/fc0 [0,4194304] 0 2024-09-13T23:06:25.433 INFO:tasks.workunit.client.1.smithi152.stdout:7/617: link d17/d24/d9f/d51/fc0 d17/d24/fd2 0 2024-09-13T23:06:25.448 INFO:tasks.workunit.client.1.smithi152.stdout:7/618: dwrite d17/d24/d9f/dac/dba/d85/fb0 [0,4194304] 0 2024-09-13T23:06:25.450 INFO:tasks.workunit.client.1.smithi152.stdout:7/619: dread d17/d24/d9f/d51/d5b/d90/d2e/d71/f95 [0,4194304] 0 2024-09-13T23:06:25.469 INFO:tasks.workunit.client.1.smithi152.stdout:7/620: dwrite d17/d6c/f88 [0,4194304] 0 2024-09-13T23:06:25.469 INFO:tasks.workunit.client.1.smithi152.stdout:7/621: chown d17/d4f/d84/ca7 440500 1 2024-09-13T23:06:25.469 INFO:tasks.workunit.client.1.smithi152.stdout:7/622: chown d17/d24/d9f/d51/d5b/d90/d2e/f56 8246573 1 2024-09-13T23:06:25.487 INFO:tasks.workunit.client.1.smithi152.stdout:5/542: sync 2024-09-13T23:06:25.488 INFO:tasks.workunit.client.1.smithi152.stdout:7/623: dwrite d17/d6c/f88 [0,4194304] 0 2024-09-13T23:06:25.489 INFO:tasks.workunit.client.1.smithi152.stdout:5/543: creat d5/dc/d19/d65/d99/da6/fb7 x:0 0 0 2024-09-13T23:06:25.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/624: rmdir d17/d4f/d84/db6 39 2024-09-13T23:06:25.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/625: fsync d17/d24/d9f/d51/d5b/d87/f89 0 2024-09-13T23:06:25.490 INFO:tasks.workunit.client.1.smithi152.stdout:5/544: dread d5/dc/d19/d65/d99/da6/f56 [0,4194304] 0 2024-09-13T23:06:25.490 INFO:tasks.workunit.client.1.smithi152.stdout:5/545: stat d5/dc/d19/d65/c53 0 2024-09-13T23:06:25.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/626: dread d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/fc2 [0,4194304] 0 2024-09-13T23:06:25.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/627: chown d17/d24/d9f/d51/d5b/d87/dc7 53 1 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:7/628: symlink d17/d24/d9f/d51/d5b/d90/ld3 0 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:7/629: chown d17/d24/d9f/d46/c4a 111832 1 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:0/470: sync 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:3/487: sync 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/548: sync 2024-09-13T23:06:25.493 INFO:tasks.workunit.client.1.smithi152.stdout:8/499: sync 2024-09-13T23:06:25.494 INFO:tasks.workunit.client.1.smithi152.stdout:8/500: write d17/f61 [3539326,97932] 0 2024-09-13T23:06:25.494 INFO:tasks.workunit.client.1.smithi152.stdout:8/501: write d17/d25/d32/f54 [5198882,103813] 0 2024-09-13T23:06:25.494 INFO:tasks.workunit.client.1.smithi152.stdout:2/628: sync 2024-09-13T23:06:25.494 INFO:tasks.workunit.client.1.smithi152.stdout:2/629: fdatasync d0/d4/d9/d14/d48/d4a/f56 0 2024-09-13T23:06:25.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/630: write d17/d24/d9f/d51/d5b/d90/d2e/f76 [211884,103481] 0 2024-09-13T23:06:25.495 INFO:tasks.workunit.client.1.smithi152.stdout:0/471: creat d18/d1f/d29/d2f/d3d/fa7 x:0 0 0 2024-09-13T23:06:25.495 INFO:tasks.workunit.client.1.smithi152.stdout:1/549: mkdir d4/d47/d8b/dbb 0 2024-09-13T23:06:25.495 INFO:tasks.workunit.client.1.smithi152.stdout:1/550: chown d4/d9/f12 1595 1 2024-09-13T23:06:25.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/630: mkdir d0/d4/d9/d18/d1e/d3c/d4d/ddc 0 2024-09-13T23:06:25.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/631: stat d0/d4/d9/d18/d1e/d3c/f8e 0 2024-09-13T23:06:25.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/632: chown d0/d4/d9/d14/d48/d4a/c7f 638619663 1 2024-09-13T23:06:25.498 INFO:tasks.workunit.client.1.smithi152.stdout:7/631: creat d17/d24/d9f/d51/d5b/d90/d2b/fd4 x:0 0 0 2024-09-13T23:06:25.500 INFO:tasks.workunit.client.1.smithi152.stdout:1/551: symlink d4/d4c/d8d/lbc 0 2024-09-13T23:06:25.503 INFO:tasks.workunit.client.1.smithi152.stdout:2/633: truncate d0/d4/d9/d16/d30/f5c 3323960 0 2024-09-13T23:06:25.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/472: rmdir d18/d1f/d39 39 2024-09-13T23:06:25.503 INFO:tasks.workunit.client.1.smithi152.stdout:7/632: truncate d17/d24/d9f/d51/d5b/d90/fa4 1919454 0 2024-09-13T23:06:25.506 INFO:tasks.workunit.client.1.smithi152.stdout:1/552: mknod d4/d4c/d8d/d99/cbd 0 2024-09-13T23:06:25.506 INFO:tasks.workunit.client.1.smithi152.stdout:1/553: chown d4/d9/d1a/d22/l3e 170973895 1 2024-09-13T23:06:25.506 INFO:tasks.workunit.client.1.smithi152.stdout:2/634: symlink d0/d4/d9/d14/d48/d71/ldd 0 2024-09-13T23:06:25.506 INFO:tasks.workunit.client.1.smithi152.stdout:2/635: write d0/d4/d9/d55/f57 [693804,72119] 0 2024-09-13T23:06:25.506 INFO:tasks.workunit.client.1.smithi152.stdout:2/636: chown d0/d4/d9/d16/d2b/f50 119261379 1 2024-09-13T23:06:25.511 INFO:tasks.workunit.client.1.smithi152.stdout:0/473: mknod d18/d1f/d29/ca8 0 2024-09-13T23:06:25.511 INFO:tasks.workunit.client.1.smithi152.stdout:7/633: symlink d17/d24/d9f/dac/dba/d85/ld5 0 2024-09-13T23:06:25.516 INFO:tasks.workunit.client.1.smithi152.stdout:0/474: link d18/d1f/d39/f76 d18/d1f/fa9 0 2024-09-13T23:06:25.516 INFO:tasks.workunit.client.1.smithi152.stdout:7/634: mknod d17/d24/d9f/d51/d5b/d90/d8e/da8/cd6 0 2024-09-13T23:06:25.516 INFO:tasks.workunit.client.1.smithi152.stdout:7/635: write d17/f1b [2693400,50811] 0 2024-09-13T23:06:25.517 INFO:tasks.workunit.client.1.smithi152.stdout:0/475: mkdir d18/d1f/d29/d3f/d40/daa 0 2024-09-13T23:06:25.518 INFO:tasks.workunit.client.1.smithi152.stdout:8/502: dwrite d17/d25/d80/f93 [4194304,4194304] 0 2024-09-13T23:06:25.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/636: rename d17/d24/l40 to d17/d24/d9f/d51/ld7 0 2024-09-13T23:06:25.519 INFO:tasks.workunit.client.1.smithi152.stdout:2/637: read d0/d4/f1a [268991,113819] 0 2024-09-13T23:06:25.519 INFO:tasks.workunit.client.1.smithi152.stdout:2/638: chown d0/d4/d9/d14/d48/fbf 123890978 1 2024-09-13T23:06:25.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/476: creat d18/d19/d74/da4/fab x:0 0 0 2024-09-13T23:06:25.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/477: readlink d18/d1f/d33/d65/l87 0 2024-09-13T23:06:25.521 INFO:tasks.workunit.client.1.smithi152.stdout:8/503: mknod d17/d25/c9d 0 2024-09-13T23:06:25.522 INFO:tasks.workunit.client.1.smithi152.stdout:7/637: fsync d17/f25 0 2024-09-13T23:06:25.522 INFO:tasks.workunit.client.1.smithi152.stdout:7/638: stat d17/d24/d9f/d51/d5b 0 2024-09-13T23:06:25.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/478: mkdir d18/d19/d2c/dac 0 2024-09-13T23:06:25.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/479: read - d18/d19/f81 zero size 2024-09-13T23:06:25.524 INFO:tasks.workunit.client.1.smithi152.stdout:7/639: creat d17/d24/d9f/d51/d5b/d90/d2e/dd0/fd8 x:0 0 0 2024-09-13T23:06:25.524 INFO:tasks.workunit.client.1.smithi152.stdout:7/640: chown d17/d4f 1101892176 1 2024-09-13T23:06:25.525 INFO:tasks.workunit.client.1.smithi152.stdout:0/480: getdents d18/d1f/d39 0 2024-09-13T23:06:25.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/481: link d18/d1f/d29/d3f/d4b/d66/d6a/f6b d18/d1f/d39/d7c/fad 0 2024-09-13T23:06:25.530 INFO:tasks.workunit.client.1.smithi152.stdout:7/641: rmdir d17/d24/d9f/d51/d5b/d90/d2e/d79/da1 39 2024-09-13T23:06:25.532 INFO:tasks.workunit.client.1.smithi152.stdout:3/488: dwrite de/f1e [0,4194304] 0 2024-09-13T23:06:25.533 INFO:tasks.workunit.client.1.smithi152.stdout:0/482: rmdir d18/d19/d2c/dac 0 2024-09-13T23:06:25.533 INFO:tasks.workunit.client.1.smithi152.stdout:8/504: write d17/d19/f88 [3390751,90201] 0 2024-09-13T23:06:25.534 INFO:tasks.workunit.client.1.smithi152.stdout:1/554: dwrite d4/d9/d1a/d22/d24/d48/fab [0,4194304] 0 2024-09-13T23:06:25.534 INFO:tasks.workunit.client.1.smithi152.stdout:1/555: read d4/d9/d71/fa2 [1973077,79812] 0 2024-09-13T23:06:25.534 INFO:tasks.workunit.client.1.smithi152.stdout:1/556: chown d4 36 1 2024-09-13T23:06:25.535 INFO:tasks.workunit.client.1.smithi152.stdout:7/642: mkdir d17/d4f/d84/dd9 0 2024-09-13T23:06:25.535 INFO:tasks.workunit.client.1.smithi152.stdout:2/639: dread d0/d4/d9/d18/d32/f5a [0,4194304] 0 2024-09-13T23:06:25.536 INFO:tasks.workunit.client.1.smithi152.stdout:3/489: creat de/d14/d47/d57/d99/fac x:0 0 0 2024-09-13T23:06:25.536 INFO:tasks.workunit.client.1.smithi152.stdout:3/490: fsync de/d14/f55 0 2024-09-13T23:06:25.538 INFO:tasks.workunit.client.1.smithi152.stdout:0/483: rename d18/d1f/d33/d6e/f7e to d18/d1f/d29/d3f/da0/fae 0 2024-09-13T23:06:25.539 INFO:tasks.workunit.client.1.smithi152.stdout:8/505: mkdir d17/d25/d32/d9a/d8f/d9e 0 2024-09-13T23:06:25.553 INFO:tasks.workunit.client.1.smithi152.stdout:7/643: unlink d17/d24/l45 0 2024-09-13T23:06:25.556 INFO:tasks.workunit.client.1.smithi152.stdout:1/557: rename d4/d9/d1a/d22/f63 to d4/d9/d71/fbe 0 2024-09-13T23:06:25.558 INFO:tasks.workunit.client.1.smithi152.stdout:3/491: dwrite de/d14/d47/d57/f80 [0,4194304] 0 2024-09-13T23:06:25.559 INFO:tasks.workunit.client.1.smithi152.stdout:0/484: creat d18/d1f/d29/d3f/d40/daa/faf x:0 0 0 2024-09-13T23:06:25.568 INFO:tasks.workunit.client.1.smithi152.stdout:3/492: read de/f40 [316443,65188] 0 2024-09-13T23:06:25.569 INFO:tasks.workunit.client.1.smithi152.stdout:3/493: read de/d14/d47/f48 [1809976,90901] 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:2/640: rename d0/d4/d9/d14/d48/d71 to d0/d4/d9/d16/d30/dde 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:2/641: write d0/d4/d9/d16/f81 [4954276,37110] 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:0/485: dread d18/d1f/d29/d3f/d4b/f57 [0,4194304] 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:2/642: getdents d0/d4/d9/d16/dd7 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:2/643: dread - d0/d4/f85 zero size 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:3/494: creat de/d14/d47/d57/d5d/fad x:0 0 0 2024-09-13T23:06:25.571 INFO:tasks.workunit.client.1.smithi152.stdout:3/495: creat de/d14/d76/fae x:0 0 0 2024-09-13T23:06:25.572 INFO:tasks.workunit.client.1.smithi152.stdout:7/644: rename d17/d24/d9f/d51/d5b/d90/d8e/da8 to d17/d24/d9f/d51/d5b/d90/d2e/dd0/dda 0 2024-09-13T23:06:25.573 INFO:tasks.workunit.client.1.smithi152.stdout:8/506: dwrite d17/d25/d32/d50/f78 [8388608,4194304] 0 2024-09-13T23:06:25.574 INFO:tasks.workunit.client.1.smithi152.stdout:2/644: creat d0/d4/d9/d18/d1e/d8c/fdf x:0 0 0 2024-09-13T23:06:25.574 INFO:tasks.workunit.client.1.smithi152.stdout:2/645: read - d0/d4/d9/d18/d1e/d3c/d4d/f95 zero size 2024-09-13T23:06:25.575 INFO:tasks.workunit.client.1.smithi152.stdout:0/486: symlink d18/d1f/d29/d3f/d4b/d66/d6a/d9f/lb0 0 2024-09-13T23:06:25.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/487: dread d18/d1f/f34 [0,4194304] 0 2024-09-13T23:06:25.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/558: dwrite d4/f72 [0,4194304] 0 2024-09-13T23:06:25.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/559: creat d4/d47/d8b/fbf x:0 0 0 2024-09-13T23:06:25.580 INFO:tasks.workunit.client.1.smithi152.stdout:7/645: creat d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/fdb x:0 0 0 2024-09-13T23:06:25.580 INFO:tasks.workunit.client.1.smithi152.stdout:7/646: read - d17/fb4 zero size 2024-09-13T23:06:25.582 INFO:tasks.workunit.client.1.smithi152.stdout:8/507: creat d17/d25/d32/d9a/d8f/d9e/f9f x:0 0 0 2024-09-13T23:06:25.582 INFO:tasks.workunit.client.1.smithi152.stdout:8/508: dread - d17/d25/d32/d9a/d8f/d9e/f9f zero size 2024-09-13T23:06:25.584 INFO:tasks.workunit.client.1.smithi152.stdout:2/646: creat d0/d4/d9/d18/d1e/fe0 x:0 0 0 2024-09-13T23:06:25.584 INFO:tasks.workunit.client.1.smithi152.stdout:2/647: fsync d0/d4/d9/d14/f34 0 2024-09-13T23:06:25.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/560: rename d4/d9/d1a/d22/f61 to d4/d9/d1a/d22/d24/daa/fc0 0 2024-09-13T23:06:25.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/561: stat d4/d4c/d8d 0 2024-09-13T23:06:25.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/562: fsync d4/f72 0 2024-09-13T23:06:25.589 INFO:tasks.workunit.client.1.smithi152.stdout:1/563: chown d4/d9/d1a/d22/f29 1589414 1 2024-09-13T23:06:25.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/496: dread de/d14/d47/d57/d5d/f41 [0,4194304] 0 2024-09-13T23:06:25.590 INFO:tasks.workunit.client.1.smithi152.stdout:7/647: rename d17/d24/d9f/d51/ld7 to d17/d24/d9f/d51/d5b/d90/d2e/d79/ldc 0 2024-09-13T23:06:25.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/648: dread - d17/d24/d9f/d51/d5b/d63/d7d/f9a zero size 2024-09-13T23:06:25.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/649: fsync d17/d24/d9f/d51/d5b/d63/faa 0 2024-09-13T23:06:25.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/650: read - d17/fb4 zero size 2024-09-13T23:06:25.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/651: write f0 [872138,68805] 0 2024-09-13T23:06:25.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/488: dread d18/d1f/d29/d3f/f59 [0,4194304] 0 2024-09-13T23:06:25.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/489: write d18/d1f/d29/f6f [44822,40543] 0 2024-09-13T23:06:25.592 INFO:tasks.workunit.client.1.smithi152.stdout:1/564: creat d4/d4c/fc1 x:0 0 0 2024-09-13T23:06:25.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/652: symlink d17/d6c/ldd 0 2024-09-13T23:06:25.595 INFO:tasks.workunit.client.1.smithi152.stdout:7/653: creat d17/d24/d9f/d51/d5b/d90/d2e/d30/fde x:0 0 0 2024-09-13T23:06:25.595 INFO:tasks.workunit.client.1.smithi152.stdout:7/654: fsync d17/d24/d9f/d51/d5b/d90/d2e/dd0/fd8 0 2024-09-13T23:06:25.596 INFO:tasks.workunit.client.1.smithi152.stdout:7/655: write d17/d24/d9f/d51/d5b/d87/f94 [100268,76717] 0 2024-09-13T23:06:25.596 INFO:tasks.workunit.client.1.smithi152.stdout:7/656: dread - d17/d24/d9f/d51/d5b/d63/d7d/fc1 zero size 2024-09-13T23:06:25.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/657: link d17/d24/d9f/d51/d5b/d90/d2e/f76 d17/d24/d9f/fdf 0 2024-09-13T23:06:25.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/658: creat d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/fe0 x:0 0 0 2024-09-13T23:06:25.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/659: rename d17/d24/d9f to d17/d24/d9f/d51/d5b/d90/d8e/de1 22 2024-09-13T23:06:25.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/497: write de/d14/d47/d70/f78 [2879761,102872] 0 2024-09-13T23:06:25.609 INFO:tasks.workunit.client.1.smithi152.stdout:3/498: write de/d14/f49 [84841,112934] 0 2024-09-13T23:06:25.609 INFO:tasks.workunit.client.1.smithi152.stdout:1/565: dread d4/f5d [0,4194304] 0 2024-09-13T23:06:25.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/499: read de/d14/f4b [4501889,94311] 0 2024-09-13T23:06:25.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/500: readlink de/d14/d47/d70/d87/l95 0 2024-09-13T23:06:25.620 INFO:tasks.workunit.client.1.smithi152.stdout:2/648: dwrite d0/d4/f53 [0,4194304] 0 2024-09-13T23:06:25.620 INFO:tasks.workunit.client.1.smithi152.stdout:2/649: chown d0/d4/d9/d18/d1e/d3c/d4d 5396 1 2024-09-13T23:06:25.620 INFO:tasks.workunit.client.1.smithi152.stdout:2/650: write d0/d4/d9/d16/f21 [1496071,54156] 0 2024-09-13T23:06:25.622 INFO:tasks.workunit.client.1.smithi152.stdout:8/509: dwrite d17/f29 [0,4194304] 0 2024-09-13T23:06:25.622 INFO:tasks.workunit.client.1.smithi152.stdout:8/510: write d17/d25/d32/d9a/f67 [50459,39817] 0 2024-09-13T23:06:25.623 INFO:tasks.workunit.client.1.smithi152.stdout:2/651: rename d0/c92 to d0/d4/d9/d18/d1e/dc0/ce1 0 2024-09-13T23:06:25.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/490: dwrite d18/d1f/f7d [0,4194304] 0 2024-09-13T23:06:25.624 INFO:tasks.workunit.client.1.smithi152.stdout:0/491: fsync d18/d19/d2c/f30 0 2024-09-13T23:06:25.625 INFO:tasks.workunit.client.1.smithi152.stdout:0/492: readlink d18/d1f/d29/d2f/l38 0 2024-09-13T23:06:25.625 INFO:tasks.workunit.client.1.smithi152.stdout:8/511: mknod d17/d25/d80/d8a/ca0 0 2024-09-13T23:06:25.625 INFO:tasks.workunit.client.1.smithi152.stdout:2/652: rmdir d0/d4/d9/d18/d1e/dc0 39 2024-09-13T23:06:25.630 INFO:tasks.workunit.client.1.smithi152.stdout:0/493: rename d18/d19/f69 to d18/d1f/fb1 0 2024-09-13T23:06:25.630 INFO:tasks.workunit.client.1.smithi152.stdout:0/494: creat d18/d1f/d29/d3f/da0/fb2 x:0 0 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:0/495: readlink d18/d1f/d29/d3f/d4b/l8c 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:0/496: dread - d18/d19/d74/da4/fab zero size 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:0/497: truncate d18/d1f/d29/d3f/d40/f4f 610335 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:2/653: truncate d0/d4/d9/f9c 50810 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:2/654: fsync d0/d4/d9/d14/f34 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/512: dread d17/d25/f79 [0,4194304] 0 2024-09-13T23:06:25.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/513: write d17/d25/f35 [4974783,92398] 0 2024-09-13T23:06:25.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/498: unlink d18/d1f/d33/f9a 0 2024-09-13T23:06:25.633 INFO:tasks.workunit.client.1.smithi152.stdout:2/655: symlink d0/d4/d9/d18/d1e/d3c/d88/d98/le2 0 2024-09-13T23:06:25.635 INFO:tasks.workunit.client.1.smithi152.stdout:8/514: creat d17/d25/d32/fa1 x:0 0 0 2024-09-13T23:06:25.635 INFO:tasks.workunit.client.1.smithi152.stdout:8/515: chown d17/d25/d32/d44/l86 1883237604 1 2024-09-13T23:06:25.636 INFO:tasks.workunit.client.1.smithi152.stdout:3/501: dwrite de/d14/d47/d70/fa1 [0,4194304] 0 2024-09-13T23:06:25.636 INFO:tasks.workunit.client.1.smithi152.stdout:1/566: dwrite d4/d9/d1a/d22/d24/daa/fc0 [0,4194304] 0 2024-09-13T23:06:25.636 INFO:tasks.workunit.client.1.smithi152.stdout:1/567: creat d4/d9/fc2 x:0 0 0 2024-09-13T23:06:25.638 INFO:tasks.workunit.client.1.smithi152.stdout:2/656: rename d0/d4/d9/d14/d48/d4a/f56 to d0/d4/d9/d16/d9f/fe3 0 2024-09-13T23:06:25.638 INFO:tasks.workunit.client.1.smithi152.stdout:0/499: creat d18/d1f/d29/fb3 x:0 0 0 2024-09-13T23:06:25.639 INFO:tasks.workunit.client.1.smithi152.stdout:2/657: write d0/d4/d9/d18/fd6 [327389,99906] 0 2024-09-13T23:06:25.644 INFO:tasks.workunit.client.1.smithi152.stdout:3/502: write de/f1d [561338,91012] 0 2024-09-13T23:06:25.645 INFO:tasks.workunit.client.1.smithi152.stdout:3/503: chown de/d14/d38/l32 2325 1 2024-09-13T23:06:25.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/658: creat d0/d4/d9/d16/dd7/fe4 x:0 0 0 2024-09-13T23:06:25.647 INFO:tasks.workunit.client.1.smithi152.stdout:3/504: symlink de/d14/d47/d70/d72/da7/laf 0 2024-09-13T23:06:25.651 INFO:tasks.workunit.client.1.smithi152.stdout:3/505: mknod de/d14/d47/d57/d93/cb0 0 2024-09-13T23:06:25.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/506: truncate de/d14/f4b 341465 0 2024-09-13T23:06:25.666 INFO:tasks.workunit.client.1.smithi152.stdout:3/507: write de/d14/d47/d57/f80 [631918,30639] 0 2024-09-13T23:06:25.668 INFO:tasks.workunit.client.1.smithi152.stdout:3/508: unlink de/d14/c4a 0 2024-09-13T23:06:25.670 INFO:tasks.workunit.client.1.smithi152.stdout:3/509: creat de/d14/d47/d70/d72/fb1 x:0 0 0 2024-09-13T23:06:25.671 INFO:tasks.workunit.client.1.smithi152.stdout:3/510: mknod de/d14/cb2 0 2024-09-13T23:06:25.672 INFO:tasks.workunit.client.1.smithi152.stdout:1/568: dwrite d4/d9/d1a/d22/d24/d48/fab [0,4194304] 0 2024-09-13T23:06:25.672 INFO:tasks.workunit.client.1.smithi152.stdout:1/569: chown d4/d9/d1a/c6f 2756 1 2024-09-13T23:06:25.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/500: dwrite d18/d19/f67 [0,4194304] 0 2024-09-13T23:06:25.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/501: getdents d18/d1f/d33/d65/d7a 0 2024-09-13T23:06:25.673 INFO:tasks.workunit.client.1.smithi152.stdout:2/659: dwrite d0/d4/d9/d16/d30/d9e/db5/fbe [0,4194304] 0 2024-09-13T23:06:25.673 INFO:tasks.workunit.client.1.smithi152.stdout:2/660: stat d0/d8/f8b 0 2024-09-13T23:06:25.678 INFO:tasks.workunit.client.1.smithi152.stdout:3/511: dread de/d14/d38/f25 [0,4194304] 0 2024-09-13T23:06:25.683 INFO:tasks.workunit.client.1.smithi152.stdout:2/661: write d0/d8/f8b [2787853,51355] 0 2024-09-13T23:06:25.683 INFO:tasks.workunit.client.1.smithi152.stdout:2/662: dread - d0/d4/d9/d55/d8f/f96 zero size 2024-09-13T23:06:25.684 INFO:tasks.workunit.client.1.smithi152.stdout:0/502: dread d18/d1f/d29/d3f/d40/f8b [0,4194304] 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/512: unlink de/d14/d47/d70/fa1 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/513: readlink de/d1f/l23 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/514: fdatasync de/d1f/f91 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/515: write de/d14/d47/d57/d5d/f7f [54503,96901] 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/516: creat de/d14/d47/d57/d5d/fb3 x:0 0 0 2024-09-13T23:06:25.688 INFO:tasks.workunit.client.1.smithi152.stdout:3/517: fsync de/d14/d47/d57/d5d/f41 0 2024-09-13T23:06:25.689 INFO:tasks.workunit.client.1.smithi152.stdout:1/570: getdents d4/d4c/db1 0 2024-09-13T23:06:25.692 INFO:tasks.workunit.client.1.smithi152.stdout:2/663: mknod d0/d4/d9/d16/dd7/ce5 0 2024-09-13T23:06:25.692 INFO:tasks.workunit.client.1.smithi152.stdout:2/664: chown d0/d4/d9/d55/lb4 124324053 1 2024-09-13T23:06:25.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/503: dread d18/d1f/d29/f60 [0,4194304] 0 2024-09-13T23:06:25.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/504: fsync d18/d1f/d33/f4d 0 2024-09-13T23:06:25.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/505: stat d18/d1f/d33/d90/f91 0 2024-09-13T23:06:25.699 INFO:tasks.workunit.client.1.smithi152.stdout:0/506: getdents d18/d1f/d29 0 2024-09-13T23:06:25.707 INFO:tasks.workunit.client.1.smithi152.stdout:0/507: write d18/d1f/d29/d3f/f5c [1276,45909] 0 2024-09-13T23:06:25.707 INFO:tasks.workunit.client.1.smithi152.stdout:0/508: stat ce 0 2024-09-13T23:06:25.711 INFO:tasks.workunit.client.1.smithi152.stdout:1/571: dwrite d4/d4c/db1/fb8 [0,4194304] 0 2024-09-13T23:06:25.714 INFO:tasks.workunit.client.1.smithi152.stdout:1/572: mknod d4/d9/d71/cc3 0 2024-09-13T23:06:25.715 INFO:tasks.workunit.client.1.smithi152.stdout:2/665: dwrite d0/d4/d9/d18/d1e/d8c/fdf [0,4194304] 0 2024-09-13T23:06:25.715 INFO:tasks.workunit.client.1.smithi152.stdout:2/666: write d0/d4/d9/d18/d32/fb6 [1690878,80785] 0 2024-09-13T23:06:25.716 INFO:tasks.workunit.client.1.smithi152.stdout:1/573: mkdir d4/d9/d1a/d22/d24/d48/dc4 0 2024-09-13T23:06:25.717 INFO:tasks.workunit.client.1.smithi152.stdout:2/667: getdents d0/d4/d9/d14/d48 0 2024-09-13T23:06:25.718 INFO:tasks.workunit.client.1.smithi152.stdout:1/574: symlink d4/d9/d1a/d22/d24/lc5 0 2024-09-13T23:06:25.719 INFO:tasks.workunit.client.1.smithi152.stdout:2/668: creat d0/d4/dca/fe6 x:0 0 0 2024-09-13T23:06:25.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/575: creat d4/d9/d1a/d22/d24/daa/fc6 x:0 0 0 2024-09-13T23:06:25.721 INFO:tasks.workunit.client.1.smithi152.stdout:2/669: mkdir d0/d4/d9/d55/de7 0 2024-09-13T23:06:25.721 INFO:tasks.workunit.client.1.smithi152.stdout:2/670: read d0/d4/d9/d18/d1e/d3c/d88/d98/fb0 [245139,119581] 0 2024-09-13T23:06:25.722 INFO:tasks.workunit.client.1.smithi152.stdout:2/671: read d0/d4/d9/f9c [27129,53833] 0 2024-09-13T23:06:25.723 INFO:tasks.workunit.client.1.smithi152.stdout:2/672: rename d0/d4/d9/ff to d0/d4/d9/d18/d1e/d3c/d88/fe8 0 2024-09-13T23:06:25.724 INFO:tasks.workunit.client.1.smithi152.stdout:2/673: mknod d0/d4/d9/d16/d30/dde/ce9 0 2024-09-13T23:06:25.724 INFO:tasks.workunit.client.1.smithi152.stdout:2/674: write d0/d4/d9/d16/d30/dde/fc9 [81196,74953] 0 2024-09-13T23:06:25.725 INFO:tasks.workunit.client.1.smithi152.stdout:2/675: write d0/d4/f93 [54132,104726] 0 2024-09-13T23:06:25.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/576: dread d4/d9/d1a/d22/d24/f6a [0,4194304] 0 2024-09-13T23:06:25.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/577: write d4/d9/d1a/f58 [9405084,12838] 0 2024-09-13T23:06:25.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/578: chown d4/d9/d1a/d22/d24/d48/l81 243840 1 2024-09-13T23:06:25.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/579: chown d4/d9/fa7 205 1 2024-09-13T23:06:25.726 INFO:tasks.workunit.client.1.smithi152.stdout:1/580: write d4/d9/d1a/d22/d24/f56 [1653929,39863] 0 2024-09-13T23:06:25.727 INFO:tasks.workunit.client.1.smithi152.stdout:1/581: truncate d4/f5d 3585688 0 2024-09-13T23:06:25.729 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:25 smithi115 ceph-mon[27601]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:25.729 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:25 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/25468376' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:25.729 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:25 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:25.729 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:25 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:25.732 INFO:tasks.workunit.client.1.smithi152.stdout:0/509: dwrite d18/d1f/fa9 [0,4194304] 0 2024-09-13T23:06:25.732 INFO:tasks.workunit.client.1.smithi152.stdout:0/510: dread - d18/d1f/d33/f7f zero size 2024-09-13T23:06:25.732 INFO:tasks.workunit.client.1.smithi152.stdout:0/511: dread - d18/d1f/d33/f68 zero size 2024-09-13T23:06:25.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/512: mkdir d18/d1f/d33/d65/d7a/db4 0 2024-09-13T23:06:25.735 INFO:tasks.workunit.client.1.smithi152.stdout:1/582: write d4/f90 [1874001,1933] 0 2024-09-13T23:06:25.738 INFO:tasks.workunit.client.1.smithi152.stdout:1/583: creat d4/d4c/db1/fc7 x:0 0 0 2024-09-13T23:06:25.738 INFO:tasks.workunit.client.1.smithi152.stdout:1/584: fsync d4/d9/f14 0 2024-09-13T23:06:25.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/676: dwrite d0/d4/d9/d16/f91 [0,4194304] 0 2024-09-13T23:06:25.743 INFO:tasks.workunit.client.1.smithi152.stdout:2/677: rename d0/f77 to d0/d4/d9/d16/d30/fea 0 2024-09-13T23:06:25.746 INFO:tasks.workunit.client.1.smithi152.stdout:2/678: rename d0/d4/d9/d14/f7c to d0/d4/d9/d14/d48/d49/feb 0 2024-09-13T23:06:25.747 INFO:tasks.workunit.client.1.smithi152.stdout:2/679: write d0/d4/d9/f9c [824619,73296] 0 2024-09-13T23:06:25.748 INFO:tasks.workunit.client.1.smithi152.stdout:2/680: rename d0/d4/d9/d16/dd7/fe4 to d0/d4/d9/d18/d1e/dc0/fec 0 2024-09-13T23:06:25.748 INFO:tasks.workunit.client.1.smithi152.stdout:2/681: dread - d0/d4/d9/fab zero size 2024-09-13T23:06:25.748 INFO:tasks.workunit.client.1.smithi152.stdout:2/682: fdatasync d0/d4/d9/d16/d2b/f6c 0 2024-09-13T23:06:25.749 INFO:tasks.workunit.client.1.smithi152.stdout:2/683: link d0/cb1 d0/d4/d9/d18/d1e/d8c/ced 0 2024-09-13T23:06:25.749 INFO:tasks.workunit.client.1.smithi152.stdout:2/684: fsync d0/d4/d9/d14/f34 0 2024-09-13T23:06:25.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/585: dwrite d4/d9/d1a/d22/d24/daa/fc0 [4194304,4194304] 0 2024-09-13T23:06:25.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/586: fsync d4/d9/d71/f89 0 2024-09-13T23:06:25.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/587: fdatasync d4/d9/d71/f89 0 2024-09-13T23:06:25.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/588: chown d4/d9 121940488 1 2024-09-13T23:06:25.755 INFO:tasks.workunit.client.1.smithi152.stdout:1/589: mkdir d4/dc8 0 2024-09-13T23:06:25.756 INFO:tasks.workunit.client.1.smithi152.stdout:1/590: link d4/d4c/db1/fb8 d4/d9/d1a/d22/d24/fc9 0 2024-09-13T23:06:25.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/591: dwrite d4/d9/d1a/f58 [0,4194304] 0 2024-09-13T23:06:25.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/592: write d4/d9/d1a/d22/d24/daa/fc6 [335777,85195] 0 2024-09-13T23:06:25.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/593: creat d4/d47/d8b/fca x:0 0 0 2024-09-13T23:06:25.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/594: write d4/d9/d1a/d22/d24/d48/f4a [898937,66170] 0 2024-09-13T23:06:25.879 INFO:tasks.workunit.client.1.smithi152.stdout:5/546: sync 2024-09-13T23:06:25.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/691: sync 2024-09-13T23:06:25.879 INFO:tasks.workunit.client.1.smithi152.stdout:9/658: sync 2024-09-13T23:06:25.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/579: sync 2024-09-13T23:06:25.880 INFO:tasks.workunit.client.1.smithi152.stdout:6/580: truncate d4/de/f13 262618 0 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/692: truncate d3/d4/d6/d66/f49 4576589 0 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/693: chown d3/d4/d6/d66/d62/d9d 0 1 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/659: mkdir d3/d24/d67/d60/de1 0 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/660: write d3/d24/d67/d4a/d8e/fdd [737235,78271] 0 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/661: chown d3/d24/l27 0 1 2024-09-13T23:06:25.881 INFO:tasks.workunit.client.1.smithi152.stdout:9/662: chown d3/d1e/d30/l70 735278057 1 2024-09-13T23:06:25.882 INFO:tasks.workunit.client.1.smithi152.stdout:9/663: chown d3/d24/d34/d45/faf 8372397 1 2024-09-13T23:06:25.883 INFO:tasks.workunit.client.1.smithi152.stdout:4/694: mknod d3/d4/d32/d86/d95/cd4 0 2024-09-13T23:06:25.886 INFO:tasks.workunit.client.1.smithi152.stdout:4/695: mknod d3/d34/cd5 0 2024-09-13T23:06:25.892 INFO:tasks.workunit.client.1.smithi152.stdout:6/581: write d4/de/f39 [2209003,107389] 0 2024-09-13T23:06:25.894 INFO:tasks.workunit.client.1.smithi152.stdout:6/582: symlink d4/de/d12/d8a/lc2 0 2024-09-13T23:06:25.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/583: unlink d4/de/l8f 0 2024-09-13T23:06:25.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/584: stat d4/c25 0 2024-09-13T23:06:25.908 INFO:tasks.workunit.client.1.smithi152.stdout:9/664: dwrite d3/d24/d67/d60/f84 [0,4194304] 0 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:9/665: read - d3/d24/d67/d4a/d71/db7/fcd zero size 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:9/666: fsync d3/d24/d34/d45/f9a 0 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:9/667: truncate d3/d1e/fa1 79504 0 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:9/668: creat d3/d1e/fe2 x:0 0 0 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:9/669: stat d3/d24/l26 0 2024-09-13T23:06:25.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/547: dwrite d5/dc/d19/d20/d55/f75 [4194304,4194304] 0 2024-09-13T23:06:25.910 INFO:tasks.workunit.client.1.smithi152.stdout:5/548: chown d5/l90 18 1 2024-09-13T23:06:25.911 INFO:tasks.workunit.client.1.smithi152.stdout:9/670: rmdir d3/d24/d34 39 2024-09-13T23:06:25.913 INFO:tasks.workunit.client.1.smithi152.stdout:9/671: mkdir d3/d24/d67/de3 0 2024-09-13T23:06:25.915 INFO:tasks.workunit.client.1.smithi152.stdout:4/696: dwrite d3/f4f [4194304,4194304] 0 2024-09-13T23:06:25.915 INFO:tasks.workunit.client.1.smithi152.stdout:4/697: write d3/d4/d8d/f55 [725593,49205] 0 2024-09-13T23:06:25.918 INFO:tasks.workunit.client.1.smithi152.stdout:4/698: rename d3/d4/d6/d66/d2b/d7c/dc7 to d3/d4/d6/d66/dd6 0 2024-09-13T23:06:25.920 INFO:tasks.workunit.client.1.smithi152.stdout:4/699: link d3/d34/f97 d3/d4/d6/d63/d79/fd7 0 2024-09-13T23:06:25.920 INFO:tasks.workunit.client.1.smithi152.stdout:5/549: write d5/dc/d19/d20/f32 [930761,57938] 0 2024-09-13T23:06:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/700: mknod d3/d4/d8d/cd8 0 2024-09-13T23:06:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/701: truncate d3/d4/d8d/f44 798070 0 2024-09-13T23:06:25.921 INFO:tasks.workunit.client.1.smithi152.stdout:6/585: dwrite d4/de/d12/d3e/f91 [0,4194304] 0 2024-09-13T23:06:25.922 INFO:tasks.workunit.client.1.smithi152.stdout:5/550: dread d5/dc/da3/db4/f7d [0,4194304] 0 2024-09-13T23:06:25.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/672: read d3/d1e/f72 [3941975,75095] 0 2024-09-13T23:06:25.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/673: chown d3/lc1 494163995 1 2024-09-13T23:06:25.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/674: read - d3/d52/d8c/fe0 zero size 2024-09-13T23:06:25.928 INFO:tasks.workunit.client.1.smithi152.stdout:9/675: mknod d3/d24/d67/d60/ce4 0 2024-09-13T23:06:25.961 INFO:tasks.workunit.client.1.smithi152.stdout:6/586: dwrite d4/de/d12/d16/d2a/d3d/d57/f60 [0,4194304] 0 2024-09-13T23:06:25.962 INFO:tasks.workunit.client.1.smithi152.stdout:4/702: dwrite d3/d4/d6/d66/d2b/d8e/fc0 [0,4194304] 0 2024-09-13T23:06:25.962 INFO:tasks.workunit.client.1.smithi152.stdout:4/703: write d3/d4/d6/d66/f85 [1383952,23594] 0 2024-09-13T23:06:25.963 INFO:tasks.workunit.client.1.smithi152.stdout:4/704: creat d3/d4/d8d/d93/db9/fd9 x:0 0 0 2024-09-13T23:06:25.963 INFO:tasks.workunit.client.1.smithi152.stdout:4/705: fsync d3/f13 0 2024-09-13T23:06:25.965 INFO:tasks.workunit.client.1.smithi152.stdout:4/706: symlink d3/d4/d6/d8/d17/d5d/d94/lda 0 2024-09-13T23:06:25.965 INFO:tasks.workunit.client.1.smithi152.stdout:9/676: dwrite d3/d24/d67/d60/f84 [0,4194304] 0 2024-09-13T23:06:25.965 INFO:tasks.workunit.client.1.smithi152.stdout:9/677: write d3/d1e/f92 [455024,129759] 0 2024-09-13T23:06:25.965 INFO:tasks.workunit.client.1.smithi152.stdout:5/551: dwrite d5/dc/d19/fb2 [0,4194304] 0 2024-09-13T23:06:25.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/707: mkdir d3/d4/d32/ddb 0 2024-09-13T23:06:25.966 INFO:tasks.workunit.client.1.smithi152.stdout:9/678: rmdir d3/d24/dac 39 2024-09-13T23:06:25.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/708: dread d3/d4/d6/d63/f7e [0,4194304] 0 2024-09-13T23:06:25.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:25 smithi152 ceph-mon[34465]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:25.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:25 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/25468376' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:25.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:25 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:25.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:25 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:5/552: symlink d5/dc/d19/d20/d55/lb8 0 2024-09-13T23:06:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/709: creat d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/fdc x:0 0 0 2024-09-13T23:06:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/710: read d3/d4/d6/d66/f7 [3431960,9793] 0 2024-09-13T23:06:25.973 INFO:tasks.workunit.client.1.smithi152.stdout:5/553: dread d5/da/f6f [0,4194304] 0 2024-09-13T23:06:25.974 INFO:tasks.workunit.client.1.smithi152.stdout:5/554: chown d5/dc/d19/d65/d99/da6/l76 72 1 2024-09-13T23:06:25.974 INFO:tasks.workunit.client.1.smithi152.stdout:4/711: mkdir d3/d4/d6/d8/d4b/ddd 0 2024-09-13T23:06:25.974 INFO:tasks.workunit.client.1.smithi152.stdout:5/555: mknod d5/da/cb9 0 2024-09-13T23:06:25.975 INFO:tasks.workunit.client.1.smithi152.stdout:5/556: dread - d5/f67 zero size 2024-09-13T23:06:25.975 INFO:tasks.workunit.client.1.smithi152.stdout:5/557: write d5/dc/d19/d20/d55/f9d [1945647,114418] 0 2024-09-13T23:06:25.975 INFO:tasks.workunit.client.1.smithi152.stdout:4/712: mkdir d3/d4/d6/d8/d17/d5d/dde 0 2024-09-13T23:06:25.975 INFO:tasks.workunit.client.1.smithi152.stdout:5/558: symlink d5/dc/d19/d20/d55/lba 0 2024-09-13T23:06:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:4/713: mkdir d3/d4/d6/d66/d2b/ddf 0 2024-09-13T23:06:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:5/559: stat c3 0 2024-09-13T23:06:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:4/714: creat d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 x:0 0 0 2024-09-13T23:06:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:4/715: dread - d3/d4/d32/f45 zero size 2024-09-13T23:06:25.977 INFO:tasks.workunit.client.1.smithi152.stdout:4/716: fdatasync d3/d4/d6/d66/f49 0 2024-09-13T23:06:25.979 INFO:tasks.workunit.client.1.smithi152.stdout:4/717: rename d3/d4/d6/d63/l75 to d3/d4/d6/d66/dd6/le1 0 2024-09-13T23:06:25.979 INFO:tasks.workunit.client.1.smithi152.stdout:5/560: getdents d5/d26 0 2024-09-13T23:06:25.979 INFO:tasks.workunit.client.1.smithi152.stdout:5/561: chown d5/dc/d19/d65/l42 691 1 2024-09-13T23:06:25.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/562: readlink d5/d26/d61/la5 0 2024-09-13T23:06:25.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/563: stat d5/d26/d61/d68/f93 0 2024-09-13T23:06:25.981 INFO:tasks.workunit.client.1.smithi152.stdout:5/564: creat d5/dc/d5e/fbb x:0 0 0 2024-09-13T23:06:25.981 INFO:tasks.workunit.client.1.smithi152.stdout:5/565: dread - d5/dc/d19/d65/d99/da6/f7a zero size 2024-09-13T23:06:25.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/718: dread d3/d4/d8d/f44 [0,4194304] 0 2024-09-13T23:06:25.982 INFO:tasks.workunit.client.1.smithi152.stdout:4/719: readlink d3/l3c 0 2024-09-13T23:06:25.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/720: creat d3/d4/d6/d66/d2b/d8e/fe2 x:0 0 0 2024-09-13T23:06:25.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/721: creat d3/d4/d6/d8/d17/d3a/fe3 x:0 0 0 2024-09-13T23:06:25.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/722: symlink d3/d4/d32/d86/d95/le4 0 2024-09-13T23:06:25.986 INFO:tasks.workunit.client.1.smithi152.stdout:4/723: fsync d3/d4/d6/d66/d62/f6a 0 2024-09-13T23:06:25.987 INFO:tasks.workunit.client.1.smithi152.stdout:4/724: creat d3/d4/d6/d66/d62/d9d/dba/fe5 x:0 0 0 2024-09-13T23:06:25.988 INFO:tasks.workunit.client.1.smithi152.stdout:4/725: creat d3/d4/d32/d82/fe6 x:0 0 0 2024-09-13T23:06:25.988 INFO:tasks.workunit.client.1.smithi152.stdout:4/726: stat d3/d4/d6/d66/c1d 0 2024-09-13T23:06:25.994 INFO:tasks.workunit.client.1.smithi152.stdout:4/727: rename d3/d4/d8d/d93/db9 to d3/d4/d6/d8/d17/d39/de7 0 2024-09-13T23:06:25.995 INFO:tasks.workunit.client.1.smithi152.stdout:9/679: dwrite d3/d24/d67/d4a/f8d [0,4194304] 0 2024-09-13T23:06:25.997 INFO:tasks.workunit.client.1.smithi152.stdout:6/587: dwrite d4/de/d12/f28 [0,4194304] 0 2024-09-13T23:06:26.005 INFO:tasks.workunit.client.1.smithi152.stdout:4/728: write d3/d4/d6/d66/d1c/d59/f68 [226649,101557] 0 2024-09-13T23:06:26.005 INFO:tasks.workunit.client.1.smithi152.stdout:4/729: truncate d3/d4/d8d/f55 989923 0 2024-09-13T23:06:26.007 INFO:tasks.workunit.client.1.smithi152.stdout:4/730: mknod d3/d4/d6/d66/d1c/d59/d60/d74/ce8 0 2024-09-13T23:06:26.017 INFO:tasks.workunit.client.1.smithi152.stdout:7/660: sync 2024-09-13T23:06:26.017 INFO:tasks.workunit.client.1.smithi152.stdout:7/661: readlink d17/d24/d9f/dac/dba/l83 0 2024-09-13T23:06:26.017 INFO:tasks.workunit.client.1.smithi152.stdout:7/662: creat d17/d6c/fe2 x:0 0 0 2024-09-13T23:06:26.020 INFO:tasks.workunit.client.1.smithi152.stdout:5/566: dwrite d5/dc/d19/d20/f4e [0,4194304] 0 2024-09-13T23:06:26.020 INFO:tasks.workunit.client.1.smithi152.stdout:5/567: readlink d5/dc/d19/d65/d99/l8a 0 2024-09-13T23:06:26.020 INFO:tasks.workunit.client.1.smithi152.stdout:6/588: dwrite d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:26.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/680: dwrite d3/d1e/fd6 [0,4194304] 0 2024-09-13T23:06:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/731: dread d3/d4/d6/d66/d62/f6a [0,4194304] 0 2024-09-13T23:06:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/568: mkdir d5/dc/d19/d65/d99/d98/dbc 0 2024-09-13T23:06:26.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/732: dread - d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/fdc zero size 2024-09-13T23:06:26.023 INFO:tasks.workunit.client.1.smithi152.stdout:6/589: dread d4/de/d1d/f6b [0,4194304] 0 2024-09-13T23:06:26.023 INFO:tasks.workunit.client.1.smithi152.stdout:6/590: fdatasync d4/de/d12/f55 0 2024-09-13T23:06:26.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/681: dread d3/d24/d67/d4a/f55 [0,4194304] 0 2024-09-13T23:06:26.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/569: dread d5/dc/da3/db4/f7d [0,4194304] 0 2024-09-13T23:06:26.026 INFO:tasks.workunit.client.1.smithi152.stdout:5/570: rename d5/faf to d5/dc/d19/d20/dab/fbd 0 2024-09-13T23:06:26.027 INFO:tasks.workunit.client.1.smithi152.stdout:9/682: rmdir d3/d52/d8c 39 2024-09-13T23:06:26.027 INFO:tasks.workunit.client.1.smithi152.stdout:9/683: creat d3/d52/fe5 x:0 0 0 2024-09-13T23:06:26.027 INFO:tasks.workunit.client.1.smithi152.stdout:5/571: creat d5/dc/fbe x:0 0 0 2024-09-13T23:06:26.043 INFO:tasks.workunit.client.1.smithi152.stdout:5/572: dread d5/f3f [0,4194304] 0 2024-09-13T23:06:26.045 INFO:tasks.workunit.client.1.smithi152.stdout:5/573: creat d5/dc/d4c/d80/fbf x:0 0 0 2024-09-13T23:06:26.047 INFO:tasks.workunit.client.1.smithi152.stdout:9/684: write d3/d52/d8c/fc8 [437299,56900] 0 2024-09-13T23:06:26.053 INFO:tasks.workunit.client.1.smithi152.stdout:7/663: dwrite d17/d24/d9f/d51/d5b/d90/fa4 [0,4194304] 0 2024-09-13T23:06:26.053 INFO:tasks.workunit.client.1.smithi152.stdout:6/591: dwrite d4/de/d12/d16/d2a/d38/d3c/f45 [0,4194304] 0 2024-09-13T23:06:26.054 INFO:tasks.workunit.client.1.smithi152.stdout:6/592: write d4/de/d12/f9f [859774,7019] 0 2024-09-13T23:06:26.054 INFO:tasks.workunit.client.1.smithi152.stdout:4/733: dwrite d3/f83 [0,4194304] 0 2024-09-13T23:06:26.057 INFO:tasks.workunit.client.1.smithi152.stdout:4/734: mkdir d3/d4/d6/d8/d17/d5d/d94/d9b/de9 0 2024-09-13T23:06:26.060 INFO:tasks.workunit.client.1.smithi152.stdout:9/685: read d3/d24/d67/f5c [3540984,93024] 0 2024-09-13T23:06:26.063 INFO:tasks.workunit.client.1.smithi152.stdout:5/574: dwrite d5/dc/d19/d65/d99/da6/fb7 [0,4194304] 0 2024-09-13T23:06:26.068 INFO:tasks.workunit.client.1.smithi152.stdout:5/575: write d5/dc/f63 [405356,22141] 0 2024-09-13T23:06:26.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/576: creat d5/dc/d19/fc0 x:0 0 0 2024-09-13T23:06:26.074 INFO:tasks.workunit.client.1.smithi152.stdout:5/577: rename d5/da/daa to d5/dc/d19/d65/d99/d98/da0/dc1 0 2024-09-13T23:06:26.077 INFO:tasks.workunit.client.1.smithi152.stdout:5/578: rename d5/dc/d4c to d5/dc/d19/d65/d99/d98/dc2 0 2024-09-13T23:06:26.077 INFO:tasks.workunit.client.1.smithi152.stdout:5/579: chown d5/dc/l57 727011 1 2024-09-13T23:06:26.079 INFO:tasks.workunit.client.1.smithi152.stdout:5/580: mknod d5/dc/d19/d20/d2e/d28/cc3 0 2024-09-13T23:06:26.080 INFO:tasks.workunit.client.1.smithi152.stdout:5/581: creat d5/dc/da3/fc4 x:0 0 0 2024-09-13T23:06:26.082 INFO:tasks.workunit.client.1.smithi152.stdout:6/593: dread d4/de/d12/f28 [0,4194304] 0 2024-09-13T23:06:26.083 INFO:tasks.workunit.client.1.smithi152.stdout:6/594: rename d4/c25 to d4/de/cc3 0 2024-09-13T23:06:26.084 INFO:tasks.workunit.client.1.smithi152.stdout:6/595: truncate d4/de/d12/d16/d2a/f2d 4666411 0 2024-09-13T23:06:26.084 INFO:tasks.workunit.client.1.smithi152.stdout:6/596: readlink d4/de/d21/l8c 0 2024-09-13T23:06:26.084 INFO:tasks.workunit.client.1.smithi152.stdout:6/597: readlink d4/de/d12/d16/d2a/d3d/daa/daf/lb0 0 2024-09-13T23:06:26.084 INFO:tasks.workunit.client.1.smithi152.stdout:6/598: truncate d4/de/d12/f28 678869 0 2024-09-13T23:06:26.084 INFO:tasks.workunit.client.1.smithi152.stdout:6/599: creat d4/de/d1d/fc4 x:0 0 0 2024-09-13T23:06:26.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/600: mknod d4/de/d12/d8a/cc5 0 2024-09-13T23:06:26.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/601: chown d4/de/d12/d16/l34 444 1 2024-09-13T23:06:26.102 INFO:tasks.workunit.client.1.smithi152.stdout:6/602: dwrite d4/de/d12/d16/f58 [0,4194304] 0 2024-09-13T23:06:26.103 INFO:tasks.workunit.client.1.smithi152.stdout:6/603: dread d4/de/d1d/f6b [0,4194304] 0 2024-09-13T23:06:26.104 INFO:tasks.workunit.client.1.smithi152.stdout:6/604: link d4/l9e d4/de/d21/lc6 0 2024-09-13T23:06:26.105 INFO:tasks.workunit.client.1.smithi152.stdout:6/605: mkdir d4/de/d12/d16/d2a/d3d/d57/dc7 0 2024-09-13T23:06:26.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/606: dread d4/de/d12/d16/d2a/d38/d3c/f54 [0,4194304] 0 2024-09-13T23:06:26.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/607: fsync d4/de/d21/f47 0 2024-09-13T23:06:26.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/608: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fc1 211655 0 2024-09-13T23:06:26.108 INFO:tasks.workunit.client.1.smithi152.stdout:6/609: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/d92/lc8 0 2024-09-13T23:06:26.109 INFO:tasks.workunit.client.1.smithi152.stdout:6/610: dread d4/de/d12/d16/d2a/d38/d3c/f54 [0,4194304] 0 2024-09-13T23:06:26.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/611: getdents d4/de/d12/d16/d2a/d38/d3c 0 2024-09-13T23:06:26.114 INFO:tasks.workunit.client.1.smithi152.stdout:5/582: getdents d5/dc 0 2024-09-13T23:06:26.115 INFO:tasks.workunit.client.1.smithi152.stdout:5/583: truncate d5/dc/d19/d20/d55/f9d 1172163 0 2024-09-13T23:06:26.116 INFO:tasks.workunit.client.1.smithi152.stdout:5/584: mknod d5/dc/d19/d65/d99/d98/dc2/d82/cc5 0 2024-09-13T23:06:26.120 INFO:tasks.workunit.client.1.smithi152.stdout:9/686: dwrite d3/d24/d67/f4d [0,4194304] 0 2024-09-13T23:06:26.120 INFO:tasks.workunit.client.1.smithi152.stdout:4/735: dwrite d3/d4/d6/d8/d17/d3a/f77 [0,4194304] 0 2024-09-13T23:06:26.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/612: read d4/de/d12/d16/d2a/d3d/d57/f85 [2750207,30818] 0 2024-09-13T23:06:26.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/613: mkdir d4/de/d21/d5c/dc9 0 2024-09-13T23:06:26.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/614: fsync d4/de/d21/d5c/f67 0 2024-09-13T23:06:26.126 INFO:tasks.workunit.client.1.smithi152.stdout:5/585: dread d5/dc/fe [0,4194304] 0 2024-09-13T23:06:26.126 INFO:tasks.workunit.client.1.smithi152.stdout:5/586: stat d5/da/cb9 0 2024-09-13T23:06:26.127 INFO:tasks.workunit.client.1.smithi152.stdout:5/587: write d5/dc/d19/d65/d70/f73 [3985361,95373] 0 2024-09-13T23:06:26.127 INFO:tasks.workunit.client.1.smithi152.stdout:4/736: mknod d3/d4/d6/d8/d17/cea 0 2024-09-13T23:06:26.128 INFO:tasks.workunit.client.1.smithi152.stdout:6/615: truncate d4/de/f39 607030 0 2024-09-13T23:06:26.128 INFO:tasks.workunit.client.1.smithi152.stdout:4/737: symlink d3/d4/d6/d66/d2b/leb 0 2024-09-13T23:06:26.129 INFO:tasks.workunit.client.1.smithi152.stdout:6/616: truncate d4/de/d12/d16/d2a/d38/fae 641672 0 2024-09-13T23:06:26.129 INFO:tasks.workunit.client.1.smithi152.stdout:6/617: creat d4/de/d1d/fca x:0 0 0 2024-09-13T23:06:26.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/738: rename d3/d4/d6/d66/d2b/d84/cd2 to d3/d4/d6/d8/d17/d5d/d94/d9b/da0/cec 0 2024-09-13T23:06:26.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/739: write d3/d4/d6/d8/d17/d3a/fe3 [244137,91018] 0 2024-09-13T23:06:26.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/740: fdatasync d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 0 2024-09-13T23:06:26.135 INFO:tasks.workunit.client.1.smithi152.stdout:4/741: write d3/d4/d6/d66/f49 [3319125,100147] 0 2024-09-13T23:06:26.135 INFO:tasks.workunit.client.1.smithi152.stdout:4/742: readlink d3/d4/d32/l5c 0 2024-09-13T23:06:26.136 INFO:tasks.workunit.client.1.smithi152.stdout:4/743: getdents d3/d4 0 2024-09-13T23:06:26.137 INFO:tasks.workunit.client.1.smithi152.stdout:4/744: symlink d3/d4/d6/d8/d17/d39/led 0 2024-09-13T23:06:26.139 INFO:tasks.workunit.client.1.smithi152.stdout:4/745: rename d3/d4/d6/d8/d17/d5d/f90 to d3/d4/d6/d8/d17/d5d/d76/fee 0 2024-09-13T23:06:26.139 INFO:tasks.workunit.client.1.smithi152.stdout:4/746: truncate d3/d4/d6/fb0 570184 0 2024-09-13T23:06:26.140 INFO:tasks.workunit.client.1.smithi152.stdout:4/747: read d3/d4/d6/d66/f85 [47816,19492] 0 2024-09-13T23:06:26.140 INFO:tasks.workunit.client.1.smithi152.stdout:4/748: readlink d3/d4/d6/d8/d4b/lb4 0 2024-09-13T23:06:26.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/588: dwrite d5/dc/d5e/f6a [0,4194304] 0 2024-09-13T23:06:26.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/589: chown d5/d26/d61/d68/f7b 6 1 2024-09-13T23:06:26.143 INFO:tasks.workunit.client.1.smithi152.stdout:5/590: link d5/dc/d19/f1a d5/dc/da3/db4/fc6 0 2024-09-13T23:06:26.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/749: rmdir d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf 39 2024-09-13T23:06:26.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/750: creat d3/d4/d6/d66/fef x:0 0 0 2024-09-13T23:06:26.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/751: dwrite d3/d4/d6/d66/d62/d9d/dba/fe5 [0,4194304] 0 2024-09-13T23:06:26.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/752: chown d3/d4/d6 263341663 1 2024-09-13T23:06:26.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/753: mkdir d3/d4/d6/d66/d1c/df0 0 2024-09-13T23:06:26.164 INFO:tasks.workunit.client.1.smithi152.stdout:4/754: rename d3/d4/d32/fb6 to d3/d4/d6/d66/d1c/ff1 0 2024-09-13T23:06:26.164 INFO:tasks.workunit.client.1.smithi152.stdout:4/755: write d3/d4/d6/d63/fcb [594419,6633] 0 2024-09-13T23:06:26.164 INFO:tasks.workunit.client.1.smithi152.stdout:4/756: read d3/d4/d6/d66/d1c/f2c [92305,20960] 0 2024-09-13T23:06:26.164 INFO:tasks.workunit.client.1.smithi152.stdout:4/757: chown d3/d4/d6/d66/f49 103284208 1 2024-09-13T23:06:26.170 INFO:tasks.workunit.client.1.smithi152.stdout:8/516: sync 2024-09-13T23:06:26.170 INFO:tasks.workunit.client.1.smithi152.stdout:3/518: sync 2024-09-13T23:06:26.170 INFO:tasks.workunit.client.1.smithi152.stdout:8/517: dread - d17/d25/d32/d44/f82 zero size 2024-09-13T23:06:26.178 INFO:tasks.workunit.client.1.smithi152.stdout:8/518: read d17/f1c [1014999,117910] 0 2024-09-13T23:06:26.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/519: truncate d17/d19/f28 1794231 0 2024-09-13T23:06:26.184 INFO:tasks.workunit.client.1.smithi152.stdout:3/519: dwrite de/d14/f4d [0,4194304] 0 2024-09-13T23:06:26.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/520: dwrite de/d14/f5b [0,4194304] 0 2024-09-13T23:06:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/521: dread de/d14/f96 [0,4194304] 0 2024-09-13T23:06:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/522: write de/d14/d76/f8e [493238,52425] 0 2024-09-13T23:06:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/523: truncate de/d14/d47/d57/d93/f97 68351 0 2024-09-13T23:06:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/524: stat de/d14/d47/d70/f81 0 2024-09-13T23:06:26.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/525: write de/d14/d47/d57/d99/fac [879803,76850] 0 2024-09-13T23:06:26.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/685: sync 2024-09-13T23:06:26.307 INFO:tasks.workunit.client.1.smithi152.stdout:1/595: sync 2024-09-13T23:06:26.307 INFO:tasks.workunit.client.1.smithi152.stdout:0/513: sync 2024-09-13T23:06:26.307 INFO:tasks.workunit.client.1.smithi152.stdout:0/514: stat d18/d1f/d29/d2f/d3d/f4c 0 2024-09-13T23:06:26.308 INFO:tasks.workunit.client.1.smithi152.stdout:0/515: dread d18/d1f/fb1 [0,4194304] 0 2024-09-13T23:06:26.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/686: truncate d0/d4/d9/d18/d1e/d3c/d88/fe8 284346 0 2024-09-13T23:06:26.320 INFO:tasks.workunit.client.1.smithi152.stdout:2/687: dread d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:26.328 INFO:tasks.workunit.client.1.smithi152.stdout:2/688: dread d0/d4/d9/d16/d2b/f46 [0,4194304] 0 2024-09-13T23:06:26.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/596: dwrite d4/d9/d1a/f2e [0,4194304] 0 2024-09-13T23:06:26.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/597: creat d4/d47/fcb x:0 0 0 2024-09-13T23:06:26.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/516: dwrite f14 [4194304,4194304] 0 2024-09-13T23:06:26.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/517: readlink d18/d19/l61 0 2024-09-13T23:06:26.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/518: stat d18/d1f/d29/ca8 0 2024-09-13T23:06:26.339 INFO:tasks.workunit.client.1.smithi152.stdout:2/689: read d0/d4/d9/d18/d1e/d8c/f51 [1595591,5005] 0 2024-09-13T23:06:26.339 INFO:tasks.workunit.client.1.smithi152.stdout:2/690: chown d0/d4/d9/d16/d30/dc7 42878907 1 2024-09-13T23:06:26.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/598: write d4/d9/d1a/f2e [898108,64283] 0 2024-09-13T23:06:26.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/599: write d4/d9/d1a/d22/d24/f6a [2504211,78301] 0 2024-09-13T23:06:26.349 INFO:tasks.workunit.client.1.smithi152.stdout:0/519: write d18/d1f/fa9 [831629,77487] 0 2024-09-13T23:06:26.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/520: write d18/d1f/d29/d2f/d3d/f5e [1401099,121610] 0 2024-09-13T23:06:26.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/521: chown d18/d1f/d29/d3f/l96 878 1 2024-09-13T23:06:26.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/522: chown l7 59259524 1 2024-09-13T23:06:26.356 INFO:tasks.workunit.client.1.smithi152.stdout:0/523: link d18/d19/d74/l98 d18/d1f/d29/d4e/lb5 0 2024-09-13T23:06:26.357 INFO:tasks.workunit.client.1.smithi152.stdout:0/524: symlink d18/d1f/d29/d3f/d4b/d66/d6a/lb6 0 2024-09-13T23:06:26.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/600: write d4/f6b [829433,69509] 0 2024-09-13T23:06:26.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/601: creat d4/fcc x:0 0 0 2024-09-13T23:06:26.367 INFO:tasks.workunit.client.1.smithi152.stdout:1/602: dread f1 [0,4194304] 0 2024-09-13T23:06:26.369 INFO:tasks.workunit.client.1.smithi152.stdout:0/525: write f0 [2847329,13579] 0 2024-09-13T23:06:26.369 INFO:tasks.workunit.client.1.smithi152.stdout:0/526: getdents d18/d1f/d33/d65/d7a/db4 0 2024-09-13T23:06:26.369 INFO:tasks.workunit.client.1.smithi152.stdout:1/603: rename d4/d47/d8b/dbb to d4/d47/dcd 0 2024-09-13T23:06:26.370 INFO:tasks.workunit.client.1.smithi152.stdout:0/527: symlink d18/d1f/d33/d6e/lb7 0 2024-09-13T23:06:26.371 INFO:tasks.workunit.client.1.smithi152.stdout:1/604: mknod d4/d9/d1a/d22/d24/d48/dc4/cce 0 2024-09-13T23:06:26.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/664: sync 2024-09-13T23:06:26.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/665: write d17/d24/d9f/dac/dba/d85/faf [1011527,54300] 0 2024-09-13T23:06:26.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/528: link d18/d1f/d33/d6e/c80 d18/d1f/d29/d3f/da0/cb8 0 2024-09-13T23:06:26.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/529: fdatasync d18/f25 0 2024-09-13T23:06:26.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/530: chown d18/d1f/d33/f7f 7626 1 2024-09-13T23:06:26.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/605: truncate d4/d9/d1a/f49 2784546 0 2024-09-13T23:06:26.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/606: chown d4/d9/d1a/d22/d24/f52 63457873 1 2024-09-13T23:06:26.374 INFO:tasks.workunit.client.1.smithi152.stdout:1/607: write d4/d4c/fc1 [943936,75450] 0 2024-09-13T23:06:26.374 INFO:tasks.workunit.client.1.smithi152.stdout:7/666: rmdir d17/d4f/d84/db6/dc4 0 2024-09-13T23:06:26.375 INFO:tasks.workunit.client.1.smithi152.stdout:7/667: write d17/d24/d9f/d51/d5b/d90/f6a [661162,126004] 0 2024-09-13T23:06:26.376 INFO:tasks.workunit.client.1.smithi152.stdout:7/668: creat d17/d24/d9f/d3f/fe3 x:0 0 0 2024-09-13T23:06:26.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/531: dwrite d18/d1f/d29/d3f/d4b/d66/d6a/f6b [0,4194304] 0 2024-09-13T23:06:26.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/608: dwrite d4/d47/f77 [0,4194304] 0 2024-09-13T23:06:26.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/609: fdatasync d4/d9/d1a/d22/d24/d48/f66 0 2024-09-13T23:06:26.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/610: creat d4/d4c/d8d/d99/fcf x:0 0 0 2024-09-13T23:06:26.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/611: truncate d4/d9/d1a/fa4 1010891 0 2024-09-13T23:06:26.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/669: dwrite d17/d24/d9f/d51/f97 [0,4194304] 0 2024-09-13T23:06:26.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/670: write d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b [1250720,124569] 0 2024-09-13T23:06:26.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/671: chown d17/d6c/f88 41548 1 2024-09-13T23:06:26.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/672: fdatasync d17/d24/d9f/d51/d5b/d87/f94 0 2024-09-13T23:06:26.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/673: chown d17/d24/d9f/dac/dba/l83 130427 1 2024-09-13T23:06:26.413 INFO:tasks.workunit.client.1.smithi152.stdout:7/674: truncate d17/d24/d9f/d51/d5b/d90/d2b/f3a 4193439 0 2024-09-13T23:06:26.413 INFO:tasks.workunit.client.1.smithi152.stdout:7/675: write d17/fb4 [321545,26378] 0 2024-09-13T23:06:26.429 INFO:tasks.workunit.client.1.smithi152.stdout:1/612: dwrite d4/d9/d1a/f2e [0,4194304] 0 2024-09-13T23:06:26.430 INFO:tasks.workunit.client.1.smithi152.stdout:1/613: mknod d4/d47/dcd/cd0 0 2024-09-13T23:06:26.433 INFO:tasks.workunit.client.1.smithi152.stdout:7/676: dwrite d17/d24/d9f/d51/d5b/d90/d8e/fbe [0,4194304] 0 2024-09-13T23:06:26.435 INFO:tasks.workunit.client.1.smithi152.stdout:7/677: rmdir d17/d24/d9f/d51/d5b/d90/d2e/dd0 39 2024-09-13T23:06:26.435 INFO:tasks.workunit.client.1.smithi152.stdout:7/678: write d17/f1d [3285072,55134] 0 2024-09-13T23:06:26.436 INFO:tasks.workunit.client.1.smithi152.stdout:7/679: unlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/fdb 0 2024-09-13T23:06:26.445 INFO:tasks.workunit.client.1.smithi152.stdout:1/614: dread d4/f72 [0,4194304] 0 2024-09-13T23:06:26.446 INFO:tasks.workunit.client.1.smithi152.stdout:1/615: mkdir d4/d47/d8b/dd1 0 2024-09-13T23:06:26.448 INFO:tasks.workunit.client.1.smithi152.stdout:7/680: write d17/d24/d9f/d51/d5b/d90/d2e/d30/f44 [5664447,50180] 0 2024-09-13T23:06:26.449 INFO:tasks.workunit.client.1.smithi152.stdout:7/681: mknod d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/ce4 0 2024-09-13T23:06:26.449 INFO:tasks.workunit.client.1.smithi152.stdout:7/682: chown d17/d24/d9f/d51/d5b/d90/d2e/d71/fbc 209 1 2024-09-13T23:06:26.449 INFO:tasks.workunit.client.1.smithi152.stdout:7/683: chown d17/d24/d9f/d51/d5b/d90/d2e/d79 62 1 2024-09-13T23:06:26.469 INFO:tasks.workunit.client.1.smithi152.stdout:1/616: dwrite d4/f5d [0,4194304] 0 2024-09-13T23:06:26.471 INFO:tasks.workunit.client.1.smithi152.stdout:1/617: write d4/d9/fb3 [21630,28631] 0 2024-09-13T23:06:26.471 INFO:tasks.workunit.client.1.smithi152.stdout:1/618: write d4/d4c/d8d/fb5 [759670,67802] 0 2024-09-13T23:06:26.471 INFO:tasks.workunit.client.1.smithi152.stdout:1/619: getdents d4/d47 0 2024-09-13T23:06:26.471 INFO:tasks.workunit.client.1.smithi152.stdout:1/620: symlink d4/d9/d1a/d22/ld2 0 2024-09-13T23:06:26.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/684: dwrite d17/d24/d9f/d51/d5b/d90/d2b/f3b [0,4194304] 0 2024-09-13T23:06:26.488 INFO:tasks.workunit.client.1.smithi152.stdout:1/621: dwrite d4/d4c/d8d/f95 [0,4194304] 0 2024-09-13T23:06:26.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/622: chown d4/d9/d1a/d22/d24/f52 124 1 2024-09-13T23:06:26.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/623: creat d4/d4c/fd3 x:0 0 0 2024-09-13T23:06:26.491 INFO:tasks.workunit.client.1.smithi152.stdout:1/624: truncate d4/d9/d1a/d22/d24/f56 502164 0 2024-09-13T23:06:26.491 INFO:tasks.workunit.client.1.smithi152.stdout:1/625: creat d4/d9/d1a/d22/d24/daa/fd4 x:0 0 0 2024-09-13T23:06:26.492 INFO:tasks.workunit.client.1.smithi152.stdout:1/626: rmdir d4/d9/d1a 39 2024-09-13T23:06:26.492 INFO:tasks.workunit.client.1.smithi152.stdout:1/627: dread - d4/f75 zero size 2024-09-13T23:06:26.492 INFO:tasks.workunit.client.1.smithi152.stdout:1/628: creat d4/d4c/db1/fd5 x:0 0 0 2024-09-13T23:06:26.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/629: symlink d4/d9/d1a/d22/ld6 0 2024-09-13T23:06:26.495 INFO:tasks.workunit.client.1.smithi152.stdout:7/685: dwrite d17/d24/d9f/d51/d5b/d90/fa4 [4194304,4194304] 0 2024-09-13T23:06:26.496 INFO:tasks.workunit.client.1.smithi152.stdout:7/686: creat d17/d24/d9f/d51/d5b/d90/d2e/dd0/dda/fe5 x:0 0 0 2024-09-13T23:06:26.497 INFO:tasks.workunit.client.1.smithi152.stdout:7/687: creat d17/d24/d9f/d51/d5b/d90/d2e/d30/fe6 x:0 0 0 2024-09-13T23:06:26.499 INFO:tasks.workunit.client.1.smithi152.stdout:7/688: dread d17/f1e [0,4194304] 0 2024-09-13T23:06:26.499 INFO:tasks.workunit.client.1.smithi152.stdout:1/630: dread d4/d9/fb3 [0,4194304] 0 2024-09-13T23:06:26.502 INFO:tasks.workunit.client.1.smithi152.stdout:1/631: symlink d4/d9/d1a/d22/d24/d48/dc4/ld7 0 2024-09-13T23:06:26.502 INFO:tasks.workunit.client.1.smithi152.stdout:7/689: dread d17/d4f/f78 [0,4194304] 0 2024-09-13T23:06:26.502 INFO:tasks.workunit.client.1.smithi152.stdout:1/632: symlink d4/d4c/d8d/d99/ld8 0 2024-09-13T23:06:26.502 INFO:tasks.workunit.client.1.smithi152.stdout:1/633: fdatasync d4/d4c/d8d/d99/fa6 0 2024-09-13T23:06:26.503 INFO:tasks.workunit.client.1.smithi152.stdout:7/690: mknod d17/d24/d9f/d51/d5b/d90/ce7 0 2024-09-13T23:06:26.517 INFO:tasks.workunit.client.1.smithi152.stdout:1/634: dwrite d4/d9/d1a/f33 [0,4194304] 0 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/635: creat d4/dc8/fd9 x:0 0 0 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/636: readlink d4/d9/d1a/d22/l4d 0 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/637: creat d4/d4c/d8d/fda x:0 0 0 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/638: write d4/d47/d8b/fca [421273,99158] 0 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/639: chown d4/d9/d1a/d22/d24/f7f 2 1 2024-09-13T23:06:26.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/640: creat d4/d4c/fdb x:0 0 0 2024-09-13T23:06:26.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/641: creat d4/d47/fdc x:0 0 0 2024-09-13T23:06:26.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/642: creat d4/d9/d1a/d22/d24/daa/fdd x:0 0 0 2024-09-13T23:06:26.537 INFO:tasks.workunit.client.1.smithi152.stdout:1/643: dwrite d4/d4c/d8d/fb7 [4194304,4194304] 0 2024-09-13T23:06:26.537 INFO:tasks.workunit.client.1.smithi152.stdout:1/644: chown d4/d9/d1a/d22/c46 34 1 2024-09-13T23:06:26.538 INFO:tasks.workunit.client.1.smithi152.stdout:1/645: mkdir d4/d9/d1a/d22/d24/dde 0 2024-09-13T23:06:26.551 INFO:tasks.workunit.client.1.smithi152.stdout:1/646: dwrite d4/d9/fb3 [0,4194304] 0 2024-09-13T23:06:26.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/647: dwrite d4/d9/fc2 [0,4194304] 0 2024-09-13T23:06:26.565 INFO:tasks.workunit.client.1.smithi152.stdout:1/648: truncate d4/d9/f98 201714 0 2024-09-13T23:06:26.567 INFO:tasks.workunit.client.1.smithi152.stdout:1/649: link l3 d4/d9/d71/ldf 0 2024-09-13T23:06:26.568 INFO:tasks.workunit.client.1.smithi152.stdout:1/650: creat d4/d9/d1a/d22/fe0 x:0 0 0 2024-09-13T23:06:26.581 INFO:tasks.workunit.client.1.smithi152.stdout:6/618: sync 2024-09-13T23:06:26.581 INFO:tasks.workunit.client.1.smithi152.stdout:9/687: sync 2024-09-13T23:06:26.581 INFO:tasks.workunit.client.1.smithi152.stdout:9/688: write d3/d24/d67/d4a/d71/db7/fcd [388949,120237] 0 2024-09-13T23:06:26.581 INFO:tasks.workunit.client.1.smithi152.stdout:9/689: write d3/d24/d67/f5c [1284974,120942] 0 2024-09-13T23:06:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:6/619: dread - d4/de/d12/d16/d2a/f90 zero size 2024-09-13T23:06:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:6/620: dread d4/de/d1d/f6b [0,4194304] 0 2024-09-13T23:06:26.582 INFO:tasks.workunit.client.1.smithi152.stdout:6/621: readlink d4/de/d12/d8a/lc2 0 2024-09-13T23:06:26.583 INFO:tasks.workunit.client.1.smithi152.stdout:9/690: creat d3/d24/d67/d60/de1/fe6 x:0 0 0 2024-09-13T23:06:26.583 INFO:tasks.workunit.client.1.smithi152.stdout:9/691: write d3/d24/d67/d4a/d71/f9e [180126,82766] 0 2024-09-13T23:06:26.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/622: mknod d4/de/d12/ccb 0 2024-09-13T23:06:26.584 INFO:tasks.workunit.client.1.smithi152.stdout:6/623: chown d4/de/d12 0 1 2024-09-13T23:06:26.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/692: stat d3/d24/l1a 0 2024-09-13T23:06:26.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/693: chown d3/d24/d67/c6f 7027 1 2024-09-13T23:06:26.597 INFO:tasks.workunit.client.1.smithi152.stdout:9/694: dwrite d3/d1e/fd6 [0,4194304] 0 2024-09-13T23:06:26.598 INFO:tasks.workunit.client.1.smithi152.stdout:9/695: unlink d3/d24/dac/lc4 0 2024-09-13T23:06:26.599 INFO:tasks.workunit.client.1.smithi152.stdout:9/696: truncate d3/f17 2460360 0 2024-09-13T23:06:26.604 INFO:tasks.workunit.client.1.smithi152.stdout:9/697: dread d3/d24/f36 [0,4194304] 0 2024-09-13T23:06:26.604 INFO:tasks.workunit.client.1.smithi152.stdout:9/698: fsync d3/d1e/fe2 0 2024-09-13T23:06:26.610 INFO:tasks.workunit.client.1.smithi152.stdout:9/699: rmdir d3 39 2024-09-13T23:06:26.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/700: mkdir d3/d24/d67/d47/de7 0 2024-09-13T23:06:26.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/701: dread - d3/d24/d34/d45/daa/dbf/fdf zero size 2024-09-13T23:06:26.628 INFO:tasks.workunit.client.1.smithi152.stdout:9/702: dwrite d3/f23 [0,4194304] 0 2024-09-13T23:06:26.634 INFO:tasks.workunit.client.1.smithi152.stdout:9/703: write d3/d24/d67/d4a/d71/f89 [3613917,49474] 0 2024-09-13T23:06:26.635 INFO:tasks.workunit.client.1.smithi152.stdout:9/704: rename d3/f28 to d3/d24/d34/dc6/fe8 0 2024-09-13T23:06:26.637 INFO:tasks.workunit.client.1.smithi152.stdout:9/705: link d3/d1e/d30/c3a d3/d24/d34/d45/daa/dbf/ce9 0 2024-09-13T23:06:26.638 INFO:tasks.workunit.client.1.smithi152.stdout:9/706: write d3/d52/fe5 [474976,96622] 0 2024-09-13T23:06:26.638 INFO:tasks.workunit.client.1.smithi152.stdout:9/707: fsync d3/d24/d67/d4a/d8e/fdc 0 2024-09-13T23:06:26.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/708: dwrite d3/d24/d67/d4a/f55 [0,4194304] 0 2024-09-13T23:06:26.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/709: read - d3/d24/d67/d60/de1/fe6 zero size 2024-09-13T23:06:26.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/710: link d3/d1e/d30/d5d/l61 d3/d24/d34/lea 0 2024-09-13T23:06:26.661 INFO:tasks.workunit.client.1.smithi152.stdout:9/711: creat d3/d24/d67/d4a/d71/feb x:0 0 0 2024-09-13T23:06:26.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/712: symlink d3/d52/lec 0 2024-09-13T23:06:26.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/713: dread - d3/d1e/d30/d5d/da3/fc3 zero size 2024-09-13T23:06:26.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/714: fsync d3/f4f 0 2024-09-13T23:06:26.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/715: unlink d3/d24/d67/d4a/f55 0 2024-09-13T23:06:26.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/716: symlink d3/d24/led 0 2024-09-13T23:06:26.666 INFO:tasks.workunit.client.1.smithi152.stdout:9/717: stat d3/db0 0 2024-09-13T23:06:26.666 INFO:tasks.workunit.client.1.smithi152.stdout:9/718: mkdir d3/d24/d67/d4a/d71/d7c/dee 0 2024-09-13T23:06:26.666 INFO:tasks.workunit.client.1.smithi152.stdout:9/719: write d3/d24/d67/d4a/f79 [1684359,7540] 0 2024-09-13T23:06:26.666 INFO:tasks.workunit.client.1.smithi152.stdout:9/720: truncate d3/d24/d67/d60/f58 972624 0 2024-09-13T23:06:26.671 INFO:tasks.workunit.client.1.smithi152.stdout:9/721: dread d3/d1e/f72 [0,4194304] 0 2024-09-13T23:06:26.672 INFO:tasks.workunit.client.1.smithi152.stdout:9/722: read d3/d1e/f92 [266163,41791] 0 2024-09-13T23:06:26.673 INFO:tasks.workunit.client.1.smithi152.stdout:9/723: creat d3/d24/d67/d4a/d8e/fef x:0 0 0 2024-09-13T23:06:26.678 INFO:tasks.workunit.client.1.smithi152.stdout:3/526: sync 2024-09-13T23:06:26.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/591: sync 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/520: sync 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/527: stat de/d14/d47/d57/d5d/l54 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/521: fdatasync d17/d25/f2f 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/522: write d17/d25/d32/d4b/f5b [5123641,79811] 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/523: fsync d17/d19/f89 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/524: creat d17/d25/d32/d9a/d8f/d9e/fa2 x:0 0 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/525: write d17/f1d [3702209,128661] 0 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/758: sync 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/759: dread - d3/fbd zero size 2024-09-13T23:06:26.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/760: write d3/d34/fae [667006,18506] 0 2024-09-13T23:06:26.680 INFO:tasks.workunit.client.1.smithi152.stdout:5/592: mkdir d5/dc/d19/d65/dc7 0 2024-09-13T23:06:26.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/526: getdents d17/d25/d32/d9a 0 2024-09-13T23:06:26.692 INFO:tasks.workunit.client.1.smithi152.stdout:3/528: dread de/f1c [0,4194304] 0 2024-09-13T23:06:26.693 INFO:tasks.workunit.client.1.smithi152.stdout:3/529: unlink de/d14/d47/d57/d5d/d6e/f79 0 2024-09-13T23:06:26.693 INFO:tasks.workunit.client.1.smithi152.stdout:3/530: stat de/d14/l8b 0 2024-09-13T23:06:26.694 INFO:tasks.workunit.client.1.smithi152.stdout:3/531: write de/d1f/f52 [1389999,73791] 0 2024-09-13T23:06:26.694 INFO:tasks.workunit.client.1.smithi152.stdout:3/532: mknod de/d14/d47/d57/d5d/cb4 0 2024-09-13T23:06:26.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/533: symlink de/d14/d47/d57/lb5 0 2024-09-13T23:06:26.706 INFO:tasks.workunit.client.1.smithi152.stdout:9/724: dwrite d3/d1e/d30/fde [0,4194304] 0 2024-09-13T23:06:26.706 INFO:tasks.workunit.client.1.smithi152.stdout:5/593: dwrite d5/dc/da3/db4/fa9 [0,4194304] 0 2024-09-13T23:06:26.708 INFO:tasks.workunit.client.1.smithi152.stdout:4/761: dwrite d3/d4/d6/d66/f85 [0,4194304] 0 2024-09-13T23:06:26.708 INFO:tasks.workunit.client.1.smithi152.stdout:5/594: symlink d5/dc/d19/d65/d99/da6/dad/lc8 0 2024-09-13T23:06:26.708 INFO:tasks.workunit.client.1.smithi152.stdout:5/595: dread - d5/f67 zero size 2024-09-13T23:06:26.709 INFO:tasks.workunit.client.1.smithi152.stdout:4/762: mkdir d3/d4/d32/d86/d95/df2 0 2024-09-13T23:06:26.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/763: mknod d3/d4/d6/d8/d17/d5d/cf3 0 2024-09-13T23:06:26.711 INFO:tasks.workunit.client.1.smithi152.stdout:4/764: mknod d3/d4/d6/d66/d2b/ddf/cf4 0 2024-09-13T23:06:26.711 INFO:tasks.workunit.client.1.smithi152.stdout:4/765: creat d3/d4/d6/d8/ff5 x:0 0 0 2024-09-13T23:06:26.712 INFO:tasks.workunit.client.1.smithi152.stdout:4/766: link d3/d4/d6/d8/d4b/lb4 d3/d4/d6/d8/d17/d5d/lf6 0 2024-09-13T23:06:26.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/767: symlink d3/d4/lf7 0 2024-09-13T23:06:26.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/768: write d3/d4/d6/d66/f7 [725115,121114] 0 2024-09-13T23:06:26.715 INFO:tasks.workunit.client.1.smithi152.stdout:4/769: getdents d3/d4/d6/d66/d62 0 2024-09-13T23:06:26.717 INFO:tasks.workunit.client.1.smithi152.stdout:8/527: dread d17/f1d [0,4194304] 0 2024-09-13T23:06:26.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/596: write d5/d26/d61/f77 [3862982,13302] 0 2024-09-13T23:06:26.718 INFO:tasks.workunit.client.1.smithi152.stdout:5/597: fdatasync d5/dc/d19/d65/d99/d98/dc2/d80/fbf 0 2024-09-13T23:06:26.720 INFO:tasks.workunit.client.1.smithi152.stdout:5/598: creat d5/d26/fc9 x:0 0 0 2024-09-13T23:06:26.720 INFO:tasks.workunit.client.1.smithi152.stdout:5/599: readlink d5/dc/d19/d65/l4d 0 2024-09-13T23:06:26.720 INFO:tasks.workunit.client.1.smithi152.stdout:9/725: read d3/d24/d67/d60/f84 [2491488,74861] 0 2024-09-13T23:06:26.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/600: link d5/dc/da3/db4/d7f/l8c d5/dc/d19/d65/d70/lca 0 2024-09-13T23:06:26.722 INFO:tasks.workunit.client.1.smithi152.stdout:9/726: rename d3/d24/d67/d4a/d71/f9e to d3/d24/d34/d45/daa/ff0 0 2024-09-13T23:06:26.724 INFO:tasks.workunit.client.1.smithi152.stdout:9/727: rename d3/d52/fc7 to d3/d24/d67/d4a/ff1 0 2024-09-13T23:06:26.724 INFO:tasks.workunit.client.1.smithi152.stdout:9/728: creat d3/d24/d67/d4a/d8e/ff2 x:0 0 0 2024-09-13T23:06:26.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/729: creat d3/d24/d67/d47/de7/ff3 x:0 0 0 2024-09-13T23:06:26.730 INFO:tasks.workunit.client.1.smithi152.stdout:5/601: rename d5/dc/l57 to d5/dc/d19/d20/dab/lcb 0 2024-09-13T23:06:26.730 INFO:tasks.workunit.client.1.smithi152.stdout:5/602: dread - d5/dc/f5b zero size 2024-09-13T23:06:26.735 INFO:tasks.workunit.client.1.smithi152.stdout:5/603: write d5/dc/d19/d65/d99/da6/f8b [1777788,110421] 0 2024-09-13T23:06:26.736 INFO:tasks.workunit.client.1.smithi152.stdout:5/604: dread - d5/dc/f5b zero size 2024-09-13T23:06:26.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/605: write d5/dc/d19/f7e [358065,2132] 0 2024-09-13T23:06:26.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/606: fdatasync d5/dc/fbe 0 2024-09-13T23:06:26.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/607: truncate d5/d26/f47 5455198 0 2024-09-13T23:06:26.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/608: creat d5/dc/da3/db4/db3/fcc x:0 0 0 2024-09-13T23:06:26.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/609: creat d5/dc/d19/d20/fcd x:0 0 0 2024-09-13T23:06:26.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/610: rename d5/dc/d19/d20/fcd to d5/dc/d19/d20/d2e/d28/d92/fce 0 2024-09-13T23:06:26.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/611: write d5/da/f6f [48222,46553] 0 2024-09-13T23:06:26.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/612: mknod d5/dc/d19/d20/d2e/d28/d92/ccf 0 2024-09-13T23:06:26.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/613: chown d5/da/f58 469563964 1 2024-09-13T23:06:26.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/614: symlink d5/d26/d61/ld0 0 2024-09-13T23:06:26.744 INFO:tasks.workunit.client.1.smithi152.stdout:5/615: symlink d5/dc/d19/d65/d99/da6/ld1 0 2024-09-13T23:06:26.744 INFO:tasks.workunit.client.1.smithi152.stdout:5/616: mkdir d5/da/dd2 0 2024-09-13T23:06:26.745 INFO:tasks.workunit.client.1.smithi152.stdout:5/617: mknod d5/dc/d19/d65/d99/da6/dad/cd3 0 2024-09-13T23:06:26.746 INFO:tasks.workunit.client.1.smithi152.stdout:5/618: unlink d5/dc/da3/db4/fa9 0 2024-09-13T23:06:26.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/619: write d5/dc/d19/d20/d2e/d28/fb6 [614543,63455] 0 2024-09-13T23:06:26.747 INFO:tasks.workunit.client.1.smithi152.stdout:5/620: creat d5/dc/d19/d65/d99/d98/dc2/d80/fd4 x:0 0 0 2024-09-13T23:06:26.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/621: rmdir d5/d26/d78 0 2024-09-13T23:06:26.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/622: chown d5/f3f 21 1 2024-09-13T23:06:26.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/623: unlink d5/dc/f89 0 2024-09-13T23:06:26.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/624: write d5/dc/d19/f7e [445184,93671] 0 2024-09-13T23:06:26.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/625: getdents d5/dc/d19/d65/d99/d98 0 2024-09-13T23:06:26.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/626: write d5/dc/d19/d20/d2e/d28/fb6 [616598,29358] 0 2024-09-13T23:06:26.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/770: dwrite d3/d34/fca [0,4194304] 0 2024-09-13T23:06:26.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/771: truncate d3/d4/d6/d8/dad/fcd 205518 0 2024-09-13T23:06:26.751 INFO:tasks.workunit.client.1.smithi152.stdout:5/627: rmdir d5/dc/d19/d65/d99/d98/da0 39 2024-09-13T23:06:26.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/528: dwrite d17/d25/d32/f63 [0,4194304] 0 2024-09-13T23:06:26.752 INFO:tasks.workunit.client.1.smithi152.stdout:9/730: dwrite d3/d24/d67/d60/f69 [0,4194304] 0 2024-09-13T23:06:26.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/772: link d3/d4/d6/d8/l15 d3/d4/lf8 0 2024-09-13T23:06:26.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/773: chown d3/f13 64153 1 2024-09-13T23:06:26.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/774: read - d3/d4/d6/d66/d1c/d59/d60/d74/fa8 zero size 2024-09-13T23:06:26.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/628: creat d5/dc/d19/d65/d70/fd5 x:0 0 0 2024-09-13T23:06:26.754 INFO:tasks.workunit.client.1.smithi152.stdout:5/629: write d5/dc/da3/db4/f7d [1023602,106190] 0 2024-09-13T23:06:26.755 INFO:tasks.workunit.client.1.smithi152.stdout:8/529: mkdir d17/d25/d80/da3 0 2024-09-13T23:06:26.761 INFO:tasks.workunit.client.1.smithi152.stdout:9/731: creat d3/d24/d67/d60/de1/ff4 x:0 0 0 2024-09-13T23:06:26.761 INFO:tasks.workunit.client.1.smithi152.stdout:9/732: readlink d3/d24/l6a 0 2024-09-13T23:06:26.761 INFO:tasks.workunit.client.1.smithi152.stdout:9/733: readlink d3/l99 0 2024-09-13T23:06:26.763 INFO:tasks.workunit.client.1.smithi152.stdout:4/775: creat d3/d4/d32/d86/d95/df2/ff9 x:0 0 0 2024-09-13T23:06:26.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/734: creat d3/d24/dac/ff5 x:0 0 0 2024-09-13T23:06:26.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/735: truncate d3/d1e/d30/f94 4294047 0 2024-09-13T23:06:26.768 INFO:tasks.workunit.client.1.smithi152.stdout:4/776: creat d3/d4/d6/d8/d17/d5d/d94/d9b/de9/ffa x:0 0 0 2024-09-13T23:06:26.769 INFO:tasks.workunit.client.1.smithi152.stdout:9/736: rmdir d3/d24/d34 39 2024-09-13T23:06:26.769 INFO:tasks.workunit.client.1.smithi152.stdout:4/777: mknod d3/d4/d6/d8/cfb 0 2024-09-13T23:06:26.771 INFO:tasks.workunit.client.1.smithi152.stdout:9/737: rename d3/d52/lec to d3/db0/lf6 0 2024-09-13T23:06:26.772 INFO:tasks.workunit.client.1.smithi152.stdout:4/778: mkdir d3/d4/d6/d66/d1c/d5f/d8b/dfc 0 2024-09-13T23:06:26.772 INFO:tasks.workunit.client.1.smithi152.stdout:4/779: write d3/d4/d6/d66/d1c/d5f/d8b/fc5 [559968,37936] 0 2024-09-13T23:06:26.773 INFO:tasks.workunit.client.1.smithi152.stdout:9/738: creat d3/d24/d34/ff7 x:0 0 0 2024-09-13T23:06:26.778 INFO:tasks.workunit.client.1.smithi152.stdout:9/739: dread d3/d1e/f3c [0,4194304] 0 2024-09-13T23:06:26.778 INFO:tasks.workunit.client.1.smithi152.stdout:9/740: fdatasync d3/d24/f36 0 2024-09-13T23:06:26.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/741: read d3/d24/d67/d4a/f8d [2465314,82124] 0 2024-09-13T23:06:26.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/742: dread - d3/d24/d34/d45/daa/dbf/fdf zero size 2024-09-13T23:06:26.788 INFO:tasks.workunit.client.1.smithi152.stdout:9/743: dread - d3/d24/dac/ff5 zero size 2024-09-13T23:06:26.790 INFO:tasks.workunit.client.1.smithi152.stdout:9/744: dread d3/d24/d67/d60/f58 [0,4194304] 0 2024-09-13T23:06:26.790 INFO:tasks.workunit.client.1.smithi152.stdout:9/745: fdatasync d3/d24/d67/d60/de1/fe6 0 2024-09-13T23:06:26.791 INFO:tasks.workunit.client.1.smithi152.stdout:9/746: link d3/d52/d8c/fe0 d3/d24/d67/ff8 0 2024-09-13T23:06:26.793 INFO:tasks.workunit.client.1.smithi152.stdout:9/747: creat d3/d24/d67/d60/ff9 x:0 0 0 2024-09-13T23:06:26.793 INFO:tasks.workunit.client.1.smithi152.stdout:9/748: readlink d3/l99 0 2024-09-13T23:06:26.794 INFO:tasks.workunit.client.1.smithi152.stdout:5/630: dwrite d5/dc/d19/d65/f50 [0,4194304] 0 2024-09-13T23:06:26.795 INFO:tasks.workunit.client.1.smithi152.stdout:4/780: dwrite d3/d4/d6/d66/f88 [0,4194304] 0 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: pgmap v9: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 233 MiB/s rd, 299 MiB/s wr, 441 op/s 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:26 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:26.802 INFO:tasks.workunit.client.1.smithi152.stdout:5/631: symlink d5/dc/d19/d65/d70/ld6 0 2024-09-13T23:06:26.806 INFO:tasks.workunit.client.1.smithi152.stdout:4/781: link d3/d4/d6/d66/d1c/l8c d3/d4/d6/d8/dad/lfd 0 2024-09-13T23:06:26.809 INFO:tasks.workunit.client.1.smithi152.stdout:4/782: mknod d3/cfe 0 2024-09-13T23:06:26.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/783: write d3/d4/d6/d8/f71 [3570883,45650] 0 2024-09-13T23:06:26.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/784: creat d3/d4/d6/d66/d1c/d5f/d8b/fff x:0 0 0 2024-09-13T23:06:26.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/785: chown d3/d4/d6/d8/d17/d5d/d76/fee 651 1 2024-09-13T23:06:26.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/786: stat d3/d4/d32/ddb 0 2024-09-13T23:06:26.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/787: write d3/d4/d6/d66/d1c/d5f/d8b/fff [170278,9388] 0 2024-09-13T23:06:26.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/632: dwrite d5/dc/d19/d65/d99/da6/fb7 [0,4194304] 0 2024-09-13T23:06:26.852 INFO:tasks.workunit.client.1.smithi152.stdout:4/788: dwrite d3/d4/d6/d66/fce [0,4194304] 0 2024-09-13T23:06:26.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/633: dwrite d5/dc/da3/db4/f7d [0,4194304] 0 2024-09-13T23:06:26.853 INFO:tasks.workunit.client.1.smithi152.stdout:5/634: dread - d5/d26/fc9 zero size 2024-09-13T23:06:26.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/789: unlink d3/f4f 0 2024-09-13T23:06:26.857 INFO:tasks.workunit.client.1.smithi152.stdout:4/790: mknod d3/d4/d6/d63/c100 0 2024-09-13T23:06:26.857 INFO:tasks.workunit.client.1.smithi152.stdout:4/791: chown d3/d4/d6/d63/d79 657997469 1 2024-09-13T23:06:26.858 INFO:tasks.workunit.client.1.smithi152.stdout:4/792: link d3/d4/d8d/l9f d3/d4/d6/d8/d17/d5d/d94/d9b/de9/l101 0 2024-09-13T23:06:26.859 INFO:tasks.workunit.client.1.smithi152.stdout:4/793: truncate d3/f83 4792215 0 2024-09-13T23:06:26.859 INFO:tasks.workunit.client.1.smithi152.stdout:5/635: getdents d5/dc/d19/d65/d99/d98/dc2/d80 0 2024-09-13T23:06:26.860 INFO:tasks.workunit.client.1.smithi152.stdout:4/794: rename d3/d4/d6/d66/cb7 to d3/d4/d6/d66/d1c/d5f/d8b/c102 0 2024-09-13T23:06:26.862 INFO:tasks.workunit.client.1.smithi152.stdout:4/795: symlink d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/l103 0 2024-09-13T23:06:26.862 INFO:tasks.workunit.client.1.smithi152.stdout:4/796: stat d3/d4/d6/f54 0 2024-09-13T23:06:26.863 INFO:tasks.workunit.client.1.smithi152.stdout:5/636: symlink d5/dc/ld7 0 2024-09-13T23:06:26.863 INFO:tasks.workunit.client.1.smithi152.stdout:5/637: fsync d5/da/f58 0 2024-09-13T23:06:26.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/797: write d3/d4/d6/d66/d1c/f28 [403504,113785] 0 2024-09-13T23:06:26.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/798: write d3/d4/d6/d63/d79/fd7 [705618,57052] 0 2024-09-13T23:06:26.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/799: truncate d3/d34/f97 1358335 0 2024-09-13T23:06:26.874 INFO:tasks.workunit.client.1.smithi152.stdout:4/800: write d3/d4/d6/f4c [2193892,104204] 0 2024-09-13T23:06:26.874 INFO:tasks.workunit.client.1.smithi152.stdout:4/801: stat d3/d4/d6/d8/d17/d5d/d94/d9b/dc8 0 2024-09-13T23:06:26.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/802: mkdir d3/d4/d6/d8/d17/d5d/d76/d104 0 2024-09-13T23:06:26.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/803: truncate d3/d4/d6/d8/d17/d3a/fe3 832229 0 2024-09-13T23:06:26.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/804: rmdir d3/d4/d6/d66/d2b 39 2024-09-13T23:06:26.880 INFO:tasks.workunit.client.1.smithi152.stdout:5/638: dwrite d5/dc/da3/db4/db3/fcc [0,4194304] 0 2024-09-13T23:06:26.882 INFO:tasks.workunit.client.1.smithi152.stdout:5/639: mkdir d5/dc/d19/d65/d99/da6/dad/dd8 0 2024-09-13T23:06:26.886 INFO:tasks.workunit.client.1.smithi152.stdout:5/640: dread d5/dc/d19/d20/dab/fbd [0,4194304] 0 2024-09-13T23:06:26.888 INFO:tasks.workunit.client.1.smithi152.stdout:5/641: unlink d5/dc/d19/d65/d99/da6/f7c 0 2024-09-13T23:06:26.889 INFO:tasks.workunit.client.1.smithi152.stdout:5/642: symlink d5/d26/ld9 0 2024-09-13T23:06:26.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/643: creat d5/dc/d19/d20/d55/fda x:0 0 0 2024-09-13T23:06:26.910 INFO:tasks.workunit.client.1.smithi152.stdout:5/644: dwrite d5/f14 [0,4194304] 0 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: pgmap v9: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 233 MiB/s rd, 299 MiB/s wr, 441 op/s 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:26 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:27.115 INFO:tasks.workunit.client.1.smithi152.stdout:0/532: sync 2024-09-13T23:06:27.117 INFO:tasks.workunit.client.1.smithi152.stdout:0/533: truncate d18/d1f/d29/d3f/d4b/f57 3628681 0 2024-09-13T23:06:27.118 INFO:tasks.workunit.client.1.smithi152.stdout:0/534: rename d18/d1f/d39/f85 to d18/d19/fb9 0 2024-09-13T23:06:27.119 INFO:tasks.workunit.client.1.smithi152.stdout:0/535: rename d18/d1f/d39/fa6 to d18/d1f/d33/d90/fba 0 2024-09-13T23:06:27.120 INFO:tasks.workunit.client.1.smithi152.stdout:0/536: truncate d18/d19/d2c/f30 978781 0 2024-09-13T23:06:27.121 INFO:tasks.workunit.client.1.smithi152.stdout:0/537: creat d18/d1f/d29/fbb x:0 0 0 2024-09-13T23:06:27.123 INFO:tasks.workunit.client.1.smithi152.stdout:0/538: rename d18/d1f/c55 to d18/d1f/d29/d3f/d4b/d66/cbc 0 2024-09-13T23:06:27.123 INFO:tasks.workunit.client.1.smithi152.stdout:0/539: write d18/d1f/d33/f5a [491167,78659] 0 2024-09-13T23:06:27.130 INFO:tasks.workunit.client.1.smithi152.stdout:0/540: dread d18/d1f/d33/f5a [0,4194304] 0 2024-09-13T23:06:27.131 INFO:tasks.workunit.client.1.smithi152.stdout:0/541: mkdir d18/d1f/d29/d3f/d40/daa/dbd 0 2024-09-13T23:06:27.131 INFO:tasks.workunit.client.1.smithi152.stdout:0/542: dread - d18/d19/f81 zero size 2024-09-13T23:06:27.132 INFO:tasks.workunit.client.1.smithi152.stdout:0/543: link d18/f25 d18/d1f/d29/d4e/fbe 0 2024-09-13T23:06:27.133 INFO:tasks.workunit.client.1.smithi152.stdout:0/544: symlink d18/d1f/lbf 0 2024-09-13T23:06:27.133 INFO:tasks.workunit.client.1.smithi152.stdout:0/545: chown d18/d1f/d29/d2f/d3d/da1/ca2 1954303 1 2024-09-13T23:06:27.149 INFO:tasks.workunit.client.1.smithi152.stdout:0/546: dwrite d18/d19/d2c/f5d [0,4194304] 0 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:7/691: sync 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:3/534: sync 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:2/691: sync 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:6/624: sync 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/651: sync 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/652: chown d4/f90 6 1 2024-09-13T23:06:27.151 INFO:tasks.workunit.client.1.smithi152.stdout:3/535: chown de/d14/d47/f86 1490 1 2024-09-13T23:06:27.152 INFO:tasks.workunit.client.1.smithi152.stdout:0/547: creat d18/d1f/d29/d3f/d40/daa/dbd/fc0 x:0 0 0 2024-09-13T23:06:27.152 INFO:tasks.workunit.client.1.smithi152.stdout:0/548: fsync d18/d1f/d29/d3f/f5c 0 2024-09-13T23:06:27.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/692: mkdir d0/d4/d9/d18/d1e/d3c/d4d/ddc/dee 0 2024-09-13T23:06:27.153 INFO:tasks.workunit.client.1.smithi152.stdout:3/536: truncate de/d14/d47/d57/f64 1330164 0 2024-09-13T23:06:27.154 INFO:tasks.workunit.client.1.smithi152.stdout:3/537: truncate de/d14/d47/d57/d5d/d6e/f94 1482376 0 2024-09-13T23:06:27.154 INFO:tasks.workunit.client.1.smithi152.stdout:0/549: mkdir d18/d1f/d29/d3f/d4b/d66/d6a/dc1 0 2024-09-13T23:06:27.155 INFO:tasks.workunit.client.1.smithi152.stdout:6/625: rmdir d4/de/d1d 39 2024-09-13T23:06:27.156 INFO:tasks.workunit.client.1.smithi152.stdout:1/653: read d4/d9/d1a/f2e [1511530,2587] 0 2024-09-13T23:06:27.156 INFO:tasks.workunit.client.1.smithi152.stdout:2/693: rename d0/d4/d9/d18/d1e/d3c/l73 to d0/d4/d9/d16/d30/d9e/db5/lef 0 2024-09-13T23:06:27.156 INFO:tasks.workunit.client.1.smithi152.stdout:2/694: stat d0/d4/d9/cae 0 2024-09-13T23:06:27.158 INFO:tasks.workunit.client.1.smithi152.stdout:3/538: creat de/d1f/da2/fb6 x:0 0 0 2024-09-13T23:06:27.159 INFO:tasks.workunit.client.1.smithi152.stdout:0/550: symlink d18/d1f/d33/d6e/lc2 0 2024-09-13T23:06:27.162 INFO:tasks.workunit.client.1.smithi152.stdout:1/654: symlink d4/d47/le1 0 2024-09-13T23:06:27.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/695: mkdir d0/d4/d9/d14/df0 0 2024-09-13T23:06:27.164 INFO:tasks.workunit.client.1.smithi152.stdout:3/539: rename de/d14/d47/c5e to de/d14/d47/d70/d72/cb7 0 2024-09-13T23:06:27.165 INFO:tasks.workunit.client.1.smithi152.stdout:3/540: fdatasync de/f3e 0 2024-09-13T23:06:27.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/696: rename d0/d4/f93 to d0/d4/d9/d18/d1e/dc0/ff1 0 2024-09-13T23:06:27.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/697: creat d0/d4/d9/d16/d30/dba/ff2 x:0 0 0 2024-09-13T23:06:27.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/698: chown d0/c36 962492498 1 2024-09-13T23:06:27.177 INFO:tasks.workunit.client.1.smithi152.stdout:1/655: dread d4/d9/f2b [0,4194304] 0 2024-09-13T23:06:27.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/692: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/f62 [0,4194304] 0 2024-09-13T23:06:27.177 INFO:tasks.workunit.client.1.smithi152.stdout:7/693: dread - d17/d24/d9f/d51/d5b/d90/d2e/dd0/dda/fe5 zero size 2024-09-13T23:06:27.178 INFO:tasks.workunit.client.1.smithi152.stdout:7/694: fdatasync d17/d24/d9f/d51/d5b/d90/d2b/f3b 0 2024-09-13T23:06:27.179 INFO:tasks.workunit.client.1.smithi152.stdout:3/541: dread de/d14/f62 [0,4194304] 0 2024-09-13T23:06:27.179 INFO:tasks.workunit.client.1.smithi152.stdout:3/542: creat de/d1f/fb8 x:0 0 0 2024-09-13T23:06:27.179 INFO:tasks.workunit.client.1.smithi152.stdout:3/543: write de/d14/d47/d57/f69 [924880,10320] 0 2024-09-13T23:06:27.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/699: dread d0/d4/d9/d14/d48/d49/f79 [0,4194304] 0 2024-09-13T23:06:27.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/700: write d0/d4/d9/d18/dc1/fc6 [4816878,16562] 0 2024-09-13T23:06:27.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/701: write d0/d4/dca/fe6 [442757,82004] 0 2024-09-13T23:06:27.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/702: fdatasync d0/d4/d9/d18/d1e/d3c/f8e 0 2024-09-13T23:06:27.180 INFO:tasks.workunit.client.1.smithi152.stdout:3/544: mkdir de/d14/d38/db9 0 2024-09-13T23:06:27.181 INFO:tasks.workunit.client.1.smithi152.stdout:3/545: write de/d14/d47/d57/f80 [1060902,21763] 0 2024-09-13T23:06:27.181 INFO:tasks.workunit.client.1.smithi152.stdout:3/546: readlink de/d14/l59 0 2024-09-13T23:06:27.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/703: unlink d0/d4/d9/d16/d30/f59 0 2024-09-13T23:06:27.184 INFO:tasks.workunit.client.1.smithi152.stdout:2/704: rename d0/d4/d9/d55/d8f/f9a to d0/d4/d9/d18/d1e/d3c/ff3 0 2024-09-13T23:06:27.184 INFO:tasks.workunit.client.1.smithi152.stdout:2/705: chown d0/d4/d9/d16/d30/d9e 1 1 2024-09-13T23:06:27.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/656: write d4/d9/f12 [238256,67297] 0 2024-09-13T23:06:27.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/657: chown d4/d9/d1a/d22/d24/daa/fdd 0 1 2024-09-13T23:06:27.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/658: readlink d4/l7d 0 2024-09-13T23:06:27.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/659: symlink d4/d4c/d8d/d99/le2 0 2024-09-13T23:06:27.188 INFO:tasks.workunit.client.1.smithi152.stdout:1/660: truncate d4/d9/d1a/d22/d24/fc9 1740824 0 2024-09-13T23:06:27.188 INFO:tasks.workunit.client.1.smithi152.stdout:1/661: chown d4/d47/lb4 151107133 1 2024-09-13T23:06:27.190 INFO:tasks.workunit.client.1.smithi152.stdout:1/662: read d4/d9/d1a/d22/d24/d48/f4a [647663,102316] 0 2024-09-13T23:06:27.193 INFO:tasks.workunit.client.1.smithi152.stdout:1/663: link d4/fae d4/d47/fe3 0 2024-09-13T23:06:27.193 INFO:tasks.workunit.client.1.smithi152.stdout:7/695: read d17/d24/d9f/d51/d5b/d63/faa [687062,31419] 0 2024-09-13T23:06:27.193 INFO:tasks.workunit.client.1.smithi152.stdout:7/696: write d17/d24/d9f/d51/d5b/d90/d2e/d30/fe6 [834990,59308] 0 2024-09-13T23:06:27.193 INFO:tasks.workunit.client.1.smithi152.stdout:6/626: dwrite d4/de/d12/d16/d2a/f2d [4194304,4194304] 0 2024-09-13T23:06:27.193 INFO:tasks.workunit.client.1.smithi152.stdout:7/697: creat d17/d6c/fe8 x:0 0 0 2024-09-13T23:06:27.195 INFO:tasks.workunit.client.1.smithi152.stdout:2/706: write d0/d4/d9/d18/dc1/fc6 [2350018,59888] 0 2024-09-13T23:06:27.196 INFO:tasks.workunit.client.1.smithi152.stdout:7/698: mkdir d17/d24/d9f/d51/d5b/d90/d2e/d30/de9 0 2024-09-13T23:06:27.199 INFO:tasks.workunit.client.1.smithi152.stdout:6/627: mkdir d4/de/d12/d16/d2a/d3d/daa/daf/dcc 0 2024-09-13T23:06:27.199 INFO:tasks.workunit.client.1.smithi152.stdout:6/628: fsync d4/de/d12/d16/d2a/d38/d3c/f45 0 2024-09-13T23:06:27.199 INFO:tasks.workunit.client.1.smithi152.stdout:6/629: chown d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 11698432 1 2024-09-13T23:06:27.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/707: creat d0/ff4 x:0 0 0 2024-09-13T23:06:27.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/708: chown d0/d4/d9/d18/d1e/d3c/d88 1669985 1 2024-09-13T23:06:27.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/709: readlink d0/d4/d9/d18/d32/lcc 0 2024-09-13T23:06:27.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/710: creat d0/d4/d9/d16/dd7/ff5 x:0 0 0 2024-09-13T23:06:27.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/711: fdatasync d0/d4/d9/d18/d1e/dc0/fec 0 2024-09-13T23:06:27.201 INFO:tasks.workunit.client.1.smithi152.stdout:7/699: mknod d17/d24/d9f/d51/d5b/d90/d2e/d79/cea 0 2024-09-13T23:06:27.203 INFO:tasks.workunit.client.1.smithi152.stdout:6/630: creat d4/de/fcd x:0 0 0 2024-09-13T23:06:27.205 INFO:tasks.workunit.client.1.smithi152.stdout:6/631: mkdir d4/de/d1d/dce 0 2024-09-13T23:06:27.206 INFO:tasks.workunit.client.1.smithi152.stdout:6/632: truncate d4/de/d12/d16/d2a/f48 4478611 0 2024-09-13T23:06:27.210 INFO:tasks.workunit.client.1.smithi152.stdout:2/712: dread d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:27.211 INFO:tasks.workunit.client.1.smithi152.stdout:1/664: dwrite d4/f90 [0,4194304] 0 2024-09-13T23:06:27.211 INFO:tasks.workunit.client.1.smithi152.stdout:1/665: dread - d4/f75 zero size 2024-09-13T23:06:27.214 INFO:tasks.workunit.client.1.smithi152.stdout:1/666: creat d4/d9/d1a/d22/d24/fe4 x:0 0 0 2024-09-13T23:06:27.215 INFO:tasks.workunit.client.1.smithi152.stdout:1/667: truncate d4/d4c/d8d/f95 838163 0 2024-09-13T23:06:27.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/713: dread d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:27.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/714: creat d0/d4/d9/d18/dc1/ff6 x:0 0 0 2024-09-13T23:06:27.230 INFO:tasks.workunit.client.1.smithi152.stdout:7/700: dwrite d17/d24/f3c [4194304,4194304] 0 2024-09-13T23:06:27.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/701: mkdir d17/d24/d9f/d51/d5b/d87/dc7/deb 0 2024-09-13T23:06:27.232 INFO:tasks.workunit.client.1.smithi152.stdout:7/702: mknod d17/d24/d9f/d51/d5b/d87/dc7/deb/cec 0 2024-09-13T23:06:27.233 INFO:tasks.workunit.client.1.smithi152.stdout:7/703: mknod d17/d24/d9f/dac/dba/d85/ced 0 2024-09-13T23:06:27.233 INFO:tasks.workunit.client.1.smithi152.stdout:7/704: write d17/d24/d9f/d51/d5b/d90/d2e/d79/fc3 [560742,87012] 0 2024-09-13T23:06:27.233 INFO:tasks.workunit.client.1.smithi152.stdout:7/705: truncate d17/d24/d9f/d51/d5b/d90/d2e/fc8 208258 0 2024-09-13T23:06:27.234 INFO:tasks.workunit.client.1.smithi152.stdout:6/633: dwrite d4/f9 [0,4194304] 0 2024-09-13T23:06:27.234 INFO:tasks.workunit.client.1.smithi152.stdout:6/634: stat d4/c36 0 2024-09-13T23:06:27.234 INFO:tasks.workunit.client.1.smithi152.stdout:6/635: chown d4/de/f6c 11889 1 2024-09-13T23:06:27.234 INFO:tasks.workunit.client.1.smithi152.stdout:7/706: symlink d17/d24/d9f/d51/d5b/d90/lee 0 2024-09-13T23:06:27.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/715: dwrite d0/ff4 [0,4194304] 0 2024-09-13T23:06:27.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/716: readlink d0/d4/d9/d16/d99/ld0 0 2024-09-13T23:06:27.236 INFO:tasks.workunit.client.1.smithi152.stdout:6/636: mkdir d4/de/d12/d16/d2a/d3d/dcf 0 2024-09-13T23:06:27.236 INFO:tasks.workunit.client.1.smithi152.stdout:6/637: dread - d4/de/d12/d16/d2a/f90 zero size 2024-09-13T23:06:27.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/707: rename d17/d24/d9f/d51/d5b/d90/d2e/d30/de9 to d17/d24/d9f/d3f/def 0 2024-09-13T23:06:27.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/708: creat d17/d24/d9f/d51/d5b/d90/d2e/d30/ff0 x:0 0 0 2024-09-13T23:06:27.241 INFO:tasks.workunit.client.1.smithi152.stdout:7/709: write d17/d24/d9f/d51/d5b/d63/faa [2020616,87957] 0 2024-09-13T23:06:27.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/717: mkdir d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7 0 2024-09-13T23:06:27.241 INFO:tasks.workunit.client.1.smithi152.stdout:6/638: symlink d4/ld0 0 2024-09-13T23:06:27.246 INFO:tasks.workunit.client.1.smithi152.stdout:7/710: symlink d17/d24/d9f/d51/d5b/d90/d2e/d79/lf1 0 2024-09-13T23:06:27.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/718: rename d0/d4/d9/d16/l5d to d0/d4/d9/d55/lf8 0 2024-09-13T23:06:27.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/719: creat d0/d4/d9/d16/d30/dba/ff9 x:0 0 0 2024-09-13T23:06:27.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/720: write d0/d4/d9/f4b [1495828,43744] 0 2024-09-13T23:06:27.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/668: dwrite d4/f7 [0,4194304] 0 2024-09-13T23:06:27.254 INFO:tasks.workunit.client.1.smithi152.stdout:1/669: mkdir d4/d9/d1a/d22/d24/dde/de5 0 2024-09-13T23:06:27.255 INFO:tasks.workunit.client.1.smithi152.stdout:1/670: symlink d4/d47/d8b/le6 0 2024-09-13T23:06:27.255 INFO:tasks.workunit.client.1.smithi152.stdout:1/671: fdatasync d4/f6b 0 2024-09-13T23:06:27.255 INFO:tasks.workunit.client.1.smithi152.stdout:1/672: fdatasync d4/d9/fb 0 2024-09-13T23:06:27.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/673: creat d4/d9/d1a/d22/d24/dde/fe7 x:0 0 0 2024-09-13T23:06:27.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/674: chown d4/d9/d1a/d22/d24/daa/cb6 738 1 2024-09-13T23:06:27.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/675: readlink d4/d9/d1a/d22/l5c 0 2024-09-13T23:06:27.256 INFO:tasks.workunit.client.1.smithi152.stdout:1/676: truncate d4/d9/fb 719642 0 2024-09-13T23:06:27.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/711: write d17/f1a [710353,123488] 0 2024-09-13T23:06:27.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/712: creat d17/d4f/ff2 x:0 0 0 2024-09-13T23:06:27.260 INFO:tasks.workunit.client.1.smithi152.stdout:6/639: dwrite d4/de/d12/d3e/fa0 [0,4194304] 0 2024-09-13T23:06:27.260 INFO:tasks.workunit.client.1.smithi152.stdout:6/640: chown d4/de/d12/f28 2 1 2024-09-13T23:06:27.260 INFO:tasks.workunit.client.1.smithi152.stdout:7/713: truncate d17/d24/d9f/d51/d5b/d63/fae 1106475 0 2024-09-13T23:06:27.263 INFO:tasks.workunit.client.1.smithi152.stdout:7/714: symlink d17/d6c/dd1/lf3 0 2024-09-13T23:06:27.264 INFO:tasks.workunit.client.1.smithi152.stdout:7/715: mkdir d17/d24/d9f/d51/d5b/d63/df4 0 2024-09-13T23:06:27.264 INFO:tasks.workunit.client.1.smithi152.stdout:7/716: chown d17/d24/d9f/dac/dba/cb7 2 1 2024-09-13T23:06:27.264 INFO:tasks.workunit.client.1.smithi152.stdout:6/641: read d4/de/d21/f47 [3302005,96301] 0 2024-09-13T23:06:27.264 INFO:tasks.workunit.client.1.smithi152.stdout:7/717: mkdir d17/d4f/d84/df5 0 2024-09-13T23:06:27.265 INFO:tasks.workunit.client.1.smithi152.stdout:7/718: truncate d17/f23 1478330 0 2024-09-13T23:06:27.266 INFO:tasks.workunit.client.1.smithi152.stdout:7/719: truncate d17/d24/d9f/d46/f50 1993031 0 2024-09-13T23:06:27.266 INFO:tasks.workunit.client.1.smithi152.stdout:7/720: truncate d17/d24/d9f/d51/fc0 96246 0 2024-09-13T23:06:27.266 INFO:tasks.workunit.client.1.smithi152.stdout:7/721: dread - d17/d24/d9f/d51/d5b/d90/d2e/d79/fc5 zero size 2024-09-13T23:06:27.267 INFO:tasks.workunit.client.1.smithi152.stdout:7/722: write d17/d24/d9f/d51/d5b/d90/fa4 [8886996,64307] 0 2024-09-13T23:06:27.267 INFO:tasks.workunit.client.1.smithi152.stdout:7/723: readlink d17/d24/d9f/d51/d5b/d90/lee 0 2024-09-13T23:06:27.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/642: dread d4/de/f2c [0,4194304] 0 2024-09-13T23:06:27.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/643: dread d4/de/d12/f55 [0,4194304] 0 2024-09-13T23:06:27.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/644: dread d4/de/f39 [0,4194304] 0 2024-09-13T23:06:27.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/724: dwrite d17/d24/d9f/d51/d5b/d90/d2e/f76 [0,4194304] 0 2024-09-13T23:06:27.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/725: fdatasync d17/d24/d9f/fdf 0 2024-09-13T23:06:27.300 INFO:tasks.workunit.client.1.smithi152.stdout:1/677: dwrite d4/d9/d1a/f30 [0,4194304] 0 2024-09-13T23:06:27.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/678: dread d4/d9/d71/f89 [0,4194304] 0 2024-09-13T23:06:27.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/679: write d4/f93 [575409,61376] 0 2024-09-13T23:06:27.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/680: dread - d4/d4c/fd3 zero size 2024-09-13T23:06:27.314 INFO:tasks.workunit.client.1.smithi152.stdout:1/681: dread d4/d9/d1a/d22/d24/f6a [0,4194304] 0 2024-09-13T23:06:27.314 INFO:tasks.workunit.client.1.smithi152.stdout:1/682: dread - d4/f75 zero size 2024-09-13T23:06:27.314 INFO:tasks.workunit.client.1.smithi152.stdout:1/683: chown d4/d9/d1a/c42 375309800 1 2024-09-13T23:06:27.314 INFO:tasks.workunit.client.1.smithi152.stdout:1/684: fdatasync d4/d4c/d8d/fb5 0 2024-09-13T23:06:27.320 INFO:tasks.workunit.client.1.smithi152.stdout:6/645: dwrite d4/de/d12/f5f [0,4194304] 0 2024-09-13T23:06:27.320 INFO:tasks.workunit.client.1.smithi152.stdout:7/726: dwrite d17/d24/d9f/d51/d5b/d90/d2e/f32 [4194304,4194304] 0 2024-09-13T23:06:27.320 INFO:tasks.workunit.client.1.smithi152.stdout:6/646: dread - d4/de/d12/d3e/f8b zero size 2024-09-13T23:06:27.321 INFO:tasks.workunit.client.1.smithi152.stdout:7/727: stat d17/d24/d9f/d51/d5b/d90/d2e/d30/c7e 0 2024-09-13T23:06:27.321 INFO:tasks.workunit.client.1.smithi152.stdout:6/647: write d4/de/d1d/fbf [5012043,20352] 0 2024-09-13T23:06:27.321 INFO:tasks.workunit.client.1.smithi152.stdout:6/648: chown d4/de/c1e 45556 1 2024-09-13T23:06:27.321 INFO:tasks.workunit.client.1.smithi152.stdout:7/728: write d17/d24/d9f/d51/d5b/d90/d2e/d30/ff0 [192868,68505] 0 2024-09-13T23:06:27.321 INFO:tasks.workunit.client.1.smithi152.stdout:6/649: write d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fc1 [176479,58680] 0 2024-09-13T23:06:27.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/729: rename d17/d24/d9f/d3f/l68 to d17/d24/d9f/d51/d5b/d63/df4/lf6 0 2024-09-13T23:06:27.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/650: creat d4/de/d12/d16/d2a/d3d/daa/daf/fd1 x:0 0 0 2024-09-13T23:06:27.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/730: mknod d17/d24/d9f/d51/d5b/d63/df4/cf7 0 2024-09-13T23:06:27.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/731: write d17/d6c/fe8 [334777,89115] 0 2024-09-13T23:06:27.325 INFO:tasks.workunit.client.1.smithi152.stdout:7/732: fdatasync d17/d24/d9f/d51/d5b/d90/d2e/d30/f53 0 2024-09-13T23:06:27.326 INFO:tasks.workunit.client.1.smithi152.stdout:6/651: symlink d4/de/d21/d5c/dc9/ld2 0 2024-09-13T23:06:27.326 INFO:tasks.workunit.client.1.smithi152.stdout:6/652: stat d4/f75 0 2024-09-13T23:06:27.326 INFO:tasks.workunit.client.1.smithi152.stdout:6/653: readlink l2 0 2024-09-13T23:06:27.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/733: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/ff8 x:0 0 0 2024-09-13T23:06:27.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/734: read d17/d24/d9f/d51/d5b/d90/d2e/f32 [2274816,68445] 0 2024-09-13T23:06:27.329 INFO:tasks.workunit.client.1.smithi152.stdout:7/735: creat d17/d24/d9f/d3f/def/ff9 x:0 0 0 2024-09-13T23:06:27.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/685: dwrite d4/d47/f88 [0,4194304] 0 2024-09-13T23:06:27.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/736: unlink d17/d24/d9f/d51/d5b/d63/l93 0 2024-09-13T23:06:27.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/737: fdatasync d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/f80 0 2024-09-13T23:06:27.333 INFO:tasks.workunit.client.1.smithi152.stdout:1/686: mkdir d4/d4c/de8 0 2024-09-13T23:06:27.341 INFO:tasks.workunit.client.1.smithi152.stdout:7/738: dread d17/d24/d9f/fdf [0,4194304] 0 2024-09-13T23:06:27.342 INFO:tasks.workunit.client.1.smithi152.stdout:7/739: mknod d17/d24/d9f/cfa 0 2024-09-13T23:06:27.342 INFO:tasks.workunit.client.1.smithi152.stdout:7/740: dread - d17/d24/d9f/d51/d5b/d90/d2b/fd4 zero size 2024-09-13T23:06:27.345 INFO:tasks.workunit.client.1.smithi152.stdout:1/687: dwrite d4/d47/d8b/f8f [0,4194304] 0 2024-09-13T23:06:27.347 INFO:tasks.workunit.client.1.smithi152.stdout:1/688: mknod d4/d9/d1a/d22/d24/d48/ce9 0 2024-09-13T23:06:27.347 INFO:tasks.workunit.client.1.smithi152.stdout:1/689: dread - d4/fcc zero size 2024-09-13T23:06:27.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/690: rmdir d4/d9/d1a/d22/d24/dde 39 2024-09-13T23:06:27.348 INFO:tasks.workunit.client.1.smithi152.stdout:1/691: truncate d4/d47/fdc 582064 0 2024-09-13T23:06:27.356 INFO:tasks.workunit.client.1.smithi152.stdout:7/741: dwrite d17/d24/d9f/d51/d5b/d90/fa4 [0,4194304] 0 2024-09-13T23:06:27.376 INFO:tasks.workunit.client.1.smithi152.stdout:1/692: dwrite d4/d9/d1a/d22/d24/daa/fdd [0,4194304] 0 2024-09-13T23:06:27.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/742: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b [0,4194304] 0 2024-09-13T23:06:27.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/693: creat d4/d9/d1a/d22/fea x:0 0 0 2024-09-13T23:06:27.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/694: stat d4/d9/d1a/l39 0 2024-09-13T23:06:27.380 INFO:tasks.workunit.client.1.smithi152.stdout:7/743: symlink d17/d24/d9f/d46/lfb 0 2024-09-13T23:06:27.381 INFO:tasks.workunit.client.1.smithi152.stdout:1/695: mknod d4/d9/d1a/d22/d24/d48/dc4/ceb 0 2024-09-13T23:06:27.382 INFO:tasks.workunit.client.1.smithi152.stdout:7/744: mknod d17/d24/d9f/d51/cfc 0 2024-09-13T23:06:27.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/696: mkdir d4/d9/d1a/d22/dec 0 2024-09-13T23:06:27.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/697: fsync d4/d4c/db1/fb8 0 2024-09-13T23:06:27.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/698: chown d4/d9/d1a/d22/d24/c4b 226478 1 2024-09-13T23:06:27.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/699: chown d4/d9/d1a/d22/ld2 1868 1 2024-09-13T23:06:27.385 INFO:tasks.workunit.client.1.smithi152.stdout:7/745: rename d17/d24/d9f/cfa to d17/d4f/cfd 0 2024-09-13T23:06:27.386 INFO:tasks.workunit.client.1.smithi152.stdout:7/746: mkdir d17/d24/d9f/d51/d5b/d90/dfe 0 2024-09-13T23:06:27.387 INFO:tasks.workunit.client.1.smithi152.stdout:7/747: truncate d17/fb4 1041185 0 2024-09-13T23:06:27.388 INFO:tasks.workunit.client.1.smithi152.stdout:7/748: link d17/d24/d9f/d51/d5b/d90/d2e/d30/fde d17/d24/d9f/dac/dba/fff 0 2024-09-13T23:06:27.388 INFO:tasks.workunit.client.1.smithi152.stdout:7/749: stat d17/d24/d9f/d51/d5b/d90/d2e/d79/cbb 0 2024-09-13T23:06:27.389 INFO:tasks.workunit.client.1.smithi152.stdout:7/750: creat d17/d24/d9f/d3f/def/f100 x:0 0 0 2024-09-13T23:06:27.389 INFO:tasks.workunit.client.1.smithi152.stdout:7/751: creat d17/d24/d9f/d51/d5b/d63/f101 x:0 0 0 2024-09-13T23:06:27.391 INFO:tasks.workunit.client.1.smithi152.stdout:7/752: mknod d17/d24/d9f/d51/d5b/d90/d2b/d4b/c102 0 2024-09-13T23:06:27.391 INFO:tasks.workunit.client.1.smithi152.stdout:7/753: readlink d17/d24/d9f/d51/d5b/d90/d2e/d30/l8c 0 2024-09-13T23:06:27.392 INFO:tasks.workunit.client.1.smithi152.stdout:7/754: mknod d17/d24/c103 0 2024-09-13T23:06:27.392 INFO:tasks.workunit.client.1.smithi152.stdout:7/755: symlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/l104 0 2024-09-13T23:06:27.399 INFO:tasks.workunit.client.1.smithi152.stdout:1/700: dwrite d4/d9/f12 [4194304,4194304] 0 2024-09-13T23:06:27.400 INFO:tasks.workunit.client.1.smithi152.stdout:1/701: mknod d4/d47/ced 0 2024-09-13T23:06:27.400 INFO:tasks.workunit.client.1.smithi152.stdout:1/702: getdents d4/d9/d1a 0 2024-09-13T23:06:27.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/756: dread d17/d24/d9f/d51/d5b/d90/d2b/f49 [0,4194304] 0 2024-09-13T23:06:27.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/703: mknod d4/d9/d71/cee 0 2024-09-13T23:06:27.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/704: write d4/f26 [1520736,54938] 0 2024-09-13T23:06:27.403 INFO:tasks.workunit.client.1.smithi152.stdout:1/705: dread d4/d9/d1a/d22/d24/f56 [0,4194304] 0 2024-09-13T23:06:27.405 INFO:tasks.workunit.client.1.smithi152.stdout:7/757: getdents d17/d4f 0 2024-09-13T23:06:27.405 INFO:tasks.workunit.client.1.smithi152.stdout:7/758: readlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/lce 0 2024-09-13T23:06:27.405 INFO:tasks.workunit.client.1.smithi152.stdout:7/759: fdatasync d17/d4f/fbf 0 2024-09-13T23:06:27.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/760: getdents d17/d24/d9f/d51/d5b/d90/d2e/d30 0 2024-09-13T23:06:27.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/761: readlink d17/d24/d9f/l3e 0 2024-09-13T23:06:27.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/762: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/db3/f105 x:0 0 0 2024-09-13T23:06:27.409 INFO:tasks.workunit.client.1.smithi152.stdout:7/763: chown d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/fc2 21339389 1 2024-09-13T23:06:27.411 INFO:tasks.workunit.client.1.smithi152.stdout:1/706: write d4/d4c/d8d/fb7 [759832,17758] 0 2024-09-13T23:06:27.413 INFO:tasks.workunit.client.1.smithi152.stdout:1/707: symlink d4/d9/d1a/d22/d24/daa/lef 0 2024-09-13T23:06:27.414 INFO:tasks.workunit.client.1.smithi152.stdout:1/708: rename d4/d47/le1 to d4/d9/d1a/lf0 0 2024-09-13T23:06:27.421 INFO:tasks.workunit.client.1.smithi152.stdout:1/709: unlink d4/d9/f14 0 2024-09-13T23:06:27.421 INFO:tasks.workunit.client.1.smithi152.stdout:1/710: write d4/d47/f88 [4393247,63372] 0 2024-09-13T23:06:27.421 INFO:tasks.workunit.client.1.smithi152.stdout:1/711: creat d4/ff1 x:0 0 0 2024-09-13T23:06:27.425 INFO:tasks.workunit.client.1.smithi152.stdout:1/712: rename d4/d9/d1a/fa4 to d4/d47/d8b/ff2 0 2024-09-13T23:06:27.425 INFO:tasks.workunit.client.1.smithi152.stdout:1/713: chown d4/d4c/d8d/d99/cbd 9 1 2024-09-13T23:06:27.426 INFO:tasks.workunit.client.1.smithi152.stdout:7/764: dwrite d17/d24/d9f/d51/f70 [0,4194304] 0 2024-09-13T23:06:27.428 INFO:tasks.workunit.client.1.smithi152.stdout:1/714: dread d4/d47/d8b/fca [0,4194304] 0 2024-09-13T23:06:27.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/715: rename d4/d9/d1a/d22/d24/f7f to d4/d4c/ff3 0 2024-09-13T23:06:27.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/716: chown d4/d9/d1a/c43 5451 1 2024-09-13T23:06:27.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/717: readlink d4/d9/d1a/d22/d24/d48/l9c 0 2024-09-13T23:06:27.440 INFO:tasks.workunit.client.1.smithi152.stdout:1/718: dread f1 [0,4194304] 0 2024-09-13T23:06:27.441 INFO:tasks.workunit.client.1.smithi152.stdout:1/719: mkdir d4/d9/d1a/d22/d24/dde/df4 0 2024-09-13T23:06:27.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/720: symlink d4/d9/d71/lf5 0 2024-09-13T23:06:27.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/721: fsync d4/d4c/db1/fd5 0 2024-09-13T23:06:27.443 INFO:tasks.workunit.client.1.smithi152.stdout:7/765: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f6d [0,4194304] 0 2024-09-13T23:06:27.444 INFO:tasks.workunit.client.1.smithi152.stdout:1/722: rmdir d4/d9/d1a/d22/dec 0 2024-09-13T23:06:27.445 INFO:tasks.workunit.client.1.smithi152.stdout:1/723: mknod d4/d47/dcd/cf6 0 2024-09-13T23:06:27.446 INFO:tasks.workunit.client.1.smithi152.stdout:1/724: link d4/d4c/f54 d4/d9/d1a/d22/d24/dde/df4/ff7 0 2024-09-13T23:06:27.446 INFO:tasks.workunit.client.1.smithi152.stdout:1/725: write d4/d4c/db1/fd5 [764332,87468] 0 2024-09-13T23:06:27.448 INFO:tasks.workunit.client.1.smithi152.stdout:1/726: getdents d4/d9/d1a/d22/d24/daa 0 2024-09-13T23:06:27.448 INFO:tasks.workunit.client.1.smithi152.stdout:1/727: stat d4/d9/d71/fa2 0 2024-09-13T23:06:27.448 INFO:tasks.workunit.client.1.smithi152.stdout:1/728: truncate d4/d9/d71/fbe 864001 0 2024-09-13T23:06:27.455 INFO:tasks.workunit.client.1.smithi152.stdout:7/766: read d17/d6c/f88 [3365938,51504] 0 2024-09-13T23:06:27.458 INFO:tasks.workunit.client.1.smithi152.stdout:7/767: rmdir d17/d24/d9f/d51/d5b/d90/db2 0 2024-09-13T23:06:27.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/768: unlink d17/d24/d9f/d51/d5b/d90/lee 0 2024-09-13T23:06:27.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/769: readlink d17/d24/d9f/d51/d5b/d90/d2e/d79/l9c 0 2024-09-13T23:06:27.461 INFO:tasks.workunit.client.1.smithi152.stdout:7/770: rename d17/d24/d9f/d51/d5b/d87/dc7/deb/cec to d17/d4f/d84/c106 0 2024-09-13T23:06:27.461 INFO:tasks.workunit.client.1.smithi152.stdout:7/771: mkdir d17/d4f/d84/d107 0 2024-09-13T23:06:27.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/772: rmdir d17/d24/d9f/d51/d5b/d90/d2e/dd0/dda 39 2024-09-13T23:06:27.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/773: fdatasync d17/d24/d9f/d3f/def/ff9 0 2024-09-13T23:06:27.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/774: creat d17/d24/d9f/d51/d5b/d63/df4/f108 x:0 0 0 2024-09-13T23:06:27.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/775: rename d17/d24/d9f/d51/d5b/d90/d2e/dd0 to d17/d24/d109 0 2024-09-13T23:06:27.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/776: dread - d17/d24/d9f/d3f/fe3 zero size 2024-09-13T23:06:27.465 INFO:tasks.workunit.client.1.smithi152.stdout:7/777: fsync d17/d24/d9f/d51/d5b/d90/d2e/d79/fc3 0 2024-09-13T23:06:27.468 INFO:tasks.workunit.client.1.smithi152.stdout:1/729: dwrite d4/ff1 [0,4194304] 0 2024-09-13T23:06:27.470 INFO:tasks.workunit.client.1.smithi152.stdout:1/730: mknod d4/d47/cf8 0 2024-09-13T23:06:27.472 INFO:tasks.workunit.client.1.smithi152.stdout:1/731: dread d4/d9/fd [0,4194304] 0 2024-09-13T23:06:27.473 INFO:tasks.workunit.client.1.smithi152.stdout:1/732: write d4/d9/d1a/d22/d24/d48/f4a [1653621,67114] 0 2024-09-13T23:06:27.473 INFO:tasks.workunit.client.1.smithi152.stdout:1/733: truncate d4/dc8/fd9 162280 0 2024-09-13T23:06:27.495 INFO:tasks.workunit.client.1.smithi152.stdout:7/778: dwrite d17/d24/d9f/d51/d5b/d63/df4/f108 [0,4194304] 0 2024-09-13T23:06:27.495 INFO:tasks.workunit.client.1.smithi152.stdout:7/779: readlink d17/d24/d9f/d51/l65 0 2024-09-13T23:06:27.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/734: dwrite d4/d47/d8b/ff2 [0,4194304] 0 2024-09-13T23:06:27.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/735: stat d4/d9/d1a/d22/d24/fe4 0 2024-09-13T23:06:27.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/736: getdents d4/d4c/de8 0 2024-09-13T23:06:27.498 INFO:tasks.workunit.client.1.smithi152.stdout:7/780: rmdir d17/d24/d9f/d51/d5b/d63 39 2024-09-13T23:06:27.499 INFO:tasks.workunit.client.1.smithi152.stdout:7/781: creat d17/d24/d109/dda/f10a x:0 0 0 2024-09-13T23:06:27.501 INFO:tasks.workunit.client.1.smithi152.stdout:7/782: mkdir d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d10b 0 2024-09-13T23:06:27.502 INFO:tasks.workunit.client.1.smithi152.stdout:7/783: mknod d17/d24/d9f/d51/d5b/d90/c10c 0 2024-09-13T23:06:27.512 INFO:tasks.workunit.client.1.smithi152.stdout:1/737: dwrite d4/d9/d1a/d22/d24/d48/f76 [0,4194304] 0 2024-09-13T23:06:27.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/738: creat d4/d9/d71/ff9 x:0 0 0 2024-09-13T23:06:27.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/739: dread - d4/d4c/db1/fc7 zero size 2024-09-13T23:06:27.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/740: fsync d4/d9/d1a/d22/d24/fe4 0 2024-09-13T23:06:27.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/741: mknod d4/d47/d8b/cfa 0 2024-09-13T23:06:27.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/742: write d4/d4c/db1/fc7 [812658,106053] 0 2024-09-13T23:06:27.515 INFO:tasks.workunit.client.1.smithi152.stdout:1/743: rename d4/d9/fb3 to d4/d9/ffb 0 2024-09-13T23:06:27.517 INFO:tasks.workunit.client.1.smithi152.stdout:1/744: link d4/d9/d1a/d22/d24/f52 d4/d4c/db1/ffc 0 2024-09-13T23:06:27.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/745: getdents d4/d4c/db1 0 2024-09-13T23:06:27.522 INFO:tasks.workunit.client.1.smithi152.stdout:1/746: rename d4/d4c/c5a to d4/d9/d1a/d22/d24/dde/cfd 0 2024-09-13T23:06:27.522 INFO:tasks.workunit.client.1.smithi152.stdout:1/747: creat d4/d47/d8b/ffe x:0 0 0 2024-09-13T23:06:27.523 INFO:tasks.workunit.client.1.smithi152.stdout:1/748: link d4/d9/d1a/d22/l4d d4/d47/dcd/lff 0 2024-09-13T23:06:27.524 INFO:tasks.workunit.client.1.smithi152.stdout:1/749: link d4/d4c/d8d/d99/fa6 d4/f100 0 2024-09-13T23:06:27.525 INFO:tasks.workunit.client.1.smithi152.stdout:1/750: symlink d4/d4c/l101 0 2024-09-13T23:06:27.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/751: unlink d4/d9/d1a/d22/d24/daa/fd4 0 2024-09-13T23:06:27.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/752: link d4/d4c/d8d/fb7 d4/d4c/db1/f102 0 2024-09-13T23:06:27.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/753: chown d4/d9/d1a/d22/d24/d48/dc4 787 1 2024-09-13T23:06:27.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/754: chown d4/f26 63063577 1 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/755: rmdir d4/dc8 39 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/756: fsync d4/d9/ffb 0 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/757: chown d4/d9/d1a/d22/l3e 3353083 1 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/758: getdents d4/dc8 0 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/759: creat d4/d4c/d8d/d99/f103 x:0 0 0 2024-09-13T23:06:27.528 INFO:tasks.workunit.client.1.smithi152.stdout:1/760: write d4/f72 [806947,49354] 0 2024-09-13T23:06:27.530 INFO:tasks.workunit.client.1.smithi152.stdout:1/761: mkdir d4/d4c/d8d/d99/d104 0 2024-09-13T23:06:27.531 INFO:tasks.workunit.client.1.smithi152.stdout:1/762: chown d4/d4c/l6c 1423 1 2024-09-13T23:06:27.537 INFO:tasks.workunit.client.1.smithi152.stdout:1/763: rmdir d4/d9 39 2024-09-13T23:06:27.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/764: dread d4/d47/f8e [0,4194304] 0 2024-09-13T23:06:27.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/765: write d4/d47/f8e [689852,7830] 0 2024-09-13T23:06:27.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/766: mkdir d4/d9/d1a/d22/d24/d105 0 2024-09-13T23:06:27.540 INFO:tasks.workunit.client.1.smithi152.stdout:1/767: getdents d4/d47/dcd 0 2024-09-13T23:06:27.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/768: read d4/d9/fc2 [1678033,27130] 0 2024-09-13T23:06:27.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/769: truncate d4/d9/d1a/d22/d24/dde/fe7 268010 0 2024-09-13T23:06:27.547 INFO:tasks.workunit.client.1.smithi152.stdout:1/770: truncate d4/d9/d71/fbe 891866 0 2024-09-13T23:06:27.548 INFO:tasks.workunit.client.1.smithi152.stdout:1/771: dread d4/d4c/d8d/f95 [0,4194304] 0 2024-09-13T23:06:27.550 INFO:tasks.workunit.client.1.smithi152.stdout:1/772: creat d4/d4c/d8d/d99/d104/f106 x:0 0 0 2024-09-13T23:06:27.567 INFO:tasks.workunit.client.1.smithi152.stdout:1/773: dwrite d4/d4c/d8d/d99/fa6 [0,4194304] 0 2024-09-13T23:06:27.570 INFO:tasks.workunit.client.1.smithi152.stdout:1/774: symlink d4/d4c/l107 0 2024-09-13T23:06:27.575 INFO:tasks.workunit.client.1.smithi152.stdout:1/775: write d4/f90 [175723,95998] 0 2024-09-13T23:06:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:27 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi115 to 1557M 2024-09-13T23:06:27.795 INFO:tasks.workunit.client.1.smithi152.stdout:8/530: sync 2024-09-13T23:06:27.796 INFO:tasks.workunit.client.1.smithi152.stdout:9/749: sync 2024-09-13T23:06:27.797 INFO:tasks.workunit.client.1.smithi152.stdout:8/531: symlink d17/d25/d32/d50/la4 0 2024-09-13T23:06:27.797 INFO:tasks.workunit.client.1.smithi152.stdout:8/532: chown d17/d25/d32/d9a/f67 43125966 1 2024-09-13T23:06:27.798 INFO:tasks.workunit.client.1.smithi152.stdout:9/750: mknod d3/d24/d67/d60/cfa 0 2024-09-13T23:06:27.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:27 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi115 to 1557M 2024-09-13T23:06:27.799 INFO:tasks.workunit.client.1.smithi152.stdout:9/751: rmdir d3/d24/d34/dd2 0 2024-09-13T23:06:27.800 INFO:tasks.workunit.client.1.smithi152.stdout:9/752: link d3/d24/l44 d3/d24/lfb 0 2024-09-13T23:06:27.802 INFO:tasks.workunit.client.1.smithi152.stdout:9/753: mknod d3/d24/d67/d4a/d8e/cfc 0 2024-09-13T23:06:27.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/754: dwrite d3/d24/d67/d60/f69 [0,4194304] 0 2024-09-13T23:06:27.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/755: write d3/d24/d34/d45/f9a [974756,93114] 0 2024-09-13T23:06:27.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/756: mknod d3/d24/d67/d4a/d8e/cfd 0 2024-09-13T23:06:27.826 INFO:tasks.workunit.client.1.smithi152.stdout:9/757: rename d3/d52/d8c to d3/d1e/d30/dfe 0 2024-09-13T23:06:27.829 INFO:tasks.workunit.client.1.smithi152.stdout:9/758: rename d3/d24/d34/lea to d3/d24/d67/d47/de7/lff 0 2024-09-13T23:06:27.829 INFO:tasks.workunit.client.1.smithi152.stdout:9/759: dread - d3/d24/d67/d4a/d8e/fdc zero size 2024-09-13T23:06:27.834 INFO:tasks.workunit.client.1.smithi152.stdout:9/760: getdents d3/d24/d67/d60 0 2024-09-13T23:06:27.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/761: symlink d3/d24/d67/d4a/d8e/l100 0 2024-09-13T23:06:27.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/762: dwrite d3/d52/f83 [0,4194304] 0 2024-09-13T23:06:27.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/763: read d3/d1e/f3c [62032,65197] 0 2024-09-13T23:06:27.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/764: write d3/d1e/d30/dfe/fa2 [747240,50883] 0 2024-09-13T23:06:27.862 INFO:tasks.workunit.client.1.smithi152.stdout:9/765: chown d3/d24/d67/d60/ce4 79 1 2024-09-13T23:06:27.867 INFO:tasks.workunit.client.1.smithi152.stdout:9/766: dread d3/f4f [0,4194304] 0 2024-09-13T23:06:27.868 INFO:tasks.workunit.client.1.smithi152.stdout:9/767: symlink d3/d1e/d30/d5d/da3/l101 0 2024-09-13T23:06:27.886 INFO:tasks.workunit.client.1.smithi152.stdout:9/768: dwrite d3/ff [0,4194304] 0 2024-09-13T23:06:27.886 INFO:tasks.workunit.client.1.smithi152.stdout:9/769: read d3/d1e/f3c [109355,130659] 0 2024-09-13T23:06:27.886 INFO:tasks.workunit.client.1.smithi152.stdout:9/770: creat d3/d24/d34/f102 x:0 0 0 2024-09-13T23:06:28.174 INFO:tasks.workunit.client.1.smithi152.stdout:7/784: sync 2024-09-13T23:06:28.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/654: sync 2024-09-13T23:06:28.174 INFO:tasks.workunit.client.1.smithi152.stdout:4/805: sync 2024-09-13T23:06:28.174 INFO:tasks.workunit.client.1.smithi152.stdout:1/776: sync 2024-09-13T23:06:28.174 INFO:tasks.workunit.client.1.smithi152.stdout:3/547: sync 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:2/721: sync 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:1/777: fdatasync d4/d47/fe3 0 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:0/551: sync 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:2/722: rename d0/d4/d9 to d0/d4/d9/d55/d8f/dfa 22 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/806: write d3/d4/d32/fc2 [623347,112190] 0 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:5/645: sync 2024-09-13T23:06:28.175 INFO:tasks.workunit.client.1.smithi152.stdout:5/646: fdatasync d5/f3f 0 2024-09-13T23:06:28.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/785: mknod d17/d24/d9f/d51/d5b/d90/dfe/c10d 0 2024-09-13T23:06:28.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/786: chown d17/d24/d9f/d51/d5b/d90/d2b/c6f 243081565 1 2024-09-13T23:06:28.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/787: chown d17/d24/d9f/d51/d5b/d90/d2b/c6f 151982 1 2024-09-13T23:06:28.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/655: symlink d4/de/d12/d16/d2a/d3d/daa/daf/dcc/ld3 0 2024-09-13T23:06:28.177 INFO:tasks.workunit.client.1.smithi152.stdout:3/548: unlink de/d14/d47/l9a 0 2024-09-13T23:06:28.177 INFO:tasks.workunit.client.1.smithi152.stdout:3/549: write de/d14/d47/d57/d5d/fad [714170,105492] 0 2024-09-13T23:06:28.178 INFO:tasks.workunit.client.1.smithi152.stdout:1/778: rename d4/d9/d1a/c18 to d4/d9/d1a/d22/d24/dde/df4/c108 0 2024-09-13T23:06:28.180 INFO:tasks.workunit.client.1.smithi152.stdout:0/552: mknod d18/cc3 0 2024-09-13T23:06:28.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/723: mknod d0/d4/d9/d16/d9f/cfb 0 2024-09-13T23:06:28.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/647: link d5/dc/d19/d20/d55/ca2 d5/dc/da3/db4/db3/cdb 0 2024-09-13T23:06:28.186 INFO:tasks.workunit.client.1.smithi152.stdout:3/550: dread de/f1e [0,4194304] 0 2024-09-13T23:06:28.186 INFO:tasks.workunit.client.1.smithi152.stdout:3/551: write de/f17 [4915611,54367] 0 2024-09-13T23:06:28.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/779: dread d4/d9/d1a/f19 [0,4194304] 0 2024-09-13T23:06:28.190 INFO:tasks.workunit.client.1.smithi152.stdout:6/656: rename d4/c17 to d4/de/d1d/dce/cd4 0 2024-09-13T23:06:28.190 INFO:tasks.workunit.client.1.smithi152.stdout:2/724: symlink d0/d4/d9/d16/d30/dc7/lfc 0 2024-09-13T23:06:28.191 INFO:tasks.workunit.client.1.smithi152.stdout:3/552: rmdir de/d14/d47/d57/d99 39 2024-09-13T23:06:28.192 INFO:tasks.workunit.client.1.smithi152.stdout:0/553: dread d18/d1f/d33/d65/f7b [0,4194304] 0 2024-09-13T23:06:28.194 INFO:tasks.workunit.client.1.smithi152.stdout:6/657: mknod d4/de/d12/d16/d2a/d3d/dcf/cd5 0 2024-09-13T23:06:28.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/725: mknod d0/d4/d9/d16/d30/d94/cfd 0 2024-09-13T23:06:28.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/726: truncate d0/d4/d9/d16/d30/fa3 164559 0 2024-09-13T23:06:28.197 INFO:tasks.workunit.client.1.smithi152.stdout:5/648: mkdir d5/dc/d19/d65/d99/d98/da0/dc1/ddc 0 2024-09-13T23:06:28.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/553: truncate de/f39 299727 0 2024-09-13T23:06:28.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/554: chown de/d14 3457781 1 2024-09-13T23:06:28.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/555: write de/d14/d47/d57/d5d/fb3 [352379,24540] 0 2024-09-13T23:06:28.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/556: readlink de/l61 0 2024-09-13T23:06:28.201 INFO:tasks.workunit.client.1.smithi152.stdout:2/727: rename d0/d4/d9/d18/d1e/fe0 to d0/d4/d9/d18/d1e/d3c/d4d/ddc/ffe 0 2024-09-13T23:06:28.204 INFO:tasks.workunit.client.1.smithi152.stdout:2/728: creat d0/d4/d9/d14/fff x:0 0 0 2024-09-13T23:06:28.205 INFO:tasks.workunit.client.1.smithi152.stdout:0/554: dread d18/f25 [0,4194304] 0 2024-09-13T23:06:28.206 INFO:tasks.workunit.client.1.smithi152.stdout:2/729: rename d0/d4/d9/d18/d1e/d8c/fdf to d0/d4/d9/d16/d30/d94/f100 0 2024-09-13T23:06:28.206 INFO:tasks.workunit.client.1.smithi152.stdout:2/730: stat d0/d4/d9/d18/d1e/d3c/ff3 0 2024-09-13T23:06:28.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/731: mknod d0/d4/d9/d16/d30/dde/c101 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/807: dwrite d3/d4/d6/d66/f6f [4194304,4194304] 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/555: rmdir d18/d1f/d33 39 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/556: getdents d18/d1f/d29/d3f/d4b/d66/d6a/dc1 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/557: write d18/d1f/d29/d3f/d4b/f57 [3270711,44212] 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/558: truncate d18/d19/f67 4816805 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/658: read d4/de/d12/d16/f69 [1719973,33118] 0 2024-09-13T23:06:28.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/659: fsync d4/de/d12/d16/d2a/d38/f42 0 2024-09-13T23:06:28.212 INFO:tasks.workunit.client.1.smithi152.stdout:4/808: rename d3/d4/d6/d66/dd6/le1 to d3/d4/d6/d66/d1c/d59/l105 0 2024-09-13T23:06:28.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/559: dread d18/d1f/f34 [0,4194304] 0 2024-09-13T23:06:28.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/560: stat d18/d1f/d33/d65/d7a/d83 0 2024-09-13T23:06:28.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/561: readlink d18/d1f/d29/d3f/d4b/d66/d6a/d9f/lb0 0 2024-09-13T23:06:28.214 INFO:tasks.workunit.client.1.smithi152.stdout:4/809: creat d3/d4/d6/d66/d1c/d59/f106 x:0 0 0 2024-09-13T23:06:28.214 INFO:tasks.workunit.client.1.smithi152.stdout:4/810: write d3/f40 [4315779,122229] 0 2024-09-13T23:06:28.214 INFO:tasks.workunit.client.1.smithi152.stdout:7/788: dwrite d17/d24/d9f/d51/f97 [0,4194304] 0 2024-09-13T23:06:28.216 INFO:tasks.workunit.client.1.smithi152.stdout:4/811: creat d3/d4/d6/d8/d17/d5d/dde/f107 x:0 0 0 2024-09-13T23:06:28.216 INFO:tasks.workunit.client.1.smithi152.stdout:6/660: dread d4/de/d1d/f37 [0,4194304] 0 2024-09-13T23:06:28.216 INFO:tasks.workunit.client.1.smithi152.stdout:7/789: mkdir d17/d4f/d84/dd9/d10e 0 2024-09-13T23:06:28.217 INFO:tasks.workunit.client.1.smithi152.stdout:4/812: rename d3/d4/d6/d66/fce to d3/d4/d6/d66/d2b/d84/f108 0 2024-09-13T23:06:28.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/780: dwrite d4/d9/d1a/f2e [0,4194304] 0 2024-09-13T23:06:28.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/781: getdents d4/d47/d8b/dd1 0 2024-09-13T23:06:28.218 INFO:tasks.workunit.client.1.smithi152.stdout:6/661: creat d4/de/d12/d3e/fd6 x:0 0 0 2024-09-13T23:06:28.218 INFO:tasks.workunit.client.1.smithi152.stdout:7/790: rmdir d17/d24/d9f/d51/d5b/d90/d2e/d30 39 2024-09-13T23:06:28.219 INFO:tasks.workunit.client.1.smithi152.stdout:0/562: dread d18/d1f/d29/f6f [0,4194304] 0 2024-09-13T23:06:28.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/557: dwrite de/d14/f62 [4194304,4194304] 0 2024-09-13T23:06:28.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/782: creat d4/d9/d1a/d22/d24/d48/f109 x:0 0 0 2024-09-13T23:06:28.221 INFO:tasks.workunit.client.1.smithi152.stdout:1/783: chown d4/d9/d1a/d22/c31 17436 1 2024-09-13T23:06:28.224 INFO:tasks.workunit.client.1.smithi152.stdout:0/563: symlink d18/d19/lc4 0 2024-09-13T23:06:28.227 INFO:tasks.workunit.client.1.smithi152.stdout:3/558: unlink de/d14/d47/d70/f81 0 2024-09-13T23:06:28.230 INFO:tasks.workunit.client.1.smithi152.stdout:0/564: rmdir d18/d1f/d29/d3f/d4b 39 2024-09-13T23:06:28.230 INFO:tasks.workunit.client.1.smithi152.stdout:0/565: chown d18/d1f/d29/fbb 204075 1 2024-09-13T23:06:28.231 INFO:tasks.workunit.client.1.smithi152.stdout:3/559: rmdir de/d14/d47/d70/d72/da7 39 2024-09-13T23:06:28.234 INFO:tasks.workunit.client.1.smithi152.stdout:0/566: rename d18/d1f/d33/d65/d7a/db4 to d18/d8f/dc5 0 2024-09-13T23:06:28.237 INFO:tasks.workunit.client.1.smithi152.stdout:1/784: dread d4/f7 [0,4194304] 0 2024-09-13T23:06:28.237 INFO:tasks.workunit.client.1.smithi152.stdout:1/785: read - d4/d4c/d8d/fda zero size 2024-09-13T23:06:28.239 INFO:tasks.workunit.client.1.smithi152.stdout:7/791: dread d17/f1c [4194304,4194304] 0 2024-09-13T23:06:28.239 INFO:tasks.workunit.client.1.smithi152.stdout:7/792: creat d17/d6c/f10f x:0 0 0 2024-09-13T23:06:28.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/793: link d17/f1e d17/f110 0 2024-09-13T23:06:28.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/794: chown d17/d24/d9f/d51/d5b/d90 3 1 2024-09-13T23:06:28.245 INFO:tasks.workunit.client.1.smithi152.stdout:2/732: dwrite d0/d4/d9/d16/d30/fa3 [0,4194304] 0 2024-09-13T23:06:28.245 INFO:tasks.workunit.client.1.smithi152.stdout:4/813: dwrite d3/d4/d6/d8/f8f [0,4194304] 0 2024-09-13T23:06:28.245 INFO:tasks.workunit.client.1.smithi152.stdout:6/662: dwrite d4/de/d12/f55 [4194304,4194304] 0 2024-09-13T23:06:28.252 INFO:tasks.workunit.client.1.smithi152.stdout:2/733: creat d0/d4/d9/d14/d48/f102 x:0 0 0 2024-09-13T23:06:28.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/814: rmdir d3/d4/d32 39 2024-09-13T23:06:28.257 INFO:tasks.workunit.client.1.smithi152.stdout:2/734: dread d0/d4/d9/d55/f57 [0,4194304] 0 2024-09-13T23:06:28.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/735: creat d0/f103 x:0 0 0 2024-09-13T23:06:28.260 INFO:tasks.workunit.client.1.smithi152.stdout:0/567: dwrite d18/d1f/d29/d2f/d3d/f4c [0,4194304] 0 2024-09-13T23:06:28.260 INFO:tasks.workunit.client.1.smithi152.stdout:2/736: rename d0/d4/f53 to d0/d4/d9/d14/d48/f104 0 2024-09-13T23:06:28.262 INFO:tasks.workunit.client.1.smithi152.stdout:7/795: dwrite d17/d24/d9f/d51/d5b/d90/d2b/f49 [0,4194304] 0 2024-09-13T23:06:28.262 INFO:tasks.workunit.client.1.smithi152.stdout:7/796: write d17/d24/d9f/d51/d5b/d87/f94 [1076586,23689] 0 2024-09-13T23:06:28.262 INFO:tasks.workunit.client.1.smithi152.stdout:0/568: truncate d18/d1f/d39/f45 315953 0 2024-09-13T23:06:28.269 INFO:tasks.workunit.client.1.smithi152.stdout:0/569: dread d18/d1f/d29/d3f/d4b/f57 [0,4194304] 0 2024-09-13T23:06:28.271 INFO:tasks.workunit.client.1.smithi152.stdout:2/737: dread d0/d4/d9/d16/f21 [0,4194304] 0 2024-09-13T23:06:28.271 INFO:tasks.workunit.client.1.smithi152.stdout:2/738: creat d0/d4/d9/d18/dc1/f105 x:0 0 0 2024-09-13T23:06:28.275 INFO:tasks.workunit.client.1.smithi152.stdout:2/739: rename d0/d4/d9/d16/d2b/l8d to d0/d4/d8a/l106 0 2024-09-13T23:06:28.276 INFO:tasks.workunit.client.1.smithi152.stdout:2/740: creat d0/d4/d9/d16/f107 x:0 0 0 2024-09-13T23:06:28.277 INFO:tasks.workunit.client.1.smithi152.stdout:2/741: unlink d0/d4/d9/d16/d30/d94/f100 0 2024-09-13T23:06:28.277 INFO:tasks.workunit.client.1.smithi152.stdout:2/742: dread - d0/d4/d9/d18/d1e/d3c/d4d/ddc/ffe zero size 2024-09-13T23:06:28.278 INFO:tasks.workunit.client.1.smithi152.stdout:2/743: dread d0/d4/d9/d14/d48/f104 [4194304,4194304] 0 2024-09-13T23:06:28.284 INFO:tasks.workunit.client.1.smithi152.stdout:0/570: dwrite d18/d1f/d29/d2f/d3d/f5e [0,4194304] 0 2024-09-13T23:06:28.285 INFO:tasks.workunit.client.1.smithi152.stdout:0/571: stat d18/d1f/d29/d4e/lb5 0 2024-09-13T23:06:28.285 INFO:tasks.workunit.client.1.smithi152.stdout:0/572: write d18/d19/d2c/f54 [393674,112898] 0 2024-09-13T23:06:28.285 INFO:tasks.workunit.client.1.smithi152.stdout:0/573: symlink d18/d1f/d29/d3f/d40/daa/lc6 0 2024-09-13T23:06:28.300 INFO:tasks.workunit.client.1.smithi152.stdout:0/574: dwrite d18/d1f/d33/d90/f91 [0,4194304] 0 2024-09-13T23:06:28.300 INFO:tasks.workunit.client.1.smithi152.stdout:0/575: dread - d18/d1f/d29/d3f/da0/fb2 zero size 2024-09-13T23:06:28.302 INFO:tasks.workunit.client.1.smithi152.stdout:0/576: rename d18/d1f/d39/f93 to d18/d1f/d29/d3f/d40/fc7 0 2024-09-13T23:06:28.316 INFO:tasks.workunit.client.1.smithi152.stdout:0/577: dwrite d18/d1f/f79 [0,4194304] 0 2024-09-13T23:06:28.324 INFO:tasks.workunit.client.1.smithi152.stdout:0/578: dread d18/d1f/f7d [0,4194304] 0 2024-09-13T23:06:28.325 INFO:tasks.workunit.client.1.smithi152.stdout:0/579: link d18/d1f/d29/d4e/l9e d18/d1f/d29/d3f/d40/daa/lc8 0 2024-09-13T23:06:28.326 INFO:tasks.workunit.client.1.smithi152.stdout:0/580: creat d18/d1f/d33/d65/d7a/d83/fc9 x:0 0 0 2024-09-13T23:06:28.327 INFO:tasks.workunit.client.1.smithi152.stdout:0/581: link d18/d1f/d33/d6e/c80 d18/d8f/cca 0 2024-09-13T23:06:28.327 INFO:tasks.workunit.client.1.smithi152.stdout:0/582: write f14 [9200141,119287] 0 2024-09-13T23:06:28.327 INFO:tasks.workunit.client.1.smithi152.stdout:0/583: creat d18/d1f/d29/d3f/d40/daa/fcb x:0 0 0 2024-09-13T23:06:28.329 INFO:tasks.workunit.client.1.smithi152.stdout:0/584: mknod d18/d1f/d29/d3f/d40/daa/ccc 0 2024-09-13T23:06:28.329 INFO:tasks.workunit.client.1.smithi152.stdout:0/585: fsync d18/d19/d2c/f5d 0 2024-09-13T23:06:28.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/586: rename d18/d1f/d33/d65/d7a/d83/c88 to d18/d1f/d29/d2f/ccd 0 2024-09-13T23:06:28.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/587: mknod d18/d1f/d29/d4e/cce 0 2024-09-13T23:06:28.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/588: readlink d18/d1f/d39/l3a 0 2024-09-13T23:06:28.332 INFO:tasks.workunit.client.1.smithi152.stdout:0/589: write d18/d1f/d29/d4e/fbe [850537,129304] 0 2024-09-13T23:06:28.332 INFO:tasks.workunit.client.1.smithi152.stdout:0/590: dread - d18/d1f/d33/f7f zero size 2024-09-13T23:06:28.337 INFO:tasks.workunit.client.1.smithi152.stdout:0/591: rmdir d18 39 2024-09-13T23:06:28.338 INFO:tasks.workunit.client.1.smithi152.stdout:0/592: read d18/d1f/d33/f36 [224595,90893] 0 2024-09-13T23:06:28.343 INFO:tasks.workunit.client.1.smithi152.stdout:0/593: read f13 [1946247,44779] 0 2024-09-13T23:06:28.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/594: creat d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fcf x:0 0 0 2024-09-13T23:06:28.360 INFO:tasks.workunit.client.1.smithi152.stdout:0/595: dwrite d18/f1b [4194304,4194304] 0 2024-09-13T23:06:28.361 INFO:tasks.workunit.client.1.smithi152.stdout:0/596: mkdir d18/d8f/dc5/dd0 0 2024-09-13T23:06:28.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/597: fsync d18/d19/f81 0 2024-09-13T23:06:28.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/598: chown d18/d1f/d29/d3f/da0/fb2 10912 1 2024-09-13T23:06:28.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/599: unlink d18/d1f/d29/d3f/d4b/d66/d6a/fa5 0 2024-09-13T23:06:28.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/533: sync 2024-09-13T23:06:28.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/534: getdents d17/d25/d32/d4b/d84/d91/d9c 0 2024-09-13T23:06:28.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/535: rename d17/d19/l8b to d17/d25/d32/d4b/d84/la5 0 2024-09-13T23:06:28.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/536: stat d17/d25/d32/d50/f57 0 2024-09-13T23:06:28.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/537: readlink d17/d25/d32/d9a/l47 0 2024-09-13T23:06:28.552 INFO:tasks.workunit.client.1.smithi152.stdout:9/771: sync 2024-09-13T23:06:28.552 INFO:tasks.workunit.client.1.smithi152.stdout:9/772: chown d3/d1e/d30/dfe/fa2 12769 1 2024-09-13T23:06:28.553 INFO:tasks.workunit.client.1.smithi152.stdout:9/773: write d3/d52/fe5 [39991,48218] 0 2024-09-13T23:06:28.554 INFO:tasks.workunit.client.1.smithi152.stdout:9/774: creat d3/d24/d34/dc6/f103 x:0 0 0 2024-09-13T23:06:28.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/775: symlink d3/l104 0 2024-09-13T23:06:28.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/776: mkdir d3/d1e/d30/d5d/da3/d105 0 2024-09-13T23:06:28.556 INFO:tasks.workunit.client.1.smithi152.stdout:9/777: mknod d3/d24/d67/d4a/d71/c106 0 2024-09-13T23:06:28.557 INFO:tasks.workunit.client.1.smithi152.stdout:9/778: mkdir d3/d1e/d30/d5d/da3/d105/d107 0 2024-09-13T23:06:28.573 INFO:tasks.workunit.client.1.smithi152.stdout:9/779: dwrite d3/d24/d34/ff7 [0,4194304] 0 2024-09-13T23:06:28.588 INFO:tasks.workunit.client.1.smithi152.stdout:9/780: dwrite d3/d24/d67/d4a/d8e/fef [0,4194304] 0 2024-09-13T23:06:28.588 INFO:tasks.workunit.client.1.smithi152.stdout:9/781: fdatasync d3/d24/d34/ff7 0 2024-09-13T23:06:28.589 INFO:tasks.workunit.client.1.smithi152.stdout:9/782: getdents d3/d1e/d30/d5d/da3 0 2024-09-13T23:06:28.589 INFO:tasks.workunit.client.1.smithi152.stdout:9/783: truncate d3/d1e/d30/dfe/fe0 883876 0 2024-09-13T23:06:28.604 INFO:tasks.workunit.client.1.smithi152.stdout:9/784: dwrite d3/d24/d67/d60/f84 [0,4194304] 0 2024-09-13T23:06:28.605 INFO:tasks.workunit.client.1.smithi152.stdout:9/785: mknod d3/d24/d34/d45/c108 0 2024-09-13T23:06:28.605 INFO:tasks.workunit.client.1.smithi152.stdout:9/786: dread - d3/d1e/fe2 zero size 2024-09-13T23:06:28.621 INFO:tasks.workunit.client.1.smithi152.stdout:9/787: dwrite d3/d24/d67/ff8 [0,4194304] 0 2024-09-13T23:06:28.621 INFO:tasks.workunit.client.1.smithi152.stdout:9/788: truncate d3/d24/d67/d4a/d8e/f93 558738 0 2024-09-13T23:06:28.622 INFO:tasks.workunit.client.1.smithi152.stdout:9/789: stat d3/d1e/d30/f39 0 2024-09-13T23:06:28.623 INFO:tasks.workunit.client.1.smithi152.stdout:9/790: unlink d3/d24/d67/d4a/d71/f89 0 2024-09-13T23:06:28.642 INFO:tasks.workunit.client.1.smithi152.stdout:9/791: dwrite d3/f15 [0,4194304] 0 2024-09-13T23:06:28.644 INFO:tasks.workunit.client.1.smithi152.stdout:9/792: write d3/f4f [105343,101355] 0 2024-09-13T23:06:28.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/793: dwrite d3/d1e/f3c [0,4194304] 0 2024-09-13T23:06:28.659 INFO:tasks.workunit.client.1.smithi152.stdout:9/794: rmdir d3/d1e/d30 39 2024-09-13T23:06:28.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/795: mknod d3/d24/d67/d47/de7/c109 0 2024-09-13T23:06:28.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/796: dread - d3/d1e/d30/f42 zero size 2024-09-13T23:06:28.661 INFO:tasks.workunit.client.1.smithi152.stdout:9/797: rename d3/d1e/d30/d5d/l61 to d3/d24/d34/d45/l10a 0 2024-09-13T23:06:28.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/798: dwrite d3/d24/d67/d60/f69 [0,4194304] 0 2024-09-13T23:06:28.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/799: fdatasync d3/d24/d67/d60/de1/fe6 0 2024-09-13T23:06:28.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/800: chown d3/d24/d67/d60/f69 96906579 1 2024-09-13T23:06:28.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/801: symlink d3/d24/d34/dc6/l10b 0 2024-09-13T23:06:28.679 INFO:tasks.workunit.client.1.smithi152.stdout:9/802: creat d3/d24/d67/d60/de1/f10c x:0 0 0 2024-09-13T23:06:28.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/803: dwrite d3/d24/d34/d45/f9a [0,4194304] 0 2024-09-13T23:06:28.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/804: unlink d3/d24/d67/d60/c68 0 2024-09-13T23:06:28.708 INFO:tasks.workunit.client.1.smithi152.stdout:9/805: dwrite d3/d24/d67/d47/f51 [0,4194304] 0 2024-09-13T23:06:28.708 INFO:tasks.workunit.client.1.smithi152.stdout:9/806: fdatasync d3/d24/d67/d60/de1/fe6 0 2024-09-13T23:06:28.708 INFO:tasks.workunit.client.1.smithi152.stdout:9/807: creat d3/d24/d34/f10d x:0 0 0 2024-09-13T23:06:28.713 INFO:tasks.workunit.client.1.smithi152.stdout:9/808: dread d3/d1e/d30/f6c [0,4194304] 0 2024-09-13T23:06:28.713 INFO:tasks.workunit.client.1.smithi152.stdout:9/809: truncate d3/d1e/fe2 703313 0 2024-09-13T23:06:28.722 INFO:tasks.workunit.client.1.smithi152.stdout:9/810: dread d3/f17 [0,4194304] 0 2024-09-13T23:06:28.723 INFO:tasks.workunit.client.1.smithi152.stdout:9/811: mkdir d3/d24/d67/d4a/d71/d7c/dee/d10e 0 2024-09-13T23:06:28.724 INFO:tasks.workunit.client.1.smithi152.stdout:9/812: rename d3/d1e/d30/ldb to d3/d24/dac/l10f 0 2024-09-13T23:06:28.724 INFO:tasks.workunit.client.1.smithi152.stdout:9/813: rmdir d3/d1e/d30 39 2024-09-13T23:06:28.724 INFO:tasks.workunit.client.1.smithi152.stdout:9/814: readlink d3/d24/d34/d45/l5a 0 2024-09-13T23:06:28.725 INFO:tasks.workunit.client.1.smithi152.stdout:9/815: write d3/d1e/d30/dfe/fa2 [526217,22620] 0 2024-09-13T23:06:28.725 INFO:tasks.workunit.client.1.smithi152.stdout:9/816: readlink d3/d24/dac/l10f 0 2024-09-13T23:06:28.732 INFO:tasks.workunit.client.1.smithi152.stdout:9/817: dread d3/d24/d34/d45/f9a [0,4194304] 0 2024-09-13T23:06:28.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/818: creat d3/d24/d67/d4a/f110 x:0 0 0 2024-09-13T23:06:28.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/819: readlink d3/d24/d67/d4a/d71/lcc 0 2024-09-13T23:06:28.734 INFO:tasks.workunit.client.1.smithi152.stdout:9/820: mkdir d3/d24/d67/d4a/d71/d111 0 2024-09-13T23:06:28.734 INFO:tasks.workunit.client.1.smithi152.stdout:9/821: fsync d3/d24/d67/d47/f97 0 2024-09-13T23:06:28.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/822: dread d3/d24/d34/f40 [0,4194304] 0 2024-09-13T23:06:28.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/823: stat d3/d24/d67/d60/f58 0 2024-09-13T23:06:28.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/824: write d3/d24/dac/ff5 [123849,49580] 0 2024-09-13T23:06:28.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/825: dwrite d3/d1e/d30/f6c [0,4194304] 0 2024-09-13T23:06:28.757 INFO:tasks.workunit.client.1.smithi152.stdout:9/826: chown d3/d24/d67/l43 577920 1 2024-09-13T23:06:28.774 INFO:tasks.workunit.client.1.smithi152.stdout:9/827: dwrite d3/d24/d67/d4a/f110 [0,4194304] 0 2024-09-13T23:06:28.775 INFO:tasks.workunit.client.1.smithi152.stdout:9/828: symlink d3/d24/d34/d45/l112 0 2024-09-13T23:06:28.783 INFO:tasks.workunit.client.1.smithi152.stdout:9/829: dread d3/d24/f20 [0,4194304] 0 2024-09-13T23:06:28.784 INFO:tasks.workunit.client.1.smithi152.stdout:9/830: creat d3/d24/d34/d45/daa/dbf/f113 x:0 0 0 2024-09-13T23:06:28.785 INFO:tasks.workunit.client.1.smithi152.stdout:9/831: unlink d3/d1e/d30/fde 0 2024-09-13T23:06:28.785 INFO:tasks.workunit.client.1.smithi152.stdout:9/832: write d3/d24/d67/d4a/d8e/ff2 [735599,73057] 0 2024-09-13T23:06:28.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:28 smithi115 ceph-mon[27601]: pgmap v10: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 212 MiB/s rd, 273 MiB/s wr, 403 op/s 2024-09-13T23:06:28.802 INFO:tasks.workunit.client.1.smithi152.stdout:9/833: dwrite d3/d1e/f92 [0,4194304] 0 2024-09-13T23:06:28.820 INFO:tasks.workunit.client.1.smithi152.stdout:9/834: dwrite d3/d24/d67/d4a/d71/fd1 [0,4194304] 0 2024-09-13T23:06:28.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/835: chown d3/f9b 35047 1 2024-09-13T23:06:28.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/836: unlink d3/d1e/c3f 0 2024-09-13T23:06:28.824 INFO:tasks.workunit.client.1.smithi152.stdout:9/837: symlink d3/d24/d67/d4a/d8e/l114 0 2024-09-13T23:06:28.837 INFO:tasks.workunit.client.1.smithi152.stdout:9/838: dread d3/d24/d34/ff7 [0,4194304] 0 2024-09-13T23:06:28.837 INFO:tasks.workunit.client.1.smithi152.stdout:9/839: chown d3/d24/l4e 1921020 1 2024-09-13T23:06:28.837 INFO:tasks.workunit.client.1.smithi152.stdout:9/840: fdatasync d3/d1e/d30/f6c 0 2024-09-13T23:06:28.837 INFO:tasks.workunit.client.1.smithi152.stdout:9/841: creat d3/d24/d67/d4a/f115 x:0 0 0 2024-09-13T23:06:28.840 INFO:tasks.workunit.client.1.smithi152.stdout:9/842: mkdir d3/d1e/d30/dfe/d116 0 2024-09-13T23:06:28.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/843: read d3/f9b [786071,29770] 0 2024-09-13T23:06:28.851 INFO:tasks.workunit.client.1.smithi152.stdout:9/844: readlink d3/d24/d67/d47/de7/lff 0 2024-09-13T23:06:28.875 INFO:tasks.workunit.client.1.smithi152.stdout:9/845: dwrite d3/f4f [0,4194304] 0 2024-09-13T23:06:28.876 INFO:tasks.workunit.client.1.smithi152.stdout:9/846: mknod d3/d24/d34/d45/daa/dbf/c117 0 2024-09-13T23:06:28.877 INFO:tasks.workunit.client.1.smithi152.stdout:9/847: creat d3/d1e/d30/d5d/da3/f118 x:0 0 0 2024-09-13T23:06:28.878 INFO:tasks.workunit.client.1.smithi152.stdout:9/848: mknod d3/d24/d34/d45/daa/c119 0 2024-09-13T23:06:28.889 INFO:tasks.workunit.client.1.smithi152.stdout:9/849: dread d3/d24/d34/dc6/fe8 [0,4194304] 0 2024-09-13T23:06:28.890 INFO:tasks.workunit.client.1.smithi152.stdout:9/850: creat d3/d24/d67/d4a/d71/d7c/dee/f11a x:0 0 0 2024-09-13T23:06:28.906 INFO:tasks.workunit.client.1.smithi152.stdout:9/851: dwrite d3/d24/d67/d60/de1/ff4 [0,4194304] 0 2024-09-13T23:06:28.906 INFO:tasks.workunit.client.1.smithi152.stdout:9/852: chown d3/d24/d67/d4a/d8e 12 1 2024-09-13T23:06:28.913 INFO:tasks.workunit.client.1.smithi152.stdout:5/649: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:2/744: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/538: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/560: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:4/815: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:6/663: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/786: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/787: chown d4/d9/d1a/d22/d24/d48/fab 911161144 1 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/788: fdatasync d4/d9/d1a/f4e 0 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/600: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/797: sync 2024-09-13T23:06:28.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/798: fsync d17/d4f/ff2 0 2024-09-13T23:06:28.915 INFO:tasks.workunit.client.1.smithi152.stdout:5/650: rename d5/dc/d19/d65/dc7 to d5/dc/da3/ddd 0 2024-09-13T23:06:28.916 INFO:tasks.workunit.client.1.smithi152.stdout:6/664: dread d4/de/d21/d5c/f76 [0,4194304] 0 2024-09-13T23:06:28.917 INFO:tasks.workunit.client.1.smithi152.stdout:6/665: fsync d4/de/d12/d8a/f74 0 2024-09-13T23:06:28.917 INFO:tasks.workunit.client.1.smithi152.stdout:0/601: creat d18/d1f/d29/fd1 x:0 0 0 2024-09-13T23:06:28.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/789: mkdir d4/d47/d10a 0 2024-09-13T23:06:28.917 INFO:tasks.workunit.client.1.smithi152.stdout:5/651: mknod d5/dc/d19/d20/d2e/cde 0 2024-09-13T23:06:28.917 INFO:tasks.workunit.client.1.smithi152.stdout:5/652: truncate d5/d26/fc9 340777 0 2024-09-13T23:06:28.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/561: rename de/d14/f4d to de/d1f/da2/da8/fba 0 2024-09-13T23:06:28.922 INFO:tasks.workunit.client.1.smithi152.stdout:3/562: chown de/d14/d47/d57/d5d/l5a 186383887 1 2024-09-13T23:06:28.922 INFO:tasks.workunit.client.1.smithi152.stdout:6/666: link d4/de/d12/f5f d4/de/d12/d16/d2a/d3d/daa/fd7 0 2024-09-13T23:06:28.922 INFO:tasks.workunit.client.1.smithi152.stdout:6/667: chown d4/de/d12/d8a/c72 4 1 2024-09-13T23:06:28.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/602: rmdir d18/d19/d74/da4 39 2024-09-13T23:06:28.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/603: write d18/d1f/d29/d3f/da0/fae [884739,104951] 0 2024-09-13T23:06:28.923 INFO:tasks.workunit.client.1.smithi152.stdout:1/790: truncate d4/d9/f12 521967 0 2024-09-13T23:06:28.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/653: write d5/dc/fe [7140744,121623] 0 2024-09-13T23:06:28.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/654: fdatasync d5/f5a 0 2024-09-13T23:06:28.924 INFO:tasks.workunit.client.1.smithi152.stdout:4/816: rename d3/d4/d6/d66/d1c/d59/d60/d74 to d3/d4/d8d/d93/d109 0 2024-09-13T23:06:28.926 INFO:tasks.workunit.client.1.smithi152.stdout:1/791: mkdir d4/d9/d10b 0 2024-09-13T23:06:28.926 INFO:tasks.workunit.client.1.smithi152.stdout:3/563: dread de/d14/d47/d57/d5d/f7f [0,4194304] 0 2024-09-13T23:06:28.928 INFO:tasks.workunit.client.1.smithi152.stdout:1/792: link d4/d47/lba d4/d4c/de8/l10c 0 2024-09-13T23:06:28.930 INFO:tasks.workunit.client.1.smithi152.stdout:1/793: mknod d4/d4c/c10d 0 2024-09-13T23:06:28.933 INFO:tasks.workunit.client.1.smithi152.stdout:9/853: dwrite d3/d24/d67/d4a/f79 [0,4194304] 0 2024-09-13T23:06:28.933 INFO:tasks.workunit.client.1.smithi152.stdout:9/854: dread - d3/d24/d67/fd8 zero size 2024-09-13T23:06:28.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/668: read d4/de/d21/f7c [3951355,71084] 0 2024-09-13T23:06:28.935 INFO:tasks.workunit.client.1.smithi152.stdout:9/855: truncate d3/d24/d67/d60/f69 1945984 0 2024-09-13T23:06:28.936 INFO:tasks.workunit.client.1.smithi152.stdout:9/856: stat d3/d24/d34/ff7 0 2024-09-13T23:06:28.937 INFO:tasks.workunit.client.1.smithi152.stdout:6/669: rename d4/de/d12/c84 to d4/de/d21/d5c/cd8 0 2024-09-13T23:06:28.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/670: truncate d4/de/d12/f6f 1882664 0 2024-09-13T23:06:28.938 INFO:tasks.workunit.client.1.smithi152.stdout:9/857: rmdir d3/d1e/d30/dfe/d116 0 2024-09-13T23:06:28.940 INFO:tasks.workunit.client.1.smithi152.stdout:6/671: link d4/de/d12/d8a/f5e d4/de/d12/fd9 0 2024-09-13T23:06:28.940 INFO:tasks.workunit.client.1.smithi152.stdout:6/672: chown d4/de/d12/d3e/la5 49 1 2024-09-13T23:06:28.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/817: dread d3/d4/d6/d66/d1c/f2c [0,4194304] 0 2024-09-13T23:06:28.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/858: symlink d3/d1e/db1/l11b 0 2024-09-13T23:06:28.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/859: chown d3/d1e/f72 10866 1 2024-09-13T23:06:28.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/860: dread - d3/d24/d34/f10d zero size 2024-09-13T23:06:28.946 INFO:tasks.workunit.client.1.smithi152.stdout:3/564: dread de/d14/d47/d70/f78 [0,4194304] 0 2024-09-13T23:06:28.949 INFO:tasks.workunit.client.1.smithi152.stdout:4/818: mknod d3/d4/d32/c10a 0 2024-09-13T23:06:28.950 INFO:tasks.workunit.client.1.smithi152.stdout:4/819: write d3/d4/d6/d66/d1c/d59/f68 [1634591,27948] 0 2024-09-13T23:06:28.953 INFO:tasks.workunit.client.1.smithi152.stdout:1/794: dread d4/d4c/f80 [0,4194304] 0 2024-09-13T23:06:28.955 INFO:tasks.workunit.client.1.smithi152.stdout:4/820: link d3/d4/d8d/d93/d109/fa8 d3/d4/d6/d66/d62/d9d/dba/f10b 0 2024-09-13T23:06:28.955 INFO:tasks.workunit.client.1.smithi152.stdout:4/821: fsync d3/d4/d6/d8/d17/d3a/f56 0 2024-09-13T23:06:28.958 INFO:tasks.workunit.client.1.smithi152.stdout:4/822: rmdir d3/d4/d8d/d93/d109 39 2024-09-13T23:06:28.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/823: chown d3/d4/d6/fb0 398765547 1 2024-09-13T23:06:28.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/824: fdatasync d3/fbd 0 2024-09-13T23:06:28.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/825: stat d3/d4/d6/d8/d17/ca1 0 2024-09-13T23:06:28.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/826: write d3/d4/d6/f54 [5029429,33399] 0 2024-09-13T23:06:28.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/827: creat d3/d4/d6/d8/d17/d5d/d76/f10c x:0 0 0 2024-09-13T23:06:28.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:28 smithi152 ceph-mon[34465]: pgmap v10: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 212 MiB/s rd, 273 MiB/s wr, 403 op/s 2024-09-13T23:06:28.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/604: dwrite d18/d1f/d33/d90/f91 [0,4194304] 0 2024-09-13T23:06:28.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/605: fdatasync d18/d19/f81 0 2024-09-13T23:06:28.971 INFO:tasks.workunit.client.1.smithi152.stdout:5/655: dwrite d5/da/f6f [0,4194304] 0 2024-09-13T23:06:28.973 INFO:tasks.workunit.client.1.smithi152.stdout:0/606: symlink d18/d19/d2c/ld2 0 2024-09-13T23:06:28.973 INFO:tasks.workunit.client.1.smithi152.stdout:5/656: chown d5/dc/f54 30 1 2024-09-13T23:06:28.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/795: dread d4/d47/f77 [0,4194304] 0 2024-09-13T23:06:28.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/796: creat d4/d4c/d8d/f10e x:0 0 0 2024-09-13T23:06:28.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/797: rmdir d4/d9/d1a/d22/d24/daa 39 2024-09-13T23:06:28.986 INFO:tasks.workunit.client.1.smithi152.stdout:1/798: dread - d4/d4c/d8d/d99/f103 zero size 2024-09-13T23:06:28.987 INFO:tasks.workunit.client.1.smithi152.stdout:1/799: rmdir d4/d4c/de8 39 2024-09-13T23:06:28.988 INFO:tasks.workunit.client.1.smithi152.stdout:1/800: rmdir d4/d4c/d8d/d99/d104 39 2024-09-13T23:06:28.992 INFO:tasks.workunit.client.1.smithi152.stdout:6/673: dwrite d4/de/d12/d16/d2a/d3d/daa/daf/fd1 [0,4194304] 0 2024-09-13T23:06:28.994 INFO:tasks.workunit.client.1.smithi152.stdout:6/674: creat d4/fda x:0 0 0 2024-09-13T23:06:28.994 INFO:tasks.workunit.client.1.smithi152.stdout:6/675: chown d4/de/d12/d16/l34 4012412 1 2024-09-13T23:06:28.995 INFO:tasks.workunit.client.1.smithi152.stdout:6/676: mknod d4/de/d12/d8a/cdb 0 2024-09-13T23:06:28.995 INFO:tasks.workunit.client.1.smithi152.stdout:6/677: chown l2 1901 1 2024-09-13T23:06:28.997 INFO:tasks.workunit.client.1.smithi152.stdout:6/678: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/ddc 0 2024-09-13T23:06:28.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/679: getdents d4/de/d1d/dce 0 2024-09-13T23:06:28.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/680: chown d4/de/d12/d8a 245510 1 2024-09-13T23:06:29.000 INFO:tasks.workunit.client.1.smithi152.stdout:6/681: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd 0 2024-09-13T23:06:29.000 INFO:tasks.workunit.client.1.smithi152.stdout:3/565: dwrite de/d14/d47/d57/d5d/f2b [0,4194304] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:2/745: dwrite d0/d4/d9/d18/d1e/d3c/d88/fe8 [0,4194304] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:2/746: write d0/d4/d9/d14/d48/d49/fbc [902989,24662] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:5/657: dwrite d5/dc/f84 [0,4194304] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:5/658: chown d5/f5a 26 1 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:3/566: dread de/d14/d47/d57/d5d/d6e/f94 [0,4194304] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/682: dread d4/fa2 [0,4194304] 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:3/567: fsync de/f1c 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/683: readlink d4/de/d21/d5c/dc9/ld2 0 2024-09-13T23:06:29.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/684: fsync d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 0 2024-09-13T23:06:29.002 INFO:tasks.workunit.client.1.smithi152.stdout:6/685: fdatasync d4/de/d21/f15 0 2024-09-13T23:06:29.003 INFO:tasks.workunit.client.1.smithi152.stdout:9/861: dwrite d3/d24/d67/d60/ff9 [0,4194304] 0 2024-09-13T23:06:29.003 INFO:tasks.workunit.client.1.smithi152.stdout:2/747: truncate d0/d4/d9/f63 147067 0 2024-09-13T23:06:29.003 INFO:tasks.workunit.client.1.smithi152.stdout:2/748: fsync d0/d4/d9/d18/d32/f35 0 2024-09-13T23:06:29.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/828: dwrite d3/f40 [0,4194304] 0 2024-09-13T23:06:29.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/829: chown d3/d4/d6/d66/f85 396938 1 2024-09-13T23:06:29.004 INFO:tasks.workunit.client.1.smithi152.stdout:0/607: dwrite d18/d1f/d29/d2f/d3d/fa7 [0,4194304] 0 2024-09-13T23:06:29.004 INFO:tasks.workunit.client.1.smithi152.stdout:0/608: write d18/d1f/d29/d3f/d40/fc7 [30746,55252] 0 2024-09-13T23:06:29.005 INFO:tasks.workunit.client.1.smithi152.stdout:5/659: chown d5/dc/l10 1374332 1 2024-09-13T23:06:29.007 INFO:tasks.workunit.client.1.smithi152.stdout:6/686: mkdir d4/de/d12/d16/d2a/d3d/dde 0 2024-09-13T23:06:29.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/862: mkdir d3/d24/d67/d4a/d71/d111/d11c 0 2024-09-13T23:06:29.009 INFO:tasks.workunit.client.1.smithi152.stdout:1/801: dwrite d4/d9/d1a/d22/d24/f52 [0,4194304] 0 2024-09-13T23:06:29.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/749: getdents d0/d4/d9/d16/d99 0 2024-09-13T23:06:29.010 INFO:tasks.workunit.client.1.smithi152.stdout:4/830: rename d3/d4/d6/f14 to d3/d4/d32/d86/d95/f10d 0 2024-09-13T23:06:29.012 INFO:tasks.workunit.client.1.smithi152.stdout:0/609: mkdir d18/d1f/d29/d2f/dd3 0 2024-09-13T23:06:29.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/750: dread d0/d4/d9/d16/d2b/f46 [0,4194304] 0 2024-09-13T23:06:29.013 INFO:tasks.workunit.client.1.smithi152.stdout:5/660: mknod d5/dc/d19/d65/cdf 0 2024-09-13T23:06:29.014 INFO:tasks.workunit.client.1.smithi152.stdout:5/661: chown d5/da/cb 1 1 2024-09-13T23:06:29.014 INFO:tasks.workunit.client.1.smithi152.stdout:6/687: mkdir d4/de/d12/d16/d2a/d3d/dcf/ddf 0 2024-09-13T23:06:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/568: dread de/d14/f5b [0,4194304] 0 2024-09-13T23:06:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/569: stat de/d14/d47/d70/d72/da7 0 2024-09-13T23:06:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/570: fsync de/d14/d38/f4e 0 2024-09-13T23:06:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/831: creat d3/d4/d6/d8/d4b/ddd/f10e x:0 0 0 2024-09-13T23:06:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/832: dread - d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 zero size 2024-09-13T23:06:29.016 INFO:tasks.workunit.client.1.smithi152.stdout:1/802: write d4/f7 [480970,1310] 0 2024-09-13T23:06:29.017 INFO:tasks.workunit.client.1.smithi152.stdout:9/863: dread d3/d24/d34/fd5 [0,4194304] 0 2024-09-13T23:06:29.017 INFO:tasks.workunit.client.1.smithi152.stdout:9/864: stat d3/d24/d34/d45/daa/dbf/c117 0 2024-09-13T23:06:29.017 INFO:tasks.workunit.client.1.smithi152.stdout:9/865: chown d3/d24/dac 917 1 2024-09-13T23:06:29.017 INFO:tasks.workunit.client.1.smithi152.stdout:2/751: unlink d0/d4/d9/d18/d1e/dc0/ce1 0 2024-09-13T23:06:29.018 INFO:tasks.workunit.client.1.smithi152.stdout:5/662: mkdir d5/d26/d61/de0 0 2024-09-13T23:06:29.019 INFO:tasks.workunit.client.1.smithi152.stdout:6/688: mkdir d4/de/d12/d16/d2a/d3d/d57/de0 0 2024-09-13T23:06:29.020 INFO:tasks.workunit.client.1.smithi152.stdout:3/571: dread de/d14/d47/d57/d5d/fb3 [0,4194304] 0 2024-09-13T23:06:29.021 INFO:tasks.workunit.client.1.smithi152.stdout:1/803: symlink d4/d47/d8b/dd1/l10f 0 2024-09-13T23:06:29.022 INFO:tasks.workunit.client.1.smithi152.stdout:9/866: symlink d3/d1e/d30/l11d 0 2024-09-13T23:06:29.022 INFO:tasks.workunit.client.1.smithi152.stdout:9/867: readlink d3/d24/d34/d45/daa/lbc 0 2024-09-13T23:06:29.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/752: rename d0/d4/d9/d16/d2b/f6c to d0/d8/f108 0 2024-09-13T23:06:29.025 INFO:tasks.workunit.client.1.smithi152.stdout:2/753: fdatasync d0/d4/f37 0 2024-09-13T23:06:29.026 INFO:tasks.workunit.client.1.smithi152.stdout:5/663: mknod d5/dc/da3/db4/db3/ce1 0 2024-09-13T23:06:29.027 INFO:tasks.workunit.client.1.smithi152.stdout:3/572: creat de/d14/d47/d57/d5d/d6e/fbb x:0 0 0 2024-09-13T23:06:29.027 INFO:tasks.workunit.client.1.smithi152.stdout:4/833: write d3/d4/d6/d66/d1c/f27 [691758,69202] 0 2024-09-13T23:06:29.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/804: symlink d4/d47/dcd/l110 0 2024-09-13T23:06:29.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/805: stat d4/d9/d1a/d22/d24/f6a 0 2024-09-13T23:06:29.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/806: creat d4/d4c/d8d/d99/f111 x:0 0 0 2024-09-13T23:06:29.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/807: readlink d4/l69 0 2024-09-13T23:06:29.029 INFO:tasks.workunit.client.1.smithi152.stdout:1/808: dread d4/d9/f98 [0,4194304] 0 2024-09-13T23:06:29.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/573: mkdir de/d14/d38/db9/dbc 0 2024-09-13T23:06:29.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/574: creat de/d1f/fbd x:0 0 0 2024-09-13T23:06:29.034 INFO:tasks.workunit.client.1.smithi152.stdout:0/610: dwrite d18/d19/fb9 [0,4194304] 0 2024-09-13T23:06:29.035 INFO:tasks.workunit.client.1.smithi152.stdout:9/868: rmdir d3/d24/d67/d60 39 2024-09-13T23:06:29.037 INFO:tasks.workunit.client.1.smithi152.stdout:2/754: rename d0/d4/d9/d16/f107 to d0/f109 0 2024-09-13T23:06:29.037 INFO:tasks.workunit.client.1.smithi152.stdout:2/755: chown d0/d4/d9/d16/d30/dba 304 1 2024-09-13T23:06:29.038 INFO:tasks.workunit.client.1.smithi152.stdout:5/664: mkdir d5/dc/d19/d65/d99/d98/de2 0 2024-09-13T23:06:29.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/575: stat de/d1f/l23 0 2024-09-13T23:06:29.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/576: dread - de/d14/d47/d57/d5d/d6e/fbb zero size 2024-09-13T23:06:29.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/577: stat de/d14/d38/c65 0 2024-09-13T23:06:29.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/578: write de/d1f/f91 [4444287,23583] 0 2024-09-13T23:06:29.049 INFO:tasks.workunit.client.1.smithi152.stdout:0/611: creat d18/d1f/d29/d2f/d3d/da1/fd4 x:0 0 0 2024-09-13T23:06:29.052 INFO:tasks.workunit.client.1.smithi152.stdout:0/612: dread d18/d1f/d33/f5a [0,4194304] 0 2024-09-13T23:06:29.054 INFO:tasks.workunit.client.1.smithi152.stdout:6/689: rename d4/de/d12/d16/f69 to d4/de/d12/d16/d2a/d3d/daa/daf/dcc/fe1 0 2024-09-13T23:06:29.057 INFO:tasks.workunit.client.1.smithi152.stdout:0/613: symlink d18/d1f/d29/d3f/d40/ld5 0 2024-09-13T23:06:29.057 INFO:tasks.workunit.client.1.smithi152.stdout:0/614: creat d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fd6 x:0 0 0 2024-09-13T23:06:29.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/615: write d18/d19/d2c/f30 [475657,58484] 0 2024-09-13T23:06:29.059 INFO:tasks.workunit.client.1.smithi152.stdout:1/809: rename d4/d47/dcd/cd0 to d4/d4c/d8d/d99/c112 0 2024-09-13T23:06:29.059 INFO:tasks.workunit.client.1.smithi152.stdout:1/810: write d4/f7 [3905096,75001] 0 2024-09-13T23:06:29.060 INFO:tasks.workunit.client.1.smithi152.stdout:6/690: creat d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/fe2 x:0 0 0 2024-09-13T23:06:29.061 INFO:tasks.workunit.client.1.smithi152.stdout:3/579: unlink de/d63/c6c 0 2024-09-13T23:06:29.064 INFO:tasks.workunit.client.1.smithi152.stdout:0/616: rmdir d18/d1f/d33/d6e 39 2024-09-13T23:06:29.066 INFO:tasks.workunit.client.1.smithi152.stdout:3/580: mknod de/d14/d47/d57/d99/cbe 0 2024-09-13T23:06:29.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/617: unlink d18/d19/l24 0 2024-09-13T23:06:29.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/618: read - d18/d1f/d29/d3f/da0/fa3 zero size 2024-09-13T23:06:29.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/619: readlink d18/d1f/d29/d2f/l38 0 2024-09-13T23:06:29.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/620: write d18/d1f/d29/d3f/d40/daa/fcb [210916,557] 0 2024-09-13T23:06:29.068 INFO:tasks.workunit.client.1.smithi152.stdout:0/621: write d18/d19/d2c/f5d [5122275,88786] 0 2024-09-13T23:06:29.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/665: dwrite d5/d26/d61/f77 [0,4194304] 0 2024-09-13T23:06:29.074 INFO:tasks.workunit.client.1.smithi152.stdout:0/622: mkdir d18/d1f/d39/dd7 0 2024-09-13T23:06:29.076 INFO:tasks.workunit.client.1.smithi152.stdout:5/666: unlink d5/dc/d19/d20/d55/l83 0 2024-09-13T23:06:29.076 INFO:tasks.workunit.client.1.smithi152.stdout:0/623: mknod d18/d19/d2c/cd8 0 2024-09-13T23:06:29.077 INFO:tasks.workunit.client.1.smithi152.stdout:0/624: mkdir d18/d8f/dc5/dd0/dd9 0 2024-09-13T23:06:29.078 INFO:tasks.workunit.client.1.smithi152.stdout:0/625: creat d18/d1f/d29/d3f/d40/daa/dbd/fda x:0 0 0 2024-09-13T23:06:29.089 INFO:tasks.workunit.client.1.smithi152.stdout:5/667: write d5/d26/f33 [660937,20382] 0 2024-09-13T23:06:29.089 INFO:tasks.workunit.client.1.smithi152.stdout:5/668: truncate d5/dc/f5b 747453 0 2024-09-13T23:06:29.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/669: symlink d5/dc/le3 0 2024-09-13T23:06:29.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/670: chown d5/dc/d19/c18 1 1 2024-09-13T23:06:29.094 INFO:tasks.workunit.client.1.smithi152.stdout:1/811: dwrite d4/d9/d1a/d22/d24/f6a [0,4194304] 0 2024-09-13T23:06:29.094 INFO:tasks.workunit.client.1.smithi152.stdout:3/581: dwrite de/d14/d47/d70/d72/fb1 [0,4194304] 0 2024-09-13T23:06:29.094 INFO:tasks.workunit.client.1.smithi152.stdout:1/812: chown d4/d9/c6e 2703 1 2024-09-13T23:06:29.094 INFO:tasks.workunit.client.1.smithi152.stdout:3/582: creat de/d14/d47/d70/d72/fbf x:0 0 0 2024-09-13T23:06:29.095 INFO:tasks.workunit.client.1.smithi152.stdout:0/626: write d18/d19/fb9 [202515,49597] 0 2024-09-13T23:06:29.098 INFO:tasks.workunit.client.1.smithi152.stdout:1/813: mkdir d4/d9/d1a/d113 0 2024-09-13T23:06:29.111 INFO:tasks.workunit.client.1.smithi152.stdout:1/814: dread d4/f5d [0,4194304] 0 2024-09-13T23:06:29.113 INFO:tasks.workunit.client.1.smithi152.stdout:1/815: symlink d4/d9/d1a/d22/d24/dde/df4/l114 0 2024-09-13T23:06:29.123 INFO:tasks.workunit.client.1.smithi152.stdout:5/671: dwrite d5/dc/d19/d65/d99/da6/f94 [0,4194304] 0 2024-09-13T23:06:29.123 INFO:tasks.workunit.client.1.smithi152.stdout:5/672: read d5/dc/d19/d20/d2e/d28/f2f [796011,107012] 0 2024-09-13T23:06:29.123 INFO:tasks.workunit.client.1.smithi152.stdout:0/627: dwrite d18/d1f/d29/d3f/d40/daa/dbd/fda [0,4194304] 0 2024-09-13T23:06:29.126 INFO:tasks.workunit.client.1.smithi152.stdout:0/628: write d18/d19/d2c/f5d [4692806,106041] 0 2024-09-13T23:06:29.126 INFO:tasks.workunit.client.1.smithi152.stdout:0/629: write d18/d1f/d29/d3f/f5c [1384962,74412] 0 2024-09-13T23:06:29.126 INFO:tasks.workunit.client.1.smithi152.stdout:3/583: dwrite de/f1d [0,4194304] 0 2024-09-13T23:06:29.126 INFO:tasks.workunit.client.1.smithi152.stdout:3/584: fsync de/d14/d47/d70/f7b 0 2024-09-13T23:06:29.127 INFO:tasks.workunit.client.1.smithi152.stdout:5/673: rename d5/d26/ld9 to d5/dc/d19/d65/d99/d98/da0/dc1/le4 0 2024-09-13T23:06:29.135 INFO:tasks.workunit.client.1.smithi152.stdout:0/630: rmdir d18/d1f 39 2024-09-13T23:06:29.135 INFO:tasks.workunit.client.1.smithi152.stdout:3/585: symlink de/d14/d38/db9/dbc/lc0 0 2024-09-13T23:06:29.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/631: mknod d18/d1f/d39/cdb 0 2024-09-13T23:06:29.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/632: dread - d18/d1f/d29/fbb zero size 2024-09-13T23:06:29.137 INFO:tasks.workunit.client.1.smithi152.stdout:0/633: truncate d18/d1f/d33/d65/d7a/d83/fc9 859400 0 2024-09-13T23:06:29.138 INFO:tasks.workunit.client.1.smithi152.stdout:5/674: dread d5/f14 [4194304,4194304] 0 2024-09-13T23:06:29.138 INFO:tasks.workunit.client.1.smithi152.stdout:5/675: chown d5/dc/da3/fc4 15153 1 2024-09-13T23:06:29.138 INFO:tasks.workunit.client.1.smithi152.stdout:0/634: unlink d18/d1f/d29/d4e/l9e 0 2024-09-13T23:06:29.139 INFO:tasks.workunit.client.1.smithi152.stdout:3/586: mkdir de/d63/dc1 0 2024-09-13T23:06:29.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/676: mknod d5/dc/d19/d65/d99/d98/dc2/ce5 0 2024-09-13T23:06:29.140 INFO:tasks.workunit.client.1.smithi152.stdout:0/635: stat d18/d19/c75 0 2024-09-13T23:06:29.141 INFO:tasks.workunit.client.1.smithi152.stdout:3/587: symlink de/d1f/lc2 0 2024-09-13T23:06:29.142 INFO:tasks.workunit.client.1.smithi152.stdout:5/677: creat d5/d26/d61/d68/fe6 x:0 0 0 2024-09-13T23:06:29.145 INFO:tasks.workunit.client.1.smithi152.stdout:0/636: rename d18/d1f/d29/d2f/d3d/c5f to d18/d1f/d39/d7c/cdc 0 2024-09-13T23:06:29.145 INFO:tasks.workunit.client.1.smithi152.stdout:3/588: link de/f3e de/d14/d47/d70/d87/fc3 0 2024-09-13T23:06:29.147 INFO:tasks.workunit.client.1.smithi152.stdout:3/589: mknod de/d14/d47/d57/d5d/d6e/cc4 0 2024-09-13T23:06:29.149 INFO:tasks.workunit.client.1.smithi152.stdout:3/590: dread de/d14/d76/f8e [0,4194304] 0 2024-09-13T23:06:29.151 INFO:tasks.workunit.client.1.smithi152.stdout:3/591: rename de/d14/d47/d57/d5d/l5a to de/d14/d47/d57/d5d/lc5 0 2024-09-13T23:06:29.152 INFO:tasks.workunit.client.1.smithi152.stdout:3/592: truncate de/f1c 1613046 0 2024-09-13T23:06:29.152 INFO:tasks.workunit.client.1.smithi152.stdout:3/593: chown de/d1f/fb8 90 1 2024-09-13T23:06:29.169 INFO:tasks.workunit.client.1.smithi152.stdout:3/594: dread de/d14/d47/d57/f80 [0,4194304] 0 2024-09-13T23:06:29.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/678: dwrite d5/da/f43 [0,4194304] 0 2024-09-13T23:06:29.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/679: fsync d5/d26/d61/d68/f7b 0 2024-09-13T23:06:29.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/680: fsync d5/dc/da3/fc4 0 2024-09-13T23:06:29.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/681: write d5/dc/d19/d20/d2e/d28/d92/fce [593884,94008] 0 2024-09-13T23:06:29.173 INFO:tasks.workunit.client.1.smithi152.stdout:5/682: truncate d5/dc/d19/d20/f32 975021 0 2024-09-13T23:06:29.173 INFO:tasks.workunit.client.1.smithi152.stdout:0/637: dwrite d18/d1f/d39/f43 [0,4194304] 0 2024-09-13T23:06:29.184 INFO:tasks.workunit.client.1.smithi152.stdout:3/595: read de/d14/d47/d57/d5d/f41 [3740817,25651] 0 2024-09-13T23:06:29.185 INFO:tasks.workunit.client.1.smithi152.stdout:3/596: rename de/d14/d76/f88 to de/d14/d47/d57/fc6 0 2024-09-13T23:06:29.186 INFO:tasks.workunit.client.1.smithi152.stdout:0/638: write d18/d1f/d29/d3f/f59 [2421206,110404] 0 2024-09-13T23:06:29.186 INFO:tasks.workunit.client.1.smithi152.stdout:0/639: chown d18/d1f/d33/d65/d7a/d83/fc9 2015638 1 2024-09-13T23:06:29.186 INFO:tasks.workunit.client.1.smithi152.stdout:0/640: chown d18/d1f/d29/d2f/d3d/f5e 0 1 2024-09-13T23:06:29.187 INFO:tasks.workunit.client.1.smithi152.stdout:0/641: mknod d18/d1f/d29/d3f/da0/cdd 0 2024-09-13T23:06:29.188 INFO:tasks.workunit.client.1.smithi152.stdout:0/642: symlink d18/d1f/d33/d6e/lde 0 2024-09-13T23:06:29.189 INFO:tasks.workunit.client.1.smithi152.stdout:0/643: getdents d18/d1f/d29/d2f 0 2024-09-13T23:06:29.190 INFO:tasks.workunit.client.1.smithi152.stdout:0/644: getdents d18/d8f/dc5 0 2024-09-13T23:06:29.191 INFO:tasks.workunit.client.1.smithi152.stdout:0/645: creat d18/d1f/d29/d3f/d40/daa/fdf x:0 0 0 2024-09-13T23:06:29.209 INFO:tasks.workunit.client.1.smithi152.stdout:0/646: dwrite d18/d1f/fb1 [0,4194304] 0 2024-09-13T23:06:29.209 INFO:tasks.workunit.client.1.smithi152.stdout:0/647: read d18/d1f/d29/f46 [2371078,106996] 0 2024-09-13T23:06:29.216 INFO:tasks.workunit.client.1.smithi152.stdout:0/648: read d18/d19/f67 [1942890,40672] 0 2024-09-13T23:06:29.217 INFO:tasks.workunit.client.1.smithi152.stdout:0/649: rmdir d18/d1f/d29/d3f/d4b/d66 39 2024-09-13T23:06:29.218 INFO:tasks.workunit.client.1.smithi152.stdout:0/650: creat d18/d19/d2c/fe0 x:0 0 0 2024-09-13T23:06:29.226 INFO:tasks.workunit.client.1.smithi152.stdout:0/651: read d18/f1a [3180087,1963] 0 2024-09-13T23:06:29.227 INFO:tasks.workunit.client.1.smithi152.stdout:0/652: mkdir d18/d1f/d33/de1 0 2024-09-13T23:06:29.287 INFO:tasks.workunit.client.1.smithi152.stdout:3/597: dread de/d14/d47/d57/d5d/d6e/f94 [0,4194304] 0 2024-09-13T23:06:29.289 INFO:tasks.workunit.client.1.smithi152.stdout:3/598: write de/d1f/f52 [955624,86490] 0 2024-09-13T23:06:29.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/599: dread de/d14/d38/f19 [0,4194304] 0 2024-09-13T23:06:29.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/600: symlink de/d14/d47/d70/lc7 0 2024-09-13T23:06:29.296 INFO:tasks.workunit.client.1.smithi152.stdout:3/601: rename de/d14/cab to de/d14/d47/d57/d5d/cc8 0 2024-09-13T23:06:29.297 INFO:tasks.workunit.client.1.smithi152.stdout:3/602: mkdir de/d14/d47/d57/dc9 0 2024-09-13T23:06:29.298 INFO:tasks.workunit.client.1.smithi152.stdout:3/603: mkdir de/d14/d47/d70/dca 0 2024-09-13T23:06:29.299 INFO:tasks.workunit.client.1.smithi152.stdout:3/604: rename de/d14/d38/db9 to de/d1f/da2/dcb 0 2024-09-13T23:06:29.299 INFO:tasks.workunit.client.1.smithi152.stdout:3/605: chown de/d14/d47/d70/d72/fb1 13935726 1 2024-09-13T23:06:29.299 INFO:tasks.workunit.client.1.smithi152.stdout:3/606: dread - de/d14/d47/d70/f7b zero size 2024-09-13T23:06:29.300 INFO:tasks.workunit.client.1.smithi152.stdout:3/607: mkdir de/d14/d47/d57/d5d/dcc 0 2024-09-13T23:06:29.304 INFO:tasks.workunit.client.1.smithi152.stdout:5/683: dwrite d5/d26/f5d [0,4194304] 0 2024-09-13T23:06:29.306 INFO:tasks.workunit.client.1.smithi152.stdout:0/653: dwrite d18/d1f/d29/f60 [0,4194304] 0 2024-09-13T23:06:29.306 INFO:tasks.workunit.client.1.smithi152.stdout:5/684: creat d5/dc/d19/d65/d99/d98/dc2/fe7 x:0 0 0 2024-09-13T23:06:29.310 INFO:tasks.workunit.client.1.smithi152.stdout:0/654: link d18/d19/f67 d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fe2 0 2024-09-13T23:06:29.313 INFO:tasks.workunit.client.1.smithi152.stdout:5/685: unlink d5/dc/d19/d20/d2e/d28/l37 0 2024-09-13T23:06:29.313 INFO:tasks.workunit.client.1.smithi152.stdout:5/686: dread - d5/dc/d19/d65/d99/d98/dc2/fe7 zero size 2024-09-13T23:06:29.315 INFO:tasks.workunit.client.1.smithi152.stdout:0/655: mkdir d18/d8f/dc5/dd0/dd9/de3 0 2024-09-13T23:06:29.316 INFO:tasks.workunit.client.1.smithi152.stdout:5/687: readlink d5/dc/l59 0 2024-09-13T23:06:29.318 INFO:tasks.workunit.client.1.smithi152.stdout:0/656: creat d18/d1f/d29/d2f/dd3/fe4 x:0 0 0 2024-09-13T23:06:29.318 INFO:tasks.workunit.client.1.smithi152.stdout:0/657: stat d18/d1f/d29/f46 0 2024-09-13T23:06:29.319 INFO:tasks.workunit.client.1.smithi152.stdout:5/688: mknod d5/dc/da3/db4/db3/ce8 0 2024-09-13T23:06:29.320 INFO:tasks.workunit.client.1.smithi152.stdout:0/658: mknod d18/d1f/d33/de1/ce5 0 2024-09-13T23:06:29.321 INFO:tasks.workunit.client.1.smithi152.stdout:5/689: write d5/dc/d19/d65/d99/d98/f9c [991555,104686] 0 2024-09-13T23:06:29.322 INFO:tasks.workunit.client.1.smithi152.stdout:5/690: creat d5/dc/d19/d65/d99/d98/dc2/d82/fe9 x:0 0 0 2024-09-13T23:06:29.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/691: getdents d5/dc/d19/d20/d55 0 2024-09-13T23:06:29.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/692: chown d5/dc/d19/d65/d99/c8e 10567 1 2024-09-13T23:06:29.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/693: creat d5/fea x:0 0 0 2024-09-13T23:06:29.327 INFO:tasks.workunit.client.1.smithi152.stdout:5/694: creat d5/dc/d19/d65/d99/d98/da0/dc1/feb x:0 0 0 2024-09-13T23:06:29.327 INFO:tasks.workunit.client.1.smithi152.stdout:5/695: dread - d5/dc/f54 zero size 2024-09-13T23:06:29.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/696: rmdir d5/d26/d61/d68 39 2024-09-13T23:06:29.355 INFO:tasks.workunit.client.1.smithi152.stdout:5/697: dwrite d5/d26/f33 [0,4194304] 0 2024-09-13T23:06:29.358 INFO:tasks.workunit.client.1.smithi152.stdout:5/698: dread d5/dc/d19/d20/dab/fbd [0,4194304] 0 2024-09-13T23:06:29.360 INFO:tasks.workunit.client.1.smithi152.stdout:5/699: symlink d5/dc/d19/d65/d99/d98/da0/dc1/lec 0 2024-09-13T23:06:29.360 INFO:tasks.workunit.client.1.smithi152.stdout:5/700: chown d5/d26/d61/c6b 457832 1 2024-09-13T23:06:29.361 INFO:tasks.workunit.client.1.smithi152.stdout:5/701: creat d5/dc/d19/d65/fed x:0 0 0 2024-09-13T23:06:29.361 INFO:tasks.workunit.client.1.smithi152.stdout:5/702: readlink d5/dc/d19/d65/d70/ld6 0 2024-09-13T23:06:29.361 INFO:tasks.workunit.client.1.smithi152.stdout:5/703: chown d5/dc/d19/d65/l3e 2779 1 2024-09-13T23:06:29.362 INFO:tasks.workunit.client.1.smithi152.stdout:5/704: symlink d5/dc/d19/lee 0 2024-09-13T23:06:29.362 INFO:tasks.workunit.client.1.smithi152.stdout:5/705: chown d5/d26/fc9 8 1 2024-09-13T23:06:29.362 INFO:tasks.workunit.client.1.smithi152.stdout:5/706: stat d5/dc/d19/d65/d99/c81 0 2024-09-13T23:06:29.362 INFO:tasks.workunit.client.1.smithi152.stdout:5/707: write f0 [1060870,103209] 0 2024-09-13T23:06:29.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/708: symlink d5/dc/d19/d65/d99/lef 0 2024-09-13T23:06:29.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/709: rename d5/dc/d19/d65/f50 to d5/ff0 0 2024-09-13T23:06:29.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/710: creat d5/dc/d19/d65/d99/da6/dad/ff1 x:0 0 0 2024-09-13T23:06:29.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/711: write d5/d26/d61/d68/f7b [417182,74454] 0 2024-09-13T23:06:29.367 INFO:tasks.workunit.client.1.smithi152.stdout:5/712: mknod d5/da/cf2 0 2024-09-13T23:06:29.367 INFO:tasks.workunit.client.1.smithi152.stdout:5/713: write d5/d26/fc9 [228184,102772] 0 2024-09-13T23:06:29.369 INFO:tasks.workunit.client.1.smithi152.stdout:5/714: symlink d5/lf3 0 2024-09-13T23:06:29.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/715: truncate d5/da/f6f 754554 0 2024-09-13T23:06:29.371 INFO:tasks.workunit.client.1.smithi152.stdout:5/716: dread d5/dc/d19/d20/dab/fbd [0,4194304] 0 2024-09-13T23:06:29.372 INFO:tasks.workunit.client.1.smithi152.stdout:5/717: write d5/dc/d19/d65/d99/d98/dc2/fe7 [128254,87751] 0 2024-09-13T23:06:29.372 INFO:tasks.workunit.client.1.smithi152.stdout:5/718: mkdir d5/d26/d61/d68/df4 0 2024-09-13T23:06:29.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/719: rmdir d5/dc/d5e 39 2024-09-13T23:06:29.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/720: read - d5/dc/d19/f9b zero size 2024-09-13T23:06:29.377 INFO:tasks.workunit.client.1.smithi152.stdout:5/721: mknod d5/dc/da3/db4/db3/cf5 0 2024-09-13T23:06:29.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/722: dread d5/da/f58 [0,4194304] 0 2024-09-13T23:06:29.380 INFO:tasks.workunit.client.1.smithi152.stdout:5/723: mkdir d5/dc/d19/d65/d99/da6/dad/dd8/df6 0 2024-09-13T23:06:29.381 INFO:tasks.workunit.client.1.smithi152.stdout:5/724: truncate d5/f7 3375018 0 2024-09-13T23:06:29.383 INFO:tasks.workunit.client.1.smithi152.stdout:5/725: mkdir d5/dc/d19/d20/dab/df7 0 2024-09-13T23:06:29.412 INFO:tasks.workunit.client.1.smithi152.stdout:5/726: dwrite d5/d26/d61/d68/f7b [0,4194304] 0 2024-09-13T23:06:29.412 INFO:tasks.workunit.client.1.smithi152.stdout:5/727: readlink d5/dc/d19/d65/l3e 0 2024-09-13T23:06:29.412 INFO:tasks.workunit.client.1.smithi152.stdout:5/728: chown d5/dc/d19/lee 1 1 2024-09-13T23:06:29.412 INFO:tasks.workunit.client.1.smithi152.stdout:5/729: creat d5/dc/d19/d65/d99/d98/dc2/d82/ff8 x:0 0 0 2024-09-13T23:06:29.412 INFO:tasks.workunit.client.1.smithi152.stdout:5/730: write d5/dc/d19/d65/fed [1015420,56108] 0 2024-09-13T23:06:29.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/731: creat d5/d26/d61/de0/ff9 x:0 0 0 2024-09-13T23:06:29.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/732: fsync d5/dc/d19/d65/d70/fd5 0 2024-09-13T23:06:29.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/733: mkdir d5/da/dfa 0 2024-09-13T23:06:29.416 INFO:tasks.workunit.client.1.smithi152.stdout:5/734: mkdir d5/dc/d19/d20/d2e/d28/dfb 0 2024-09-13T23:06:29.416 INFO:tasks.workunit.client.1.smithi152.stdout:5/735: write f0 [6082166,383] 0 2024-09-13T23:06:29.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/736: unlink d5/dc/d19/d65/d99/d98/dc2/fe7 0 2024-09-13T23:06:29.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/737: readlink d5/l90 0 2024-09-13T23:06:29.430 INFO:tasks.workunit.client.1.smithi152.stdout:5/738: write d5/da/f43 [571969,108505] 0 2024-09-13T23:06:29.433 INFO:tasks.workunit.client.1.smithi152.stdout:5/739: truncate f0 5133927 0 2024-09-13T23:06:29.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/740: dread d5/d26/d61/f77 [0,4194304] 0 2024-09-13T23:06:29.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/741: stat d5/d26/d61/d68/f93 0 2024-09-13T23:06:29.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/539: sync 2024-09-13T23:06:29.681 INFO:tasks.workunit.client.1.smithi152.stdout:7/799: sync 2024-09-13T23:06:29.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/540: chown d17/d19/l64 1 1 2024-09-13T23:06:29.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/541: creat d17/d25/d80/d8a/fa6 x:0 0 0 2024-09-13T23:06:29.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/542: symlink d17/d25/d32/d4b/la7 0 2024-09-13T23:06:29.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/543: dread - d17/d25/d32/fa1 zero size 2024-09-13T23:06:29.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/544: getdents d17/d25/d32/d4b/d84 0 2024-09-13T23:06:29.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/545: write d17/d25/f85 [341717,12857] 0 2024-09-13T23:06:29.685 INFO:tasks.workunit.client.1.smithi152.stdout:8/546: truncate d17/f1d 2104302 0 2024-09-13T23:06:29.685 INFO:tasks.workunit.client.1.smithi152.stdout:8/547: truncate d17/d25/d80/f93 7931449 0 2024-09-13T23:06:29.690 INFO:tasks.workunit.client.1.smithi152.stdout:7/800: read d17/d24/d9f/d51/d5b/d90/d2b/f49 [2075868,80164] 0 2024-09-13T23:06:29.690 INFO:tasks.workunit.client.1.smithi152.stdout:7/801: chown d17/d24 771530 1 2024-09-13T23:06:29.693 INFO:tasks.workunit.client.1.smithi152.stdout:7/802: dread d17/d24/d9f/d51/d5b/d90/d2b/f49 [0,4194304] 0 2024-09-13T23:06:29.695 INFO:tasks.workunit.client.1.smithi152.stdout:7/803: dread d17/d24/d9f/f8b [0,4194304] 0 2024-09-13T23:06:29.695 INFO:tasks.workunit.client.1.smithi152.stdout:7/804: write d17/d24/d9f/d51/d5b/d90/d2b/f49 [4839380,113594] 0 2024-09-13T23:06:29.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/805: dread d17/d24/d9f/d51/d5b/d63/faa [0,4194304] 0 2024-09-13T23:06:29.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/806: stat d17/d24/d9f/dac/dba/fff 0 2024-09-13T23:06:29.714 INFO:tasks.workunit.client.1.smithi152.stdout:8/548: dwrite d17/d19/f20 [0,4194304] 0 2024-09-13T23:06:29.740 INFO:tasks.workunit.client.1.smithi152.stdout:7/807: link d17/d24/d9f/d51/d5b/d90/d2b/f72 d17/d24/f111 0 2024-09-13T23:06:29.754 INFO:tasks.workunit.client.1.smithi152.stdout:8/549: creat d17/d25/d32/d4b/d84/d91/fa8 x:0 0 0 2024-09-13T23:06:29.759 INFO:tasks.workunit.client.1.smithi152.stdout:7/808: chown d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/l55 922429 1 2024-09-13T23:06:29.759 INFO:tasks.workunit.client.1.smithi152.stdout:7/809: write d17/d24/d9f/d51/d5b/d90/d2b/fd4 [335317,49351] 0 2024-09-13T23:06:29.760 INFO:tasks.workunit.client.1.smithi152.stdout:7/810: creat d17/d24/d9f/d51/d5b/d90/f112 x:0 0 0 2024-09-13T23:06:29.774 INFO:tasks.workunit.client.1.smithi152.stdout:8/550: dwrite d17/d25/d32/d4b/d84/d91/fa8 [0,4194304] 0 2024-09-13T23:06:29.775 INFO:tasks.workunit.client.1.smithi152.stdout:8/551: truncate d17/d19/f56 690139 0 2024-09-13T23:06:29.777 INFO:tasks.workunit.client.1.smithi152.stdout:8/552: mknod d17/d25/ca9 0 2024-09-13T23:06:29.778 INFO:tasks.workunit.client.1.smithi152.stdout:8/553: creat d17/d25/d32/d4b/d84/d91/d9c/faa x:0 0 0 2024-09-13T23:06:29.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/554: mknod d17/d25/d32/cab 0 2024-09-13T23:06:29.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/555: dread - d17/d25/d32/d9a/d8f/d9e/f9f zero size 2024-09-13T23:06:29.780 INFO:tasks.workunit.client.1.smithi152.stdout:8/556: mkdir d17/d19/dac 0 2024-09-13T23:06:29.781 INFO:tasks.workunit.client.1.smithi152.stdout:8/557: creat d17/d25/d32/d4b/d95/fad x:0 0 0 2024-09-13T23:06:29.789 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:29 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:29.790 INFO:tasks.workunit.client.1.smithi152.stdout:7/811: dwrite d17/d6c/fe8 [0,4194304] 0 2024-09-13T23:06:29.793 INFO:tasks.workunit.client.1.smithi152.stdout:8/558: dread d17/d25/f2f [0,4194304] 0 2024-09-13T23:06:29.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:29 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:29.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/559: dwrite d17/d25/d32/d44/f6c [0,4194304] 0 2024-09-13T23:06:29.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/560: dread - d17/f43 zero size 2024-09-13T23:06:29.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/561: link d17/f29 d17/d25/d32/d50/fae 0 2024-09-13T23:06:29.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/562: chown d17/l87 1283145 1 2024-09-13T23:06:29.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/563: creat d17/faf x:0 0 0 2024-09-13T23:06:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:8/564: dwrite d17/f61 [0,4194304] 0 2024-09-13T23:06:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:6/691: sync 2024-09-13T23:06:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:6/692: write d4/de/fcd [86120,55546] 0 2024-09-13T23:06:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:6/693: chown d4/de/d21 1330 1 2024-09-13T23:06:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:2/756: sync 2024-09-13T23:06:29.835 INFO:tasks.workunit.client.1.smithi152.stdout:6/694: unlink d4/f75 0 2024-09-13T23:06:29.835 INFO:tasks.workunit.client.1.smithi152.stdout:6/695: getdents d4/de/d12/d3e/db3 0 2024-09-13T23:06:29.847 INFO:tasks.workunit.client.1.smithi152.stdout:8/565: read d17/d25/d32/f63 [1135237,90887] 0 2024-09-13T23:06:29.848 INFO:tasks.workunit.client.1.smithi152.stdout:8/566: readlink d17/d25/d32/d4b/la7 0 2024-09-13T23:06:29.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/567: creat d17/d25/d32/d4b/d84/fb0 x:0 0 0 2024-09-13T23:06:29.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/568: read - d17/d25/d32/d9a/d8f/d9e/f9f zero size 2024-09-13T23:06:29.849 INFO:tasks.workunit.client.1.smithi152.stdout:8/569: stat d17/d25/d32/l60 0 2024-09-13T23:06:29.849 INFO:tasks.workunit.client.1.smithi152.stdout:7/812: fsync d17/d24/d9f/d51/d5b/d90/f112 0 2024-09-13T23:06:29.850 INFO:tasks.workunit.client.1.smithi152.stdout:6/696: write d4/de/d12/f5f [709126,123623] 0 2024-09-13T23:06:29.851 INFO:tasks.workunit.client.1.smithi152.stdout:2/757: dwrite d0/d4/d9/d14/d48/f102 [0,4194304] 0 2024-09-13T23:06:29.851 INFO:tasks.workunit.client.1.smithi152.stdout:8/570: creat d17/d25/d80/da3/fb1 x:0 0 0 2024-09-13T23:06:29.852 INFO:tasks.workunit.client.1.smithi152.stdout:7/813: truncate d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f6d 3481288 0 2024-09-13T23:06:29.858 INFO:tasks.workunit.client.1.smithi152.stdout:2/758: creat d0/d4/d9/d18/d1e/dc0/f10a x:0 0 0 2024-09-13T23:06:29.858 INFO:tasks.workunit.client.1.smithi152.stdout:8/571: mkdir d17/d25/d32/d4b/d84/db2 0 2024-09-13T23:06:29.861 INFO:tasks.workunit.client.1.smithi152.stdout:8/572: dread d17/d25/f81 [0,4194304] 0 2024-09-13T23:06:29.861 INFO:tasks.workunit.client.1.smithi152.stdout:6/697: dread d4/de/d12/f9b [0,4194304] 0 2024-09-13T23:06:29.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/759: unlink d0/d4/f1d 0 2024-09-13T23:06:29.863 INFO:tasks.workunit.client.1.smithi152.stdout:6/698: creat d4/de/d12/fe3 x:0 0 0 2024-09-13T23:06:29.865 INFO:tasks.workunit.client.1.smithi152.stdout:2/760: mkdir d0/d4/d9/d16/d30/d9e/db5/d10b 0 2024-09-13T23:06:29.865 INFO:tasks.workunit.client.1.smithi152.stdout:2/761: write d0/d4/d9/d55/fa1 [478541,87405] 0 2024-09-13T23:06:29.866 INFO:tasks.workunit.client.1.smithi152.stdout:6/699: rename d4/de/d12/d16/d2a/d3d/daa/cbe to d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/ce4 0 2024-09-13T23:06:29.866 INFO:tasks.workunit.client.1.smithi152.stdout:6/700: read - d4/de/d12/fe3 zero size 2024-09-13T23:06:29.868 INFO:tasks.workunit.client.1.smithi152.stdout:6/701: rename d4/de/d21/d5c/f67 to d4/de/d12/d16/d2a/d3d/dcf/ddf/fe5 0 2024-09-13T23:06:29.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/702: dread d4/de/d1d/f6b [0,4194304] 0 2024-09-13T23:06:29.870 INFO:tasks.workunit.client.1.smithi152.stdout:6/703: creat d4/de/d12/d16/d2a/d3d/dcf/fe6 x:0 0 0 2024-09-13T23:06:29.871 INFO:tasks.workunit.client.1.smithi152.stdout:6/704: stat d4/de/d12/d16/f9c 0 2024-09-13T23:06:29.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/573: dwrite d17/d25/d32/f3f [0,4194304] 0 2024-09-13T23:06:29.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/574: write d17/d25/f79 [151433,71397] 0 2024-09-13T23:06:29.877 INFO:tasks.workunit.client.1.smithi152.stdout:8/575: mknod d17/d25/d32/d4b/d84/d91/cb3 0 2024-09-13T23:06:29.878 INFO:tasks.workunit.client.1.smithi152.stdout:8/576: rename d17/d25/d32/c42 to d17/d25/d32/d4b/cb4 0 2024-09-13T23:06:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/577: chown d17/d25/d32/f38 2973 1 2024-09-13T23:06:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/578: creat d17/d25/d32/d4b/d84/db2/fb5 x:0 0 0 2024-09-13T23:06:29.880 INFO:tasks.workunit.client.1.smithi152.stdout:8/579: write d17/d25/d32/f3e [884733,104127] 0 2024-09-13T23:06:29.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/580: symlink d17/d25/d32/d4b/d95/lb6 0 2024-09-13T23:06:29.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/581: write d17/d19/f56 [1109269,59132] 0 2024-09-13T23:06:29.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/582: chown d17/d25/ca9 0 1 2024-09-13T23:06:29.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/583: dread - d17/d25/d32/d9a/d8f/d9e/f9f zero size 2024-09-13T23:06:29.884 INFO:tasks.workunit.client.1.smithi152.stdout:8/584: rmdir d17/d25/d32/d9a/d8f/d9e 39 2024-09-13T23:06:29.885 INFO:tasks.workunit.client.1.smithi152.stdout:8/585: mknod d17/d25/d32/d4b/d84/d91/d9c/cb7 0 2024-09-13T23:06:29.885 INFO:tasks.workunit.client.1.smithi152.stdout:8/586: read - d17/f43 zero size 2024-09-13T23:06:29.885 INFO:tasks.workunit.client.1.smithi152.stdout:8/587: truncate d17/d19/f28 1140695 0 2024-09-13T23:06:29.887 INFO:tasks.workunit.client.1.smithi152.stdout:8/588: symlink d17/d25/d80/da3/lb8 0 2024-09-13T23:06:29.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/589: rmdir d17/d25/d32/d4b/d84 39 2024-09-13T23:06:29.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/590: chown d17/d25/d32/d4b/f6e 288491983 1 2024-09-13T23:06:29.893 INFO:tasks.workunit.client.1.smithi152.stdout:8/591: rmdir d17/d25/d32/d4b/d84 39 2024-09-13T23:06:29.893 INFO:tasks.workunit.client.1.smithi152.stdout:8/592: chown d17/d25/d80/d8a/fa6 128526706 1 2024-09-13T23:06:29.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/816: sync 2024-09-13T23:06:29.904 INFO:tasks.workunit.client.1.smithi152.stdout:9/869: sync 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:4/834: sync 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/608: sync 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:4/835: chown d3/d4/d32/d86/d95/cd4 2399068 1 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:4/836: fdatasync d3/d4/d6/d63/f7e 0 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:5/742: sync 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/659: sync 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:5/743: truncate d5/dc/d19/d65/d99/d98/da0/dc1/feb 510599 0 2024-09-13T23:06:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:5/744: chown d5/dc/d19/d20/d2e/d28/d92/ccf 1 1 2024-09-13T23:06:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:0/660: write d18/d19/d2c/f30 [1873039,56565] 0 2024-09-13T23:06:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:1/817: rmdir d4/d9/d1a/d22/d24 39 2024-09-13T23:06:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/593: dwrite d17/d25/f85 [0,4194304] 0 2024-09-13T23:06:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/594: stat d17/d25/d32/d4b/d84/d91 0 2024-09-13T23:06:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/595: write d17/d25/d32/d9a/f8c [197584,89732] 0 2024-09-13T23:06:29.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/745: mkdir d5/dc/d19/d65/d99/d98/dc2/d80/dfc 0 2024-09-13T23:06:29.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/818: mknod d4/d9/c115 0 2024-09-13T23:06:29.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/819: stat d4/l86 0 2024-09-13T23:06:29.912 INFO:tasks.workunit.client.1.smithi152.stdout:8/596: creat d17/d19/dac/fb9 x:0 0 0 2024-09-13T23:06:29.913 INFO:tasks.workunit.client.1.smithi152.stdout:3/609: write de/d14/d47/d70/d87/fc3 [2426900,1335] 0 2024-09-13T23:06:29.913 INFO:tasks.workunit.client.1.smithi152.stdout:5/746: mknod d5/dc/d19/d20/d2e/d28/cfd 0 2024-09-13T23:06:29.913 INFO:tasks.workunit.client.1.smithi152.stdout:5/747: readlink d5/dc/le3 0 2024-09-13T23:06:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/837: dread d3/d4/d6/f54 [0,4194304] 0 2024-09-13T23:06:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/838: chown d3/d4/d6/d66/d62/d9d 9877 1 2024-09-13T23:06:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/839: fsync d3/fbd 0 2024-09-13T23:06:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/840: write d3/d4/d8d/d93/d109/fa8 [975862,90771] 0 2024-09-13T23:06:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:1/820: symlink d4/d9/d1a/d22/d24/dde/df4/l116 0 2024-09-13T23:06:29.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/821: write d4/d9/d1a/d22/f9b [209536,49516] 0 2024-09-13T23:06:29.918 INFO:tasks.workunit.client.1.smithi152.stdout:8/597: mkdir d17/d25/d32/dba 0 2024-09-13T23:06:29.918 INFO:tasks.workunit.client.1.smithi152.stdout:9/870: dwrite d3/d24/d67/d4a/d8e/fef [0,4194304] 0 2024-09-13T23:06:29.919 INFO:tasks.workunit.client.1.smithi152.stdout:0/661: write d18/d1f/d29/f60 [234662,89179] 0 2024-09-13T23:06:29.920 INFO:tasks.workunit.client.1.smithi152.stdout:3/610: creat de/fcd x:0 0 0 2024-09-13T23:06:29.921 INFO:tasks.workunit.client.1.smithi152.stdout:3/611: dread de/d14/d76/f8e [0,4194304] 0 2024-09-13T23:06:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:5/748: truncate d5/dc/d19/d20/d2e/f34 6932123 0 2024-09-13T23:06:29.927 INFO:tasks.workunit.client.1.smithi152.stdout:4/841: creat d3/d4/d6/d66/d62/f10f x:0 0 0 2024-09-13T23:06:29.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/662: write d18/d19/d2c/f6d [6244099,19202] 0 2024-09-13T23:06:29.932 INFO:tasks.workunit.client.1.smithi152.stdout:1/822: rename d4/d9/d1a/d22/d24/d48/f4a to d4/d9/d1a/d22/d24/f117 0 2024-09-13T23:06:29.932 INFO:tasks.workunit.client.1.smithi152.stdout:1/823: chown d4/d47/d10a 1209 1 2024-09-13T23:06:29.936 INFO:tasks.workunit.client.1.smithi152.stdout:9/871: creat d3/d24/f11e x:0 0 0 2024-09-13T23:06:29.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/612: creat de/d14/d47/d57/d93/fce x:0 0 0 2024-09-13T23:06:29.942 INFO:tasks.workunit.client.1.smithi152.stdout:5/749: mknod d5/dc/da3/db4/cfe 0 2024-09-13T23:06:29.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/598: rename d17/d25/d32/d9a/l37 to d17/d25/d32/d44/lbb 0 2024-09-13T23:06:29.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/599: chown c8 1 1 2024-09-13T23:06:29.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/600: creat d17/d25/d80/d8a/fbc x:0 0 0 2024-09-13T23:06:29.946 INFO:tasks.workunit.client.1.smithi152.stdout:8/601: fdatasync d17/d25/d32/d50/f57 0 2024-09-13T23:06:29.947 INFO:tasks.workunit.client.1.smithi152.stdout:1/824: mknod d4/d47/d10a/c118 0 2024-09-13T23:06:29.949 INFO:tasks.workunit.client.1.smithi152.stdout:9/872: creat d3/db0/f11f x:0 0 0 2024-09-13T23:06:29.949 INFO:tasks.workunit.client.1.smithi152.stdout:5/750: dread d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:29.950 INFO:tasks.workunit.client.1.smithi152.stdout:3/613: symlink de/d1f/da2/lcf 0 2024-09-13T23:06:29.952 INFO:tasks.workunit.client.1.smithi152.stdout:8/602: creat d17/d25/d32/d4b/d84/db2/fbd x:0 0 0 2024-09-13T23:06:29.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/603: read d17/d19/f98 [1329208,94225] 0 2024-09-13T23:06:29.954 INFO:tasks.workunit.client.1.smithi152.stdout:5/751: stat d5/dc/da3/db4/db3/cdb 0 2024-09-13T23:06:29.954 INFO:tasks.workunit.client.1.smithi152.stdout:3/614: mknod de/cd0 0 2024-09-13T23:06:29.957 INFO:tasks.workunit.client.1.smithi152.stdout:5/752: dread d5/da/f58 [0,4194304] 0 2024-09-13T23:06:29.959 INFO:tasks.workunit.client.1.smithi152.stdout:3/615: symlink de/ld1 0 2024-09-13T23:06:29.960 INFO:tasks.workunit.client.1.smithi152.stdout:5/753: rename d5/dc/d19/d20/d2e/d28/cc3 to d5/da/cff 0 2024-09-13T23:06:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:5/754: fsync d5/da/f6f 0 2024-09-13T23:06:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:5/755: fdatasync d5/dc/d5e/f6a 0 2024-09-13T23:06:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:5/756: fsync d5/d26/d61/d68/fe6 0 2024-09-13T23:06:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:5/757: write d5/dc/d19/d65/d99/da6/dad/fb0 [292599,118045] 0 2024-09-13T23:06:29.962 INFO:tasks.workunit.client.1.smithi152.stdout:3/616: chown de/d63/c7e 40167 1 2024-09-13T23:06:29.964 INFO:tasks.workunit.client.1.smithi152.stdout:5/758: unlink d5/dc/d19/fc0 0 2024-09-13T23:06:29.965 INFO:tasks.workunit.client.1.smithi152.stdout:3/617: truncate de/f39 342308 0 2024-09-13T23:06:29.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/618: creat de/d1f/fd2 x:0 0 0 2024-09-13T23:06:29.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/759: dread d5/dc/d19/d20/f32 [0,4194304] 0 2024-09-13T23:06:29.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/760: stat d5/dc/d19/f9b 0 2024-09-13T23:06:29.967 INFO:tasks.workunit.client.1.smithi152.stdout:3/619: mkdir de/d1f/da2/dd3 0 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:9/873: dread d3/d24/d67/d60/f84 [0,4194304] 0 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:4/842: dwrite d3/d4/d6/d66/d1c/d59/f68 [4194304,4194304] 0 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:4/843: chown d3/d4/d6/d63/d79/fd7 0 1 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:9/874: rmdir d3/d24/d67/d4a/d71 39 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:0/663: dwrite d18/d1f/f34 [0,4194304] 0 2024-09-13T23:06:29.968 INFO:tasks.workunit.client.1.smithi152.stdout:0/664: write d18/d1f/d39/f45 [578891,102686] 0 2024-09-13T23:06:29.969 INFO:tasks.workunit.client.1.smithi152.stdout:3/620: dread de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:29.971 INFO:tasks.workunit.client.1.smithi152.stdout:4/844: rename d3/d4/d32/l70 to d3/d4/d6/d66/d1c/l110 0 2024-09-13T23:06:29.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/825: dwrite d4/d47/fdc [0,4194304] 0 2024-09-13T23:06:29.971 INFO:tasks.workunit.client.1.smithi152.stdout:1/826: chown d4/f93 6 1 2024-09-13T23:06:29.974 INFO:tasks.workunit.client.1.smithi152.stdout:3/621: creat de/d14/d47/d70/dca/fd4 x:0 0 0 2024-09-13T23:06:29.974 INFO:tasks.workunit.client.1.smithi152.stdout:3/622: chown de/d1f/fd2 2117088422 1 2024-09-13T23:06:29.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/761: write d5/dc/d19/fb2 [4165390,50758] 0 2024-09-13T23:06:29.985 INFO:tasks.workunit.client.1.smithi152.stdout:3/623: creat de/d1f/da2/da8/fd5 x:0 0 0 2024-09-13T23:06:29.985 INFO:tasks.workunit.client.1.smithi152.stdout:3/624: getdents de/d1f/da2/dd3 0 2024-09-13T23:06:29.986 INFO:tasks.workunit.client.1.smithi152.stdout:4/845: dread d3/f40 [0,4194304] 0 2024-09-13T23:06:29.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/625: mknod de/d1f/da2/cd6 0 2024-09-13T23:06:29.994 INFO:tasks.workunit.client.1.smithi152.stdout:5/762: dread d5/dc/da3/db4/db3/fcc [0,4194304] 0 2024-09-13T23:06:29.994 INFO:tasks.workunit.client.1.smithi152.stdout:5/763: fsync d5/f7 0 2024-09-13T23:06:29.995 INFO:tasks.workunit.client.1.smithi152.stdout:3/626: creat de/d14/d47/fd7 x:0 0 0 2024-09-13T23:06:29.999 INFO:tasks.workunit.client.1.smithi152.stdout:4/846: write d3/d4/d6/d8/d17/d3a/f77 [2201030,82440] 0 2024-09-13T23:06:29.999 INFO:tasks.workunit.client.1.smithi152.stdout:9/875: dwrite d3/d24/d67/d4a/d71/db7/fcd [0,4194304] 0 2024-09-13T23:06:29.999 INFO:tasks.workunit.client.1.smithi152.stdout:9/876: write d3/d52/fe5 [398520,120885] 0 2024-09-13T23:06:30.002 INFO:tasks.workunit.client.1.smithi152.stdout:0/665: dwrite d18/f2d [0,4194304] 0 2024-09-13T23:06:30.004 INFO:tasks.workunit.client.1.smithi152.stdout:5/764: write d5/f22 [6557406,101139] 0 2024-09-13T23:06:30.009 INFO:tasks.workunit.client.1.smithi152.stdout:3/627: write de/f45 [6294864,35990] 0 2024-09-13T23:06:30.009 INFO:tasks.workunit.client.1.smithi152.stdout:1/827: dwrite d4/d9/d1a/d22/fe0 [0,4194304] 0 2024-09-13T23:06:30.010 INFO:tasks.workunit.client.1.smithi152.stdout:3/628: write de/d14/d47/d57/d5d/d6e/f94 [357531,114840] 0 2024-09-13T23:06:30.013 INFO:tasks.workunit.client.1.smithi152.stdout:4/847: rename d3/d4/d6/d66/d62/d9d to d3/d4/d6/d63/d111 0 2024-09-13T23:06:30.017 INFO:tasks.workunit.client.1.smithi152.stdout:0/666: write d18/f2d [2998559,92762] 0 2024-09-13T23:06:30.020 INFO:tasks.workunit.client.1.smithi152.stdout:3/629: truncate de/d14/d47/d57/f69 513730 0 2024-09-13T23:06:30.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/877: dwrite d3/f4f [0,4194304] 0 2024-09-13T23:06:30.020 INFO:tasks.workunit.client.1.smithi152.stdout:5/765: dread d5/dc/d19/d65/d99/da6/f94 [0,4194304] 0 2024-09-13T23:06:30.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/878: stat d3/d24/c7d 0 2024-09-13T23:06:30.020 INFO:tasks.workunit.client.1.smithi152.stdout:9/879: chown d3/d52/c77 278610 1 2024-09-13T23:06:30.021 INFO:tasks.workunit.client.1.smithi152.stdout:1/828: rename d4/d9/d1a/d22/d24/d48/ce9 to d4/d9/d1a/d22/d24/daa/c119 0 2024-09-13T23:06:30.022 INFO:tasks.workunit.client.1.smithi152.stdout:0/667: getdents d18/d19/d74 0 2024-09-13T23:06:30.023 INFO:tasks.workunit.client.1.smithi152.stdout:4/848: write d3/d4/d6/f54 [2184315,32659] 0 2024-09-13T23:06:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/849: dread d3/d4/d6/d66/d1c/d5f/d8b/fff [0,4194304] 0 2024-09-13T23:06:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/850: write d3/d4/d6/d63/d79/f96 [465398,44398] 0 2024-09-13T23:06:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/851: write d3/d4/d6/d66/d2b/d84/f48 [4410246,93965] 0 2024-09-13T23:06:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:3/630: getdents de/d14/d47/d57/d5d 0 2024-09-13T23:06:30.026 INFO:tasks.workunit.client.1.smithi152.stdout:9/880: creat d3/d24/d34/d45/daa/f120 x:0 0 0 2024-09-13T23:06:30.029 INFO:tasks.workunit.client.1.smithi152.stdout:9/881: dread d3/d24/d67/d4a/f96 [0,4194304] 0 2024-09-13T23:06:30.029 INFO:tasks.workunit.client.1.smithi152.stdout:1/829: mknod d4/d4c/d8d/d99/d104/c11a 0 2024-09-13T23:06:30.032 INFO:tasks.workunit.client.1.smithi152.stdout:0/668: symlink d18/d8f/dc5/le6 0 2024-09-13T23:06:30.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/882: write d3/d24/d67/d60/f84 [1880146,34522] 0 2024-09-13T23:06:30.034 INFO:tasks.workunit.client.1.smithi152.stdout:4/852: rename d3/d4/d6/d63/f7e to d3/d4/d6/d8/d17/d5d/d94/d9b/da0/f112 0 2024-09-13T23:06:30.034 INFO:tasks.workunit.client.1.smithi152.stdout:4/853: readlink d3/d4/d6/d66/d1c/l38 0 2024-09-13T23:06:30.036 INFO:tasks.workunit.client.1.smithi152.stdout:1/830: creat d4/dc8/f11b x:0 0 0 2024-09-13T23:06:30.037 INFO:tasks.workunit.client.1.smithi152.stdout:0/669: creat d18/d1f/d29/d2f/d3d/fe7 x:0 0 0 2024-09-13T23:06:30.037 INFO:tasks.workunit.client.1.smithi152.stdout:0/670: fdatasync d18/d19/d74/da4/fab 0 2024-09-13T23:06:30.038 INFO:tasks.workunit.client.1.smithi152.stdout:9/883: mknod d3/d1e/d30/d5d/da3/d105/d107/c121 0 2024-09-13T23:06:30.039 INFO:tasks.workunit.client.1.smithi152.stdout:9/884: fsync d3/d24/d67/d4a/d71/fd1 0 2024-09-13T23:06:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/766: dwrite d5/dc/d19/d20/d2e/d28/d92/f87 [0,4194304] 0 2024-09-13T23:06:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/767: truncate d5/dc/d19/f9b 661930 0 2024-09-13T23:06:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/631: rename de/d14/d47/d57/d5d/cc8 to de/d1f/da2/dd3/cd8 0 2024-09-13T23:06:30.041 INFO:tasks.workunit.client.1.smithi152.stdout:4/854: truncate d3/d4/d6/d66/d2b/d8e/fc0 373226 0 2024-09-13T23:06:30.041 INFO:tasks.workunit.client.1.smithi152.stdout:4/855: fsync d3/d4/d8d/f44 0 2024-09-13T23:06:30.042 INFO:tasks.workunit.client.1.smithi152.stdout:0/671: link d18/d1f/d29/f46 d18/d8f/dc5/dd0/dd9/de3/fe8 0 2024-09-13T23:06:30.043 INFO:tasks.workunit.client.1.smithi152.stdout:9/885: dread d3/d24/f2a [0,4194304] 0 2024-09-13T23:06:30.046 INFO:tasks.workunit.client.1.smithi152.stdout:5/768: link d5/dc/d19/d65/d99/d98/dc2/ce5 d5/dc/d19/d20/d2e/d28/c100 0 2024-09-13T23:06:30.046 INFO:tasks.workunit.client.1.smithi152.stdout:5/769: chown d5/dc/d19/d20/d2e/d28/d92 0 1 2024-09-13T23:06:30.048 INFO:tasks.workunit.client.1.smithi152.stdout:1/831: rename d4/d4c/db1 to d4/d4c/d8d/d11c 0 2024-09-13T23:06:30.050 INFO:tasks.workunit.client.1.smithi152.stdout:4/856: truncate d3/d4/d6/f35 1898664 0 2024-09-13T23:06:30.050 INFO:tasks.workunit.client.1.smithi152.stdout:4/857: chown d3/d4/d8d/c5b 649 1 2024-09-13T23:06:30.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/672: fsync d18/d1f/d29/d3f/d40/daa/faf 0 2024-09-13T23:06:30.052 INFO:tasks.workunit.client.1.smithi152.stdout:9/886: truncate d3/d24/d67/d47/fcf 1304283 0 2024-09-13T23:06:30.053 INFO:tasks.workunit.client.1.smithi152.stdout:5/770: mkdir d5/dc/d19/d65/d99/d101 0 2024-09-13T23:06:30.056 INFO:tasks.workunit.client.1.smithi152.stdout:0/673: mknod d18/d1f/d33/de1/ce9 0 2024-09-13T23:06:30.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/887: link d3/d1e/d30/d5d/lab d3/d1e/d30/d5d/da3/l122 0 2024-09-13T23:06:30.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/674: mknod d18/d1f/d29/d3f/d40/d94/cea 0 2024-09-13T23:06:30.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/675: write d18/f1a [3940021,53946] 0 2024-09-13T23:06:30.058 INFO:tasks.workunit.client.1.smithi152.stdout:9/888: unlink d3/d1e/l29 0 2024-09-13T23:06:30.059 INFO:tasks.workunit.client.1.smithi152.stdout:9/889: stat d3/d24/d34/d45/daa/dbf/f113 0 2024-09-13T23:06:30.061 INFO:tasks.workunit.client.1.smithi152.stdout:9/890: unlink d3/d24/d67/d4a/d71/c106 0 2024-09-13T23:06:30.061 INFO:tasks.workunit.client.1.smithi152.stdout:5/771: dread d5/dc/f84 [0,4194304] 0 2024-09-13T23:06:30.064 INFO:tasks.workunit.client.1.smithi152.stdout:1/832: dwrite d4/d9/d1a/d22/d24/f56 [0,4194304] 0 2024-09-13T23:06:30.064 INFO:tasks.workunit.client.1.smithi152.stdout:1/833: chown d4/l86 0 1 2024-09-13T23:06:30.065 INFO:tasks.workunit.client.1.smithi152.stdout:9/891: creat d3/d1e/d30/dfe/f123 x:0 0 0 2024-09-13T23:06:30.067 INFO:tasks.workunit.client.1.smithi152.stdout:5/772: mknod d5/dc/d19/d20/d2e/d28/d92/c102 0 2024-09-13T23:06:30.072 INFO:tasks.workunit.client.1.smithi152.stdout:1/834: unlink d4/d9/f12 0 2024-09-13T23:06:30.077 INFO:tasks.workunit.client.1.smithi152.stdout:3/632: rename de/d1f/da2/dd3/cd8 to de/d1f/da2/dd3/cd9 0 2024-09-13T23:06:30.078 INFO:tasks.workunit.client.1.smithi152.stdout:9/892: rename d3/d24/d34/f102 to d3/d24/d67/d47/de7/f124 0 2024-09-13T23:06:30.085 INFO:tasks.workunit.client.1.smithi152.stdout:4/858: read d3/d4/d6/f35 [974552,39089] 0 2024-09-13T23:06:30.089 INFO:tasks.workunit.client.1.smithi152.stdout:1/835: link d4/d9/l7b d4/d9/l11d 0 2024-09-13T23:06:30.092 INFO:tasks.workunit.client.1.smithi152.stdout:1/836: write d4/d4c/d8d/d11c/fd5 [636374,56730] 0 2024-09-13T23:06:30.094 INFO:tasks.workunit.client.1.smithi152.stdout:0/676: truncate d18/d1f/f34 2861706 0 2024-09-13T23:06:30.096 INFO:tasks.workunit.client.1.smithi152.stdout:3/633: creat de/d14/d47/d57/d99/fda x:0 0 0 2024-09-13T23:06:30.096 INFO:tasks.workunit.client.1.smithi152.stdout:9/893: dwrite d3/d24/d67/d4a/d71/d7c/dee/f11a [0,4194304] 0 2024-09-13T23:06:30.102 INFO:tasks.workunit.client.1.smithi152.stdout:1/837: unlink d4/d9/f27 0 2024-09-13T23:06:30.102 INFO:tasks.workunit.client.1.smithi152.stdout:3/634: rename de/d1f/da2/cd6 to de/d14/d47/d57/d93/cdb 0 2024-09-13T23:06:30.107 INFO:tasks.workunit.client.1.smithi152.stdout:9/894: mknod d3/d24/d67/d4a/d71/d111/c125 0 2024-09-13T23:06:30.108 INFO:tasks.workunit.client.1.smithi152.stdout:3/635: dread de/f90 [0,4194304] 0 2024-09-13T23:06:30.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/895: mknod d3/d24/d34/c126 0 2024-09-13T23:06:30.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/636: write de/d14/f5b [1231489,91500] 0 2024-09-13T23:06:30.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/637: chown de/d1f/l4c 3294 1 2024-09-13T23:06:30.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/859: dwrite d3/d4/d8d/d93/d109/fbb [0,4194304] 0 2024-09-13T23:06:30.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/860: chown d3/d4/d6/d8/d17/c1f 1596007 1 2024-09-13T23:06:30.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/861: stat d3/d4/lf7 0 2024-09-13T23:06:30.112 INFO:tasks.workunit.client.1.smithi152.stdout:0/677: dwrite d18/d1f/d39/d7c/fad [0,4194304] 0 2024-09-13T23:06:30.112 INFO:tasks.workunit.client.1.smithi152.stdout:0/678: creat d18/d1f/d29/d2f/d3d/da1/feb x:0 0 0 2024-09-13T23:06:30.112 INFO:tasks.workunit.client.1.smithi152.stdout:3/638: creat de/d63/fdc x:0 0 0 2024-09-13T23:06:30.112 INFO:tasks.workunit.client.1.smithi152.stdout:3/639: getdents de/d63/dc1 0 2024-09-13T23:06:30.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/862: unlink d3/d4/d6/d8/d17/c1f 0 2024-09-13T23:06:30.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/679: fsync d18/d1f/f34 0 2024-09-13T23:06:30.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/680: fsync d18/d1f/f20 0 2024-09-13T23:06:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:3/640: mkdir de/d14/d47/d70/d87/ddd 0 2024-09-13T23:06:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/863: dread d3/d4/d32/fc2 [0,4194304] 0 2024-09-13T23:06:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/864: chown d3/d34/l46 178605141 1 2024-09-13T23:06:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/865: fsync d3/d4/d6/f54 0 2024-09-13T23:06:30.121 INFO:tasks.workunit.client.1.smithi152.stdout:0/681: rename d18/d1f/d33/de1 to d18/d1f/d29/d4e/dec 0 2024-09-13T23:06:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:3/641: mknod de/d14/d47/d57/cde 0 2024-09-13T23:06:30.123 INFO:tasks.workunit.client.1.smithi152.stdout:4/866: creat d3/d4/d32/d86/d95/f113 x:0 0 0 2024-09-13T23:06:30.124 INFO:tasks.workunit.client.1.smithi152.stdout:0/682: rename d18/d1f/d29/d3f/d40/d94/c95 to d18/d1f/d29/d4e/dec/ced 0 2024-09-13T23:06:30.125 INFO:tasks.workunit.client.1.smithi152.stdout:3/642: getdents de/d1f/da2/dcb 0 2024-09-13T23:06:30.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/896: dwrite d3/d24/d67/d4a/f96 [0,4194304] 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:3/643: dwrite de/d14/d47/d57/d99/fac [0,4194304] 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:3/644: fsync de/d1f/fb8 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:3/645: truncate de/d14/d47/d57/d5d/d6e/fbb 1018196 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:0/683: dwrite d18/d1f/d33/f7f [0,4194304] 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:9/897: dwrite d3/d24/d34/ff7 [0,4194304] 0 2024-09-13T23:06:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:0/684: read d18/d1f/d29/d3f/d40/fc7 [2295,92610] 0 2024-09-13T23:06:30.160 INFO:tasks.workunit.client.1.smithi152.stdout:3/646: link de/d14/d47/d57/lb5 de/d14/d47/d57/ldf 0 2024-09-13T23:06:30.163 INFO:tasks.workunit.client.1.smithi152.stdout:3/647: dread de/d14/d47/d57/d5d/f7f [0,4194304] 0 2024-09-13T23:06:30.163 INFO:tasks.workunit.client.1.smithi152.stdout:3/648: fsync de/f3e 0 2024-09-13T23:06:30.165 INFO:tasks.workunit.client.1.smithi152.stdout:0/685: getdents d18/d1f/d33 0 2024-09-13T23:06:30.165 INFO:tasks.workunit.client.1.smithi152.stdout:0/686: write d18/d19/d74/da4/fab [514274,76897] 0 2024-09-13T23:06:30.171 INFO:tasks.workunit.client.1.smithi152.stdout:0/687: rename d18/d1f/d39/cdb to d18/d1f/d29/d3f/d40/daa/cee 0 2024-09-13T23:06:30.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/688: write d18/d1f/d29/d3f/d40/daa/dbd/fda [1827772,15] 0 2024-09-13T23:06:30.189 INFO:tasks.workunit.client.1.smithi152.stdout:9/898: dwrite d3/d24/d67/f4d [4194304,4194304] 0 2024-09-13T23:06:30.191 INFO:tasks.workunit.client.1.smithi152.stdout:3/649: dwrite de/d14/d47/d57/d99/fda [0,4194304] 0 2024-09-13T23:06:30.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/689: dwrite d18/d1f/d29/d3f/d40/f8b [0,4194304] 0 2024-09-13T23:06:30.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/690: readlink d18/d1f/d33/d6e/lde 0 2024-09-13T23:06:30.202 INFO:tasks.workunit.client.1.smithi152.stdout:0/691: link d18/d1f/d29/d4e/lb5 d18/d19/d74/da4/lef 0 2024-09-13T23:06:30.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/650: dwrite de/f1d [0,4194304] 0 2024-09-13T23:06:30.215 INFO:tasks.workunit.client.1.smithi152.stdout:9/899: dwrite d3/d24/d67/d60/de1/fe6 [0,4194304] 0 2024-09-13T23:06:30.216 INFO:tasks.workunit.client.1.smithi152.stdout:3/651: creat de/d14/d47/d70/d87/fe0 x:0 0 0 2024-09-13T23:06:30.218 INFO:tasks.workunit.client.1.smithi152.stdout:3/652: truncate de/d14/f62 4410077 0 2024-09-13T23:06:30.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/653: stat de/d14/d47/d70/d87/ddd 0 2024-09-13T23:06:30.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/654: readlink de/d14/d47/d70/d87/l95 0 2024-09-13T23:06:30.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/655: mkdir de/d14/d38/de1 0 2024-09-13T23:06:30.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/656: chown de/f5c 15 1 2024-09-13T23:06:30.221 INFO:tasks.workunit.client.1.smithi152.stdout:3/657: creat de/d1f/da2/dcb/fe2 x:0 0 0 2024-09-13T23:06:30.222 INFO:tasks.workunit.client.1.smithi152.stdout:3/658: mkdir de/d1f/da2/da8/de3 0 2024-09-13T23:06:30.222 INFO:tasks.workunit.client.1.smithi152.stdout:3/659: creat de/d14/d47/d57/fe4 x:0 0 0 2024-09-13T23:06:30.223 INFO:tasks.workunit.client.1.smithi152.stdout:0/692: dwrite d18/f25 [0,4194304] 0 2024-09-13T23:06:30.227 INFO:tasks.workunit.client.1.smithi152.stdout:3/660: symlink de/d14/d47/d57/le5 0 2024-09-13T23:06:30.229 INFO:tasks.workunit.client.1.smithi152.stdout:9/900: dread d3/d24/d67/d4a/d71/db7/fcd [0,4194304] 0 2024-09-13T23:06:30.240 INFO:tasks.workunit.client.1.smithi152.stdout:3/661: mkdir de/d1f/da2/dcb/de6 0 2024-09-13T23:06:30.245 INFO:tasks.workunit.client.1.smithi152.stdout:0/693: dwrite d18/d1f/d29/d2f/dd3/fe4 [0,4194304] 0 2024-09-13T23:06:30.245 INFO:tasks.workunit.client.1.smithi152.stdout:0/694: write d18/d1f/d29/d3f/d40/daa/fdf [547736,53950] 0 2024-09-13T23:06:30.245 INFO:tasks.workunit.client.1.smithi152.stdout:3/662: dread de/d14/d47/d57/d5d/f41 [0,4194304] 0 2024-09-13T23:06:30.248 INFO:tasks.workunit.client.1.smithi152.stdout:3/663: truncate de/d14/d38/f1a 957337 0 2024-09-13T23:06:30.248 INFO:tasks.workunit.client.1.smithi152.stdout:9/901: dwrite d3/d1e/fa1 [0,4194304] 0 2024-09-13T23:06:30.248 INFO:tasks.workunit.client.1.smithi152.stdout:0/695: getdents d18/d1f/d29/d3f/d4b/d66/d6a/d9f 0 2024-09-13T23:06:30.252 INFO:tasks.workunit.client.1.smithi152.stdout:9/902: write d3/d24/d67/d60/f69 [3781,73302] 0 2024-09-13T23:06:30.253 INFO:tasks.workunit.client.1.smithi152.stdout:0/696: mknod d18/d19/d74/da4/cf0 0 2024-09-13T23:06:30.253 INFO:tasks.workunit.client.1.smithi152.stdout:0/697: fdatasync d18/d1f/d33/f7f 0 2024-09-13T23:06:30.254 INFO:tasks.workunit.client.1.smithi152.stdout:9/903: getdents d3/d1e/d30/d5d 0 2024-09-13T23:06:30.254 INFO:tasks.workunit.client.1.smithi152.stdout:0/698: getdents d18/d1f/d29/d3f/d40/daa 0 2024-09-13T23:06:30.256 INFO:tasks.workunit.client.1.smithi152.stdout:9/904: creat d3/d24/d34/d45/f127 x:0 0 0 2024-09-13T23:06:30.258 INFO:tasks.workunit.client.1.smithi152.stdout:0/699: symlink d18/d8f/dc5/dd0/dd9/de3/lf1 0 2024-09-13T23:06:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/700: creat d18/d1f/d29/d4e/dec/ff2 x:0 0 0 2024-09-13T23:06:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/664: dread de/d63/f7d [0,4194304] 0 2024-09-13T23:06:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/665: creat de/d14/d47/fe7 x:0 0 0 2024-09-13T23:06:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/666: chown de/d14/d47/d57/f80 44 1 2024-09-13T23:06:30.262 INFO:tasks.workunit.client.1.smithi152.stdout:3/667: mknod de/d14/d76/ce8 0 2024-09-13T23:06:30.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/668: dwrite de/d14/d47/d57/fc6 [0,4194304] 0 2024-09-13T23:06:30.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/669: truncate de/d14/d47/d70/d72/fbf 45692 0 2024-09-13T23:06:30.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/670: dread - de/d63/fdc zero size 2024-09-13T23:06:30.280 INFO:tasks.workunit.client.1.smithi152.stdout:3/671: mknod de/d1f/da2/dcb/de6/ce9 0 2024-09-13T23:06:30.280 INFO:tasks.workunit.client.1.smithi152.stdout:3/672: creat de/fea x:0 0 0 2024-09-13T23:06:30.280 INFO:tasks.workunit.client.1.smithi152.stdout:3/673: creat de/d14/d47/d57/feb x:0 0 0 2024-09-13T23:06:30.282 INFO:tasks.workunit.client.1.smithi152.stdout:3/674: mkdir de/d14/d47/d70/dec 0 2024-09-13T23:06:30.283 INFO:tasks.workunit.client.1.smithi152.stdout:3/675: rmdir de/d14/d38/de1 0 2024-09-13T23:06:30.283 INFO:tasks.workunit.client.1.smithi152.stdout:3/676: chown de/d1f/da2/da8/de3 104 1 2024-09-13T23:06:30.283 INFO:tasks.workunit.client.1.smithi152.stdout:3/677: dread - de/d14/d47/d70/d87/fe0 zero size 2024-09-13T23:06:30.284 INFO:tasks.workunit.client.1.smithi152.stdout:3/678: write de/d1f/f91 [4045454,25304] 0 2024-09-13T23:06:30.284 INFO:tasks.workunit.client.1.smithi152.stdout:3/679: write de/d14/d38/f4e [468612,38256] 0 2024-09-13T23:06:30.374 INFO:tasks.workunit.client.1.smithi152.stdout:3/680: dwrite de/d14/d47/d57/fe4 [0,4194304] 0 2024-09-13T23:06:30.389 INFO:tasks.workunit.client.1.smithi152.stdout:3/681: dwrite de/d14/d47/d57/d5d/f7f [0,4194304] 0 2024-09-13T23:06:30.390 INFO:tasks.workunit.client.1.smithi152.stdout:3/682: write de/d14/d47/d70/f78 [2964346,31976] 0 2024-09-13T23:06:30.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/683: creat de/d14/d47/d70/d72/da7/fed x:0 0 0 2024-09-13T23:06:30.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/684: dread - de/fcd zero size 2024-09-13T23:06:30.395 INFO:tasks.workunit.client.1.smithi152.stdout:3/685: write de/f1c [1156216,101253] 0 2024-09-13T23:06:30.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/686: mkdir de/d14/d47/d57/dc9/dee 0 2024-09-13T23:06:30.400 INFO:tasks.workunit.client.1.smithi152.stdout:3/687: unlink de/d14/d38/f4e 0 2024-09-13T23:06:30.400 INFO:tasks.workunit.client.1.smithi152.stdout:3/688: dread - de/d14/d47/fe7 zero size 2024-09-13T23:06:30.407 INFO:tasks.workunit.client.1.smithi152.stdout:3/689: dread de/f3e [0,4194304] 0 2024-09-13T23:06:30.409 INFO:tasks.workunit.client.1.smithi152.stdout:3/690: mknod de/d14/d47/d70/d87/cef 0 2024-09-13T23:06:30.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/691: mknod de/d14/d47/d70/dec/cf0 0 2024-09-13T23:06:30.414 INFO:tasks.workunit.client.1.smithi152.stdout:3/692: getdents de/d14/d47/d70/d87 0 2024-09-13T23:06:30.430 INFO:tasks.workunit.client.1.smithi152.stdout:3/693: dwrite de/f45 [8388608,4194304] 0 2024-09-13T23:06:30.432 INFO:tasks.workunit.client.1.smithi152.stdout:7/814: sync 2024-09-13T23:06:30.436 INFO:tasks.workunit.client.1.smithi152.stdout:3/694: mkdir de/d63/df1 0 2024-09-13T23:06:30.455 INFO:tasks.workunit.client.1.smithi152.stdout:7/815: dwrite d17/d24/d9f/d51/d5b/d63/fae [0,4194304] 0 2024-09-13T23:06:30.455 INFO:tasks.workunit.client.1.smithi152.stdout:3/695: dwrite de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:30.455 INFO:tasks.workunit.client.1.smithi152.stdout:7/816: chown d17/d24/d9f/d51/d5b/d90/d2e/d71 826 1 2024-09-13T23:06:30.459 INFO:tasks.workunit.client.1.smithi152.stdout:3/696: getdents de/d14/d47/d57/d5d 0 2024-09-13T23:06:30.459 INFO:tasks.workunit.client.1.smithi152.stdout:3/697: chown de/d14/d47/d70/d87/cef 1761 1 2024-09-13T23:06:30.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/817: mknod d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/c113 0 2024-09-13T23:06:30.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/818: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/f114 x:0 0 0 2024-09-13T23:06:30.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/819: write d17/d24/d9f/d51/d5b/d90/d2b/f49 [3973498,40382] 0 2024-09-13T23:06:30.463 INFO:tasks.workunit.client.1.smithi152.stdout:7/820: write f16 [360537,59963] 0 2024-09-13T23:06:30.466 INFO:tasks.workunit.client.1.smithi152.stdout:7/821: dread d17/d24/d9f/d51/d5b/d90/d2e/f56 [0,4194304] 0 2024-09-13T23:06:30.466 INFO:tasks.workunit.client.1.smithi152.stdout:3/698: write de/d14/f49 [3481794,124375] 0 2024-09-13T23:06:30.471 INFO:tasks.workunit.client.1.smithi152.stdout:7/822: link d17/d4f/d84/fca d17/d24/d9f/d51/d5b/d87/f115 0 2024-09-13T23:06:30.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/699: unlink de/d1f/l5f 0 2024-09-13T23:06:30.474 INFO:tasks.workunit.client.1.smithi152.stdout:3/700: write de/d14/f6d [2267098,123023] 0 2024-09-13T23:06:30.477 INFO:tasks.workunit.client.1.smithi152.stdout:7/823: mkdir d17/d6c/d116 0 2024-09-13T23:06:30.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/701: mkdir de/d14/d47/d57/d5d/d6e/df2 0 2024-09-13T23:06:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:4/867: sync 2024-09-13T23:06:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:0/701: sync 2024-09-13T23:06:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:9/905: sync 2024-09-13T23:06:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:8/604: sync 2024-09-13T23:06:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:6/705: sync 2024-09-13T23:06:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:1/838: sync 2024-09-13T23:06:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:2/762: sync 2024-09-13T23:06:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:5/773: sync 2024-09-13T23:06:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/605: write d17/d25/d32/d4b/d84/db2/fb5 [98811,103774] 0 2024-09-13T23:06:30.486 INFO:tasks.workunit.client.1.smithi152.stdout:3/702: dread de/d14/f6d [4194304,4194304] 0 2024-09-13T23:06:30.486 INFO:tasks.workunit.client.1.smithi152.stdout:3/703: write de/d14/d47/d57/faa [1027497,87340] 0 2024-09-13T23:06:30.488 INFO:tasks.workunit.client.1.smithi152.stdout:6/706: link d4/de/d12/c1b d4/de/d12/d8a/dc0/ce7 0 2024-09-13T23:06:30.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/839: write d4/d9/d1a/f4e [1419226,49882] 0 2024-09-13T23:06:30.490 INFO:tasks.workunit.client.1.smithi152.stdout:9/906: mknod d3/d1e/d30/c128 0 2024-09-13T23:06:30.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/824: dwrite d17/f1d [0,4194304] 0 2024-09-13T23:06:30.491 INFO:tasks.workunit.client.1.smithi152.stdout:7/825: creat d17/d24/d9f/d51/d5b/d90/d2e/d79/f117 x:0 0 0 2024-09-13T23:06:30.491 INFO:tasks.workunit.client.1.smithi152.stdout:0/702: mkdir d18/d1f/d29/d2f/dd3/df3 0 2024-09-13T23:06:30.494 INFO:tasks.workunit.client.1.smithi152.stdout:2/763: unlink d0/d4/d9/d18/ca0 0 2024-09-13T23:06:30.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/774: rename d5/dc/d19/d65/d99/da6/f44 to d5/dc/da3/db4/d7f/f103 0 2024-09-13T23:06:30.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/775: creat d5/dc/d19/d65/d70/f104 x:0 0 0 2024-09-13T23:06:30.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/704: stat de/d14/d47/d57/lb5 0 2024-09-13T23:06:30.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/705: write de/d14/d47/d70/dca/fd4 [266956,53623] 0 2024-09-13T23:06:30.498 INFO:tasks.workunit.client.1.smithi152.stdout:6/707: mknod d4/de/d12/d16/d2a/d3d/dcf/ce8 0 2024-09-13T23:06:30.499 INFO:tasks.workunit.client.1.smithi152.stdout:6/708: write d4/de/d12/d16/d2a/d3d/d57/f85 [1318879,48622] 0 2024-09-13T23:06:30.499 INFO:tasks.workunit.client.1.smithi152.stdout:1/840: creat d4/d4c/d8d/d11c/f11e x:0 0 0 2024-09-13T23:06:30.501 INFO:tasks.workunit.client.1.smithi152.stdout:9/907: symlink d3/d1e/d30/dfe/l129 0 2024-09-13T23:06:30.501 INFO:tasks.workunit.client.1.smithi152.stdout:9/908: chown d3/d1e/db1 42 1 2024-09-13T23:06:30.504 INFO:tasks.workunit.client.1.smithi152.stdout:7/826: mknod d17/d24/d9f/d51/d5b/d90/d2e/c118 0 2024-09-13T23:06:30.505 INFO:tasks.workunit.client.1.smithi152.stdout:0/703: mknod d18/d1f/d39/d7c/cf4 0 2024-09-13T23:06:30.505 INFO:tasks.workunit.client.1.smithi152.stdout:0/704: fdatasync d18/d1f/d39/d7c/fad 0 2024-09-13T23:06:30.507 INFO:tasks.workunit.client.1.smithi152.stdout:5/776: creat d5/dc/d19/d65/d99/d98/da0/f105 x:0 0 0 2024-09-13T23:06:30.509 INFO:tasks.workunit.client.1.smithi152.stdout:3/706: unlink l6 0 2024-09-13T23:06:30.509 INFO:tasks.workunit.client.1.smithi152.stdout:4/868: dwrite d3/d4/d6/d8/dad/fc4 [0,4194304] 0 2024-09-13T23:06:30.512 INFO:tasks.workunit.client.1.smithi152.stdout:6/709: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/le9 0 2024-09-13T23:06:30.513 INFO:tasks.workunit.client.1.smithi152.stdout:1/841: rename d4/d9/d71/c91 to d4/d4c/d8d/d99/c11f 0 2024-09-13T23:06:30.514 INFO:tasks.workunit.client.1.smithi152.stdout:8/606: dwrite d17/d25/d32/d44/f5f [0,4194304] 0 2024-09-13T23:06:30.515 INFO:tasks.workunit.client.1.smithi152.stdout:8/607: fsync d17/d25/d32/d9a/f2b 0 2024-09-13T23:06:30.517 INFO:tasks.workunit.client.1.smithi152.stdout:0/705: mkdir d18/d1f/d33/df5 0 2024-09-13T23:06:30.520 INFO:tasks.workunit.client.1.smithi152.stdout:2/764: dwrite d0/d4/f85 [0,4194304] 0 2024-09-13T23:06:30.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/777: creat d5/dc/d19/d65/d99/d98/dc2/d80/f106 x:0 0 0 2024-09-13T23:06:30.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/778: fdatasync d5/da/f43 0 2024-09-13T23:06:30.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/779: chown d5/dc/d19/d65/d99/da6/l64 15750973 1 2024-09-13T23:06:30.521 INFO:tasks.workunit.client.1.smithi152.stdout:4/869: write d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 [724320,31404] 0 2024-09-13T23:06:30.521 INFO:tasks.workunit.client.1.smithi152.stdout:4/870: creat d3/d4/d6/d8/d17/d3a/f114 x:0 0 0 2024-09-13T23:06:30.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/909: dwrite d3/d24/d34/d45/f9a [0,4194304] 0 2024-09-13T23:06:30.521 INFO:tasks.workunit.client.1.smithi152.stdout:9/910: fdatasync d3/d24/f2a 0 2024-09-13T23:06:30.522 INFO:tasks.workunit.client.1.smithi152.stdout:0/706: mkdir d18/d1f/d29/d2f/dd3/df3/df6 0 2024-09-13T23:06:30.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/765: mkdir d0/d4/d9/d16/d30/d10c 0 2024-09-13T23:06:30.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/766: write d0/d8/f8b [2349787,94886] 0 2024-09-13T23:06:30.527 INFO:tasks.workunit.client.1.smithi152.stdout:2/767: write d0/d4/d9/d16/f91 [5228969,40849] 0 2024-09-13T23:06:30.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/608: link d17/d25/c40 d17/d25/d32/d4b/cbe 0 2024-09-13T23:06:30.532 INFO:tasks.workunit.client.1.smithi152.stdout:6/710: rename d4/de/d12/d3e/c59 to d4/de/d12/d16/d2a/cea 0 2024-09-13T23:06:30.532 INFO:tasks.workunit.client.1.smithi152.stdout:1/842: creat d4/d47/d10a/f120 x:0 0 0 2024-09-13T23:06:30.534 INFO:tasks.workunit.client.1.smithi152.stdout:4/871: write d3/f83 [1816320,7838] 0 2024-09-13T23:06:30.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/911: rename d3/d24/d67/d4a/d71/db7/fbb to d3/d24/d34/d45/f12a 0 2024-09-13T23:06:30.538 INFO:tasks.workunit.client.1.smithi152.stdout:1/843: mknod d4/d4c/d8d/d99/d104/c121 0 2024-09-13T23:06:30.538 INFO:tasks.workunit.client.1.smithi152.stdout:1/844: dread - d4/d4c/d8d/d99/d104/f106 zero size 2024-09-13T23:06:30.541 INFO:tasks.workunit.client.1.smithi152.stdout:9/912: creat d3/d1e/d30/d5d/f12b x:0 0 0 2024-09-13T23:06:30.545 INFO:tasks.workunit.client.1.smithi152.stdout:1/845: mkdir d4/d9/d1a/d22/d24/daa/d122 0 2024-09-13T23:06:30.545 INFO:tasks.workunit.client.1.smithi152.stdout:1/846: fdatasync d4/d9/d1a/d22/d24/f56 0 2024-09-13T23:06:30.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/609: dread d17/d25/d32/d44/f5f [0,4194304] 0 2024-09-13T23:06:30.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/610: stat d17/d25/d32/l6d 0 2024-09-13T23:06:30.547 INFO:tasks.workunit.client.1.smithi152.stdout:6/711: rename d4/de/d12/d8a/dc0 to d4/de/d1d/deb 0 2024-09-13T23:06:30.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/827: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/fb5 [0,4194304] 0 2024-09-13T23:06:30.552 INFO:tasks.workunit.client.1.smithi152.stdout:3/707: dwrite de/d14/f4f [0,4194304] 0 2024-09-13T23:06:30.552 INFO:tasks.workunit.client.1.smithi152.stdout:5/780: dwrite d5/dc/d19/d20/d55/fda [0,4194304] 0 2024-09-13T23:06:30.553 INFO:tasks.workunit.client.1.smithi152.stdout:1/847: getdents d4/d47/d8b/dd1 0 2024-09-13T23:06:30.553 INFO:tasks.workunit.client.1.smithi152.stdout:1/848: readlink d4/d4c/l9a 0 2024-09-13T23:06:30.553 INFO:tasks.workunit.client.1.smithi152.stdout:1/849: write d4/d4c/ff3 [127719,21870] 0 2024-09-13T23:06:30.553 INFO:tasks.workunit.client.1.smithi152.stdout:1/850: getdents d4/d47/d8b/dd1 0 2024-09-13T23:06:30.554 INFO:tasks.workunit.client.1.smithi152.stdout:1/851: fdatasync d4/d4c/d8d/d99/f111 0 2024-09-13T23:06:30.555 INFO:tasks.workunit.client.1.smithi152.stdout:7/828: truncate d17/d24/d9f/d51/d5b/d90/d2e/d79/fc3 456858 0 2024-09-13T23:06:30.557 INFO:tasks.workunit.client.1.smithi152.stdout:8/611: dread d17/d25/f85 [0,4194304] 0 2024-09-13T23:06:30.558 INFO:tasks.workunit.client.1.smithi152.stdout:2/768: dwrite d0/d4/d9/d18/d1e/d3c/f8e [0,4194304] 0 2024-09-13T23:06:30.560 INFO:tasks.workunit.client.1.smithi152.stdout:3/708: mknod de/d63/df1/cf3 0 2024-09-13T23:06:30.561 INFO:tasks.workunit.client.1.smithi152.stdout:9/913: dwrite d3/d24/d67/d60/de1/f10c [0,4194304] 0 2024-09-13T23:06:30.561 INFO:tasks.workunit.client.1.smithi152.stdout:9/914: write d3/f15 [8682502,51963] 0 2024-09-13T23:06:30.562 INFO:tasks.workunit.client.1.smithi152.stdout:6/712: link d4/de/d12/d16/d2a/d3d/daa/daf/dcc/ld3 d4/de/d12/d16/d2a/lec 0 2024-09-13T23:06:30.562 INFO:tasks.workunit.client.1.smithi152.stdout:6/713: chown d4/de/d21/d5c/dc9 3 1 2024-09-13T23:06:30.564 INFO:tasks.workunit.client.1.smithi152.stdout:5/781: link d5/dc/d19/d65/d99/lef d5/dc/d19/d20/d2e/l107 0 2024-09-13T23:06:30.564 INFO:tasks.workunit.client.1.smithi152.stdout:5/782: fsync d5/da/f58 0 2024-09-13T23:06:30.573 INFO:tasks.workunit.client.1.smithi152.stdout:7/829: rename d17/d24/d9f/d51/d5b/d90/d2b/f3b to d17/d24/d109/dda/f119 0 2024-09-13T23:06:30.574 INFO:tasks.workunit.client.1.smithi152.stdout:2/769: mknod d0/d4/d9/d18/dc1/c10d 0 2024-09-13T23:06:30.574 INFO:tasks.workunit.client.1.smithi152.stdout:2/770: readlink d0/d8/l4e 0 2024-09-13T23:06:30.576 INFO:tasks.workunit.client.1.smithi152.stdout:3/709: symlink de/d14/d47/d70/lf4 0 2024-09-13T23:06:30.576 INFO:tasks.workunit.client.1.smithi152.stdout:3/710: chown de/d14/d47/c89 643630171 1 2024-09-13T23:06:30.579 INFO:tasks.workunit.client.1.smithi152.stdout:8/612: dwrite fd [0,4194304] 0 2024-09-13T23:06:30.579 INFO:tasks.workunit.client.1.smithi152.stdout:8/613: write d17/d25/f2f [211689,36288] 0 2024-09-13T23:06:30.579 INFO:tasks.workunit.client.1.smithi152.stdout:1/852: dwrite d4/d47/d8b/ffe [0,4194304] 0 2024-09-13T23:06:30.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/853: stat d4/d9/d1a/d22/d24/dde/df4 0 2024-09-13T23:06:30.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/854: write d4/d9/fa7 [790918,4027] 0 2024-09-13T23:06:30.580 INFO:tasks.workunit.client.1.smithi152.stdout:1/855: stat d4 0 2024-09-13T23:06:30.580 INFO:tasks.workunit.client.1.smithi152.stdout:9/915: truncate d3/d24/d67/ff8 1643441 0 2024-09-13T23:06:30.581 INFO:tasks.workunit.client.1.smithi152.stdout:6/714: mkdir d4/de/d12/d16/d2a/d3d/dcf/ded 0 2024-09-13T23:06:30.581 INFO:tasks.workunit.client.1.smithi152.stdout:6/715: readlink d4/de/d12/d16/l3a 0 2024-09-13T23:06:30.582 INFO:tasks.workunit.client.1.smithi152.stdout:5/783: mknod d5/dc/d19/d65/d99/d98/dc2/d80/dfc/c108 0 2024-09-13T23:06:30.582 INFO:tasks.workunit.client.1.smithi152.stdout:5/784: write d5/dc/d19/d65/d99/d98/dc2/d80/fbf [984559,26391] 0 2024-09-13T23:06:30.583 INFO:tasks.workunit.client.1.smithi152.stdout:7/830: truncate d17/d24/d9f/d51/d5b/d90/fa4 4769290 0 2024-09-13T23:06:30.584 INFO:tasks.workunit.client.1.smithi152.stdout:7/831: fsync d17/d24/d9f/d51/d5b/d90/d2b/f49 0 2024-09-13T23:06:30.585 INFO:tasks.workunit.client.1.smithi152.stdout:3/711: mkdir de/d14/d47/d70/dca/df5 0 2024-09-13T23:06:30.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/856: rename d4/d9/d1a/d22/fe0 to d4/d47/d10a/f123 0 2024-09-13T23:06:30.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/857: fdatasync d4/d47/d10a/f120 0 2024-09-13T23:06:30.590 INFO:tasks.workunit.client.1.smithi152.stdout:9/916: unlink d3/db0/fb2 0 2024-09-13T23:06:30.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/716: rmdir d4/de/d12/d16/d2a 39 2024-09-13T23:06:30.590 INFO:tasks.workunit.client.1.smithi152.stdout:6/717: fdatasync d4/de/fcd 0 2024-09-13T23:06:30.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/832: getdents d17/d6c/dd1 0 2024-09-13T23:06:30.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/833: write d17/d4f/fbf [429151,103565] 0 2024-09-13T23:06:30.592 INFO:tasks.workunit.client.1.smithi152.stdout:3/712: rmdir de/d63/df1 39 2024-09-13T23:06:30.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/785: rename d5/dc/d19/d65/l42 to d5/dc/d19/d65/d99/d98/da0/dc1/ddc/l109 0 2024-09-13T23:06:30.596 INFO:tasks.workunit.client.1.smithi152.stdout:9/917: creat d3/d24/d67/d4a/d71/d111/f12c x:0 0 0 2024-09-13T23:06:30.596 INFO:tasks.workunit.client.1.smithi152.stdout:9/918: readlink d3/d24/d67/d47/de7/lff 0 2024-09-13T23:06:30.596 INFO:tasks.workunit.client.1.smithi152.stdout:9/919: creat d3/d24/f12d x:0 0 0 2024-09-13T23:06:30.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/834: link d17/d24/d9f/d51/d5b/d90/f6a d17/d24/d9f/d51/d5b/d90/d2e/f11a 0 2024-09-13T23:06:30.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/771: dwrite d0/d4/d9/d18/dc1/ff6 [0,4194304] 0 2024-09-13T23:06:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/614: dwrite d17/f29 [4194304,4194304] 0 2024-09-13T23:06:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/615: truncate d17/d25/d32/d4b/d84/fb0 490705 0 2024-09-13T23:06:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/616: chown d17/d25 25973671 1 2024-09-13T23:06:30.602 INFO:tasks.workunit.client.1.smithi152.stdout:9/920: symlink d3/d24/d67/d47/de7/l12e 0 2024-09-13T23:06:30.604 INFO:tasks.workunit.client.1.smithi152.stdout:7/835: rename d17/d24/d9f/f8b to d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/f11b 0 2024-09-13T23:06:30.604 INFO:tasks.workunit.client.1.smithi152.stdout:7/836: write d17/d6c/f88 [4300949,12579] 0 2024-09-13T23:06:30.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/713: dread de/d1f/f20 [0,4194304] 0 2024-09-13T23:06:30.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/714: read de/d14/f6d [863716,5413] 0 2024-09-13T23:06:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/921: getdents d3/d1e/db1 0 2024-09-13T23:06:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/922: dread - d3/db0/f11f zero size 2024-09-13T23:06:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/923: creat d3/d24/d34/d45/daa/f12f x:0 0 0 2024-09-13T23:06:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/924: write d3/d24/d67/d4a/d8e/fdc [243775,70841] 0 2024-09-13T23:06:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:9/925: fdatasync d3/d1e/fd6 0 2024-09-13T23:06:30.614 INFO:tasks.workunit.client.1.smithi152.stdout:7/837: stat d17/d24/d9f/d51/d5b/d90/d2e/c41 0 2024-09-13T23:06:30.614 INFO:tasks.workunit.client.1.smithi152.stdout:7/838: chown d17/d24/d9f/d51/d5b/d90/d2b/c6f 30224 1 2024-09-13T23:06:30.614 INFO:tasks.workunit.client.1.smithi152.stdout:7/839: chown d17/d24/d9f/d51/d5b/d90/d2b/fd4 12 1 2024-09-13T23:06:30.616 INFO:tasks.workunit.client.1.smithi152.stdout:8/617: symlink d17/d25/d32/d4b/lbf 0 2024-09-13T23:06:30.617 INFO:tasks.workunit.client.1.smithi152.stdout:8/618: write d17/d25/f81 [14400,31857] 0 2024-09-13T23:06:30.618 INFO:tasks.workunit.client.1.smithi152.stdout:9/926: symlink d3/d24/d67/de3/l130 0 2024-09-13T23:06:30.618 INFO:tasks.workunit.client.1.smithi152.stdout:9/927: readlink d3/d1e/d30/d5d/da3/ld4 0 2024-09-13T23:06:30.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/840: mkdir d17/d24/d9f/d3f/d11c 0 2024-09-13T23:06:30.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/841: stat d17/f110 0 2024-09-13T23:06:30.620 INFO:tasks.workunit.client.1.smithi152.stdout:8/619: stat d17/d25/d32/d4b/l6f 0 2024-09-13T23:06:30.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/620: creat d17/d25/d32/d4b/d84/db2/fc0 x:0 0 0 2024-09-13T23:06:30.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/621: chown la 16576 1 2024-09-13T23:06:30.624 INFO:tasks.workunit.client.1.smithi152.stdout:6/718: dwrite d4/de/d12/d16/d2a/d38/d3c/f4c [0,4194304] 0 2024-09-13T23:06:30.625 INFO:tasks.workunit.client.1.smithi152.stdout:1/858: dwrite d4/d4c/d8d/d11c/ffc [0,4194304] 0 2024-09-13T23:06:30.630 INFO:tasks.workunit.client.1.smithi152.stdout:1/859: mknod d4/d4c/d8d/d11c/c124 0 2024-09-13T23:06:30.633 INFO:tasks.workunit.client.1.smithi152.stdout:5/786: dwrite d5/da/f1b [0,4194304] 0 2024-09-13T23:06:30.633 INFO:tasks.workunit.client.1.smithi152.stdout:5/787: stat d5/dc/d19/d20/d55/f75 0 2024-09-13T23:06:30.635 INFO:tasks.workunit.client.1.smithi152.stdout:3/715: dwrite de/d14/d47/d57/faa [0,4194304] 0 2024-09-13T23:06:30.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/860: link d4/d9/d1a/d22/l36 d4/d9/d1a/d22/d24/daa/d122/l125 0 2024-09-13T23:06:30.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/622: read d17/d25/d80/f8d [6530812,70903] 0 2024-09-13T23:06:30.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/623: fsync d17/d25/d32/d4b/d84/fb0 0 2024-09-13T23:06:30.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/772: dwrite d0/d8/f8b [4194304,4194304] 0 2024-09-13T23:06:30.643 INFO:tasks.workunit.client.1.smithi152.stdout:9/928: getdents d3/d24 0 2024-09-13T23:06:30.643 INFO:tasks.workunit.client.1.smithi152.stdout:2/773: dread d0/d4/d8a/fd9 [0,4194304] 0 2024-09-13T23:06:30.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/861: truncate d4/d47/fcb 635159 0 2024-09-13T23:06:30.652 INFO:tasks.workunit.client.1.smithi152.stdout:1/862: readlink d4/d9/l7b 0 2024-09-13T23:06:30.653 INFO:tasks.workunit.client.1.smithi152.stdout:8/624: link l13 d17/d25/d32/d9a/d8f/d9e/lc1 0 2024-09-13T23:06:30.654 INFO:tasks.workunit.client.1.smithi152.stdout:2/774: symlink d0/d8/l10e 0 2024-09-13T23:06:30.654 INFO:tasks.workunit.client.1.smithi152.stdout:1/863: mkdir d4/d4c/d8d/d99/d126 0 2024-09-13T23:06:30.655 INFO:tasks.workunit.client.1.smithi152.stdout:2/775: creat d0/d4/d9/d16/d30/f10f x:0 0 0 2024-09-13T23:06:30.656 INFO:tasks.workunit.client.1.smithi152.stdout:1/864: symlink d4/d9/d1a/d22/d24/d48/l127 0 2024-09-13T23:06:30.661 INFO:tasks.workunit.client.1.smithi152.stdout:7/842: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b [4194304,4194304] 0 2024-09-13T23:06:30.661 INFO:tasks.workunit.client.1.smithi152.stdout:1/865: dread d4/d4c/f54 [0,4194304] 0 2024-09-13T23:06:30.664 INFO:tasks.workunit.client.1.smithi152.stdout:1/866: creat d4/d4c/f128 x:0 0 0 2024-09-13T23:06:30.664 INFO:tasks.workunit.client.1.smithi152.stdout:1/867: readlink d4/d9/d1a/d22/l5c 0 2024-09-13T23:06:30.666 INFO:tasks.workunit.client.1.smithi152.stdout:1/868: creat d4/d9/d1a/d22/d24/d105/f129 x:0 0 0 2024-09-13T23:06:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/776: dread d0/d4/d9/d14/d48/fb3 [0,4194304] 0 2024-09-13T23:06:30.669 INFO:tasks.workunit.client.1.smithi152.stdout:2/777: dread - d0/d4/d9/d18/d1e/d3c/d4d/f95 zero size 2024-09-13T23:06:30.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/719: dwrite d4/de/d12/f6f [0,4194304] 0 2024-09-13T23:06:30.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/720: readlink d4/l5 0 2024-09-13T23:06:30.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/721: read d4/de/f6c [428270,129202] 0 2024-09-13T23:06:30.669 INFO:tasks.workunit.client.1.smithi152.stdout:5/788: dwrite d5/dc/d19/d65/d99/d98/f9c [0,4194304] 0 2024-09-13T23:06:30.670 INFO:tasks.workunit.client.1.smithi152.stdout:1/869: dread d4/d47/d8b/fca [0,4194304] 0 2024-09-13T23:06:30.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/789: dread - d5/d26/d61/de0/ff9 zero size 2024-09-13T23:06:30.670 INFO:tasks.workunit.client.1.smithi152.stdout:3/716: dwrite de/d14/d47/d57/d5d/d6e/fbb [0,4194304] 0 2024-09-13T23:06:30.670 INFO:tasks.workunit.client.1.smithi152.stdout:2/778: symlink d0/d4/d9/d16/d9f/l110 0 2024-09-13T23:06:30.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/717: link de/d14/d47/d70/d72/la9 de/d1f/da2/dcb/lf6 0 2024-09-13T23:06:30.682 INFO:tasks.workunit.client.1.smithi152.stdout:2/779: truncate d0/d4/d9/d16/d2b/faa 3827694 0 2024-09-13T23:06:30.682 INFO:tasks.workunit.client.1.smithi152.stdout:6/722: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/lee 0 2024-09-13T23:06:30.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/790: write d5/dc/da3/db4/f7d [72592,32030] 0 2024-09-13T23:06:30.682 INFO:tasks.workunit.client.1.smithi152.stdout:5/791: stat d5/d26/d61/la5 0 2024-09-13T23:06:30.683 INFO:tasks.workunit.client.1.smithi152.stdout:3/718: dread de/f3e [0,4194304] 0 2024-09-13T23:06:30.685 INFO:tasks.workunit.client.1.smithi152.stdout:6/723: unlink d4/de/d12/d16/f7e 0 2024-09-13T23:06:30.685 INFO:tasks.workunit.client.1.smithi152.stdout:6/724: chown d4/de/f39 111 1 2024-09-13T23:06:30.685 INFO:tasks.workunit.client.1.smithi152.stdout:6/725: fdatasync d4/de/d12/d16/d2a/d3d/d57/f81 0 2024-09-13T23:06:30.686 INFO:tasks.workunit.client.1.smithi152.stdout:8/625: rename d17/d25/d32/d9a/d8f/d9e to d17/d25/d32/d50/dc2 0 2024-09-13T23:06:30.686 INFO:tasks.workunit.client.1.smithi152.stdout:8/626: write d17/d19/f68 [1063061,51193] 0 2024-09-13T23:06:30.689 INFO:tasks.workunit.client.1.smithi152.stdout:6/726: link d4/de/d12/d16/d2a/d38/d3c/fba d4/de/d12/d3e/db3/fef 0 2024-09-13T23:06:30.694 INFO:tasks.workunit.client.1.smithi152.stdout:2/780: dread d0/d4/d9/f10 [0,4194304] 0 2024-09-13T23:06:30.694 INFO:tasks.workunit.client.1.smithi152.stdout:2/781: write d0/f2e [4778390,23388] 0 2024-09-13T23:06:30.694 INFO:tasks.workunit.client.1.smithi152.stdout:2/782: chown d0/d4/d9/d16/d2b/f46 517456917 1 2024-09-13T23:06:30.696 INFO:tasks.workunit.client.1.smithi152.stdout:1/870: getdents d4/d9/d1a/d22/d24/d105 0 2024-09-13T23:06:30.697 INFO:tasks.workunit.client.1.smithi152.stdout:5/792: read d5/f3f [1808653,42067] 0 2024-09-13T23:06:30.698 INFO:tasks.workunit.client.1.smithi152.stdout:7/843: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/f80 [0,4194304] 0 2024-09-13T23:06:30.700 INFO:tasks.workunit.client.1.smithi152.stdout:2/783: link d0/d4/d9/d18/d1e/l61 d0/d4/d9/d18/d1e/d3c/l111 0 2024-09-13T23:06:30.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/844: symlink d17/d24/d9f/d3f/d11c/l11d 0 2024-09-13T23:06:30.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/845: readlink d17/d24/d9f/d51/d5b/d90/d2e/d79/l9c 0 2024-09-13T23:06:30.707 INFO:tasks.workunit.client.1.smithi152.stdout:5/793: write d5/dc/d19/d65/d99/d98/f9c [3378697,94420] 0 2024-09-13T23:06:30.707 INFO:tasks.workunit.client.1.smithi152.stdout:5/794: fdatasync d5/dc/d19/d20/f4e 0 2024-09-13T23:06:30.707 INFO:tasks.workunit.client.1.smithi152.stdout:5/795: dread - d5/dc/d19/d65/d99/da6/f7a zero size 2024-09-13T23:06:30.708 INFO:tasks.workunit.client.1.smithi152.stdout:5/796: truncate d5/dc/da3/db4/f7d 4368876 0 2024-09-13T23:06:30.709 INFO:tasks.workunit.client.1.smithi152.stdout:1/871: dwrite d4/d9/f8a [0,4194304] 0 2024-09-13T23:06:30.709 INFO:tasks.workunit.client.1.smithi152.stdout:1/872: chown d4/d9/d1a/d22/d24/dde/df4/c108 14407 1 2024-09-13T23:06:30.710 INFO:tasks.workunit.client.1.smithi152.stdout:2/784: rename d0/d4/d9/d18/d32/f35 to d0/d4/d9/d16/dd7/f112 0 2024-09-13T23:06:30.710 INFO:tasks.workunit.client.1.smithi152.stdout:2/785: write d0/d4/d9/d18/d1e/dc0/ff1 [4201959,17776] 0 2024-09-13T23:06:30.711 INFO:tasks.workunit.client.1.smithi152.stdout:7/846: symlink d17/d24/d9f/d46/l11e 0 2024-09-13T23:06:30.718 INFO:tasks.workunit.client.1.smithi152.stdout:0/707: sync 2024-09-13T23:06:30.718 INFO:tasks.workunit.client.1.smithi152.stdout:1/873: read d4/d4c/d8d/d11c/f102 [5175807,70504] 0 2024-09-13T23:06:30.719 INFO:tasks.workunit.client.1.smithi152.stdout:1/874: chown d4/d9/d1a/d22/d24/dde/fe7 17 1 2024-09-13T23:06:30.719 INFO:tasks.workunit.client.1.smithi152.stdout:0/708: write f14 [8526727,90934] 0 2024-09-13T23:06:30.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/709: write d18/d1f/d29/d4e/f64 [21357,118389] 0 2024-09-13T23:06:30.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/710: write d18/d1f/d29/f60 [2031972,64608] 0 2024-09-13T23:06:30.721 INFO:tasks.workunit.client.1.smithi152.stdout:5/797: rename d5/dc/d19/d65/cdf to d5/dc/d19/d20/d2e/d28/c10a 0 2024-09-13T23:06:30.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/847: creat d17/d24/d9f/d51/d5b/d63/f11f x:0 0 0 2024-09-13T23:06:30.735 INFO:tasks.workunit.client.1.smithi152.stdout:2/786: dread d0/d4/d9/d16/d30/f5c [0,4194304] 0 2024-09-13T23:06:30.738 INFO:tasks.workunit.client.1.smithi152.stdout:1/875: mknod d4/d9/d1a/d22/d24/c12a 0 2024-09-13T23:06:30.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/711: mkdir d18/d1f/d33/d6e/df7 0 2024-09-13T23:06:30.740 INFO:tasks.workunit.client.1.smithi152.stdout:0/712: chown d18/d1f/d29/d3f/d40/daa/lc8 863076281 1 2024-09-13T23:06:30.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/798: rename d5/dc/d19/d65/d99/da6/dad/lc8 to d5/dc/d19/d20/dab/l10b 0 2024-09-13T23:06:30.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/799: read d5/d26/fc9 [92468,95165] 0 2024-09-13T23:06:30.746 INFO:tasks.workunit.client.1.smithi152.stdout:7/848: truncate d17/d24/d9f/d51/d5b/d90/d8e/fbe 2195320 0 2024-09-13T23:06:30.746 INFO:tasks.workunit.client.1.smithi152.stdout:7/849: truncate d17/d24/fd2 652513 0 2024-09-13T23:06:30.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/872: sync 2024-09-13T23:06:30.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/873: dread - d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/fdc zero size 2024-09-13T23:06:30.750 INFO:tasks.workunit.client.1.smithi152.stdout:2/787: link d0/d4/d9/d18/d1e/d3c/d4d/l4f d0/d4/d9/d18/d1e/d3c/d4d/ddc/dee/l113 0 2024-09-13T23:06:30.753 INFO:tasks.workunit.client.1.smithi152.stdout:1/876: link d4/d9/d1a/d22/d24/daa/fc6 d4/d4c/de8/f12b 0 2024-09-13T23:06:30.754 INFO:tasks.workunit.client.1.smithi152.stdout:0/713: unlink d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fe2 0 2024-09-13T23:06:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:7/850: dread d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b [4194304,4194304] 0 2024-09-13T23:06:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:0/714: write d18/d1f/d33/d65/d7a/d83/fc9 [507608,95911] 0 2024-09-13T23:06:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:0/715: readlink d18/d1f/d33/d65/l97 0 2024-09-13T23:06:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:5/800: stat d5/dc/d19/d65/d99/d98/dc2/ce5 0 2024-09-13T23:06:30.760 INFO:tasks.workunit.client.1.smithi152.stdout:2/788: creat d0/d4/d9/d16/d30/d9e/db5/d10b/f114 x:0 0 0 2024-09-13T23:06:30.763 INFO:tasks.workunit.client.1.smithi152.stdout:1/877: creat d4/d9/d71/f12c x:0 0 0 2024-09-13T23:06:30.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/716: dread d18/d19/d2c/f5d [0,4194304] 0 2024-09-13T23:06:30.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/717: chown d18/d1f/fb1 3267 1 2024-09-13T23:06:30.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/718: fdatasync d18/d19/d2c/f54 0 2024-09-13T23:06:30.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/719: read d18/d1f/d33/f36 [102867,53748] 0 2024-09-13T23:06:30.768 INFO:tasks.workunit.client.1.smithi152.stdout:7/851: mknod d17/d24/d9f/d51/d5b/d90/d2b/d4b/c120 0 2024-09-13T23:06:30.769 INFO:tasks.workunit.client.1.smithi152.stdout:4/874: getdents d3/d4/d6/d8/dad 0 2024-09-13T23:06:30.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/852: write d17/f110 [564074,26060] 0 2024-09-13T23:06:30.771 INFO:tasks.workunit.client.1.smithi152.stdout:1/878: mkdir d4/d9/d1a/d22/d24/daa/d122/d12d 0 2024-09-13T23:06:30.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/720: mknod d18/d1f/d29/d3f/d40/daa/cf8 0 2024-09-13T23:06:30.774 INFO:tasks.workunit.client.1.smithi152.stdout:4/875: mkdir d3/d4/d8d/d93/d115 0 2024-09-13T23:06:30.775 INFO:tasks.workunit.client.1.smithi152.stdout:7/853: mknod d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/c121 0 2024-09-13T23:06:30.776 INFO:tasks.workunit.client.1.smithi152.stdout:4/876: symlink d3/d4/d6/d8/d17/d5d/d94/d9b/de9/l116 0 2024-09-13T23:06:30.776 INFO:tasks.workunit.client.1.smithi152.stdout:4/877: dread - d3/d4/d6/d66/d62/f10f zero size 2024-09-13T23:06:30.777 INFO:tasks.workunit.client.1.smithi152.stdout:4/878: chown d3/d4/d6/d8/d17/d3a/f56 3341838 1 2024-09-13T23:06:30.779 INFO:tasks.workunit.client.1.smithi152.stdout:4/879: rename d3/d4/d6/d63/d79/l89 to d3/d4/d6/d66/d2b/d8e/l117 0 2024-09-13T23:06:30.779 INFO:tasks.workunit.client.1.smithi152.stdout:4/880: chown d3/d4/d6/d8/d17/d39 7 1 2024-09-13T23:06:30.783 INFO:tasks.workunit.client.1.smithi152.stdout:4/881: rename d3/d4/d8d/f55 to d3/d4/d6/d66/d62/f118 0 2024-09-13T23:06:30.783 INFO:tasks.workunit.client.1.smithi152.stdout:4/882: chown d3/d4/d6/d66/d1c/f2c 42959855 1 2024-09-13T23:06:30.784 INFO:tasks.workunit.client.1.smithi152.stdout:5/801: dwrite d5/dc/d19/d65/d99/da6/f8b [0,4194304] 0 2024-09-13T23:06:30.784 INFO:tasks.workunit.client.1.smithi152.stdout:5/802: write d5/dc/d19/d20/dab/fbd [1218544,93029] 0 2024-09-13T23:06:30.791 INFO:tasks.workunit.client.1.smithi152.stdout:7/854: fdatasync d17/f110 0 2024-09-13T23:06:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:2/789: dwrite d0/d4/d9/d55/f57 [0,4194304] 0 2024-09-13T23:06:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:2/790: fsync d0/d4/d9/d18/d1e/dc0/fec 0 2024-09-13T23:06:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:1/879: dwrite d4/f72 [4194304,4194304] 0 2024-09-13T23:06:30.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/883: read d3/d4/d6/d66/f49 [2085610,67319] 0 2024-09-13T23:06:30.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/884: write d3/d4/d6/f4c [1758262,82648] 0 2024-09-13T23:06:30.795 INFO:tasks.workunit.client.1.smithi152.stdout:7/855: rename d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/f80 to d17/d24/d9f/dac/dba/f122 0 2024-09-13T23:06:30.798 INFO:tasks.workunit.client.1.smithi152.stdout:5/803: dread d5/da/f1b [4194304,4194304] 0 2024-09-13T23:06:30.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:30 smithi115 ceph-mon[27601]: pgmap v11: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 212 MiB/s rd, 273 MiB/s wr, 403 op/s 2024-09-13T23:06:30.804 INFO:tasks.workunit.client.1.smithi152.stdout:2/791: unlink d0/d4/f85 0 2024-09-13T23:06:30.804 INFO:tasks.workunit.client.1.smithi152.stdout:1/880: symlink d4/d9/d1a/d22/d24/dde/df4/l12e 0 2024-09-13T23:06:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/881: dread d4/d9/d1a/d22/f9b [0,4194304] 0 2024-09-13T23:06:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/882: write d4/d9/d1a/d22/d24/dde/fe7 [1238404,129991] 0 2024-09-13T23:06:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/883: write d4/d47/fcb [755446,89998] 0 2024-09-13T23:06:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/884: creat d4/d9/d71/f12f x:0 0 0 2024-09-13T23:06:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:1/885: fsync d4/d9/ffb 0 2024-09-13T23:06:30.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/856: symlink d17/d6c/l123 0 2024-09-13T23:06:30.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/804: creat d5/d26/d61/d68/f10c x:0 0 0 2024-09-13T23:06:30.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/792: getdents d0/d4/d9/d16/d2b 0 2024-09-13T23:06:30.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/793: creat d0/d4/d9/d16/d30/d9e/db5/d10b/f115 x:0 0 0 2024-09-13T23:06:30.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/794: symlink d0/d4/d9/d16/d30/dba/l116 0 2024-09-13T23:06:30.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/795: rename d0/d4/d9/d16/d30/dc7/lfc to d0/d4/d9/d14/d48/l117 0 2024-09-13T23:06:30.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/796: chown d0/d4/d9/d14/d48/d49/f79 0 1 2024-09-13T23:06:30.834 INFO:tasks.workunit.client.1.smithi152.stdout:2/797: creat d0/d4/d9/d14/d48/f118 x:0 0 0 2024-09-13T23:06:30.843 INFO:tasks.workunit.client.1.smithi152.stdout:7/857: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/fe0 [0,4194304] 0 2024-09-13T23:06:30.843 INFO:tasks.workunit.client.1.smithi152.stdout:7/858: chown d17/d24/d109/dda/cd6 3409267 1 2024-09-13T23:06:30.843 INFO:tasks.workunit.client.1.smithi152.stdout:1/886: dwrite d4/d9/d1a/f33 [0,4194304] 0 2024-09-13T23:06:30.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/805: dwrite d5/d26/d61/d68/fe6 [0,4194304] 0 2024-09-13T23:06:30.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/806: chown d5/da/dd2 386 1 2024-09-13T23:06:30.849 INFO:tasks.workunit.client.1.smithi152.stdout:7/859: creat d17/d24/d9f/dac/dba/d85/f124 x:0 0 0 2024-09-13T23:06:30.849 INFO:tasks.workunit.client.1.smithi152.stdout:7/860: fdatasync d17/d24/d9f/d51/d5b/d90/d2e/d71/fbc 0 2024-09-13T23:06:30.849 INFO:tasks.workunit.client.1.smithi152.stdout:7/861: chown cf 1725 1 2024-09-13T23:06:30.855 INFO:tasks.workunit.client.1.smithi152.stdout:2/798: dwrite d0/d4/d9/d55/fa1 [0,4194304] 0 2024-09-13T23:06:30.856 INFO:tasks.workunit.client.1.smithi152.stdout:2/799: truncate d0/f103 878038 0 2024-09-13T23:06:30.859 INFO:tasks.workunit.client.1.smithi152.stdout:7/862: link d17/d24/d9f/d51/d5b/d90/d2e/d79/da1/c121 d17/d24/d9f/c125 0 2024-09-13T23:06:30.860 INFO:tasks.workunit.client.1.smithi152.stdout:1/887: getdents d4/d9 0 2024-09-13T23:06:30.860 INFO:tasks.workunit.client.1.smithi152.stdout:1/888: fsync d4/d47/d8b/f8f 0 2024-09-13T23:06:30.864 INFO:tasks.workunit.client.1.smithi152.stdout:2/800: rename d0/d4/d9/d16/d2b/faa to d0/d4/dca/f119 0 2024-09-13T23:06:30.865 INFO:tasks.workunit.client.1.smithi152.stdout:7/863: dread d17/d24/d9f/d51/fc0 [0,4194304] 0 2024-09-13T23:06:30.869 INFO:tasks.workunit.client.1.smithi152.stdout:1/889: unlink d4/d4c/fc1 0 2024-09-13T23:06:30.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/864: creat d17/d24/d9f/d51/d5b/d90/d8e/f126 x:0 0 0 2024-09-13T23:06:30.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/865: fsync d17/d24/f29 0 2024-09-13T23:06:30.872 INFO:tasks.workunit.client.1.smithi152.stdout:7/866: mknod d17/d24/d9f/d51/c127 0 2024-09-13T23:06:30.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/867: unlink d17/d24/d9f/d51/d5b/d90/d2b/f8d 0 2024-09-13T23:06:30.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/868: write d17/d24/d9f/d51/d5b/d87/f8a [1028639,15014] 0 2024-09-13T23:06:30.875 INFO:tasks.workunit.client.1.smithi152.stdout:7/869: link d17/f1d d17/d4f/d84/db6/f128 0 2024-09-13T23:06:30.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/890: dread d4/d9/d1a/d22/d24/f56 [0,4194304] 0 2024-09-13T23:06:30.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/891: fsync d4/d9/d1a/d22/d24/dde/fe7 0 2024-09-13T23:06:30.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/892: dread - d4/f75 zero size 2024-09-13T23:06:30.878 INFO:tasks.workunit.client.1.smithi152.stdout:7/870: mkdir d17/d24/d9f/d46/d129 0 2024-09-13T23:06:30.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/893: symlink d4/d9/l130 0 2024-09-13T23:06:30.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/894: symlink d4/d9/d1a/d22/d24/l131 0 2024-09-13T23:06:30.879 INFO:tasks.workunit.client.1.smithi152.stdout:1/895: chown d4/d9/d1a/d22/d24/dde/df4/l114 19202 1 2024-09-13T23:06:30.885 INFO:tasks.workunit.client.1.smithi152.stdout:2/801: dwrite d0/d4/d9/d14/d48/d49/feb [0,4194304] 0 2024-09-13T23:06:30.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/871: dread d17/d24/d9f/d51/d5b/d90/d2b/f72 [0,4194304] 0 2024-09-13T23:06:30.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/872: read f16 [608601,30044] 0 2024-09-13T23:06:30.888 INFO:tasks.workunit.client.1.smithi152.stdout:1/896: write d4/d47/f88 [2548443,93498] 0 2024-09-13T23:06:30.888 INFO:tasks.workunit.client.1.smithi152.stdout:1/897: chown d4/d9/d1a/d22/d24/daa/d122/d12d 812 1 2024-09-13T23:06:30.888 INFO:tasks.workunit.client.1.smithi152.stdout:1/898: chown d4/d9/d1a/d22/d24/dde 24269728 1 2024-09-13T23:06:30.888 INFO:tasks.workunit.client.1.smithi152.stdout:7/873: symlink d17/d24/d9f/dac/dba/d85/l12a 0 2024-09-13T23:06:30.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/874: truncate d17/d24/d9f/dac/dba/d85/faf 1038716 0 2024-09-13T23:06:30.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/875: stat d17/d24/d9f/d51/d5b/d90/d2b/d4b 0 2024-09-13T23:06:30.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/876: dread - d17/d24/d109/dda/fe5 zero size 2024-09-13T23:06:30.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/877: readlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/l64 0 2024-09-13T23:06:30.892 INFO:tasks.workunit.client.1.smithi152.stdout:1/899: rename d4/d47/dcd/lff to d4/d4c/d8d/d99/d104/l132 0 2024-09-13T23:06:30.893 INFO:tasks.workunit.client.1.smithi152.stdout:7/878: mkdir d17/d24/d9f/d51/d12b 0 2024-09-13T23:06:30.894 INFO:tasks.workunit.client.1.smithi152.stdout:7/879: creat d17/d24/d9f/d51/d5b/f12c x:0 0 0 2024-09-13T23:06:30.894 INFO:tasks.workunit.client.1.smithi152.stdout:7/880: fdatasync d17/d24/d9f/d51/d5b/d90/d2e/d30/f44 0 2024-09-13T23:06:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:2/802: write d0/d4/d9/d14/f2f [3661475,97023] 0 2024-09-13T23:06:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:1/900: dread d4/d9/d1a/d22/f9b [0,4194304] 0 2024-09-13T23:06:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/881: mkdir d17/d24/d9f/d46/d129/d12d 0 2024-09-13T23:06:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/882: chown d17/d24/d9f/d51/d5b/d90/d2b/d4b/c102 0 1 2024-09-13T23:06:30.898 INFO:tasks.workunit.client.1.smithi152.stdout:2/803: mkdir d0/d4/d8a/d11a 0 2024-09-13T23:06:30.900 INFO:tasks.workunit.client.1.smithi152.stdout:7/883: symlink d17/d24/d9f/d51/d12b/l12e 0 2024-09-13T23:06:30.900 INFO:tasks.workunit.client.1.smithi152.stdout:7/884: creat d17/d24/d9f/d46/f12f x:0 0 0 2024-09-13T23:06:30.901 INFO:tasks.workunit.client.1.smithi152.stdout:2/804: symlink d0/d4/d8a/d11a/l11b 0 2024-09-13T23:06:30.904 INFO:tasks.workunit.client.1.smithi152.stdout:7/885: rename d17/d24/d9f/d51/d5b/d90/d2e/d30/ff0 to d17/d24/d9f/d51/d5b/d63/df4/f130 0 2024-09-13T23:06:30.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/901: dwrite d4/d9/d1a/d22/d24/d48/f76 [4194304,4194304] 0 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:8/627: sync 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/727: sync 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:9/929: sync 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:3/719: sync 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:0/721: sync 2024-09-13T23:06:30.915 INFO:tasks.workunit.client.1.smithi152.stdout:8/628: write d17/d25/d32/d4b/d95/fad [742469,107052] 0 2024-09-13T23:06:30.917 INFO:tasks.workunit.client.1.smithi152.stdout:8/629: mkdir d17/d25/d32/d50/dc2/dc3 0 2024-09-13T23:06:30.917 INFO:tasks.workunit.client.1.smithi152.stdout:3/720: write de/d14/d47/d57/f69 [191795,18380] 0 2024-09-13T23:06:30.921 INFO:tasks.workunit.client.1.smithi152.stdout:8/630: truncate d17/d25/d32/d4b/f6e 928652 0 2024-09-13T23:06:30.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/805: truncate d0/d4/d9/d14/d48/d49/feb 3427638 0 2024-09-13T23:06:30.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/806: write d0/d4/d9/d18/f6f [1267189,50647] 0 2024-09-13T23:06:30.925 INFO:tasks.workunit.client.1.smithi152.stdout:2/807: dread d0/d4/d9/d18/d1e/d3c/d88/d98/fb0 [0,4194304] 0 2024-09-13T23:06:30.925 INFO:tasks.workunit.client.1.smithi152.stdout:3/721: creat de/d63/dc1/ff7 x:0 0 0 2024-09-13T23:06:30.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/631: truncate d17/d19/f33 956029 0 2024-09-13T23:06:30.929 INFO:tasks.workunit.client.1.smithi152.stdout:3/722: symlink de/d14/d47/d70/d72/lf8 0 2024-09-13T23:06:30.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/902: write d4/f100 [2102844,130256] 0 2024-09-13T23:06:30.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/903: dread - d4/d4c/d8d/d11c/f11e zero size 2024-09-13T23:06:30.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/904: fsync d4/d9/d1a/d22/d24/f45 0 2024-09-13T23:06:30.932 INFO:tasks.workunit.client.1.smithi152.stdout:8/632: creat d17/d25/d32/d4b/d84/d91/d9c/fc4 x:0 0 0 2024-09-13T23:06:30.932 INFO:tasks.workunit.client.1.smithi152.stdout:8/633: chown d17/d19/f3d 35994311 1 2024-09-13T23:06:30.935 INFO:tasks.workunit.client.1.smithi152.stdout:3/723: rename de/d14/d47/d57/d5d/d6e/f94 to de/d14/d47/d70/dca/df5/ff9 0 2024-09-13T23:06:30.935 INFO:tasks.workunit.client.1.smithi152.stdout:3/724: chown de/f98 363549 1 2024-09-13T23:06:30.935 INFO:tasks.workunit.client.1.smithi152.stdout:8/634: dread d17/d25/d32/d4b/d84/db2/fb5 [0,4194304] 0 2024-09-13T23:06:30.939 INFO:tasks.workunit.client.1.smithi152.stdout:2/808: dread d0/d4/d9/d14/f34 [0,4194304] 0 2024-09-13T23:06:30.939 INFO:tasks.workunit.client.1.smithi152.stdout:2/809: stat d0/d4/d9/d16/d30 0 2024-09-13T23:06:30.946 INFO:tasks.workunit.client.1.smithi152.stdout:9/930: dwrite d3/d24/d34/ff7 [0,4194304] 0 2024-09-13T23:06:30.948 INFO:tasks.workunit.client.1.smithi152.stdout:9/931: rename d3/db0/cd3 to d3/d1e/d30/dfe/c131 0 2024-09-13T23:06:30.948 INFO:tasks.workunit.client.1.smithi152.stdout:9/932: creat d3/d24/dac/f132 x:0 0 0 2024-09-13T23:06:30.948 INFO:tasks.workunit.client.1.smithi152.stdout:9/933: creat d3/d24/d34/d45/f133 x:0 0 0 2024-09-13T23:06:30.951 INFO:tasks.workunit.client.1.smithi152.stdout:9/934: creat d3/d24/f134 x:0 0 0 2024-09-13T23:06:30.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/935: rmdir d3/d24/d67/d4a/d71/d111/d11c 0 2024-09-13T23:06:30.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/936: chown d3/d24/d67/d60/cfa 287509 1 2024-09-13T23:06:30.964 INFO:tasks.workunit.client.1.smithi152.stdout:0/722: dwrite f14 [0,4194304] 0 2024-09-13T23:06:30.966 INFO:tasks.workunit.client.1.smithi152.stdout:0/723: creat d18/d1f/d33/d6e/df7/ff9 x:0 0 0 2024-09-13T23:06:30.967 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:30 smithi152 ceph-mon[34465]: pgmap v11: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 212 MiB/s rd, 273 MiB/s wr, 403 op/s 2024-09-13T23:06:30.968 INFO:tasks.workunit.client.1.smithi152.stdout:6/728: dwrite d4/de/fcd [0,4194304] 0 2024-09-13T23:06:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:9/937: dread d3/d1e/f92 [0,4194304] 0 2024-09-13T23:06:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:9/938: read - d3/d24/f11e zero size 2024-09-13T23:06:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:9/939: write d3/d24/d34/d45/f12a [1032107,103359] 0 2024-09-13T23:06:30.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/724: link d18/d19/d74/da4/cf0 d18/d1f/d29/d3f/d4b/d66/d6a/cfa 0 2024-09-13T23:06:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:6/729: creat d4/de/d1d/d79/ff0 x:0 0 0 2024-09-13T23:06:30.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/730: rename d4/de/d12/d3e/c83 to d4/de/d12/d16/d2a/d3d/dde/cf1 0 2024-09-13T23:06:30.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/731: dread - d4/de/d1d/fca zero size 2024-09-13T23:06:30.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/732: write d4/de/d21/d5c/f76 [463607,89352] 0 2024-09-13T23:06:30.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/733: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/fbd 1080400 0 2024-09-13T23:06:30.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/734: creat d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ff2 x:0 0 0 2024-09-13T23:06:30.983 INFO:tasks.workunit.client.1.smithi152.stdout:8/635: dwrite d17/d25/d32/d44/f6a [0,4194304] 0 2024-09-13T23:06:30.983 INFO:tasks.workunit.client.1.smithi152.stdout:8/636: creat d17/d25/d32/d4b/d84/db2/fc5 x:0 0 0 2024-09-13T23:06:30.986 INFO:tasks.workunit.client.1.smithi152.stdout:7/886: dwrite d17/d24/fd2 [0,4194304] 0 2024-09-13T23:06:30.986 INFO:tasks.workunit.client.1.smithi152.stdout:7/887: readlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/l64 0 2024-09-13T23:06:30.986 INFO:tasks.workunit.client.1.smithi152.stdout:7/888: stat f16 0 2024-09-13T23:06:30.986 INFO:tasks.workunit.client.1.smithi152.stdout:7/889: write d17/d24/d9f/d51/d5b/d63/df4/f130 [874997,20435] 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:1/905: dwrite d4/d4c/d8d/d11c/fd5 [0,4194304] 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/725: dwrite de/f1d [0,4194304] 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/726: creat de/d1f/ffa x:0 0 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/637: rename d17/l87 to d17/d25/d32/d9a/d8f/lc6 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/638: creat d17/d25/d32/d4b/d84/d91/d9c/fc7 x:0 0 0 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/639: chown d17/d25/d32/f5d 6795 1 2024-09-13T23:06:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:8/640: write d17/d25/d32/d4b/d84/d91/d9c/fc4 [297549,52942] 0 2024-09-13T23:06:30.991 INFO:tasks.workunit.client.1.smithi152.stdout:1/906: creat d4/d9/d1a/d22/d24/daa/d122/f133 x:0 0 0 2024-09-13T23:06:30.993 INFO:tasks.workunit.client.1.smithi152.stdout:3/727: mknod de/d14/d47/d57/dc9/dee/cfb 0 2024-09-13T23:06:30.993 INFO:tasks.workunit.client.1.smithi152.stdout:3/728: stat de/d14/d47/d70/f78 0 2024-09-13T23:06:30.994 INFO:tasks.workunit.client.1.smithi152.stdout:1/907: mknod d4/d9/d1a/d22/d24/daa/d122/c134 0 2024-09-13T23:06:30.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/890: dread d17/d24/d9f/d46/f74 [0,4194304] 0 2024-09-13T23:06:30.996 INFO:tasks.workunit.client.1.smithi152.stdout:7/891: write d17/d24/d9f/d51/d5b/d90/d2e/f32 [1190356,87993] 0 2024-09-13T23:06:30.996 INFO:tasks.workunit.client.1.smithi152.stdout:7/892: creat d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/f131 x:0 0 0 2024-09-13T23:06:31.034 INFO:tasks.workunit.client.1.smithi152.stdout:9/940: rmdir d3/d1e 39 2024-09-13T23:06:31.034 INFO:tasks.workunit.client.1.smithi152.stdout:6/735: dread d4/de/d21/f14 [0,4194304] 0 2024-09-13T23:06:31.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/810: dwrite d0/d4/d9/d18/d32/fb6 [0,4194304] 0 2024-09-13T23:06:31.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/811: stat d0/d4/d9/d18/d1e/d8c/fbb 0 2024-09-13T23:06:31.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/812: fsync d0/d4/d9/f63 0 2024-09-13T23:06:31.035 INFO:tasks.workunit.client.1.smithi152.stdout:9/941: symlink d3/d24/d67/d4a/d71/d7c/dee/d10e/l135 0 2024-09-13T23:06:31.035 INFO:tasks.workunit.client.1.smithi152.stdout:2/813: mknod d0/d4/d9/d16/d9f/c11c 0 2024-09-13T23:06:31.036 INFO:tasks.workunit.client.1.smithi152.stdout:9/942: unlink d3/d24/d34/d45/daa/lbc 0 2024-09-13T23:06:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:2/814: mknod d0/d4/d9/d14/df0/c11d 0 2024-09-13T23:06:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:3/729: dread de/f17 [0,4194304] 0 2024-09-13T23:06:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:9/943: creat d3/d24/d67/d4a/d71/d7c/dee/d10e/f136 x:0 0 0 2024-09-13T23:06:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:2/815: write d0/d4/d9/d18/dc1/fc6 [2674601,83654] 0 2024-09-13T23:06:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:2/816: read d0/d4/d9/f10 [2830441,45327] 0 2024-09-13T23:06:31.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/730: truncate de/d1f/da2/da8/fba 3720230 0 2024-09-13T23:06:31.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/731: dread - de/d1f/da2/da8/fd5 zero size 2024-09-13T23:06:31.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/732: write de/d14/d47/d57/d93/fce [416922,58891] 0 2024-09-13T23:06:31.041 INFO:tasks.workunit.client.1.smithi152.stdout:3/733: chown de/d14/d47/d57/d5d 8 1 2024-09-13T23:06:31.042 INFO:tasks.workunit.client.1.smithi152.stdout:1/908: dread d4/d47/d10a/f123 [0,4194304] 0 2024-09-13T23:06:31.042 INFO:tasks.workunit.client.1.smithi152.stdout:1/909: chown d4/d9/l7b 672540587 1 2024-09-13T23:06:31.042 INFO:tasks.workunit.client.1.smithi152.stdout:1/910: fsync d4/d4c/d8d/d99/d104/f106 0 2024-09-13T23:06:31.043 INFO:tasks.workunit.client.1.smithi152.stdout:9/944: truncate d3/d24/d67/d47/f97 4089886 0 2024-09-13T23:06:31.044 INFO:tasks.workunit.client.1.smithi152.stdout:1/911: rmdir d4/d9/d1a/d22/d24/dde/df4 39 2024-09-13T23:06:31.045 INFO:tasks.workunit.client.1.smithi152.stdout:9/945: read d3/f9b [4696717,69006] 0 2024-09-13T23:06:31.045 INFO:tasks.workunit.client.1.smithi152.stdout:9/946: creat d3/d24/d34/d45/f137 x:0 0 0 2024-09-13T23:06:31.046 INFO:tasks.workunit.client.1.smithi152.stdout:9/947: dread - d3/d1e/d30/d5d/da3/f118 zero size 2024-09-13T23:06:31.046 INFO:tasks.workunit.client.1.smithi152.stdout:9/948: truncate d3/d1e/d30/d5d/da3/fc3 681129 0 2024-09-13T23:06:31.048 INFO:tasks.workunit.client.1.smithi152.stdout:6/736: dread d4/de/d12/f1a [0,4194304] 0 2024-09-13T23:06:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/949: link d3/d24/d67/c6f d3/d24/d67/d4a/d71/db7/c138 0 2024-09-13T23:06:31.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/737: mknod d4/de/d21/d5c/cf3 0 2024-09-13T23:06:31.051 INFO:tasks.workunit.client.1.smithi152.stdout:9/950: truncate d3/d1e/fa1 483227 0 2024-09-13T23:06:31.053 INFO:tasks.workunit.client.1.smithi152.stdout:9/951: mknod d3/d24/d67/d60/de1/c139 0 2024-09-13T23:06:31.054 INFO:tasks.workunit.client.1.smithi152.stdout:3/734: dread de/d14/d38/fa3 [0,4194304] 0 2024-09-13T23:06:31.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/735: dread - de/d14/d47/d57/f8f zero size 2024-09-13T23:06:31.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/736: creat de/d1f/da2/da8/ffc x:0 0 0 2024-09-13T23:06:31.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/737: stat de/d14/d47/d70/d72/da7 0 2024-09-13T23:06:31.055 INFO:tasks.workunit.client.1.smithi152.stdout:3/738: readlink de/d14/d47/d70/lf4 0 2024-09-13T23:06:31.060 INFO:tasks.workunit.client.1.smithi152.stdout:3/739: symlink de/d14/d47/d57/dc9/lfd 0 2024-09-13T23:06:31.063 INFO:tasks.workunit.client.1.smithi152.stdout:2/817: dwrite d0/d4/d8a/fac [0,4194304] 0 2024-09-13T23:06:31.064 INFO:tasks.workunit.client.1.smithi152.stdout:2/818: read - d0/d4/d9/d16/d30/dba/ff2 zero size 2024-09-13T23:06:31.067 INFO:tasks.workunit.client.1.smithi152.stdout:2/819: dread d0/d4/d9/d14/d48/d49/fbc [0,4194304] 0 2024-09-13T23:06:31.068 INFO:tasks.workunit.client.1.smithi152.stdout:1/912: dwrite d4/d4c/fd3 [0,4194304] 0 2024-09-13T23:06:31.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/913: creat d4/d47/f135 x:0 0 0 2024-09-13T23:06:31.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/914: fsync d4/d4c/d8d/f95 0 2024-09-13T23:06:31.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/915: fsync d4/dc8/f11b 0 2024-09-13T23:06:31.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/916: fdatasync d4/d9/d1a/d22/d24/d105/f129 0 2024-09-13T23:06:31.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/917: fsync d4/d9/d1a/d22/d24/f56 0 2024-09-13T23:06:31.076 INFO:tasks.workunit.client.1.smithi152.stdout:1/918: mknod d4/d47/d8b/dd1/c136 0 2024-09-13T23:06:31.077 INFO:tasks.workunit.client.1.smithi152.stdout:4/885: sync 2024-09-13T23:06:31.078 INFO:tasks.workunit.client.1.smithi152.stdout:4/886: link d3/d4/d6/d66/f49 d3/d4/d6/d8/d17/d3a/f119 0 2024-09-13T23:06:31.080 INFO:tasks.workunit.client.1.smithi152.stdout:4/887: link d3/d34/fca d3/d4/d32/d82/f11a 0 2024-09-13T23:06:31.081 INFO:tasks.workunit.client.1.smithi152.stdout:4/888: symlink d3/d4/d6/d66/d2b/d8e/l11b 0 2024-09-13T23:06:31.081 INFO:tasks.workunit.client.1.smithi152.stdout:2/820: write d0/fe [1707062,69912] 0 2024-09-13T23:06:31.082 INFO:tasks.workunit.client.1.smithi152.stdout:2/821: stat d0/d4/d9/d14/c2d 0 2024-09-13T23:06:31.083 INFO:tasks.workunit.client.1.smithi152.stdout:2/822: creat d0/d4/d9/d18/f11e x:0 0 0 2024-09-13T23:06:31.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/823: rmdir d0/d4/d9/d18/dc1 39 2024-09-13T23:06:31.087 INFO:tasks.workunit.client.1.smithi152.stdout:9/952: dwrite d3/d1e/f21 [0,4194304] 0 2024-09-13T23:06:31.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/824: creat d0/d4/d9/d55/f11f x:0 0 0 2024-09-13T23:06:31.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/825: stat d0/d4/d9/d14/d48/d49/feb 0 2024-09-13T23:06:31.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/826: write d0/d8/f108 [553828,99486] 0 2024-09-13T23:06:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/919: dread d4/d47/d8b/f8f [0,4194304] 0 2024-09-13T23:06:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/920: dread - d4/d4c/d8d/d99/f111 zero size 2024-09-13T23:06:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/921: readlink d4/d9/d1a/d22/d24/daa/d122/l125 0 2024-09-13T23:06:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:6/738: dwrite d4/de/d12/d16/d2a/f4f [0,4194304] 0 2024-09-13T23:06:31.092 INFO:tasks.workunit.client.1.smithi152.stdout:6/739: chown d4/de/f6c 238419440 1 2024-09-13T23:06:31.092 INFO:tasks.workunit.client.1.smithi152.stdout:6/740: write d4/de/d12/d16/d2a/f48 [2971296,16234] 0 2024-09-13T23:06:31.092 INFO:tasks.workunit.client.1.smithi152.stdout:3/740: dwrite de/d14/d38/f19 [0,4194304] 0 2024-09-13T23:06:31.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/922: mknod d4/d9/d1a/d22/d24/daa/d122/c137 0 2024-09-13T23:06:31.099 INFO:tasks.workunit.client.1.smithi152.stdout:1/923: truncate d4/d4c/d8d/d99/f103 263231 0 2024-09-13T23:06:31.102 INFO:tasks.workunit.client.1.smithi152.stdout:3/741: rename de/d1f/ffa to de/d14/d47/d70/dca/ffe 0 2024-09-13T23:06:31.103 INFO:tasks.workunit.client.1.smithi152.stdout:3/742: readlink de/l9f 0 2024-09-13T23:06:31.103 INFO:tasks.workunit.client.1.smithi152.stdout:2/827: getdents d0/d4/d9/d55/d8f 0 2024-09-13T23:06:31.103 INFO:tasks.workunit.client.1.smithi152.stdout:6/741: write d4/de/d12/d16/d2a/d3d/d57/f60 [852780,67055] 0 2024-09-13T23:06:31.105 INFO:tasks.workunit.client.1.smithi152.stdout:1/924: mkdir d4/d9/d1a/d22/d24/dde/d138 0 2024-09-13T23:06:31.105 INFO:tasks.workunit.client.1.smithi152.stdout:3/743: rename de/d1f/da2/dcb/fe2 to de/d14/d47/d57/d99/fff 0 2024-09-13T23:06:31.106 INFO:tasks.workunit.client.1.smithi152.stdout:4/889: dwrite d3/d4/d6/d66/d2b/d8e/fe2 [0,4194304] 0 2024-09-13T23:06:31.107 INFO:tasks.workunit.client.1.smithi152.stdout:9/953: dwrite d3/d24/d67/d4a/ff1 [0,4194304] 0 2024-09-13T23:06:31.107 INFO:tasks.workunit.client.1.smithi152.stdout:9/954: chown d3/d24/d67/d4a/f8d 9796701 1 2024-09-13T23:06:31.108 INFO:tasks.workunit.client.1.smithi152.stdout:2/828: mkdir d0/d4/d9/d16/d30/d10c/d120 0 2024-09-13T23:06:31.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/742: symlink d4/de/d1d/deb/lf4 0 2024-09-13T23:06:31.110 INFO:tasks.workunit.client.1.smithi152.stdout:1/925: dread d4/d4c/d8d/fb5 [0,4194304] 0 2024-09-13T23:06:31.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/744: rename de/f39 to de/d1f/da2/dd3/f100 0 2024-09-13T23:06:31.111 INFO:tasks.workunit.client.1.smithi152.stdout:3/745: truncate de/d1f/da2/da8/ffc 996591 0 2024-09-13T23:06:31.112 INFO:tasks.workunit.client.1.smithi152.stdout:3/746: chown de/d63/df1/cf3 21009 1 2024-09-13T23:06:31.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/743: dread d4/de/d21/d5c/f76 [0,4194304] 0 2024-09-13T23:06:31.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/744: chown d4/f9 2063429 1 2024-09-13T23:06:31.115 INFO:tasks.workunit.client.1.smithi152.stdout:6/745: truncate d4/de/d12/f6f 4681051 0 2024-09-13T23:06:31.120 INFO:tasks.workunit.client.1.smithi152.stdout:9/955: link d3/d24/d34/d45/f82 d3/d24/d67/d4a/d71/d7c/dee/f13a 0 2024-09-13T23:06:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:4/890: write d3/d4/d6/d8/d17/d5d/d76/fee [2484598,27285] 0 2024-09-13T23:06:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:4/891: fdatasync d3/d4/d6/d66/d62/f10f 0 2024-09-13T23:06:31.124 INFO:tasks.workunit.client.1.smithi152.stdout:3/747: mknod de/d14/d47/d70/d87/ddd/c101 0 2024-09-13T23:06:31.124 INFO:tasks.workunit.client.1.smithi152.stdout:3/748: creat de/d1f/f102 x:0 0 0 2024-09-13T23:06:31.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/892: link d3/d4/d6/fb0 d3/d4/d6/d8/d17/d5d/f11c 0 2024-09-13T23:06:31.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/893: getdents d3/d4/d8d/d93 0 2024-09-13T23:06:31.136 INFO:tasks.workunit.client.1.smithi152.stdout:4/894: link d3/d4/d6/d66/d2b/d84/f48 d3/d4/d6/d66/d2b/d84/dac/f11d 0 2024-09-13T23:06:31.137 INFO:tasks.workunit.client.1.smithi152.stdout:4/895: write d3/d4/d6/f4c [2062346,80100] 0 2024-09-13T23:06:31.142 INFO:tasks.workunit.client.1.smithi152.stdout:4/896: creat d3/d4/d6/d66/d1c/d59/d60/f11e x:0 0 0 2024-09-13T23:06:31.145 INFO:tasks.workunit.client.1.smithi152.stdout:9/956: dread d3/d52/f83 [0,4194304] 0 2024-09-13T23:06:31.145 INFO:tasks.workunit.client.1.smithi152.stdout:4/897: unlink d3/d34/f97 0 2024-09-13T23:06:31.145 INFO:tasks.workunit.client.1.smithi152.stdout:4/898: creat d3/d4/d6/d8/d17/d3a/f11f x:0 0 0 2024-09-13T23:06:31.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/829: dwrite d0/d4/d9/d14/d48/d49/fbc [0,4194304] 0 2024-09-13T23:06:31.147 INFO:tasks.workunit.client.1.smithi152.stdout:1/926: dwrite d4/d4c/d8d/d99/f103 [0,4194304] 0 2024-09-13T23:06:31.147 INFO:tasks.workunit.client.1.smithi152.stdout:2/830: creat d0/d4/d9/d18/f121 x:0 0 0 2024-09-13T23:06:31.148 INFO:tasks.workunit.client.1.smithi152.stdout:4/899: rename d3/d4/d6/d66/d62/f10f to d3/d4/d8d/d93/d115/f120 0 2024-09-13T23:06:31.150 INFO:tasks.workunit.client.1.smithi152.stdout:6/746: dwrite d4/de/d12/d3e/f8b [0,4194304] 0 2024-09-13T23:06:31.154 INFO:tasks.workunit.client.1.smithi152.stdout:2/831: symlink d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/l122 0 2024-09-13T23:06:31.157 INFO:tasks.workunit.client.1.smithi152.stdout:6/747: rename d4/de/d12/d16/d2a/d38/d3c/f4c to d4/de/d12/d3e/ff5 0 2024-09-13T23:06:31.158 INFO:tasks.workunit.client.1.smithi152.stdout:6/748: chown d4/de/d12/d16/d2a/d38/c5a 613794663 1 2024-09-13T23:06:31.158 INFO:tasks.workunit.client.1.smithi152.stdout:6/749: readlink d4/de/d12/d16/d2a/lec 0 2024-09-13T23:06:31.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/750: creat d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/ff6 x:0 0 0 2024-09-13T23:06:31.160 INFO:tasks.workunit.client.1.smithi152.stdout:9/957: write d3/d1e/f33 [4191211,43397] 0 2024-09-13T23:06:31.160 INFO:tasks.workunit.client.1.smithi152.stdout:9/958: write d3/d24/d67/d4a/d8e/fdc [1253861,7819] 0 2024-09-13T23:06:31.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/751: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/df7 0 2024-09-13T23:06:31.170 INFO:tasks.workunit.client.1.smithi152.stdout:3/749: dwrite de/d14/d76/fae [0,4194304] 0 2024-09-13T23:06:31.170 INFO:tasks.workunit.client.1.smithi152.stdout:1/927: dwrite d4/fae [0,4194304] 0 2024-09-13T23:06:31.175 INFO:tasks.workunit.client.1.smithi152.stdout:3/750: link de/ff de/d1f/da2/f103 0 2024-09-13T23:06:31.182 INFO:tasks.workunit.client.1.smithi152.stdout:1/928: mkdir d4/d47/d8b/dd1/d139 0 2024-09-13T23:06:31.184 INFO:tasks.workunit.client.1.smithi152.stdout:3/751: creat de/d1f/da2/dcb/dbc/f104 x:0 0 0 2024-09-13T23:06:31.184 INFO:tasks.workunit.client.1.smithi152.stdout:3/752: truncate de/d1f/fd2 901621 0 2024-09-13T23:06:31.185 INFO:tasks.workunit.client.1.smithi152.stdout:4/900: dwrite d3/d4/d6/d66/d2b/d84/dac/fd0 [0,4194304] 0 2024-09-13T23:06:31.185 INFO:tasks.workunit.client.1.smithi152.stdout:1/929: getdents d4/d9/d1a/d22/d24/dde 0 2024-09-13T23:06:31.187 INFO:tasks.workunit.client.1.smithi152.stdout:3/753: truncate de/d1f/f74 2180152 0 2024-09-13T23:06:31.189 INFO:tasks.workunit.client.1.smithi152.stdout:3/754: chown de/d1f/da2/dcb/de6 117290 1 2024-09-13T23:06:31.190 INFO:tasks.workunit.client.1.smithi152.stdout:3/755: truncate de/d14/d47/d70/f73 691299 0 2024-09-13T23:06:31.190 INFO:tasks.workunit.client.1.smithi152.stdout:9/959: dwrite d3/d24/d67/d4a/fc0 [0,4194304] 0 2024-09-13T23:06:31.190 INFO:tasks.workunit.client.1.smithi152.stdout:9/960: fdatasync d3/d1e/d30/d5d/f12b 0 2024-09-13T23:06:31.191 INFO:tasks.workunit.client.1.smithi152.stdout:1/930: mkdir d4/d47/d8b/dd1/d139/d13a 0 2024-09-13T23:06:31.191 INFO:tasks.workunit.client.1.smithi152.stdout:6/752: dwrite d4/f6 [0,4194304] 0 2024-09-13T23:06:31.200 INFO:tasks.workunit.client.1.smithi152.stdout:9/961: mkdir d3/d24/d67/d47/d13b 0 2024-09-13T23:06:31.200 INFO:tasks.workunit.client.1.smithi152.stdout:9/962: write d3/d24/d67/d47/de7/f124 [735867,13411] 0 2024-09-13T23:06:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:5/807: sync 2024-09-13T23:06:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:5/808: chown d5/f3f 127 1 2024-09-13T23:06:31.205 INFO:tasks.workunit.client.1.smithi152.stdout:6/753: unlink d4/de/d12/d16/d2a/d3d/d57/d8d/lee 0 2024-09-13T23:06:31.206 INFO:tasks.workunit.client.1.smithi152.stdout:0/725: sync 2024-09-13T23:06:31.208 INFO:tasks.workunit.client.1.smithi152.stdout:1/931: unlink d4/d47/ced 0 2024-09-13T23:06:31.210 INFO:tasks.workunit.client.1.smithi152.stdout:5/809: mknod d5/dc/d19/d20/c10d 0 2024-09-13T23:06:31.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/963: dread d3/d1e/fd6 [0,4194304] 0 2024-09-13T23:06:31.213 INFO:tasks.workunit.client.1.smithi152.stdout:6/754: rename d4/l5 to d4/de/d1d/deb/lf8 0 2024-09-13T23:06:31.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/726: rmdir d18/d1f/d33/d6e 39 2024-09-13T23:06:31.217 INFO:tasks.workunit.client.1.smithi152.stdout:6/755: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/df9 0 2024-09-13T23:06:31.218 INFO:tasks.workunit.client.1.smithi152.stdout:0/727: mknod d18/d1f/d29/d2f/cfb 0 2024-09-13T23:06:31.220 INFO:tasks.workunit.client.1.smithi152.stdout:5/810: mknod d5/dc/d19/d65/d99/d98/c10e 0 2024-09-13T23:06:31.222 INFO:tasks.workunit.client.1.smithi152.stdout:9/964: rmdir d3/d24/d34/dc6 39 2024-09-13T23:06:31.226 INFO:tasks.workunit.client.1.smithi152.stdout:6/756: creat d4/de/d1d/dce/ffa x:0 0 0 2024-09-13T23:06:31.226 INFO:tasks.workunit.client.1.smithi152.stdout:6/757: readlink d4/de/d21/d5c/dc9/ld2 0 2024-09-13T23:06:31.227 INFO:tasks.workunit.client.1.smithi152.stdout:6/758: dread d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 [0,4194304] 0 2024-09-13T23:06:31.233 INFO:tasks.workunit.client.1.smithi152.stdout:0/728: dread d18/f1b [0,4194304] 0 2024-09-13T23:06:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/901: dwrite d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 [0,4194304] 0 2024-09-13T23:06:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:4/902: fdatasync d3/d34/fae 0 2024-09-13T23:06:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:3/756: dwrite de/d14/d47/fd7 [0,4194304] 0 2024-09-13T23:06:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:3/757: dread - de/fcd zero size 2024-09-13T23:06:31.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/729: rename d18/d1f/d29/d2f/ccd to d18/d1f/d33/df5/cfc 0 2024-09-13T23:06:31.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/730: stat d18/d1f/d33/d90/fba 0 2024-09-13T23:06:31.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/731: chown d18/d8f/dc5/dd0/dd9/de3/fe8 1473 1 2024-09-13T23:06:31.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/732: truncate d18/d1f/d29/d4e/dec/ff2 361747 0 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:3/758: rename de/d1f/da2/da8/de3 to de/d14/d47/d70/d105 0 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/932: dwrite d4/d9/d71/ff9 [0,4194304] 0 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:6/759: dread d4/de/d12/d16/f58 [0,4194304] 0 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/933: truncate d4/d47/d8b/fbf 522894 0 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/934: chown d4/f100 64398 1 2024-09-13T23:06:31.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/935: creat d4/d4c/f13b x:0 0 0 2024-09-13T23:06:31.243 INFO:tasks.workunit.client.1.smithi152.stdout:5/811: dwrite d5/d26/d61/d68/f93 [0,4194304] 0 2024-09-13T23:06:31.244 INFO:tasks.workunit.client.1.smithi152.stdout:3/759: creat de/d14/d47/d57/dc9/f106 x:0 0 0 2024-09-13T23:06:31.244 INFO:tasks.workunit.client.1.smithi152.stdout:3/760: readlink de/d14/d47/d70/lc7 0 2024-09-13T23:06:31.245 INFO:tasks.workunit.client.1.smithi152.stdout:1/936: mknod d4/d4c/d8d/c13c 0 2024-09-13T23:06:31.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/812: mkdir d5/dc/d19/d65/d99/d98/da0/d10f 0 2024-09-13T23:06:31.247 INFO:tasks.workunit.client.1.smithi152.stdout:6/760: rename d4/de/d21/l8c to d4/de/lfb 0 2024-09-13T23:06:31.247 INFO:tasks.workunit.client.1.smithi152.stdout:1/937: symlink d4/d4c/l13d 0 2024-09-13T23:06:31.249 INFO:tasks.workunit.client.1.smithi152.stdout:5/813: getdents d5/dc/da3/db4 0 2024-09-13T23:06:31.249 INFO:tasks.workunit.client.1.smithi152.stdout:1/938: getdents d4/d47/d8b/dd1/d139 0 2024-09-13T23:06:31.249 INFO:tasks.workunit.client.1.smithi152.stdout:1/939: chown d4/d4c/d8d/lac 28675 1 2024-09-13T23:06:31.251 INFO:tasks.workunit.client.1.smithi152.stdout:0/733: dread d18/d1f/d29/d2f/d3d/fa7 [0,4194304] 0 2024-09-13T23:06:31.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/940: dread d4/d9/d1a/f19 [0,4194304] 0 2024-09-13T23:06:31.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/814: write d5/dc/d19/d20/f4e [2084675,85177] 0 2024-09-13T23:06:31.261 INFO:tasks.workunit.client.1.smithi152.stdout:5/815: write d5/f7 [3764984,8408] 0 2024-09-13T23:06:31.262 INFO:tasks.workunit.client.1.smithi152.stdout:6/761: write d4/de/d12/d16/d2a/f2d [5832598,88909] 0 2024-09-13T23:06:31.262 INFO:tasks.workunit.client.1.smithi152.stdout:6/762: stat d4/de/ff 0 2024-09-13T23:06:31.267 INFO:tasks.workunit.client.1.smithi152.stdout:3/761: dwrite de/d14/d38/fa3 [4194304,4194304] 0 2024-09-13T23:06:31.269 INFO:tasks.workunit.client.1.smithi152.stdout:5/816: dread d5/dc/da3/db4/fc6 [0,4194304] 0 2024-09-13T23:06:31.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/965: dwrite d3/d24/d67/d47/fcf [4194304,4194304] 0 2024-09-13T23:06:31.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/966: write d3/d24/dac/ff5 [364336,68323] 0 2024-09-13T23:06:31.269 INFO:tasks.workunit.client.1.smithi152.stdout:4/903: dwrite d3/fab [0,4194304] 0 2024-09-13T23:06:31.276 INFO:tasks.workunit.client.1.smithi152.stdout:6/763: dread d4/de/d12/d16/d2a/f48 [0,4194304] 0 2024-09-13T23:06:31.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/762: dread de/d14/d47/d57/d5d/fad [0,4194304] 0 2024-09-13T23:06:31.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/763: fsync de/d14/f49 0 2024-09-13T23:06:31.284 INFO:tasks.workunit.client.1.smithi152.stdout:0/734: dwrite d18/d1f/d29/f60 [4194304,4194304] 0 2024-09-13T23:06:31.286 INFO:tasks.workunit.client.1.smithi152.stdout:5/817: dread d5/d26/f33 [0,4194304] 0 2024-09-13T23:06:31.288 INFO:tasks.workunit.client.1.smithi152.stdout:4/904: creat d3/d4/f121 x:0 0 0 2024-09-13T23:06:31.288 INFO:tasks.workunit.client.1.smithi152.stdout:4/905: stat d3/d4/d6/d8/c16 0 2024-09-13T23:06:31.289 INFO:tasks.workunit.client.1.smithi152.stdout:9/967: read d3/d24/d67/d60/de1/f10c [3261025,24383] 0 2024-09-13T23:06:31.289 INFO:tasks.workunit.client.1.smithi152.stdout:9/968: fsync d3/d1e/d30/d5d/da3/fc3 0 2024-09-13T23:06:31.290 INFO:tasks.workunit.client.1.smithi152.stdout:1/941: dwrite d4/d4c/f54 [0,4194304] 0 2024-09-13T23:06:31.290 INFO:tasks.workunit.client.1.smithi152.stdout:9/969: chown d3/d1e/d30/c3b 1927380891 1 2024-09-13T23:06:31.290 INFO:tasks.workunit.client.1.smithi152.stdout:6/764: write d4/de/d12/d16/d2a/f71 [2163582,68908] 0 2024-09-13T23:06:31.291 INFO:tasks.workunit.client.1.smithi152.stdout:3/764: creat de/d14/d38/f107 x:0 0 0 2024-09-13T23:06:31.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/735: write d18/d1f/fb1 [517057,111948] 0 2024-09-13T23:06:31.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/736: chown d18/d1f/d29/d2f/d3d/f5e 1211887 1 2024-09-13T23:06:31.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/818: mknod d5/dc/d19/d20/dab/c110 0 2024-09-13T23:06:31.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/819: getdents d5/dc/d19/d20/d2e/d28/dfb 0 2024-09-13T23:06:31.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/820: truncate d5/dc/d19/d20/d2e/d28/fb6 1211375 0 2024-09-13T23:06:31.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/641: sync 2024-09-13T23:06:31.298 INFO:tasks.workunit.client.1.smithi152.stdout:7/893: sync 2024-09-13T23:06:31.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/642: readlink la 0 2024-09-13T23:06:31.299 INFO:tasks.workunit.client.1.smithi152.stdout:4/906: symlink d3/d4/d6/d66/d2b/d84/dac/l122 0 2024-09-13T23:06:31.299 INFO:tasks.workunit.client.1.smithi152.stdout:9/970: dread d3/d24/f36 [4194304,4194304] 0 2024-09-13T23:06:31.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/894: dread d17/d24/d9f/d51/d5b/d87/f94 [0,4194304] 0 2024-09-13T23:06:31.306 INFO:tasks.workunit.client.1.smithi152.stdout:1/942: symlink d4/d9/l13e 0 2024-09-13T23:06:31.306 INFO:tasks.workunit.client.1.smithi152.stdout:1/943: read d4/d47/f88 [2052060,84117] 0 2024-09-13T23:06:31.307 INFO:tasks.workunit.client.1.smithi152.stdout:3/765: creat de/d14/d47/d57/d5d/dcc/f108 x:0 0 0 2024-09-13T23:06:31.307 INFO:tasks.workunit.client.1.smithi152.stdout:1/944: dread d4/d9/d1a/f19 [0,4194304] 0 2024-09-13T23:06:31.309 INFO:tasks.workunit.client.1.smithi152.stdout:5/821: mknod d5/dc/d19/d65/d99/d98/dc2/d82/c111 0 2024-09-13T23:06:31.310 INFO:tasks.workunit.client.1.smithi152.stdout:8/643: mknod d17/d25/d80/d8a/cc8 0 2024-09-13T23:06:31.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/971: creat d3/d24/d67/d47/d13b/f13c x:0 0 0 2024-09-13T23:06:31.313 INFO:tasks.workunit.client.1.smithi152.stdout:2/832: sync 2024-09-13T23:06:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/907: dwrite d3/d4/d6/f1a [0,4194304] 0 2024-09-13T23:06:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/895: rmdir d17/d24/d9f/d51/d5b/d87 39 2024-09-13T23:06:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/908: dread - d3/d4/d6/d8/d17/d5d/dde/f107 zero size 2024-09-13T23:06:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/909: write d3/d4/d6/d8/d17/d3a/fe3 [909076,57565] 0 2024-09-13T23:06:31.317 INFO:tasks.workunit.client.1.smithi152.stdout:6/765: rmdir d4/de/d12/d3e 39 2024-09-13T23:06:31.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/945: creat d4/d9/f13f x:0 0 0 2024-09-13T23:06:31.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/946: dread - d4/d9/d1a/d22/d24/daa/d122/f133 zero size 2024-09-13T23:06:31.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/947: chown d4/l2c 545634 1 2024-09-13T23:06:31.323 INFO:tasks.workunit.client.1.smithi152.stdout:5/822: rmdir d5/dc/d19/d65/d99/d98/dc2/d80/dfc 39 2024-09-13T23:06:31.323 INFO:tasks.workunit.client.1.smithi152.stdout:5/823: readlink d5/dc/d19/d65/d99/l6e 0 2024-09-13T23:06:31.323 INFO:tasks.workunit.client.1.smithi152.stdout:5/824: fsync d5/dc/d19/d65/fed 0 2024-09-13T23:06:31.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/644: mknod d17/d25/d32/cc9 0 2024-09-13T23:06:31.326 INFO:tasks.workunit.client.1.smithi152.stdout:9/972: mkdir d3/d1e/d13d 0 2024-09-13T23:06:31.327 INFO:tasks.workunit.client.1.smithi152.stdout:2/833: getdents d0 0 2024-09-13T23:06:31.327 INFO:tasks.workunit.client.1.smithi152.stdout:7/896: mknod d17/d4f/d84/df5/c132 0 2024-09-13T23:06:31.330 INFO:tasks.workunit.client.1.smithi152.stdout:4/910: mknod d3/d4/d6/d66/d2b/ddf/c123 0 2024-09-13T23:06:31.333 INFO:tasks.workunit.client.1.smithi152.stdout:6/766: link d4/de/d21/lc6 d4/de/d12/d16/d2a/d3d/dcf/ddf/lfc 0 2024-09-13T23:06:31.333 INFO:tasks.workunit.client.1.smithi152.stdout:3/766: getdents de/d14/d47/d57/d5d/dcc 0 2024-09-13T23:06:31.333 INFO:tasks.workunit.client.1.smithi152.stdout:1/948: creat d4/d4c/d8d/d99/d126/f140 x:0 0 0 2024-09-13T23:06:31.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/825: creat d5/dc/d19/d65/d99/da6/dad/dd8/df6/f112 x:0 0 0 2024-09-13T23:06:31.336 INFO:tasks.workunit.client.1.smithi152.stdout:5/826: creat d5/dc/d19/d65/d99/da6/dad/f113 x:0 0 0 2024-09-13T23:06:31.336 INFO:tasks.workunit.client.1.smithi152.stdout:8/645: getdents d17/d25 0 2024-09-13T23:06:31.337 INFO:tasks.workunit.client.1.smithi152.stdout:1/949: dread d4/d9/d1a/d22/f3d [0,4194304] 0 2024-09-13T23:06:31.339 INFO:tasks.workunit.client.1.smithi152.stdout:9/973: rename d3/d24/d67/d4a/d8e/ff2 to d3/d24/d67/d4a/d71/d7c/dee/d10e/f13e 0 2024-09-13T23:06:31.339 INFO:tasks.workunit.client.1.smithi152.stdout:9/974: write d3/f48 [842764,31664] 0 2024-09-13T23:06:31.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/911: mkdir d3/d4/d6/d66/d1c/d5f/d8b/d124 0 2024-09-13T23:06:31.346 INFO:tasks.workunit.client.1.smithi152.stdout:6/767: rmdir d4/de/d12/d16/d2a/d38 39 2024-09-13T23:06:31.346 INFO:tasks.workunit.client.1.smithi152.stdout:6/768: fsync d4/de/d12/f5f 0 2024-09-13T23:06:31.347 INFO:tasks.workunit.client.1.smithi152.stdout:9/975: creat d3/d24/d67/d47/f13f x:0 0 0 2024-09-13T23:06:31.347 INFO:tasks.workunit.client.1.smithi152.stdout:3/767: creat de/d14/d47/d70/dec/f109 x:0 0 0 2024-09-13T23:06:31.347 INFO:tasks.workunit.client.1.smithi152.stdout:1/950: mknod d4/d4c/c141 0 2024-09-13T23:06:31.348 INFO:tasks.workunit.client.1.smithi152.stdout:5/827: getdents d5/dc/d19/d65/d70 0 2024-09-13T23:06:31.348 INFO:tasks.workunit.client.1.smithi152.stdout:5/828: stat d5/dc/d19/d65/d99/da6/l64 0 2024-09-13T23:06:31.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/769: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/df7/lfd 0 2024-09-13T23:06:31.349 INFO:tasks.workunit.client.1.smithi152.stdout:3/768: mkdir de/d14/d47/d57/d5d/d6e/df2/d10a 0 2024-09-13T23:06:31.349 INFO:tasks.workunit.client.1.smithi152.stdout:3/769: fdatasync de/d14/d47/d70/d72/fb1 0 2024-09-13T23:06:31.355 INFO:tasks.workunit.client.1.smithi152.stdout:2/834: dwrite d0/d4/d9/d14/d48/fbf [0,4194304] 0 2024-09-13T23:06:31.356 INFO:tasks.workunit.client.1.smithi152.stdout:9/976: dread d3/f17 [0,4194304] 0 2024-09-13T23:06:31.356 INFO:tasks.workunit.client.1.smithi152.stdout:1/951: link d4/d9/d1a/d22/d24/d48/dc4/ceb d4/d47/d8b/c142 0 2024-09-13T23:06:31.356 INFO:tasks.workunit.client.1.smithi152.stdout:8/646: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:31.357 INFO:tasks.workunit.client.1.smithi152.stdout:9/977: creat d3/d1e/d30/d5d/f140 x:0 0 0 2024-09-13T23:06:31.357 INFO:tasks.workunit.client.1.smithi152.stdout:9/978: chown d3/d1e/d30/c3b 217365815 1 2024-09-13T23:06:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/952: symlink d4/d4c/d8d/d99/d104/l143 0 2024-09-13T23:06:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:8/647: mknod d17/d25/cca 0 2024-09-13T23:06:31.362 INFO:tasks.workunit.client.1.smithi152.stdout:9/979: unlink d3/d24/d34/d45/f12a 0 2024-09-13T23:06:31.363 INFO:tasks.workunit.client.1.smithi152.stdout:1/953: unlink d4/d4c/f54 0 2024-09-13T23:06:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/770: dread de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/771: truncate de/d14/d47/d57/fe4 4263231 0 2024-09-13T23:06:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/772: creat de/d14/d47/d57/d5d/d6e/f10b x:0 0 0 2024-09-13T23:06:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/773: dread - de/d14/d47/d57/dc9/f106 zero size 2024-09-13T23:06:31.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/954: dread d4/d4c/d8d/fb7 [4194304,4194304] 0 2024-09-13T23:06:31.374 INFO:tasks.workunit.client.1.smithi152.stdout:1/955: truncate d4/f6b 3344444 0 2024-09-13T23:06:31.374 INFO:tasks.workunit.client.1.smithi152.stdout:1/956: creat d4/d4c/d8d/d99/f144 x:0 0 0 2024-09-13T23:06:31.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/897: dwrite d17/d24/d9f/d51/d5b/d90/d2e/d79/db3/f105 [0,4194304] 0 2024-09-13T23:06:31.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/957: unlink d4/d9/d1a/d22/d24/dde/df4/l114 0 2024-09-13T23:06:31.378 INFO:tasks.workunit.client.1.smithi152.stdout:1/958: fsync d4/f1c 0 2024-09-13T23:06:31.379 INFO:tasks.workunit.client.1.smithi152.stdout:3/774: dread de/d1f/f91 [0,4194304] 0 2024-09-13T23:06:31.379 INFO:tasks.workunit.client.1.smithi152.stdout:7/898: rename d17/d24/d9f/d51/d5b/d90/d2b/la9 to d17/d4f/l133 0 2024-09-13T23:06:31.379 INFO:tasks.workunit.client.1.smithi152.stdout:7/899: read d17/d24/d9f/d51/d5b/d90/d2b/fd4 [333728,130614] 0 2024-09-13T23:06:31.380 INFO:tasks.workunit.client.1.smithi152.stdout:1/959: mkdir d4/d9/d1a/d145 0 2024-09-13T23:06:31.380 INFO:tasks.workunit.client.1.smithi152.stdout:1/960: chown d4/d9/d1a/c9d 25 1 2024-09-13T23:06:31.381 INFO:tasks.workunit.client.1.smithi152.stdout:1/961: symlink d4/d9/d1a/d22/d24/dde/l146 0 2024-09-13T23:06:31.382 INFO:tasks.workunit.client.1.smithi152.stdout:3/775: rmdir de/d14/d47/d70/dca 39 2024-09-13T23:06:31.390 INFO:tasks.workunit.client.1.smithi152.stdout:9/980: read d3/f48 [445129,12665] 0 2024-09-13T23:06:31.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/981: stat d3/d24/d34/d45/daa/cca 0 2024-09-13T23:06:31.392 INFO:tasks.workunit.client.1.smithi152.stdout:9/982: mkdir d3/d24/d141 0 2024-09-13T23:06:31.393 INFO:tasks.workunit.client.1.smithi152.stdout:9/983: link d3/f9b d3/d24/d34/d45/daa/f142 0 2024-09-13T23:06:31.394 INFO:tasks.workunit.client.1.smithi152.stdout:4/912: dwrite d3/d4/d6/d8/f8f [0,4194304] 0 2024-09-13T23:06:31.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/835: dwrite d0/d4/d9/d18/dc1/fc6 [0,4194304] 0 2024-09-13T23:06:31.407 INFO:tasks.workunit.client.1.smithi152.stdout:5/829: dwrite d5/dc/d5e/fbb [0,4194304] 0 2024-09-13T23:06:31.408 INFO:tasks.workunit.client.1.smithi152.stdout:5/830: rmdir d5/dc/da3/db4/d7f 39 2024-09-13T23:06:31.431 INFO:tasks.workunit.client.1.smithi152.stdout:8/648: dwrite d17/d25/d32/d4b/d84/d91/d9c/fc4 [0,4194304] 0 2024-09-13T23:06:31.431 INFO:tasks.workunit.client.1.smithi152.stdout:8/649: truncate d17/faf 298570 0 2024-09-13T23:06:31.432 INFO:tasks.workunit.client.1.smithi152.stdout:8/650: chown d17/d25/d32/d4b/la7 111 1 2024-09-13T23:06:31.434 INFO:tasks.workunit.client.1.smithi152.stdout:8/651: mknod d17/d25/d80/d8a/ccb 0 2024-09-13T23:06:31.434 INFO:tasks.workunit.client.1.smithi152.stdout:8/652: write d17/d25/d32/d4b/d84/db2/fc5 [251614,64787] 0 2024-09-13T23:06:31.434 INFO:tasks.workunit.client.1.smithi152.stdout:7/900: dwrite d17/d4f/f78 [0,4194304] 0 2024-09-13T23:06:31.434 INFO:tasks.workunit.client.1.smithi152.stdout:3/776: dwrite de/f1d [0,4194304] 0 2024-09-13T23:06:31.435 INFO:tasks.workunit.client.1.smithi152.stdout:3/777: fsync de/d1f/da2/dd3/f100 0 2024-09-13T23:06:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:2/836: dwrite d0/d4/d9/d55/f11f [0,4194304] 0 2024-09-13T23:06:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:7/901: mknod d17/d4f/d84/db6/c134 0 2024-09-13T23:06:31.438 INFO:tasks.workunit.client.1.smithi152.stdout:4/913: dwrite d3/d4/d6/d66/f85 [0,4194304] 0 2024-09-13T23:06:31.438 INFO:tasks.workunit.client.1.smithi152.stdout:4/914: chown d3/d4/d6/d8/d17/d5d/dde 305 1 2024-09-13T23:06:31.439 INFO:tasks.workunit.client.1.smithi152.stdout:5/831: dwrite d5/d26/f5d [0,4194304] 0 2024-09-13T23:06:31.439 INFO:tasks.workunit.client.1.smithi152.stdout:5/832: truncate d5/dc/d19/d65/f5c 817760 0 2024-09-13T23:06:31.443 INFO:tasks.workunit.client.1.smithi152.stdout:3/778: rename de/d1f/da2/da8/fd5 to de/d14/d47/d57/d99/f10c 0 2024-09-13T23:06:31.443 INFO:tasks.workunit.client.1.smithi152.stdout:3/779: dread - de/d14/d47/d70/dca/ffe zero size 2024-09-13T23:06:31.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/902: link d17/d24/d9f/d51/d5b/f75 d17/d24/d9f/d51/d5b/d63/df4/f135 0 2024-09-13T23:06:31.447 INFO:tasks.workunit.client.1.smithi152.stdout:4/915: mknod d3/d4/d32/d86/d95/df2/c125 0 2024-09-13T23:06:31.447 INFO:tasks.workunit.client.1.smithi152.stdout:2/837: dread d0/d4/d9/d18/d1e/d3c/fa6 [0,4194304] 0 2024-09-13T23:06:31.452 INFO:tasks.workunit.client.1.smithi152.stdout:5/833: rmdir d5/dc/da3/ddd 0 2024-09-13T23:06:31.456 INFO:tasks.workunit.client.1.smithi152.stdout:3/780: creat de/d14/d47/d70/dca/df5/f10d x:0 0 0 2024-09-13T23:06:31.456 INFO:tasks.workunit.client.1.smithi152.stdout:3/781: write de/d1f/fb8 [988974,82372] 0 2024-09-13T23:06:31.456 INFO:tasks.workunit.client.1.smithi152.stdout:3/782: creat de/d1f/da2/f10e x:0 0 0 2024-09-13T23:06:31.456 INFO:tasks.workunit.client.1.smithi152.stdout:3/783: write de/d1f/da2/da8/ffc [1400753,79955] 0 2024-09-13T23:06:31.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/903: truncate d17/d24/d9f/d51/d5b/d63/faa 537843 0 2024-09-13T23:06:31.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/904: truncate d17/d24/d9f/d51/d5b/d90/f112 204259 0 2024-09-13T23:06:31.461 INFO:tasks.workunit.client.1.smithi152.stdout:4/916: symlink d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/l126 0 2024-09-13T23:06:31.461 INFO:tasks.workunit.client.1.smithi152.stdout:4/917: readlink d3/d4/d8d/d93/d109/l7a 0 2024-09-13T23:06:31.462 INFO:tasks.workunit.client.1.smithi152.stdout:2/838: creat d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/f123 x:0 0 0 2024-09-13T23:06:31.462 INFO:tasks.workunit.client.1.smithi152.stdout:3/784: creat de/d14/d47/d57/d5d/d6e/df2/d10a/f10f x:0 0 0 2024-09-13T23:06:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/905: creat d17/d24/d9f/dac/f136 x:0 0 0 2024-09-13T23:06:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/906: write d17/d24/d9f/d51/d5b/f75 [1172667,2832] 0 2024-09-13T23:06:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/907: creat d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/f137 x:0 0 0 2024-09-13T23:06:31.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/785: dread de/d14/d47/d57/fe4 [0,4194304] 0 2024-09-13T23:06:31.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/786: chown de/d14/d47/d57/d5d/c92 362535905 1 2024-09-13T23:06:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/787: dread de/d1f/da2/da8/fba [0,4194304] 0 2024-09-13T23:06:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/788: chown de/f40 248636 1 2024-09-13T23:06:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/789: readlink de/d14/d47/d70/lc7 0 2024-09-13T23:06:31.489 INFO:tasks.workunit.client.1.smithi152.stdout:0/737: sync 2024-09-13T23:06:31.490 INFO:tasks.workunit.client.1.smithi152.stdout:3/790: getdents de/d14/d47/d57/d99 0 2024-09-13T23:06:31.491 INFO:tasks.workunit.client.1.smithi152.stdout:3/791: rename de/c34 to de/d14/d47/d57/d5d/d6e/df2/d10a/c110 0 2024-09-13T23:06:31.492 INFO:tasks.workunit.client.1.smithi152.stdout:6/770: sync 2024-09-13T23:06:31.492 INFO:tasks.workunit.client.1.smithi152.stdout:0/738: getdents d18/d1f/d29/d3f/d40/daa/dbd 0 2024-09-13T23:06:31.492 INFO:tasks.workunit.client.1.smithi152.stdout:0/739: readlink d18/d1f/d29/d3f/l96 0 2024-09-13T23:06:31.493 INFO:tasks.workunit.client.1.smithi152.stdout:2/839: dwrite d0/d4/d9/d14/d48/fbf [0,4194304] 0 2024-09-13T23:06:31.493 INFO:tasks.workunit.client.1.smithi152.stdout:2/840: chown d0/d4/d9/d16/d30/fea 970050 1 2024-09-13T23:06:31.493 INFO:tasks.workunit.client.1.smithi152.stdout:6/771: dread d4/de/d12/d16/d2a/f48 [4194304,4194304] 0 2024-09-13T23:06:31.494 INFO:tasks.workunit.client.1.smithi152.stdout:5/834: dwrite d5/dc/d19/d65/d99/da6/dad/fb0 [0,4194304] 0 2024-09-13T23:06:31.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/918: dwrite d3/d4/d6/d66/d1c/d59/f106 [0,4194304] 0 2024-09-13T23:06:31.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/792: rename de/d14/d47/d57/d5d/d6e/cc4 to de/d14/d47/d57/d5d/c111 0 2024-09-13T23:06:31.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/793: read - de/d63/dc1/ff7 zero size 2024-09-13T23:06:31.499 INFO:tasks.workunit.client.1.smithi152.stdout:4/919: mkdir d3/d4/d6/d66/d1c/d5f/d8b/dbf/d127 0 2024-09-13T23:06:31.499 INFO:tasks.workunit.client.1.smithi152.stdout:4/920: dread - d3/d4/d6/d8/d17/d5d/d76/f10c zero size 2024-09-13T23:06:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/921: creat d3/d4/d6/d8/d17/d5d/d76/d104/f128 x:0 0 0 2024-09-13T23:06:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/922: fdatasync d3/d4/d6/d66/d62/f118 0 2024-09-13T23:06:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:4/923: readlink d3/d4/d8d/l9f 0 2024-09-13T23:06:31.518 INFO:tasks.workunit.client.1.smithi152.stdout:0/740: dread d18/d1f/d29/d3f/d4b/f57 [0,4194304] 0 2024-09-13T23:06:31.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/794: write de/d14/d47/d57/d5d/f7f [2839268,16976] 0 2024-09-13T23:06:31.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/795: chown de/d14/d47/d57/d93/cdb 445376 1 2024-09-13T23:06:31.526 INFO:tasks.workunit.client.1.smithi152.stdout:3/796: symlink de/d14/d47/d70/d87/l112 0 2024-09-13T23:06:31.527 INFO:tasks.workunit.client.1.smithi152.stdout:3/797: unlink de/f1e 0 2024-09-13T23:06:31.528 INFO:tasks.workunit.client.1.smithi152.stdout:0/741: read d18/d1f/d29/d2f/d3d/f4c [3199458,47777] 0 2024-09-13T23:06:31.528 INFO:tasks.workunit.client.1.smithi152.stdout:3/798: truncate de/d1f/f91 2063033 0 2024-09-13T23:06:31.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/742: truncate d18/d1f/d29/d2f/dd3/fe4 812151 0 2024-09-13T23:06:31.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/743: write d18/d19/f81 [78655,68431] 0 2024-09-13T23:06:31.530 INFO:tasks.workunit.client.1.smithi152.stdout:6/772: dwrite d4/de/ff [0,4194304] 0 2024-09-13T23:06:31.530 INFO:tasks.workunit.client.1.smithi152.stdout:6/773: fdatasync d4/de/d1d/fbf 0 2024-09-13T23:06:31.530 INFO:tasks.workunit.client.1.smithi152.stdout:2/841: dwrite d0/d4/d9/d18/d1e/f1c [4194304,4194304] 0 2024-09-13T23:06:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:3/799: rename de/d14/d47/d70/dca/df5/ff9 to de/d14/d47/d57/dc9/dee/f113 0 2024-09-13T23:06:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:4/924: dwrite d3/d4/d6/d66/d1c/ff1 [0,4194304] 0 2024-09-13T23:06:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:4/925: readlink d3/d4/d32/l91 0 2024-09-13T23:06:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:4/926: read - d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/fdc zero size 2024-09-13T23:06:31.532 INFO:tasks.workunit.client.1.smithi152.stdout:2/842: mknod d0/d4/d9/d16/d30/c124 0 2024-09-13T23:06:31.533 INFO:tasks.workunit.client.1.smithi152.stdout:0/744: dread d18/d19/d74/da4/fab [0,4194304] 0 2024-09-13T23:06:31.536 INFO:tasks.workunit.client.1.smithi152.stdout:2/843: creat d0/d4/d9/d18/d1e/d3c/d88/db9/f125 x:0 0 0 2024-09-13T23:06:31.536 INFO:tasks.workunit.client.1.smithi152.stdout:0/745: creat d18/d1f/d33/df5/ffd x:0 0 0 2024-09-13T23:06:31.537 INFO:tasks.workunit.client.1.smithi152.stdout:4/927: dread d3/d34/fae [0,4194304] 0 2024-09-13T23:06:31.537 INFO:tasks.workunit.client.1.smithi152.stdout:4/928: chown d3/d4/d6/d8/d17/d5d/d94/d9b/de9 42213 1 2024-09-13T23:06:31.538 INFO:tasks.workunit.client.1.smithi152.stdout:2/844: rename d0/d4/d9/d14/d48/d4a/l87 to d0/d4/d9/d16/d9f/l126 0 2024-09-13T23:06:31.538 INFO:tasks.workunit.client.1.smithi152.stdout:5/835: dwrite d5/ff0 [0,4194304] 0 2024-09-13T23:06:31.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/774: dwrite d4/de/d12/d16/d2a/d38/d3c/f54 [0,4194304] 0 2024-09-13T23:06:31.549 INFO:tasks.workunit.client.1.smithi152.stdout:5/836: symlink d5/dc/d19/d65/d99/d98/da0/dc1/l114 0 2024-09-13T23:06:31.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/845: getdents d0/d4/d9/d16 0 2024-09-13T23:06:31.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/846: chown d0/d4/d9/d16/d9f/fe3 689 1 2024-09-13T23:06:31.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/847: fdatasync d0/d4/d9/d14/d48/d4a/fc2 0 2024-09-13T23:06:31.557 INFO:tasks.workunit.client.1.smithi152.stdout:6/775: creat d4/de/d12/d16/d2a/d3d/daa/ffe x:0 0 0 2024-09-13T23:06:31.557 INFO:tasks.workunit.client.1.smithi152.stdout:6/776: fsync d4/de/d12/d16/d2a/d38/d3c/fba 0 2024-09-13T23:06:31.559 INFO:tasks.workunit.client.1.smithi152.stdout:2/848: mknod d0/d4/d9/d18/d32/c127 0 2024-09-13T23:06:31.560 INFO:tasks.workunit.client.1.smithi152.stdout:6/777: dread d4/de/d12/f9f [0,4194304] 0 2024-09-13T23:06:31.561 INFO:tasks.workunit.client.1.smithi152.stdout:2/849: mkdir d0/d4/d9/d16/d30/d128 0 2024-09-13T23:06:31.564 INFO:tasks.workunit.client.1.smithi152.stdout:2/850: getdents d0/d4/d9/d14/d48 0 2024-09-13T23:06:31.566 INFO:tasks.workunit.client.1.smithi152.stdout:2/851: symlink d0/d4/d9/d16/d30/d10c/l129 0 2024-09-13T23:06:31.566 INFO:tasks.workunit.client.1.smithi152.stdout:2/852: chown d0/d4/d9/d18/d1e/d3c/d4d 9 1 2024-09-13T23:06:31.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/746: dwrite d18/d1f/d33/f5a [0,4194304] 0 2024-09-13T23:06:31.568 INFO:tasks.workunit.client.1.smithi152.stdout:2/853: symlink d0/d4/d9/d14/d48/dd1/l12a 0 2024-09-13T23:06:31.572 INFO:tasks.workunit.client.1.smithi152.stdout:6/778: read d4/de/d21/f14 [1682871,28067] 0 2024-09-13T23:06:31.572 INFO:tasks.workunit.client.1.smithi152.stdout:6/779: write d4/de/d21/f6e [465132,7012] 0 2024-09-13T23:06:31.577 INFO:tasks.workunit.client.1.smithi152.stdout:3/800: truncate de/d1f/f91 618155 0 2024-09-13T23:06:31.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/780: dread d4/de/fcd [0,4194304] 0 2024-09-13T23:06:31.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/781: getdents d4/de/d12/d16/d2a/d3d/d57/de0 0 2024-09-13T23:06:31.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/782: dread d4/de/d12/f28 [0,4194304] 0 2024-09-13T23:06:31.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/783: fdatasync d4/de/d12/d8a/f68 0 2024-09-13T23:06:31.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/784: chown d4/de/d1d/fca 0 1 2024-09-13T23:06:31.585 INFO:tasks.workunit.client.1.smithi152.stdout:6/785: write d4/de/d21/f15 [2791618,12265] 0 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:8/653: sync 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/908: sync 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/909: chown d17/d24/d9f/d51/f70 8 1 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:8/654: write d17/f77 [4891330,14668] 0 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/910: dread - d17/d24/d9f/d51/d5b/d63/f11f zero size 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:7/911: write d17/d24/d9f/d51/d5b/d63/d7d/fc1 [77082,109668] 0 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/962: sync 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/984: sync 2024-09-13T23:06:31.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/985: write d3/d24/d67/d47/de7/f124 [1229596,68797] 0 2024-09-13T23:06:31.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/986: chown d3/d52/lb4 0 1 2024-09-13T23:06:31.589 INFO:tasks.workunit.client.1.smithi152.stdout:7/912: symlink d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/l138 0 2024-09-13T23:06:31.595 INFO:tasks.workunit.client.1.smithi152.stdout:9/987: mknod d3/d24/d67/d47/c143 0 2024-09-13T23:06:31.595 INFO:tasks.workunit.client.1.smithi152.stdout:9/988: creat d3/d24/f144 x:0 0 0 2024-09-13T23:06:31.614 INFO:tasks.workunit.client.1.smithi152.stdout:2/854: dwrite d0/d4/d9/fab [0,4194304] 0 2024-09-13T23:06:31.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/747: dwrite d18/d1f/d29/d4e/f99 [0,4194304] 0 2024-09-13T23:06:31.636 INFO:tasks.workunit.client.1.smithi152.stdout:3/801: dwrite de/d14/f62 [0,4194304] 0 2024-09-13T23:06:31.636 INFO:tasks.workunit.client.1.smithi152.stdout:3/802: chown de/d14/d47/d70/d72/fb1 0 1 2024-09-13T23:06:31.639 INFO:tasks.workunit.client.1.smithi152.stdout:1/963: dwrite d4/d4c/d8d/d99/f111 [0,4194304] 0 2024-09-13T23:06:31.646 INFO:tasks.workunit.client.1.smithi152.stdout:3/803: dread de/d14/d47/d57/d99/fda [0,4194304] 0 2024-09-13T23:06:31.647 INFO:tasks.workunit.client.1.smithi152.stdout:3/804: symlink de/d63/df1/l114 0 2024-09-13T23:06:31.647 INFO:tasks.workunit.client.1.smithi152.stdout:6/786: dwrite d4/de/d12/f28 [0,4194304] 0 2024-09-13T23:06:31.648 INFO:tasks.workunit.client.1.smithi152.stdout:8/655: dwrite d17/d25/d32/f3e [0,4194304] 0 2024-09-13T23:06:31.648 INFO:tasks.workunit.client.1.smithi152.stdout:6/787: write d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/ff6 [621977,78253] 0 2024-09-13T23:06:31.648 INFO:tasks.workunit.client.1.smithi152.stdout:6/788: write d4/de/d12/f28 [4242423,60110] 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:3/805: fsync de/f90 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:2/855: dwrite d0/d4/d9/d18/d32/fb6 [0,4194304] 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:9/989: dwrite d3/d24/d67/d4a/f115 [0,4194304] 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:1/964: dread d4/d4c/d8d/d11c/fd5 [0,4194304] 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:1/965: readlink d4/d9/l13e 0 2024-09-13T23:06:31.649 INFO:tasks.workunit.client.1.smithi152.stdout:9/990: dread - d3/d1e/d30/f42 zero size 2024-09-13T23:06:31.651 INFO:tasks.workunit.client.1.smithi152.stdout:0/748: dwrite d18/d1f/d39/f76 [0,4194304] 0 2024-09-13T23:06:31.652 INFO:tasks.workunit.client.1.smithi152.stdout:3/806: chown de/f9d 257885 1 2024-09-13T23:06:31.658 INFO:tasks.workunit.client.1.smithi152.stdout:1/966: rename d4/d9/l25 to d4/d4c/d8d/d99/l147 0 2024-09-13T23:06:31.659 INFO:tasks.workunit.client.1.smithi152.stdout:9/991: symlink d3/d1e/d30/d5d/da3/l145 0 2024-09-13T23:06:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/749: rmdir d18/d1f/d33/d65 39 2024-09-13T23:06:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/750: chown d18/d1f/d29/d3f/d40/daa/cf8 0 1 2024-09-13T23:06:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/751: fsync d18/d1f/d29/d2f/d3d/f5e 0 2024-09-13T23:06:31.662 INFO:tasks.workunit.client.1.smithi152.stdout:8/656: link d17/d25/d32/d4b/d84/d91/d9c/cb7 d17/d25/d32/d4b/ccc 0 2024-09-13T23:06:31.664 INFO:tasks.workunit.client.1.smithi152.stdout:6/789: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/dff 0 2024-09-13T23:06:31.664 INFO:tasks.workunit.client.1.smithi152.stdout:3/807: mkdir de/d14/d47/d57/d5d/d115 0 2024-09-13T23:06:31.666 INFO:tasks.workunit.client.1.smithi152.stdout:1/967: mknod d4/d47/d10a/c148 0 2024-09-13T23:06:31.667 INFO:tasks.workunit.client.1.smithi152.stdout:0/752: symlink d18/d1f/d29/d2f/d3d/da1/lfe 0 2024-09-13T23:06:31.668 INFO:tasks.workunit.client.1.smithi152.stdout:8/657: getdents d17/d25/d32/d9a 0 2024-09-13T23:06:31.669 INFO:tasks.workunit.client.1.smithi152.stdout:6/790: truncate d4/de/d12/f9b 3255908 0 2024-09-13T23:06:31.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/929: sync 2024-09-13T23:06:31.673 INFO:tasks.workunit.client.1.smithi152.stdout:9/992: getdents d3/d1e/d30/d5d 0 2024-09-13T23:06:31.673 INFO:tasks.workunit.client.1.smithi152.stdout:9/993: write d3/d24/d67/d4a/d71/d7c/dee/f11a [4397596,37327] 0 2024-09-13T23:06:31.673 INFO:tasks.workunit.client.1.smithi152.stdout:9/994: read - d3/d24/d34/d45/f137 zero size 2024-09-13T23:06:31.673 INFO:tasks.workunit.client.1.smithi152.stdout:9/995: fsync d3/d1e/d30/f39 0 2024-09-13T23:06:31.675 INFO:tasks.workunit.client.1.smithi152.stdout:8/658: rename d17/d25/ca9 to d17/d25/d32/d4b/d84/d91/d9c/ccd 0 2024-09-13T23:06:31.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/753: write d18/d1f/d29/d4e/fbe [351185,72344] 0 2024-09-13T23:06:31.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/754: write d18/d1f/d29/d3f/da0/fa3 [709013,100007] 0 2024-09-13T23:06:31.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/791: symlink d4/de/d12/d16/d2a/d3d/d57/dc7/l100 0 2024-09-13T23:06:31.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/792: fsync d4/de/d1d/f6b 0 2024-09-13T23:06:31.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/793: write d4/de/d12/f28 [5244646,80106] 0 2024-09-13T23:06:31.677 INFO:tasks.workunit.client.1.smithi152.stdout:4/930: creat d3/d4/d6/d63/d79/f129 x:0 0 0 2024-09-13T23:06:31.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/808: unlink de/d1f/f74 0 2024-09-13T23:06:31.679 INFO:tasks.workunit.client.1.smithi152.stdout:1/968: getdents d4/d4c/d8d/d99/d126 0 2024-09-13T23:06:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:9/996: symlink d3/d24/d67/d47/l146 0 2024-09-13T23:06:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:9/997: creat d3/d24/d67/d47/f147 x:0 0 0 2024-09-13T23:06:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:9/998: chown d3/d24/l1a 265 1 2024-09-13T23:06:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:1/969: write d4/d4c/d8d/fb5 [412348,108045] 0 2024-09-13T23:06:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:9/999: dread - d3/d1e/d30/d5d/da3/f118 zero size 2024-09-13T23:06:31.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/755: creat d18/d8f/dc5/dd0/dd9/fff x:0 0 0 2024-09-13T23:06:31.684 INFO:tasks.workunit.client.1.smithi152.stdout:0/756: chown d18/d19/d2c/f30 58411449 1 2024-09-13T23:06:31.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/931: dwrite d3/d4/d6/d8/d4b/ddd/f10e [0,4194304] 0 2024-09-13T23:06:31.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/932: write d3/d4/d6/fb0 [985878,115914] 0 2024-09-13T23:06:31.692 INFO:tasks.workunit.client.1.smithi152.stdout:6/794: getdents d4/de/d12/d16/d2a/d3d 0 2024-09-13T23:06:31.693 INFO:tasks.workunit.client.1.smithi152.stdout:3/809: symlink de/d14/d47/d70/d105/l116 0 2024-09-13T23:06:31.696 INFO:tasks.workunit.client.1.smithi152.stdout:1/970: truncate d4/f1c 4330760 0 2024-09-13T23:06:31.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/659: rmdir d17/d25/d32/d4b/d84/db2 39 2024-09-13T23:06:31.700 INFO:tasks.workunit.client.1.smithi152.stdout:0/757: getdents d18/d1f/d33/d65 0 2024-09-13T23:06:31.700 INFO:tasks.workunit.client.1.smithi152.stdout:0/758: fsync d18/d19/d2c/f6d 0 2024-09-13T23:06:31.703 INFO:tasks.workunit.client.1.smithi152.stdout:4/933: mknod d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/c12a 0 2024-09-13T23:06:31.704 INFO:tasks.workunit.client.1.smithi152.stdout:4/934: readlink d3/d4/d6/d8/d17/d39/led 0 2024-09-13T23:06:31.704 INFO:tasks.workunit.client.1.smithi152.stdout:6/795: mkdir d4/de/d1d/deb/d101 0 2024-09-13T23:06:31.706 INFO:tasks.workunit.client.1.smithi152.stdout:1/971: unlink d4/d4c/d8d/d99/c112 0 2024-09-13T23:06:31.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/759: getdents d18/d1f/d33/d6e 0 2024-09-13T23:06:31.709 INFO:tasks.workunit.client.1.smithi152.stdout:4/935: creat d3/d4/d6/d66/d2b/f12b x:0 0 0 2024-09-13T23:06:31.709 INFO:tasks.workunit.client.1.smithi152.stdout:4/936: stat d3/d4/d6/d63/d79/f129 0 2024-09-13T23:06:31.709 INFO:tasks.workunit.client.1.smithi152.stdout:4/937: chown d3/d4/d6/d8/d17/d5d/d94/d9b/de9/l101 4 1 2024-09-13T23:06:31.709 INFO:tasks.workunit.client.1.smithi152.stdout:4/938: dread - d3/fbd zero size 2024-09-13T23:06:31.709 INFO:tasks.workunit.client.1.smithi152.stdout:1/972: write d4/d47/f77 [814688,38] 0 2024-09-13T23:06:31.710 INFO:tasks.workunit.client.1.smithi152.stdout:1/973: write d4/d4c/fd3 [4734321,74791] 0 2024-09-13T23:06:31.710 INFO:tasks.workunit.client.1.smithi152.stdout:1/974: chown d4/d9/d71/ldf 770468 1 2024-09-13T23:06:31.710 INFO:tasks.workunit.client.1.smithi152.stdout:1/975: fdatasync d4/d47/f88 0 2024-09-13T23:06:31.711 INFO:tasks.workunit.client.1.smithi152.stdout:1/976: write d4/d4c/f5e [676092,68739] 0 2024-09-13T23:06:31.711 INFO:tasks.workunit.client.1.smithi152.stdout:8/660: write fd [3920482,10218] 0 2024-09-13T23:06:31.714 INFO:tasks.workunit.client.1.smithi152.stdout:8/661: rename d17/c18 to d17/d25/d32/d50/dc2/cce 0 2024-09-13T23:06:31.714 INFO:tasks.workunit.client.1.smithi152.stdout:8/662: fdatasync d17/d25/d80/f93 0 2024-09-13T23:06:31.714 INFO:tasks.workunit.client.1.smithi152.stdout:8/663: chown d17/d25/f85 1857 1 2024-09-13T23:06:31.715 INFO:tasks.workunit.client.1.smithi152.stdout:1/977: dread d4/d9/d1a/d22/d24/daa/fc6 [0,4194304] 0 2024-09-13T23:06:31.715 INFO:tasks.workunit.client.1.smithi152.stdout:1/978: dread - d4/d9/d71/f12c zero size 2024-09-13T23:06:31.719 INFO:tasks.workunit.client.1.smithi152.stdout:1/979: getdents d4/d47 0 2024-09-13T23:06:31.724 INFO:tasks.workunit.client.1.smithi152.stdout:3/810: dwrite de/d14/d47/d70/d87/fe0 [0,4194304] 0 2024-09-13T23:06:31.724 INFO:tasks.workunit.client.1.smithi152.stdout:3/811: chown de/d1f/da2/da8/ffc 15521 1 2024-09-13T23:06:31.724 INFO:tasks.workunit.client.1.smithi152.stdout:3/812: creat de/d1f/da2/dcb/f117 x:0 0 0 2024-09-13T23:06:31.737 INFO:tasks.workunit.client.1.smithi152.stdout:3/813: dread de/d14/f62 [0,4194304] 0 2024-09-13T23:06:31.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/814: dread de/d1f/fb8 [0,4194304] 0 2024-09-13T23:06:31.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/815: write de/d1f/da2/dcb/f117 [55055,6884] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/939: dwrite d3/d4/d6/d63/d111/dba/f10b [0,4194304] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/940: stat d3/d4/d6/d8/d17/cea 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/941: dread - d3/d4/d32/d86/d95/f113 zero size 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:4/942: write d3/d4/d6/d8/ff5 [550161,27719] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:0/760: dwrite d18/d1f/d33/d6e/df7/ff9 [0,4194304] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/816: mkdir de/d63/d118 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:6/796: dwrite d4/de/d12/d16/d2a/d38/d3c/f45 [4194304,4194304] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:6/797: chown d4/de/cb4 0 1 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/664: dwrite d17/d19/f88 [0,4194304] 0 2024-09-13T23:06:31.743 INFO:tasks.workunit.client.1.smithi152.stdout:8/665: chown d17/d25/d80/f93 1175646 1 2024-09-13T23:06:31.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/943: creat d3/d4/d6/d8/d17/d5d/d94/f12c x:0 0 0 2024-09-13T23:06:31.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/761: creat d18/d1f/d29/d3f/d4b/d66/d6a/dc1/f100 x:0 0 0 2024-09-13T23:06:31.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/762: chown d18/d19/c75 55 1 2024-09-13T23:06:31.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/763: write d18/d1f/d33/d65/d7a/d83/f86 [740977,18469] 0 2024-09-13T23:06:31.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/764: stat c11 0 2024-09-13T23:06:31.750 INFO:tasks.workunit.client.1.smithi152.stdout:0/765: read - d18/d8f/dc5/dd0/dd9/fff zero size 2024-09-13T23:06:31.752 INFO:tasks.workunit.client.1.smithi152.stdout:6/798: rename d4/de/d12/f98 to d4/de/d12/d16/d2a/d3d/daa/daf/dcc/f102 0 2024-09-13T23:06:31.753 INFO:tasks.workunit.client.1.smithi152.stdout:8/666: rmdir d17/d25/d32/d4b/d84/db2 39 2024-09-13T23:06:31.753 INFO:tasks.workunit.client.1.smithi152.stdout:8/667: readlink d17/d25/d32/l94 0 2024-09-13T23:06:31.761 INFO:tasks.workunit.client.1.smithi152.stdout:8/668: mkdir d17/d25/d32/d50/dcf 0 2024-09-13T23:06:31.765 INFO:tasks.workunit.client.1.smithi152.stdout:0/766: rename d18/d19 to d18/d1f/d29/d2f/dd3/d101 0 2024-09-13T23:06:31.767 INFO:tasks.workunit.client.1.smithi152.stdout:6/799: rename d4/de/d12/d3e/la5 to d4/de/d1d/deb/l103 0 2024-09-13T23:06:31.771 INFO:tasks.workunit.client.1.smithi152.stdout:3/817: dwrite de/ff [0,4194304] 0 2024-09-13T23:06:31.773 INFO:tasks.workunit.client.1.smithi152.stdout:4/944: dwrite d3/d4/d6/d8/ff5 [0,4194304] 0 2024-09-13T23:06:31.773 INFO:tasks.workunit.client.1.smithi152.stdout:3/818: creat de/d14/d47/d57/d99/f119 x:0 0 0 2024-09-13T23:06:31.779 INFO:tasks.workunit.client.1.smithi152.stdout:3/819: dread de/d14/d38/f1a [0,4194304] 0 2024-09-13T23:06:31.782 INFO:tasks.workunit.client.1.smithi152.stdout:3/820: truncate de/d1f/f52 168253 0 2024-09-13T23:06:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/821: chown de/d14/d47/d57/d5d/d115 1 1 2024-09-13T23:06:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/822: write de/d14/d47/d57/feb [333109,101473] 0 2024-09-13T23:06:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/823: stat de/d14/d47/d57/d5d/c58 0 2024-09-13T23:06:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/824: truncate de/d1f/da2/dcb/dbc/f104 629599 0 2024-09-13T23:06:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/825: rename de/l2a to de/d1f/da2/l11a 0 2024-09-13T23:06:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/826: chown de/d14/d47/d57/d5d/f56 74 1 2024-09-13T23:06:31.796 INFO:tasks.workunit.client.1.smithi152.stdout:0/767: dwrite d18/d1f/d29/d2f/d3d/f5e [0,4194304] 0 2024-09-13T23:06:31.796 INFO:tasks.workunit.client.1.smithi152.stdout:6/800: dwrite d4/de/d12/d16/d2a/d3d/d57/f60 [0,4194304] 0 2024-09-13T23:06:31.797 INFO:tasks.workunit.client.1.smithi152.stdout:6/801: fdatasync d4/de/d12/d16/d2a/d3d/daa/daf/fd1 0 2024-09-13T23:06:31.798 INFO:tasks.workunit.client.1.smithi152.stdout:0/768: mkdir d18/d1f/d29/d4e/dec/d102 0 2024-09-13T23:06:31.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/827: dwrite de/d14/d47/d57/d5d/f56 [0,4194304] 0 2024-09-13T23:06:31.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/828: fsync de/d14/d38/f25 0 2024-09-13T23:06:31.802 INFO:tasks.workunit.client.1.smithi152.stdout:6/802: mkdir d4/de/d12/d16/d2a/d3d/dcf/ddf/d104 0 2024-09-13T23:06:31.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/769: symlink d18/d1f/d29/d2f/d3d/l103 0 2024-09-13T23:06:31.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/770: chown d18/d8f/dc5/le6 2 1 2024-09-13T23:06:31.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/771: truncate d18/d1f/d29/d4e/f64 595759 0 2024-09-13T23:06:31.814 INFO:tasks.workunit.client.1.smithi152.stdout:3/829: dread de/d14/d47/d57/d99/fac [0,4194304] 0 2024-09-13T23:06:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:6/803: dwrite d4/de/d12/d16/d2a/f71 [4194304,4194304] 0 2024-09-13T23:06:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:0/772: creat d18/d1f/d29/d4e/dec/d102/f104 x:0 0 0 2024-09-13T23:06:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:2/856: sync 2024-09-13T23:06:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:7/913: sync 2024-09-13T23:06:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/837: sync 2024-09-13T23:06:31.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/914: fdatasync d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/f137 0 2024-09-13T23:06:31.823 INFO:tasks.workunit.client.1.smithi152.stdout:6/804: rename d4/de/d12/d16/d2a/d3d/d57/dc7/l100 to d4/de/d12/d8a/l105 0 2024-09-13T23:06:31.826 INFO:tasks.workunit.client.1.smithi152.stdout:0/773: unlink d18/d1f/d29/d3f/d40/daa/cee 0 2024-09-13T23:06:31.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/857: mknod d0/d4/d9/d16/d30/d128/c12b 0 2024-09-13T23:06:31.828 INFO:tasks.workunit.client.1.smithi152.stdout:5/838: mkdir d5/dc/d19/d65/d99/da6/dad/dd8/d115 0 2024-09-13T23:06:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:7/915: rename d17/d4f/fbf to d17/d24/d9f/d51/d5b/d87/dc7/f139 0 2024-09-13T23:06:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:7/916: chown d17/d24/d9f/d51/d5b/d90/d2e/d71/fbc 1 1 2024-09-13T23:06:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:7/917: chown d17/d24/d9f/d51/d5b/d63/f11f 362 1 2024-09-13T23:06:31.831 INFO:tasks.workunit.client.1.smithi152.stdout:7/918: readlink d17/d4f/la0 0 2024-09-13T23:06:31.831 INFO:tasks.workunit.client.1.smithi152.stdout:6/805: mknod d4/de/d1d/deb/d101/c106 0 2024-09-13T23:06:31.831 INFO:tasks.workunit.client.1.smithi152.stdout:6/806: dread - d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fb7 zero size 2024-09-13T23:06:31.833 INFO:tasks.workunit.client.1.smithi152.stdout:5/839: rename d5/dc/d19/c23 to d5/dc/d19/d65/d99/da6/dad/dd8/d115/c116 0 2024-09-13T23:06:31.835 INFO:tasks.workunit.client.1.smithi152.stdout:6/807: symlink d4/de/d12/d16/d2a/d3d/daa/l107 0 2024-09-13T23:06:31.837 INFO:tasks.workunit.client.1.smithi152.stdout:3/830: dwrite de/d14/d47/d57/d5d/fad [0,4194304] 0 2024-09-13T23:06:31.837 INFO:tasks.workunit.client.1.smithi152.stdout:3/831: chown de/d14/d47/d57/d5d/fb3 2388 1 2024-09-13T23:06:31.837 INFO:tasks.workunit.client.1.smithi152.stdout:5/840: rename d5/dc/d19/l1f to d5/dc/d19/d65/l117 0 2024-09-13T23:06:31.838 INFO:tasks.workunit.client.1.smithi152.stdout:5/841: read d5/da/f58 [165669,46457] 0 2024-09-13T23:06:31.838 INFO:tasks.workunit.client.1.smithi152.stdout:7/919: getdents d17/d24/d9f/dac/dba/d85 0 2024-09-13T23:06:31.840 INFO:tasks.workunit.client.1.smithi152.stdout:6/808: symlink d4/l108 0 2024-09-13T23:06:31.841 INFO:tasks.workunit.client.1.smithi152.stdout:7/920: mknod d17/d24/d9f/d51/d5b/d90/d2e/d30/c13a 0 2024-09-13T23:06:31.842 INFO:tasks.workunit.client.1.smithi152.stdout:7/921: readlink d17/d24/d9f/l3d 0 2024-09-13T23:06:31.842 INFO:tasks.workunit.client.1.smithi152.stdout:7/922: chown d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d67/f137 4577 1 2024-09-13T23:06:31.842 INFO:tasks.workunit.client.1.smithi152.stdout:7/923: dread - d17/d24/d9f/d51/d5b/d63/f101 zero size 2024-09-13T23:06:31.842 INFO:tasks.workunit.client.1.smithi152.stdout:6/809: rename d4/de/d12/fe3 to d4/de/d12/f109 0 2024-09-13T23:06:31.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/832: getdents de/d1f/da2/da8 0 2024-09-13T23:06:31.843 INFO:tasks.workunit.client.1.smithi152.stdout:5/842: mknod d5/dc/c118 0 2024-09-13T23:06:31.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/843: truncate d5/dc/d19/d65/d99/da6/f8b 4642380 0 2024-09-13T23:06:31.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/844: readlink d5/dc/d19/d65/d99/d98/da0/dc1/le4 0 2024-09-13T23:06:31.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/845: getdents d5/dc/d19/d65/d99/d98/da0/d10f 0 2024-09-13T23:06:31.846 INFO:tasks.workunit.client.1.smithi152.stdout:7/924: unlink d17/d24/d109/dda/f119 0 2024-09-13T23:06:31.846 INFO:tasks.workunit.client.1.smithi152.stdout:7/925: stat d17/d6c/fe8 0 2024-09-13T23:06:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:5/846: creat d5/dc/d19/d20/d2e/d28/dfb/f119 x:0 0 0 2024-09-13T23:06:31.850 INFO:tasks.workunit.client.1.smithi152.stdout:7/926: mknod d17/d24/d9f/d51/d5b/d90/d2e/d9d/c13b 0 2024-09-13T23:06:31.850 INFO:tasks.workunit.client.1.smithi152.stdout:7/927: chown d17/d24/d9f/d51/d5b/d90/d2e/d79/f114 49322 1 2024-09-13T23:06:31.856 INFO:tasks.workunit.client.1.smithi152.stdout:0/774: dwrite d18/d1f/d29/d2f/dd3/d101/d2c/f54 [0,4194304] 0 2024-09-13T23:06:31.857 INFO:tasks.workunit.client.1.smithi152.stdout:2/858: dwrite d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:31.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/833: dwrite de/d14/d47/d70/d72/fb1 [4194304,4194304] 0 2024-09-13T23:06:31.865 INFO:tasks.workunit.client.1.smithi152.stdout:6/810: dread d4/de/d12/f5f [0,4194304] 0 2024-09-13T23:06:31.866 INFO:tasks.workunit.client.1.smithi152.stdout:3/834: truncate de/d14/d47/d57/d5d/fb3 599079 0 2024-09-13T23:06:31.868 INFO:tasks.workunit.client.1.smithi152.stdout:2/859: mkdir d0/d4/d9/d55/d12c 0 2024-09-13T23:06:31.873 INFO:tasks.workunit.client.1.smithi152.stdout:3/835: rename de/d14/d47/d57/dc9/dee/cfb to de/d14/d47/d70/d72/da7/c11b 0 2024-09-13T23:06:31.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/928: dwrite d17/d24/d9f/dac/dba/d85/f124 [0,4194304] 0 2024-09-13T23:06:31.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/929: truncate d17/d24/d9f/d51/d5b/d90/f112 1155220 0 2024-09-13T23:06:31.874 INFO:tasks.workunit.client.1.smithi152.stdout:7/930: write d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/f131 [775140,26230] 0 2024-09-13T23:06:31.875 INFO:tasks.workunit.client.1.smithi152.stdout:7/931: dread - d17/d24/d9f/d46/f12f zero size 2024-09-13T23:06:31.875 INFO:tasks.workunit.client.1.smithi152.stdout:7/932: getdents d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d10b 0 2024-09-13T23:06:31.875 INFO:tasks.workunit.client.1.smithi152.stdout:6/811: unlink d4/de/d12/d16/d2a/d3d/d57/d8d/c8e 0 2024-09-13T23:06:31.876 INFO:tasks.workunit.client.1.smithi152.stdout:3/836: rename de/d14/d47/d70/lc7 to de/d63/df1/l11c 0 2024-09-13T23:06:31.880 INFO:tasks.workunit.client.1.smithi152.stdout:7/933: creat d17/d24/d9f/d46/d129/d12d/f13c x:0 0 0 2024-09-13T23:06:31.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/860: dread d0/ff4 [0,4194304] 0 2024-09-13T23:06:31.882 INFO:tasks.workunit.client.1.smithi152.stdout:3/837: truncate de/f13 3421855 0 2024-09-13T23:06:31.882 INFO:tasks.workunit.client.1.smithi152.stdout:2/861: creat d0/d4/d9/d16/d9f/f12d x:0 0 0 2024-09-13T23:06:31.883 INFO:tasks.workunit.client.1.smithi152.stdout:0/775: dwrite d18/d1f/d39/d7c/fad [0,4194304] 0 2024-09-13T23:06:31.884 INFO:tasks.workunit.client.1.smithi152.stdout:2/862: link d0/d4/d9/d18/d32/f5a d0/d4/d9/d55/d12c/f12e 0 2024-09-13T23:06:31.885 INFO:tasks.workunit.client.1.smithi152.stdout:0/776: mkdir d18/d1f/d29/d4e/d105 0 2024-09-13T23:06:31.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/863: mkdir d0/d4/d9/d55/d12c/d12f 0 2024-09-13T23:06:31.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/864: mknod d0/d4/d9/d14/d48/d4a/c130 0 2024-09-13T23:06:31.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/865: creat d0/d4/d9/d18/d1e/d8c/f131 x:0 0 0 2024-09-13T23:06:31.891 INFO:tasks.workunit.client.1.smithi152.stdout:2/866: creat d0/d4/d9/d18/d1e/d3c/d88/f132 x:0 0 0 2024-09-13T23:06:31.891 INFO:tasks.workunit.client.1.smithi152.stdout:6/812: dwrite d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fb7 [0,4194304] 0 2024-09-13T23:06:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:2/867: rename d0/ff4 to d0/d4/d9/d18/d1e/f133 0 2024-09-13T23:06:31.896 INFO:tasks.workunit.client.1.smithi152.stdout:5/847: dwrite d5/d26/d61/d68/f7b [0,4194304] 0 2024-09-13T23:06:31.897 INFO:tasks.workunit.client.1.smithi152.stdout:2/868: symlink d0/d4/d9/d18/d1e/d3c/d88/db9/l134 0 2024-09-13T23:06:31.902 INFO:tasks.workunit.client.1.smithi152.stdout:3/838: rmdir de/d63 39 2024-09-13T23:06:31.907 INFO:tasks.workunit.client.1.smithi152.stdout:6/813: dread d4/de/d12/f6f [0,4194304] 0 2024-09-13T23:06:31.910 INFO:tasks.workunit.client.1.smithi152.stdout:5/848: write d5/da/f1b [3508873,54581] 0 2024-09-13T23:06:31.910 INFO:tasks.workunit.client.1.smithi152.stdout:5/849: chown d5/da/dfa 2738546 1 2024-09-13T23:06:31.911 INFO:tasks.workunit.client.1.smithi152.stdout:5/850: readlink d5/dc/d19/d20/dab/l10b 0 2024-09-13T23:06:31.913 INFO:tasks.workunit.client.1.smithi152.stdout:2/869: truncate d0/d4/d9/d16/f21 1727004 0 2024-09-13T23:06:31.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/839: mkdir de/d14/d47/d70/d72/d11d 0 2024-09-13T23:06:31.919 INFO:tasks.workunit.client.1.smithi152.stdout:6/814: creat d4/de/d12/d16/d2a/d3d/f10a x:0 0 0 2024-09-13T23:06:31.919 INFO:tasks.workunit.client.1.smithi152.stdout:6/815: fsync d4/de/d12/f1a 0 2024-09-13T23:06:31.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/934: dwrite d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/f7b [4194304,4194304] 0 2024-09-13T23:06:31.923 INFO:tasks.workunit.client.1.smithi152.stdout:6/816: link l2 d4/de/d12/d16/d2a/d3d/d57/de0/l10b 0 2024-09-13T23:06:31.923 INFO:tasks.workunit.client.1.smithi152.stdout:6/817: chown d4/de/d12/d16/d2a/d3d/d57/f85 1 1 2024-09-13T23:06:31.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/870: dread d0/d4/d9/d18/d1e/d3c/d88/fe8 [0,4194304] 0 2024-09-13T23:06:31.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/777: dwrite d18/d1f/f20 [0,4194304] 0 2024-09-13T23:06:31.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/778: fdatasync d18/d8f/dc5/dd0/dd9/fff 0 2024-09-13T23:06:31.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/779: read d18/f1a [3861390,22041] 0 2024-09-13T23:06:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:3/840: write de/d14/f55 [1861206,31868] 0 2024-09-13T23:06:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:3/841: dread - de/d14/d47/d57/d99/f10c zero size 2024-09-13T23:06:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:6/818: creat d4/de/d12/d16/f10c x:0 0 0 2024-09-13T23:06:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:6/819: creat d4/de/d12/d16/d2a/d3d/f10d x:0 0 0 2024-09-13T23:06:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/780: mkdir d18/d1f/d39/d106 0 2024-09-13T23:06:31.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/980: sync 2024-09-13T23:06:31.931 INFO:tasks.workunit.client.1.smithi152.stdout:1/981: write d4/d9/d1a/d22/f29 [2505782,108583] 0 2024-09-13T23:06:31.931 INFO:tasks.workunit.client.1.smithi152.stdout:8/669: sync 2024-09-13T23:06:31.932 INFO:tasks.workunit.client.1.smithi152.stdout:1/982: truncate d4/d9/d1a/f58 750292 0 2024-09-13T23:06:31.932 INFO:tasks.workunit.client.1.smithi152.stdout:1/983: chown d4/d9/c115 972291 1 2024-09-13T23:06:31.934 INFO:tasks.workunit.client.1.smithi152.stdout:1/984: symlink d4/d9/l149 0 2024-09-13T23:06:31.935 INFO:tasks.workunit.client.1.smithi152.stdout:1/985: chown d4/d9/d1a/d22/d24/dde/df4/ff7 457192 1 2024-09-13T23:06:31.935 INFO:tasks.workunit.client.1.smithi152.stdout:1/986: creat d4/d9/d1a/d22/d24/d48/f14a x:0 0 0 2024-09-13T23:06:31.935 INFO:tasks.workunit.client.1.smithi152.stdout:1/987: dread - d4/d4c/d8d/d11c/f11e zero size 2024-09-13T23:06:31.936 INFO:tasks.workunit.client.1.smithi152.stdout:1/988: fdatasync d4/d47/f135 0 2024-09-13T23:06:31.937 INFO:tasks.workunit.client.1.smithi152.stdout:5/851: dwrite d5/f8 [0,4194304] 0 2024-09-13T23:06:31.940 INFO:tasks.workunit.client.1.smithi152.stdout:1/989: mknod d4/d9/d10b/c14b 0 2024-09-13T23:06:31.940 INFO:tasks.workunit.client.1.smithi152.stdout:4/945: sync 2024-09-13T23:06:31.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/781: write d18/d1f/d29/d3f/da0/fae [174546,26887] 0 2024-09-13T23:06:31.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/782: fsync d18/d1f/d29/d3f/d4b/d66/d6a/f82 0 2024-09-13T23:06:31.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/783: chown d18/d1f/d29/fd1 0 1 2024-09-13T23:06:31.941 INFO:tasks.workunit.client.1.smithi152.stdout:5/852: truncate d5/dc/d19/f7e 511608 0 2024-09-13T23:06:31.942 INFO:tasks.workunit.client.1.smithi152.stdout:0/784: mknod d18/d1f/d33/d65/d7a/d83/c107 0 2024-09-13T23:06:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/853: creat d5/dc/d19/d65/f11a x:0 0 0 2024-09-13T23:06:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/854: creat d5/dc/d19/d20/d2e/d28/dfb/f11b x:0 0 0 2024-09-13T23:06:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/855: truncate d5/dc/d19/d65/d99/d98/dc2/d80/f9e 1608126 0 2024-09-13T23:06:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/856: fsync d5/dc/da3/db4/d7f/f103 0 2024-09-13T23:06:31.945 INFO:tasks.workunit.client.1.smithi152.stdout:4/946: dread d3/d4/d6/fb0 [0,4194304] 0 2024-09-13T23:06:31.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/785: mkdir d18/d8f/dc5/d108 0 2024-09-13T23:06:31.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/786: stat d18/d1f/d29/d3f/d40/daa/dbd/fc0 0 2024-09-13T23:06:31.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/787: creat d18/d1f/d29/d4e/dec/f109 x:0 0 0 2024-09-13T23:06:31.946 INFO:tasks.workunit.client.1.smithi152.stdout:5/857: mkdir d5/dc/da3/db4/db3/d11c 0 2024-09-13T23:06:31.948 INFO:tasks.workunit.client.1.smithi152.stdout:4/947: creat d3/d4/d32/f12d x:0 0 0 2024-09-13T23:06:31.951 INFO:tasks.workunit.client.1.smithi152.stdout:0/788: mkdir d18/d1f/d39/d106/d10a 0 2024-09-13T23:06:31.952 INFO:tasks.workunit.client.1.smithi152.stdout:5/858: mknod d5/dc/d19/d20/dab/c11d 0 2024-09-13T23:06:31.956 INFO:tasks.workunit.client.1.smithi152.stdout:0/789: creat d18/d1f/d29/d3f/d40/f10b x:0 0 0 2024-09-13T23:06:31.956 INFO:tasks.workunit.client.1.smithi152.stdout:0/790: truncate d18/f9b 320918 0 2024-09-13T23:06:31.956 INFO:tasks.workunit.client.1.smithi152.stdout:0/791: truncate d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fd6 604752 0 2024-09-13T23:06:31.956 INFO:tasks.workunit.client.1.smithi152.stdout:1/990: dread d4/d4c/fd3 [0,4194304] 0 2024-09-13T23:06:31.957 INFO:tasks.workunit.client.1.smithi152.stdout:5/859: link d5/da/cb d5/dc/d19/d20/d2e/d28/c11e 0 2024-09-13T23:06:31.957 INFO:tasks.workunit.client.1.smithi152.stdout:0/792: mkdir d18/d1f/d29/d4e/d105/d10c 0 2024-09-13T23:06:31.957 INFO:tasks.workunit.client.1.smithi152.stdout:5/860: mkdir d5/dc/d19/d65/d99/d98/de2/d11f 0 2024-09-13T23:06:31.958 INFO:tasks.workunit.client.1.smithi152.stdout:0/793: mknod d18/d8f/dc5/dd0/dd9/de3/c10d 0 2024-09-13T23:06:31.959 INFO:tasks.workunit.client.1.smithi152.stdout:5/861: mknod d5/dc/d19/d65/d99/da6/dad/dd8/d115/c120 0 2024-09-13T23:06:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:0/794: unlink d18/d1f/d29/d2f/dd3/d101/d2c/f30 0 2024-09-13T23:06:31.962 INFO:tasks.workunit.client.1.smithi152.stdout:0/795: rename d18/d1f/d29/d4e/dec/ced to d18/d1f/d29/d3f/d40/daa/dbd/c10e 0 2024-09-13T23:06:31.962 INFO:tasks.workunit.client.1.smithi152.stdout:0/796: chown d18/d1f/d33/d65/l87 3839210 1 2024-09-13T23:06:31.962 INFO:tasks.workunit.client.1.smithi152.stdout:2/871: dwrite d0/d4/d9/d18/d32/fcb [4194304,4194304] 0 2024-09-13T23:06:31.964 INFO:tasks.workunit.client.1.smithi152.stdout:0/797: symlink d18/d1f/d39/l10f 0 2024-09-13T23:06:31.964 INFO:tasks.workunit.client.1.smithi152.stdout:0/798: fdatasync d18/d8f/dc5/dd0/dd9/fff 0 2024-09-13T23:06:31.965 INFO:tasks.workunit.client.1.smithi152.stdout:2/872: mknod d0/d4/d9/d18/d1e/dc0/c135 0 2024-09-13T23:06:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/799: symlink d18/d1f/d29/d4e/l110 0 2024-09-13T23:06:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:0/800: truncate d18/d1f/d29/d4e/dec/ff2 555151 0 2024-09-13T23:06:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:7/935: dwrite d17/d24/d9f/d3f/def/ff9 [0,4194304] 0 2024-09-13T23:06:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:7/936: creat d17/d24/d9f/d51/d5b/d90/d2b/f13d x:0 0 0 2024-09-13T23:06:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:7/937: stat d17/d24/d9f 0 2024-09-13T23:06:31.968 INFO:tasks.workunit.client.1.smithi152.stdout:0/801: mkdir d18/d1f/d33/d6e/df7/d111 0 2024-09-13T23:06:31.974 INFO:tasks.workunit.client.1.smithi152.stdout:7/938: symlink d17/d24/d9f/d51/d5b/d87/l13e 0 2024-09-13T23:06:31.989 INFO:tasks.workunit.client.1.smithi152.stdout:8/670: dwrite d17/d25/d32/d4b/d95/fad [0,4194304] 0 2024-09-13T23:06:31.989 INFO:tasks.workunit.client.1.smithi152.stdout:3/842: dwrite de/f90 [0,4194304] 0 2024-09-13T23:06:31.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/671: link d17/d25/d32/d4b/d84/la5 d17/d25/d80/ld0 0 2024-09-13T23:06:31.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/672: mknod d17/d25/d32/d50/cd1 0 2024-09-13T23:06:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:6/820: dwrite d4/de/d12/d16/d2a/d38/fae [0,4194304] 0 2024-09-13T23:06:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:6/821: stat d4/de/d12/d16/d2a/d3d/daa 0 2024-09-13T23:06:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:6/822: creat d4/de/d12/d16/f10e x:0 0 0 2024-09-13T23:06:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:4/948: dwrite d3/d4/d6/d66/f6f [0,4194304] 0 2024-09-13T23:06:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:8/673: link d17/l1f d17/d25/d32/d4b/ld2 0 2024-09-13T23:06:31.997 INFO:tasks.workunit.client.1.smithi152.stdout:8/674: fsync d17/d25/d32/d50/dc2/fa2 0 2024-09-13T23:06:31.997 INFO:tasks.workunit.client.1.smithi152.stdout:6/823: getdents d4/de/d12/d16/d2a/d3d/d57 0 2024-09-13T23:06:31.998 INFO:tasks.workunit.client.1.smithi152.stdout:4/949: mkdir d3/d4/d6/d66/d1c/d59/d12e 0 2024-09-13T23:06:32.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/675: symlink d17/d25/d32/d50/dc2/dc3/ld3 0 2024-09-13T23:06:32.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/676: write d17/d25/d32/d50/dc2/f9f [199133,9752] 0 2024-09-13T23:06:32.000 INFO:tasks.workunit.client.1.smithi152.stdout:6/824: truncate d4/de/d21/f7c 2678841 0 2024-09-13T23:06:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/825: read - d4/de/d1d/dce/ffa zero size 2024-09-13T23:06:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/950: mknod d3/d4/d6/d66/d62/c12f 0 2024-09-13T23:06:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:5/862: dwrite d5/d26/d61/de0/ff9 [0,4194304] 0 2024-09-13T23:06:32.002 INFO:tasks.workunit.client.1.smithi152.stdout:1/991: dwrite d4/d4c/de8/f12b [0,4194304] 0 2024-09-13T23:06:32.002 INFO:tasks.workunit.client.1.smithi152.stdout:2/873: dwrite d0/d4/d9/d55/f5f [0,4194304] 0 2024-09-13T23:06:32.003 INFO:tasks.workunit.client.1.smithi152.stdout:6/826: creat d4/de/d12/d16/d2a/d3d/dcf/ddf/f10f x:0 0 0 2024-09-13T23:06:32.003 INFO:tasks.workunit.client.1.smithi152.stdout:6/827: write d4/de/d12/fd9 [2201329,26565] 0 2024-09-13T23:06:32.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/939: dwrite d17/d24/d9f/d51/d5b/d90/d2e/d30/fde [0,4194304] 0 2024-09-13T23:06:32.004 INFO:tasks.workunit.client.1.smithi152.stdout:4/951: dread d3/d4/d6/d63/f99 [0,4194304] 0 2024-09-13T23:06:32.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/863: getdents d5/dc/d5e 0 2024-09-13T23:06:32.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/677: write d17/d25/d32/d44/f6c [516059,126544] 0 2024-09-13T23:06:32.013 INFO:tasks.workunit.client.1.smithi152.stdout:1/992: symlink d4/d47/d8b/l14c 0 2024-09-13T23:06:32.013 INFO:tasks.workunit.client.1.smithi152.stdout:1/993: fdatasync d4/d9/d1a/f2e 0 2024-09-13T23:06:32.024 INFO:tasks.workunit.client.1.smithi152.stdout:6/828: symlink d4/de/d12/d16/d2a/d3d/d57/dc7/l110 0 2024-09-13T23:06:32.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/940: mkdir d17/d24/d9f/d51/d5b/d90/dfe/d13f 0 2024-09-13T23:06:32.027 INFO:tasks.workunit.client.1.smithi152.stdout:4/952: dwrite d3/d4/d6/d66/d2b/f12b [0,4194304] 0 2024-09-13T23:06:32.029 INFO:tasks.workunit.client.1.smithi152.stdout:2/874: dwrite d0/d4/d9/d14/f2f [4194304,4194304] 0 2024-09-13T23:06:32.031 INFO:tasks.workunit.client.1.smithi152.stdout:1/994: rename d4/d9/d10b to d4/d9/d1a/d22/d24/d105/d14d 0 2024-09-13T23:06:32.033 INFO:tasks.workunit.client.1.smithi152.stdout:7/941: mknod d17/d24/d109/dda/c140 0 2024-09-13T23:06:32.033 INFO:tasks.workunit.client.1.smithi152.stdout:7/942: write d17/d24/d9f/dac/f136 [453410,129369] 0 2024-09-13T23:06:32.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/864: rmdir d5/dc/d19/d65 39 2024-09-13T23:06:32.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/865: dread - d5/dc/f54 zero size 2024-09-13T23:06:32.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/866: write d5/f3f [3610914,59456] 0 2024-09-13T23:06:32.040 INFO:tasks.workunit.client.1.smithi152.stdout:6/829: read d4/de/d12/d16/d2a/d3d/d57/f60 [7236870,103743] 0 2024-09-13T23:06:32.040 INFO:tasks.workunit.client.1.smithi152.stdout:6/830: truncate d4/de/d12/d3e/fa0 4200898 0 2024-09-13T23:06:32.043 INFO:tasks.workunit.client.1.smithi152.stdout:2/875: rmdir d0/d8 39 2024-09-13T23:06:32.043 INFO:tasks.workunit.client.1.smithi152.stdout:5/867: dread d5/dc/d19/d20/dab/fbd [0,4194304] 0 2024-09-13T23:06:32.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/678: mknod d17/d25/d32/d4b/cd4 0 2024-09-13T23:06:32.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/679: creat d17/fd5 x:0 0 0 2024-09-13T23:06:32.047 INFO:tasks.workunit.client.1.smithi152.stdout:3/843: write de/d14/d38/f1a [1569130,92928] 0 2024-09-13T23:06:32.047 INFO:tasks.workunit.client.1.smithi152.stdout:1/995: mkdir d4/dc8/d14e 0 2024-09-13T23:06:32.048 INFO:tasks.workunit.client.1.smithi152.stdout:1/996: creat d4/d9/d1a/d22/d24/daa/d122/f14f x:0 0 0 2024-09-13T23:06:32.048 INFO:tasks.workunit.client.1.smithi152.stdout:1/997: dread - d4/d47/f135 zero size 2024-09-13T23:06:32.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/953: dwrite d3/d4/d6/fb0 [0,4194304] 0 2024-09-13T23:06:32.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/954: readlink d3/d4/lf7 0 2024-09-13T23:06:32.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/955: truncate d3/d4/d6/f4c 4499772 0 2024-09-13T23:06:32.051 INFO:tasks.workunit.client.1.smithi152.stdout:7/943: mknod d17/d24/d9f/d51/d5b/d87/dc7/c141 0 2024-09-13T23:06:32.051 INFO:tasks.workunit.client.1.smithi152.stdout:7/944: readlink d17/d24/d9f/d3f/d11c/l11d 0 2024-09-13T23:06:32.052 INFO:tasks.workunit.client.1.smithi152.stdout:6/831: symlink d4/de/d1d/deb/l111 0 2024-09-13T23:06:32.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/868: rmdir d5/dc/d19/d65/d99/d98/de2/d11f 0 2024-09-13T23:06:32.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/680: dread d17/f61 [0,4194304] 0 2024-09-13T23:06:32.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/681: fdatasync d17/d25/d32/d4b/f6e 0 2024-09-13T23:06:32.057 INFO:tasks.workunit.client.1.smithi152.stdout:3/844: mkdir de/d14/d47/d70/dca/d11e 0 2024-09-13T23:06:32.057 INFO:tasks.workunit.client.1.smithi152.stdout:3/845: creat de/d14/d47/d57/dc9/f11f x:0 0 0 2024-09-13T23:06:32.057 INFO:tasks.workunit.client.1.smithi152.stdout:3/846: creat de/d14/d76/f120 x:0 0 0 2024-09-13T23:06:32.061 INFO:tasks.workunit.client.1.smithi152.stdout:1/998: truncate d4/d4c/fd3 3860838 0 2024-09-13T23:06:32.061 INFO:tasks.workunit.client.1.smithi152.stdout:5/869: dread d5/dc/da3/db4/fc6 [0,4194304] 0 2024-09-13T23:06:32.066 INFO:tasks.workunit.client.1.smithi152.stdout:8/682: write d17/d25/d32/f3e [3621507,34568] 0 2024-09-13T23:06:32.074 INFO:tasks.workunit.client.1.smithi152.stdout:4/956: creat d3/d4/d6/d66/d2b/d7c/f130 x:0 0 0 2024-09-13T23:06:32.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/876: dwrite d0/d8/f108 [0,4194304] 0 2024-09-13T23:06:32.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/877: chown d0/d4/d9/d16/d9f/c11c 498 1 2024-09-13T23:06:32.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/832: dwrite d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fc1 [0,4194304] 0 2024-09-13T23:06:32.075 INFO:tasks.workunit.client.1.smithi152.stdout:7/945: link d17/d24/d9f/dac/dba/d85/faf d17/d24/d109/dda/f142 0 2024-09-13T23:06:32.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/847: symlink de/d14/d47/d57/d93/l121 0 2024-09-13T23:06:32.080 INFO:tasks.workunit.client.1.smithi152.stdout:3/848: write de/d14/d47/d57/dc9/dee/f113 [999667,128652] 0 2024-09-13T23:06:32.082 INFO:tasks.workunit.client.1.smithi152.stdout:1/999: mkdir d4/d9/d71/d150 0 2024-09-13T23:06:32.083 INFO:tasks.workunit.client.1.smithi152.stdout:5/870: mknod d5/dc/da3/db4/db3/d11c/c121 0 2024-09-13T23:06:32.084 INFO:tasks.workunit.client.1.smithi152.stdout:5/871: dread d5/dc/f5b [0,4194304] 0 2024-09-13T23:06:32.084 INFO:tasks.workunit.client.1.smithi152.stdout:2/878: read d0/d4/d9/d14/d48/d49/f79 [850501,1178] 0 2024-09-13T23:06:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:8/683: symlink d17/d25/d32/d50/dc2/dc3/ld6 0 2024-09-13T23:06:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:8/684: fsync d17/d25/d32/d50/f57 0 2024-09-13T23:06:32.088 INFO:tasks.workunit.client.1.smithi152.stdout:4/957: mkdir d3/d4/d6/d8/d17/d3a/d131 0 2024-09-13T23:06:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:5/872: dread d5/d26/d61/d68/f93 [0,4194304] 0 2024-09-13T23:06:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:5/873: fdatasync d5/d26/fc9 0 2024-09-13T23:06:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:6/833: creat d4/de/d12/d16/d2a/d3d/d57/de0/f112 x:0 0 0 2024-09-13T23:06:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:6/834: stat d4/de/d12/d16/d2a/d3d/d57/d8d/ddc 0 2024-09-13T23:06:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:6/835: write d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/ff6 [863550,33918] 0 2024-09-13T23:06:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:7/946: mknod d17/d24/d9f/d51/d5b/d90/d2e/c143 0 2024-09-13T23:06:32.103 INFO:tasks.workunit.client.1.smithi152.stdout:3/849: link de/d14/f49 de/d14/d47/d57/d5d/d6e/f122 0 2024-09-13T23:06:32.104 INFO:tasks.workunit.client.1.smithi152.stdout:2/879: mknod d0/d4/d9/d55/de7/c136 0 2024-09-13T23:06:32.105 INFO:tasks.workunit.client.1.smithi152.stdout:4/958: mknod d3/d4/d6/d66/d2b/ddf/c132 0 2024-09-13T23:06:32.106 INFO:tasks.workunit.client.1.smithi152.stdout:5/874: truncate d5/d26/f33 247669 0 2024-09-13T23:06:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/836: mknod d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/df9/c113 0 2024-09-13T23:06:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/837: chown d4/de/d21/f6e 252500566 1 2024-09-13T23:06:32.108 INFO:tasks.workunit.client.1.smithi152.stdout:8/685: dwrite d17/d25/d32/d44/f6c [0,4194304] 0 2024-09-13T23:06:32.108 INFO:tasks.workunit.client.1.smithi152.stdout:7/947: mknod d17/d4f/d84/db6/c144 0 2024-09-13T23:06:32.108 INFO:tasks.workunit.client.1.smithi152.stdout:7/948: chown d17/d24/d9f/d51/d5b/d90 0 1 2024-09-13T23:06:32.109 INFO:tasks.workunit.client.1.smithi152.stdout:2/880: creat d0/d4/d9/d16/d30/d128/f137 x:0 0 0 2024-09-13T23:06:32.110 INFO:tasks.workunit.client.1.smithi152.stdout:2/881: fsync d0/d4/d8a/fac 0 2024-09-13T23:06:32.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/959: creat d3/d4/d6/d66/d1c/d5f/d8b/d124/f133 x:0 0 0 2024-09-13T23:06:32.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/960: getdents d3/d4/d8d/d93 0 2024-09-13T23:06:32.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/802: sync 2024-09-13T23:06:32.112 INFO:tasks.workunit.client.1.smithi152.stdout:3/850: dread de/d14/d47/d57/fe4 [0,4194304] 0 2024-09-13T23:06:32.113 INFO:tasks.workunit.client.1.smithi152.stdout:5/875: dread d5/dc/f5f [0,4194304] 0 2024-09-13T23:06:32.113 INFO:tasks.workunit.client.1.smithi152.stdout:5/876: chown d5/dc/da3/db4/fc6 310473012 1 2024-09-13T23:06:32.113 INFO:tasks.workunit.client.1.smithi152.stdout:6/838: mkdir d4/de/d12/d16/d2a/d3d/d57/d114 0 2024-09-13T23:06:32.114 INFO:tasks.workunit.client.1.smithi152.stdout:8/686: mknod d17/d25/d32/d9a/d8f/cd7 0 2024-09-13T23:06:32.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/882: rename d0/fe to d0/d8/f138 0 2024-09-13T23:06:32.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/961: unlink d3/d4/d6/d66/d2b/ddf/c132 0 2024-09-13T23:06:32.120 INFO:tasks.workunit.client.1.smithi152.stdout:0/803: mkdir d18/d1f/d29/d3f/d4b/d66/d6a/d9f/d112 0 2024-09-13T23:06:32.122 INFO:tasks.workunit.client.1.smithi152.stdout:3/851: rename de/d1f/da2/dcb/de6/ce9 to de/d63/dc1/c123 0 2024-09-13T23:06:32.122 INFO:tasks.workunit.client.1.smithi152.stdout:3/852: creat de/d14/d47/d57/d93/f124 x:0 0 0 2024-09-13T23:06:32.124 INFO:tasks.workunit.client.1.smithi152.stdout:4/962: truncate d3/d4/d6/d66/d1c/d5f/d8b/fc5 577647 0 2024-09-13T23:06:32.124 INFO:tasks.workunit.client.1.smithi152.stdout:4/963: fsync d3/d4/d6/d8/d17/d5d/f11c 0 2024-09-13T23:06:32.125 INFO:tasks.workunit.client.1.smithi152.stdout:6/839: dread d4/de/d12/f28 [0,4194304] 0 2024-09-13T23:06:32.125 INFO:tasks.workunit.client.1.smithi152.stdout:6/840: write d4/de/d21/f47 [761576,84959] 0 2024-09-13T23:06:32.127 INFO:tasks.workunit.client.1.smithi152.stdout:5/877: rename d5/dc/d19/f1a to d5/dc/da3/db4/db3/f122 0 2024-09-13T23:06:32.128 INFO:tasks.workunit.client.1.smithi152.stdout:5/878: chown d5/dc/le3 834 1 2024-09-13T23:06:32.131 INFO:tasks.workunit.client.1.smithi152.stdout:4/964: truncate d3/d4/d6/d66/d2b/d84/f48 2572166 0 2024-09-13T23:06:32.133 INFO:tasks.workunit.client.1.smithi152.stdout:7/949: dwrite d17/d24/d9f/d51/d5b/d63/fae [0,4194304] 0 2024-09-13T23:06:32.135 INFO:tasks.workunit.client.1.smithi152.stdout:6/841: mknod d4/de/d12/d3e/c115 0 2024-09-13T23:06:32.136 INFO:tasks.workunit.client.1.smithi152.stdout:6/842: chown d4/de/d12/d16/d2a/d3d/d57/dc7/l110 1462207 1 2024-09-13T23:06:32.136 INFO:tasks.workunit.client.1.smithi152.stdout:0/804: rename d18/d1f/d29/d2f/dd3/d101/lc4 to d18/d1f/d29/d3f/d4b/d66/d6a/d9f/d112/l113 0 2024-09-13T23:06:32.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/879: mkdir d5/dc/d19/d20/d55/d123 0 2024-09-13T23:06:32.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/880: truncate d5/f7 4006468 0 2024-09-13T23:06:32.138 INFO:tasks.workunit.client.1.smithi152.stdout:7/950: mkdir d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61/d145 0 2024-09-13T23:06:32.139 INFO:tasks.workunit.client.1.smithi152.stdout:5/881: dread d5/dc/d19/d20/d2e/d28/f2f [0,4194304] 0 2024-09-13T23:06:32.143 INFO:tasks.workunit.client.1.smithi152.stdout:6/843: creat d4/de/d12/d16/d2a/d3d/d57/d8d/f116 x:0 0 0 2024-09-13T23:06:32.148 INFO:tasks.workunit.client.1.smithi152.stdout:2/883: dwrite d0/d4/d9/f9c [0,4194304] 0 2024-09-13T23:06:32.149 INFO:tasks.workunit.client.1.smithi152.stdout:8/687: dwrite d17/d25/d32/d44/f6a [0,4194304] 0 2024-09-13T23:06:32.149 INFO:tasks.workunit.client.1.smithi152.stdout:8/688: creat d17/d25/d32/fd8 x:0 0 0 2024-09-13T23:06:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/844: rmdir d4/de/d12/d16/d2a/d3d/d57/d114 0 2024-09-13T23:06:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/845: fsync d4/de/d12/d16/f9c 0 2024-09-13T23:06:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/846: dread - d4/de/d12/d3e/db3/fef zero size 2024-09-13T23:06:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/847: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ff2 879949 0 2024-09-13T23:06:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:6/848: readlink d4/de/lb9 0 2024-09-13T23:06:32.155 INFO:tasks.workunit.client.1.smithi152.stdout:4/965: rename d3/d4/d6/d63 to d3/d4/d6/d66/d134 0 2024-09-13T23:06:32.164 INFO:tasks.workunit.client.1.smithi152.stdout:2/884: creat d0/d4/d9/d16/d30/dde/f139 x:0 0 0 2024-09-13T23:06:32.167 INFO:tasks.workunit.client.1.smithi152.stdout:7/951: dwrite d17/f25 [0,4194304] 0 2024-09-13T23:06:32.167 INFO:tasks.workunit.client.1.smithi152.stdout:7/952: truncate d17/d4f/f78 5079087 0 2024-09-13T23:06:32.167 INFO:tasks.workunit.client.1.smithi152.stdout:7/953: fdatasync d17/d24/d9f/d51/d5b/d63/d7d/f9a 0 2024-09-13T23:06:32.167 INFO:tasks.workunit.client.1.smithi152.stdout:8/689: mkdir d17/d25/d32/d50/dd9 0 2024-09-13T23:06:32.171 INFO:tasks.workunit.client.1.smithi152.stdout:2/885: rmdir d0/d4/d9/d16/d30/d9e/db5 39 2024-09-13T23:06:32.171 INFO:tasks.workunit.client.1.smithi152.stdout:2/886: fdatasync d0/d4/d9/f10 0 2024-09-13T23:06:32.171 INFO:tasks.workunit.client.1.smithi152.stdout:2/887: chown d0/d4/d9/d18/d32/l6d 217 1 2024-09-13T23:06:32.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/849: mknod d4/de/c117 0 2024-09-13T23:06:32.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/850: read - d4/de/d12/d16/d2a/d3d/dcf/fe6 zero size 2024-09-13T23:06:32.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/851: dread - d4/de/d12/d16/d2a/d3d/f10a zero size 2024-09-13T23:06:32.174 INFO:tasks.workunit.client.1.smithi152.stdout:0/805: rename d18/d1f/d39/c84 to d18/d1f/d33/d65/d7a/c114 0 2024-09-13T23:06:32.174 INFO:tasks.workunit.client.1.smithi152.stdout:0/806: chown d18/d1f/d29/d3f/d40/daa/faf 57872719 1 2024-09-13T23:06:32.174 INFO:tasks.workunit.client.1.smithi152.stdout:0/807: write d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fcf [612202,78851] 0 2024-09-13T23:06:32.174 INFO:tasks.workunit.client.1.smithi152.stdout:0/808: write d18/d1f/d33/d65/d7a/d83/f86 [919534,82116] 0 2024-09-13T23:06:32.177 INFO:tasks.workunit.client.1.smithi152.stdout:5/882: dwrite d5/d26/f47 [0,4194304] 0 2024-09-13T23:06:32.178 INFO:tasks.workunit.client.1.smithi152.stdout:4/966: dwrite d3/d4/d6/d66/d2b/f12b [4194304,4194304] 0 2024-09-13T23:06:32.181 INFO:tasks.workunit.client.1.smithi152.stdout:2/888: rmdir d0/d4/d9/d18/d1e/d3c/d88 39 2024-09-13T23:06:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:8/690: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:8/691: fdatasync d17/d25/d32/d4b/f6e 0 2024-09-13T23:06:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:8/692: fdatasync d17/d19/f20 0 2024-09-13T23:06:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:8/693: truncate d17/d25/d32/fa1 533720 0 2024-09-13T23:06:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:7/954: dread f16 [0,4194304] 0 2024-09-13T23:06:32.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/967: unlink d3/d4/d6/d8/d17/d5d/d94/d9b/da0/f112 0 2024-09-13T23:06:32.193 INFO:tasks.workunit.client.1.smithi152.stdout:6/852: rename d4/de/d12/d16/d2a/d3d/daa/daf to d4/de/d12/d8a/d118 0 2024-09-13T23:06:32.193 INFO:tasks.workunit.client.1.smithi152.stdout:6/853: write d4/de/d12/d16/f3f [4876012,2981] 0 2024-09-13T23:06:32.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/968: symlink d3/d4/d6/d8/d17/d3a/l135 0 2024-09-13T23:06:32.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/969: chown d3/d4/d6/d66/d1c/d5f/d8b/c102 7562 1 2024-09-13T23:06:32.207 INFO:tasks.workunit.client.1.smithi152.stdout:6/854: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/df7/l119 0 2024-09-13T23:06:32.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/955: rmdir d17/d24/d9f/dac 39 2024-09-13T23:06:32.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/855: unlink d4/de/d12/d8a/cc5 0 2024-09-13T23:06:32.212 INFO:tasks.workunit.client.1.smithi152.stdout:8/694: dwrite d17/d19/f7a [0,4194304] 0 2024-09-13T23:06:32.213 INFO:tasks.workunit.client.1.smithi152.stdout:2/889: dwrite d0/d4/d9/d16/d30/dba/ff9 [0,4194304] 0 2024-09-13T23:06:32.213 INFO:tasks.workunit.client.1.smithi152.stdout:2/890: creat d0/d4/d9/d16/d30/dba/f13a x:0 0 0 2024-09-13T23:06:32.213 INFO:tasks.workunit.client.1.smithi152.stdout:0/809: dwrite d18/d1f/d29/d4e/f62 [0,4194304] 0 2024-09-13T23:06:32.213 INFO:tasks.workunit.client.1.smithi152.stdout:7/956: unlink d17/d24/d9f/d51/d5b/d90/d2e/d79/l9c 0 2024-09-13T23:06:32.214 INFO:tasks.workunit.client.1.smithi152.stdout:0/810: read - d18/d1f/d29/d2f/d3d/fe7 zero size 2024-09-13T23:06:32.214 INFO:tasks.workunit.client.1.smithi152.stdout:4/970: creat d3/d4/d6/d66/d134/d79/d7d/f136 x:0 0 0 2024-09-13T23:06:32.215 INFO:tasks.workunit.client.1.smithi152.stdout:6/856: creat d4/de/d21/f11a x:0 0 0 2024-09-13T23:06:32.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/695: creat d17/d25/d32/d50/dc2/dc3/fda x:0 0 0 2024-09-13T23:06:32.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/696: readlink d17/d25/d32/l60 0 2024-09-13T23:06:32.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/697: fsync d17/d25/d32/d44/f82 0 2024-09-13T23:06:32.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/957: mknod d17/d24/d9f/dac/dba/d85/c146 0 2024-09-13T23:06:32.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/958: stat d17/d6c/l123 0 2024-09-13T23:06:32.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/891: dread d0/d4/d9/d18/d1e/d8c/f51 [0,4194304] 0 2024-09-13T23:06:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:4/971: mknod d3/d4/d6/d8/d17/d5d/c137 0 2024-09-13T23:06:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:4/972: truncate d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/fdc 837561 0 2024-09-13T23:06:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:4/973: write d3/d4/d6/f54 [4100935,52721] 0 2024-09-13T23:06:32.227 INFO:tasks.workunit.client.1.smithi152.stdout:6/857: symlink d4/de/d1d/dce/l11b 0 2024-09-13T23:06:32.228 INFO:tasks.workunit.client.1.smithi152.stdout:7/959: dread d17/d24/f111 [0,4194304] 0 2024-09-13T23:06:32.228 INFO:tasks.workunit.client.1.smithi152.stdout:7/960: truncate d17/d24/d9f/dac/dba/d85/f124 4802330 0 2024-09-13T23:06:32.230 INFO:tasks.workunit.client.1.smithi152.stdout:2/892: mkdir d0/d4/d9/d16/d30/dc7/d13b 0 2024-09-13T23:06:32.233 INFO:tasks.workunit.client.1.smithi152.stdout:4/974: dread d3/d4/d6/d66/d134/d79/fd7 [0,4194304] 0 2024-09-13T23:06:32.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/893: rename d0/d4/d9/d18/d1e/d3c/d88/d98 to d0/d4/d9/d18/d13c 0 2024-09-13T23:06:32.235 INFO:tasks.workunit.client.1.smithi152.stdout:6/858: getdents d4/de/d12/d16/d2a/d3d 0 2024-09-13T23:06:32.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/894: fsync d0/d4/d9/d16/d9f/f12d 0 2024-09-13T23:06:32.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/811: write d18/d1f/d39/f76 [227562,86032] 0 2024-09-13T23:06:32.238 INFO:tasks.workunit.client.1.smithi152.stdout:6/859: mknod d4/de/d21/d5c/c11c 0 2024-09-13T23:06:32.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/895: getdents d0/d4/d9/d55 0 2024-09-13T23:06:32.244 INFO:tasks.workunit.client.1.smithi152.stdout:2/896: creat d0/d4/d9/d55/d12c/d12f/f13d x:0 0 0 2024-09-13T23:06:32.249 INFO:tasks.workunit.client.1.smithi152.stdout:8/698: dwrite d17/d25/f79 [0,4194304] 0 2024-09-13T23:06:32.249 INFO:tasks.workunit.client.1.smithi152.stdout:8/699: chown d17/d25/d32/fa1 3986193 1 2024-09-13T23:06:32.252 INFO:tasks.workunit.client.1.smithi152.stdout:4/975: dread d3/f40 [0,4194304] 0 2024-09-13T23:06:32.252 INFO:tasks.workunit.client.1.smithi152.stdout:4/976: fdatasync d3/d4/d6/d8/dad/fc4 0 2024-09-13T23:06:32.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/977: mkdir d3/d4/d6/d8/d17/d5d/d94/d9b/de9/d138 0 2024-09-13T23:06:32.254 INFO:tasks.workunit.client.1.smithi152.stdout:4/978: truncate d3/d4/d6/d66/d134/d79/d7d/f136 676725 0 2024-09-13T23:06:32.255 INFO:tasks.workunit.client.1.smithi152.stdout:4/979: creat d3/d4/d6/d66/d134/d79/d7d/f139 x:0 0 0 2024-09-13T23:06:32.256 INFO:tasks.workunit.client.1.smithi152.stdout:4/980: truncate d3/d4/d6/d66/d134/d79/fd7 244387 0 2024-09-13T23:06:32.260 INFO:tasks.workunit.client.1.smithi152.stdout:7/961: dwrite d17/d24/d9f/d51/d5b/d90/d2e/d79/db3/f105 [0,4194304] 0 2024-09-13T23:06:32.263 INFO:tasks.workunit.client.1.smithi152.stdout:3/853: sync 2024-09-13T23:06:32.265 INFO:tasks.workunit.client.1.smithi152.stdout:3/854: symlink de/d1f/da2/dcb/l125 0 2024-09-13T23:06:32.265 INFO:tasks.workunit.client.1.smithi152.stdout:3/855: chown de/d14/d76/f120 0 1 2024-09-13T23:06:32.267 INFO:tasks.workunit.client.1.smithi152.stdout:3/856: dread de/d14/d47/f86 [0,4194304] 0 2024-09-13T23:06:32.268 INFO:tasks.workunit.client.1.smithi152.stdout:3/857: symlink de/d1f/l126 0 2024-09-13T23:06:32.269 INFO:tasks.workunit.client.1.smithi152.stdout:6/860: dwrite d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ff2 [0,4194304] 0 2024-09-13T23:06:32.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/861: truncate d4/de/d12/d8a/d118/fd1 1262014 0 2024-09-13T23:06:32.274 INFO:tasks.workunit.client.1.smithi152.stdout:3/858: link de/l9f de/d14/d47/d70/d72/da7/l127 0 2024-09-13T23:06:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:3/859: chown de/d14/d47/d57/le5 15758138 1 2024-09-13T23:06:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:3/860: fsync de/d14/d47/d70/d72/fb1 0 2024-09-13T23:06:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/962: write d17/d24/d9f/d51/d5b/d90/d2b/d4b/d4d/fb5 [2527113,111585] 0 2024-09-13T23:06:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/862: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/dff/l11d 0 2024-09-13T23:06:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:6/863: fsync d4/de/d12/f28 0 2024-09-13T23:06:32.276 INFO:tasks.workunit.client.1.smithi152.stdout:3/861: truncate de/d14/d47/f48 3827344 0 2024-09-13T23:06:32.279 INFO:tasks.workunit.client.1.smithi152.stdout:6/864: write d4/de/d21/f24 [663642,107060] 0 2024-09-13T23:06:32.280 INFO:tasks.workunit.client.1.smithi152.stdout:6/865: fsync d4/de/d12/d16/d2a/d3d/d57/d8d/fbd 0 2024-09-13T23:06:32.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/963: unlink d17/d24/d9f/d51/d5b/d90/d2e/d30/fe6 0 2024-09-13T23:06:32.283 INFO:tasks.workunit.client.1.smithi152.stdout:8/700: dwrite d17/d25/d32/d4b/d95/fad [0,4194304] 0 2024-09-13T23:06:32.283 INFO:tasks.workunit.client.1.smithi152.stdout:4/981: dwrite d3/d4/d6/d66/d134/d79/f129 [0,4194304] 0 2024-09-13T23:06:32.284 INFO:tasks.workunit.client.1.smithi152.stdout:8/701: fdatasync d17/d25/d32/d50/dc2/f9f 0 2024-09-13T23:06:32.284 INFO:tasks.workunit.client.1.smithi152.stdout:4/982: dread - d3/d4/d32/f12d zero size 2024-09-13T23:06:32.284 INFO:tasks.workunit.client.1.smithi152.stdout:4/983: dread - d3/d4/d6/d66/d134/d79/d7d/f139 zero size 2024-09-13T23:06:32.286 INFO:tasks.workunit.client.1.smithi152.stdout:5/883: sync 2024-09-13T23:06:32.286 INFO:tasks.workunit.client.1.smithi152.stdout:5/884: fsync d5/dc/d19/d65/d99/da6/dad/dd8/df6/f112 0 2024-09-13T23:06:32.289 INFO:tasks.workunit.client.1.smithi152.stdout:7/964: mkdir d17/d24/d9f/d51/d5b/d90/d2e/d79/db3/d147 0 2024-09-13T23:06:32.289 INFO:tasks.workunit.client.1.smithi152.stdout:7/965: chown d17/d4f/f78 16067275 1 2024-09-13T23:06:32.290 INFO:tasks.workunit.client.1.smithi152.stdout:2/897: dwrite d0/d4/d9/d55/d12c/f12e [0,4194304] 0 2024-09-13T23:06:32.294 INFO:tasks.workunit.client.1.smithi152.stdout:6/866: rmdir d4/de/d12/d16/d2a/d3d/dcf/ddf 39 2024-09-13T23:06:32.294 INFO:tasks.workunit.client.1.smithi152.stdout:6/867: truncate d4/de/d12/d8a/f68 223717 0 2024-09-13T23:06:32.300 INFO:tasks.workunit.client.1.smithi152.stdout:8/702: rename d17/d25/d32/d50/dc2/dc3 to d17/ddb 0 2024-09-13T23:06:32.300 INFO:tasks.workunit.client.1.smithi152.stdout:4/984: dread d3/d4/fa5 [0,4194304] 0 2024-09-13T23:06:32.300 INFO:tasks.workunit.client.1.smithi152.stdout:4/985: fdatasync d3/d4/d6/d66/d134/f99 0 2024-09-13T23:06:32.302 INFO:tasks.workunit.client.1.smithi152.stdout:8/703: symlink d17/d25/d32/dba/ldc 0 2024-09-13T23:06:32.304 INFO:tasks.workunit.client.1.smithi152.stdout:4/986: rename d3/d4/d32/d86/d95/la7 to d3/d4/d6/d8/d4b/l13a 0 2024-09-13T23:06:32.304 INFO:tasks.workunit.client.1.smithi152.stdout:4/987: creat d3/d4/d6/d8/d17/d5d/d94/d9b/dc8/f13b x:0 0 0 2024-09-13T23:06:32.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/704: write d17/d25/d32/d4b/f5b [964636,95827] 0 2024-09-13T23:06:32.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/705: fdatasync d17/d19/f56 0 2024-09-13T23:06:32.317 INFO:tasks.workunit.client.1.smithi152.stdout:8/706: mkdir d17/d25/d32/dba/ddd 0 2024-09-13T23:06:32.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/707: mknod d17/d25/d32/d4b/d84/d91/d9c/cde 0 2024-09-13T23:06:32.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/708: readlink d17/d25/d32/d44/l97 0 2024-09-13T23:06:32.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/709: fsync d17/f1c 0 2024-09-13T23:06:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/710: rename d17/d25/d32/d4b/d84/la5 to d17/ldf 0 2024-09-13T23:06:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/711: write d17/f1c [8189446,106146] 0 2024-09-13T23:06:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/712: fsync d17/d25/d32/d9a/f4f 0 2024-09-13T23:06:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/713: read d17/d25/d32/d4b/d84/db2/fb5 [188242,102038] 0 2024-09-13T23:06:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/714: stat d17/ddb/ld3 0 2024-09-13T23:06:32.320 INFO:tasks.workunit.client.1.smithi152.stdout:8/715: fsync d17/d19/f20 0 2024-09-13T23:06:32.321 INFO:tasks.workunit.client.1.smithi152.stdout:8/716: unlink d17/d25/d32/d4b/d95/l83 0 2024-09-13T23:06:32.321 INFO:tasks.workunit.client.1.smithi152.stdout:8/717: creat d17/d25/d32/d4b/d84/db2/fe0 x:0 0 0 2024-09-13T23:06:32.321 INFO:tasks.workunit.client.1.smithi152.stdout:8/718: fsync d17/d25/d32/d9a/f67 0 2024-09-13T23:06:32.345 INFO:tasks.workunit.client.1.smithi152.stdout:5/885: dwrite d5/dc/d19/d65/d99/d98/f9c [0,4194304] 0 2024-09-13T23:06:32.345 INFO:tasks.workunit.client.1.smithi152.stdout:3/862: dwrite de/d14/d47/fd7 [0,4194304] 0 2024-09-13T23:06:32.346 INFO:tasks.workunit.client.1.smithi152.stdout:7/966: dwrite d17/d24/d109/dda/f10a [0,4194304] 0 2024-09-13T23:06:32.346 INFO:tasks.workunit.client.1.smithi152.stdout:8/719: dwrite d17/d25/d32/d4b/d84/d91/d9c/fc7 [0,4194304] 0 2024-09-13T23:06:32.347 INFO:tasks.workunit.client.1.smithi152.stdout:2/898: dwrite d0/d4/d9/d16/d30/dba/f13a [0,4194304] 0 2024-09-13T23:06:32.348 INFO:tasks.workunit.client.1.smithi152.stdout:5/886: dread d5/dc/d19/d20/d2e/d28/f2f [0,4194304] 0 2024-09-13T23:06:32.348 INFO:tasks.workunit.client.1.smithi152.stdout:6/868: dwrite d4/de/d12/d16/f9c [0,4194304] 0 2024-09-13T23:06:32.353 INFO:tasks.workunit.client.1.smithi152.stdout:8/720: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:32.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/863: dread de/d14/d47/d57/fc6 [0,4194304] 0 2024-09-13T23:06:32.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/864: fsync de/d14/d47/d57/d5d/d6e/df2/d10a/f10f 0 2024-09-13T23:06:32.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/865: dread - de/d1f/fbd zero size 2024-09-13T23:06:32.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/866: readlink de/d14/d47/d70/lf4 0 2024-09-13T23:06:32.364 INFO:tasks.workunit.client.1.smithi152.stdout:2/899: link d0/d4/dca/f119 d0/d4/d9/d16/d30/dc7/d13b/f13e 0 2024-09-13T23:06:32.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/887: mknod d5/dc/d19/d65/d99/da6/dad/dd8/df6/c124 0 2024-09-13T23:06:32.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/888: fdatasync d5/dc/d19/d65/d99/d98/dc2/d82/ff8 0 2024-09-13T23:06:32.367 INFO:tasks.workunit.client.1.smithi152.stdout:8/721: symlink d17/ddb/le1 0 2024-09-13T23:06:32.367 INFO:tasks.workunit.client.1.smithi152.stdout:8/722: stat d17/d19/dac/fb9 0 2024-09-13T23:06:32.368 INFO:tasks.workunit.client.1.smithi152.stdout:8/723: chown d17/d25/d32/d4b/d84/d91/d9c/fc7 1426 1 2024-09-13T23:06:32.368 INFO:tasks.workunit.client.1.smithi152.stdout:7/967: getdents d17/d24/d9f/d51/d5b/d90/d2b/d4b/d61 0 2024-09-13T23:06:32.369 INFO:tasks.workunit.client.1.smithi152.stdout:7/968: write d17/d24/d9f/d51/d5b/d90/d2e/d79/f117 [98924,8258] 0 2024-09-13T23:06:32.369 INFO:tasks.workunit.client.1.smithi152.stdout:7/969: chown d17/d24/d9f/d3f/cab 929032323 1 2024-09-13T23:06:32.369 INFO:tasks.workunit.client.1.smithi152.stdout:7/970: fsync d17/d24/d9f/dac/dba/d85/f124 0 2024-09-13T23:06:32.371 INFO:tasks.workunit.client.1.smithi152.stdout:5/889: truncate d5/dc/da3/db4/d7f/f103 2362170 0 2024-09-13T23:06:32.371 INFO:tasks.workunit.client.1.smithi152.stdout:8/724: creat d17/d25/d32/dba/ddd/fe2 x:0 0 0 2024-09-13T23:06:32.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/867: unlink de/d1f/f102 0 2024-09-13T23:06:32.373 INFO:tasks.workunit.client.1.smithi152.stdout:3/868: write de/d14/d47/d70/dca/fd4 [3032,73295] 0 2024-09-13T23:06:32.373 INFO:tasks.workunit.client.1.smithi152.stdout:7/971: creat d17/d6c/dd1/f148 x:0 0 0 2024-09-13T23:06:32.373 INFO:tasks.workunit.client.1.smithi152.stdout:7/972: chown d17/d24/d9f/d51/d5b/d63/df4/f108 0 1 2024-09-13T23:06:32.373 INFO:tasks.workunit.client.1.smithi152.stdout:7/973: creat d17/d24/d9f/d51/d5b/f149 x:0 0 0 2024-09-13T23:06:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/890: creat d5/dc/da3/db4/f125 x:0 0 0 2024-09-13T23:06:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/891: fdatasync d5/da/f43 0 2024-09-13T23:06:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:3/869: truncate de/d14/d47/d57/faa 2070259 0 2024-09-13T23:06:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/812: sync 2024-09-13T23:06:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/813: chown d18/d1f/d29/d3f/d4b/f57 207898 1 2024-09-13T23:06:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/814: chown d18/d1f/d33/f7f 202955181 1 2024-09-13T23:06:32.377 INFO:tasks.workunit.client.1.smithi152.stdout:0/815: read - d18/d1f/d33/df5/ffd zero size 2024-09-13T23:06:32.378 INFO:tasks.workunit.client.1.smithi152.stdout:8/725: dread d17/d25/d32/d4b/f5b [0,4194304] 0 2024-09-13T23:06:32.378 INFO:tasks.workunit.client.1.smithi152.stdout:7/974: mkdir d17/d4f/d84/dd9/d10e/d14a 0 2024-09-13T23:06:32.379 INFO:tasks.workunit.client.1.smithi152.stdout:7/975: chown d17/d24/f111 0 1 2024-09-13T23:06:32.380 INFO:tasks.workunit.client.1.smithi152.stdout:5/892: creat d5/dc/d19/d65/d99/d98/da0/dc1/ddc/f126 x:0 0 0 2024-09-13T23:06:32.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/870: rename de/d14/d47/d70/d72/d11d to de/d14/d47/d70/d87/ddd/d128 0 2024-09-13T23:06:32.381 INFO:tasks.workunit.client.1.smithi152.stdout:2/900: dwrite d0/d4/d9/d55/d12c/f12e [0,4194304] 0 2024-09-13T23:06:32.381 INFO:tasks.workunit.client.1.smithi152.stdout:2/901: fsync d0/d4/d9/d55/d8f/fcd 0 2024-09-13T23:06:32.382 INFO:tasks.workunit.client.1.smithi152.stdout:8/726: creat d17/d25/d32/d9a/d8f/fe3 x:0 0 0 2024-09-13T23:06:32.382 INFO:tasks.workunit.client.1.smithi152.stdout:7/976: write d17/d24/d9f/d51/d5b/d90/d2b/f72 [353698,9495] 0 2024-09-13T23:06:32.388 INFO:tasks.workunit.client.1.smithi152.stdout:2/902: symlink d0/d4/d9/d16/d30/d10c/l13f 0 2024-09-13T23:06:32.388 INFO:tasks.workunit.client.1.smithi152.stdout:2/903: chown d0/d4/d9/d16/d30/dc7/d13b 8 1 2024-09-13T23:06:32.390 INFO:tasks.workunit.client.1.smithi152.stdout:0/816: creat d18/d1f/d39/d106/d10a/f115 x:0 0 0 2024-09-13T23:06:32.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/727: mknod d17/d25/d80/da3/ce4 0 2024-09-13T23:06:32.392 INFO:tasks.workunit.client.1.smithi152.stdout:8/728: chown d17/d25/d32/d4b/d84/d91/d9c/ccd 741 1 2024-09-13T23:06:32.393 INFO:tasks.workunit.client.1.smithi152.stdout:7/977: mkdir d17/d6c/d14b 0 2024-09-13T23:06:32.395 INFO:tasks.workunit.client.1.smithi152.stdout:5/893: creat d5/dc/d19/d65/d99/d98/dbc/f127 x:0 0 0 2024-09-13T23:06:32.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/871: read de/f98 [911810,86328] 0 2024-09-13T23:06:32.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/904: rename d0/d4/d9/d16/d30/dde/ce9 to d0/d4/d9/d18/d1e/d3c/d4d/ddc/c140 0 2024-09-13T23:06:32.398 INFO:tasks.workunit.client.1.smithi152.stdout:3/872: dread de/d14/d47/d70/d72/fbf [0,4194304] 0 2024-09-13T23:06:32.399 INFO:tasks.workunit.client.1.smithi152.stdout:8/729: symlink d17/d25/d32/dba/le5 0 2024-09-13T23:06:32.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/905: write d0/d4/d9/f4b [1240840,53280] 0 2024-09-13T23:06:32.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/978: creat d17/d24/f14c x:0 0 0 2024-09-13T23:06:32.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/979: chown d17/d24/d9f/d51/d5b/d90/d2b/f13d 5380159 1 2024-09-13T23:06:32.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/980: fdatasync d17/d24/d9f/d51/d5b/d63/df4/f135 0 2024-09-13T23:06:32.401 INFO:tasks.workunit.client.1.smithi152.stdout:5/894: mknod d5/d26/d61/d68/df4/c128 0 2024-09-13T23:06:32.403 INFO:tasks.workunit.client.1.smithi152.stdout:8/730: dread d17/f22 [0,4194304] 0 2024-09-13T23:06:32.403 INFO:tasks.workunit.client.1.smithi152.stdout:0/817: rmdir d18/d8f/dc5/dd0/dd9 39 2024-09-13T23:06:32.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/873: mkdir de/d1f/d129 0 2024-09-13T23:06:32.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/731: link d17/d25/d32/f5d d17/d19/dac/fe6 0 2024-09-13T23:06:32.411 INFO:tasks.workunit.client.1.smithi152.stdout:0/818: link d18/d8f/cca d18/d1f/d29/d2f/dd3/d101/d2c/c116 0 2024-09-13T23:06:32.419 INFO:tasks.workunit.client.1.smithi152.stdout:3/874: dread de/f3e [0,4194304] 0 2024-09-13T23:06:32.419 INFO:tasks.workunit.client.1.smithi152.stdout:3/875: truncate de/d1f/da2/da8/ffc 2262948 0 2024-09-13T23:06:32.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/906: getdents d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7 0 2024-09-13T23:06:32.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/907: fdatasync d0/d4/d9/d55/d12c/f12e 0 2024-09-13T23:06:32.431 INFO:tasks.workunit.client.1.smithi152.stdout:0/819: mkdir d18/d1f/d33/d117 0 2024-09-13T23:06:32.433 INFO:tasks.workunit.client.1.smithi152.stdout:3/876: truncate de/d14/f49 2105676 0 2024-09-13T23:06:32.433 INFO:tasks.workunit.client.1.smithi152.stdout:3/877: write de/f9d [2899339,23685] 0 2024-09-13T23:06:32.434 INFO:tasks.workunit.client.1.smithi152.stdout:2/908: truncate d0/d4/d9/d18/d1e/f133 1590831 0 2024-09-13T23:06:32.434 INFO:tasks.workunit.client.1.smithi152.stdout:2/909: read d0/d4/d9/d16/d2b/f46 [478140,55969] 0 2024-09-13T23:06:32.436 INFO:tasks.workunit.client.1.smithi152.stdout:7/981: rename d17/d24/d9f/d51/d5b/d90/d2e/d79/da1 to d17/d24/d9f/d51/d5b/d63/d7d/d14d 0 2024-09-13T23:06:32.439 INFO:tasks.workunit.client.1.smithi152.stdout:8/732: link d17/d19/l55 d17/d25/d32/le7 0 2024-09-13T23:06:32.439 INFO:tasks.workunit.client.1.smithi152.stdout:0/820: dread d18/d1f/d29/d4e/f99 [0,4194304] 0 2024-09-13T23:06:32.439 INFO:tasks.workunit.client.1.smithi152.stdout:0/821: chown d18/d1f/d29/d2f/dd3/d101/d74/l98 3 1 2024-09-13T23:06:32.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/822: write d18/d1f/d29/d3f/d40/daa/fcb [177778,44074] 0 2024-09-13T23:06:32.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/823: write d18/d1f/fa9 [2873218,83604] 0 2024-09-13T23:06:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/910: creat d0/d4/d9/d18/d1e/d3c/d4d/ddc/dee/f141 x:0 0 0 2024-09-13T23:06:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/911: fdatasync d0/d4/d9/d18/d1e/d3c/f8e 0 2024-09-13T23:06:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/912: write d0/d4/d9/d16/f81 [1218062,116112] 0 2024-09-13T23:06:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/913: stat d0/d4/c72 0 2024-09-13T23:06:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/914: dread - d0/d4/d9/d55/d8f/f96 zero size 2024-09-13T23:06:32.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/915: dread d0/d4/d9/d18/d1e/f44 [0,4194304] 0 2024-09-13T23:06:32.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/916: chown d0/d4/d9/d14/l7e 279653553 1 2024-09-13T23:06:32.446 INFO:tasks.workunit.client.1.smithi152.stdout:3/878: rename de/ff to de/d14/d47/d70/dec/f12a 0 2024-09-13T23:06:32.447 INFO:tasks.workunit.client.1.smithi152.stdout:0/824: mknod d18/d1f/d29/d2f/dd3/d101/d74/da4/c118 0 2024-09-13T23:06:32.447 INFO:tasks.workunit.client.1.smithi152.stdout:0/825: creat d18/d1f/d29/d2f/d3d/da1/f119 x:0 0 0 2024-09-13T23:06:32.449 INFO:tasks.workunit.client.1.smithi152.stdout:8/733: read d17/d25/d32/d4b/f74 [2419860,86577] 0 2024-09-13T23:06:32.450 INFO:tasks.workunit.client.1.smithi152.stdout:6/869: sync 2024-09-13T23:06:32.450 INFO:tasks.workunit.client.1.smithi152.stdout:4/988: sync 2024-09-13T23:06:32.450 INFO:tasks.workunit.client.1.smithi152.stdout:6/870: write d4/de/d12/d8a/f5e [2880647,75259] 0 2024-09-13T23:06:32.451 INFO:tasks.workunit.client.1.smithi152.stdout:2/917: mknod d0/d4/d9/d18/d1e/d3c/d88/db9/c142 0 2024-09-13T23:06:32.452 INFO:tasks.workunit.client.1.smithi152.stdout:7/982: rename d17/d24/d9f/d51/d5b/d90/d2b/c31 to d17/d24/d9f/d51/d5b/d87/dc7/deb/c14e 0 2024-09-13T23:06:32.455 INFO:tasks.workunit.client.1.smithi152.stdout:3/879: link de/d14/d38/l9c de/d63/df1/l12b 0 2024-09-13T23:06:32.455 INFO:tasks.workunit.client.1.smithi152.stdout:3/880: fsync de/d1f/fd2 0 2024-09-13T23:06:32.460 INFO:tasks.workunit.client.1.smithi152.stdout:2/918: read d0/d4/d9/fab [1484647,34565] 0 2024-09-13T23:06:32.460 INFO:tasks.workunit.client.1.smithi152.stdout:2/919: creat d0/d4/d9/d16/dd7/f143 x:0 0 0 2024-09-13T23:06:32.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/826: symlink d18/d1f/d29/d2f/d3d/da1/l11a 0 2024-09-13T23:06:32.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/827: write d18/d1f/d29/d4e/dec/d102/f104 [864243,83659] 0 2024-09-13T23:06:32.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/828: getdents d18/d1f/d33/d65 0 2024-09-13T23:06:32.461 INFO:tasks.workunit.client.1.smithi152.stdout:8/734: mknod d17/d25/d32/dba/ddd/ce8 0 2024-09-13T23:06:32.462 INFO:tasks.workunit.client.1.smithi152.stdout:4/989: mknod d3/d4/d6/d66/d1c/d5f/d8b/dfc/c13c 0 2024-09-13T23:06:32.462 INFO:tasks.workunit.client.1.smithi152.stdout:6/871: creat d4/de/d12/d16/d2a/d3d/dcf/ddf/d104/f11e x:0 0 0 2024-09-13T23:06:32.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/983: getdents d17/d24/d9f/d46/d129 0 2024-09-13T23:06:32.464 INFO:tasks.workunit.client.1.smithi152.stdout:4/990: dread d3/d4/d6/d66/f49 [4194304,4194304] 0 2024-09-13T23:06:32.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/984: fsync d17/d6c/fe8 0 2024-09-13T23:06:32.464 INFO:tasks.workunit.client.1.smithi152.stdout:7/985: fdatasync d17/d4f/d84/fcb 0 2024-09-13T23:06:32.464 INFO:tasks.workunit.client.1.smithi152.stdout:4/991: dread - d3/d4/d32/f12d zero size 2024-09-13T23:06:32.468 INFO:tasks.workunit.client.1.smithi152.stdout:2/920: unlink d0/d4/d9/d18/d1e/d3c/d88/f132 0 2024-09-13T23:06:32.470 INFO:tasks.workunit.client.1.smithi152.stdout:0/829: stat d18/d1f/d33/d65/d7a/c114 0 2024-09-13T23:06:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:8/735: mkdir d17/d25/d32/d50/dcf/de9 0 2024-09-13T23:06:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/872: mkdir d4/de/d12/d16/d2a/d3d/d11f 0 2024-09-13T23:06:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/873: dread - d4/fda zero size 2024-09-13T23:06:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:3/881: dwrite de/d14/f5b [0,4194304] 0 2024-09-13T23:06:32.478 INFO:tasks.workunit.client.1.smithi152.stdout:5/895: sync 2024-09-13T23:06:32.478 INFO:tasks.workunit.client.1.smithi152.stdout:7/986: dread d17/d24/d9f/d46/f74 [0,4194304] 0 2024-09-13T23:06:32.478 INFO:tasks.workunit.client.1.smithi152.stdout:3/882: mkdir de/d14/d47/d70/dca/df5/d12c 0 2024-09-13T23:06:32.478 INFO:tasks.workunit.client.1.smithi152.stdout:8/736: mkdir d17/d25/d32/d50/dea 0 2024-09-13T23:06:32.478 INFO:tasks.workunit.client.1.smithi152.stdout:8/737: readlink d17/d25/d32/d44/l86 0 2024-09-13T23:06:32.479 INFO:tasks.workunit.client.1.smithi152.stdout:5/896: rmdir d5/d26/d61/d68/df4 39 2024-09-13T23:06:32.479 INFO:tasks.workunit.client.1.smithi152.stdout:5/897: read - d5/dc/d19/d65/d70/f104 zero size 2024-09-13T23:06:32.481 INFO:tasks.workunit.client.1.smithi152.stdout:7/987: creat d17/d24/d9f/d51/d5b/d90/d2e/d30/f14f x:0 0 0 2024-09-13T23:06:32.482 INFO:tasks.workunit.client.1.smithi152.stdout:4/992: dread d3/d4/d6/d8/d17/d5d/d94/d9b/da0/daf/fe0 [0,4194304] 0 2024-09-13T23:06:32.483 INFO:tasks.workunit.client.1.smithi152.stdout:3/883: chown de/ld1 225 1 2024-09-13T23:06:32.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/738: creat d17/d25/d32/d50/dcf/feb x:0 0 0 2024-09-13T23:06:32.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/739: write d17/d25/d32/d4b/d84/db2/fc5 [761199,3036] 0 2024-09-13T23:06:32.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/740: dread - d17/d25/d32/d4b/d84/db2/fe0 zero size 2024-09-13T23:06:32.485 INFO:tasks.workunit.client.1.smithi152.stdout:5/898: creat d5/d26/d61/f129 x:0 0 0 2024-09-13T23:06:32.486 INFO:tasks.workunit.client.1.smithi152.stdout:8/741: dread d17/d25/d32/d4b/d84/fb0 [0,4194304] 0 2024-09-13T23:06:32.487 INFO:tasks.workunit.client.1.smithi152.stdout:7/988: mkdir d17/d24/d9f/d51/d5b/d90/dfe/d150 0 2024-09-13T23:06:32.487 INFO:tasks.workunit.client.1.smithi152.stdout:7/989: write d17/d24/d9f/dac/f136 [635754,68886] 0 2024-09-13T23:06:32.487 INFO:tasks.workunit.client.1.smithi152.stdout:7/990: fdatasync d17/d6c/fe2 0 2024-09-13T23:06:32.487 INFO:tasks.workunit.client.1.smithi152.stdout:7/991: chown d17/d24/d9f/d51/d5b/d90/d2e/d30/f44 91664177 1 2024-09-13T23:06:32.489 INFO:tasks.workunit.client.1.smithi152.stdout:3/884: mkdir de/d1f/da2/d12d 0 2024-09-13T23:06:32.489 INFO:tasks.workunit.client.1.smithi152.stdout:8/742: symlink d17/ddb/lec 0 2024-09-13T23:06:32.489 INFO:tasks.workunit.client.1.smithi152.stdout:8/743: write d17/d25/d32/d4b/f7d [1000802,66324] 0 2024-09-13T23:06:32.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/992: symlink d17/d24/d9f/d51/d12b/l151 0 2024-09-13T23:06:32.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/993: chown d17/d24/d9f/d51/d5b/d87/l13e 224201104 1 2024-09-13T23:06:32.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/994: readlink d17/d24/d9f/d3f/l43 0 2024-09-13T23:06:32.490 INFO:tasks.workunit.client.1.smithi152.stdout:7/995: chown d17/d6c/f88 0 1 2024-09-13T23:06:32.490 INFO:tasks.workunit.client.1.smithi152.stdout:3/885: symlink de/d14/d47/d70/dca/l12e 0 2024-09-13T23:06:32.491 INFO:tasks.workunit.client.1.smithi152.stdout:3/886: creat de/d14/d47/d57/d93/f12f x:0 0 0 2024-09-13T23:06:32.491 INFO:tasks.workunit.client.1.smithi152.stdout:8/744: mknod d17/d25/d32/d4b/d84/d91/ced 0 2024-09-13T23:06:32.493 INFO:tasks.workunit.client.1.smithi152.stdout:3/887: creat de/d14/d47/d70/f130 x:0 0 0 2024-09-13T23:06:32.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/830: dwrite f13 [0,4194304] 0 2024-09-13T23:06:32.501 INFO:tasks.workunit.client.1.smithi152.stdout:2/921: dwrite d0/d4/d9/f4b [0,4194304] 0 2024-09-13T23:06:32.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/899: dread d5/dc/d19/d20/d2e/d28/d92/f87 [0,4194304] 0 2024-09-13T23:06:32.502 INFO:tasks.workunit.client.1.smithi152.stdout:0/831: mkdir d18/d8f/dc5/dd0/dd9/d11b 0 2024-09-13T23:06:32.502 INFO:tasks.workunit.client.1.smithi152.stdout:6/874: dwrite d4/de/d12/d16/d2a/d38/d3c/f45 [0,4194304] 0 2024-09-13T23:06:32.504 INFO:tasks.workunit.client.1.smithi152.stdout:8/745: write d17/d25/d32/f4e [3715442,88246] 0 2024-09-13T23:06:32.506 INFO:tasks.workunit.client.1.smithi152.stdout:2/922: unlink d0/d4/fc3 0 2024-09-13T23:06:32.506 INFO:tasks.workunit.client.1.smithi152.stdout:5/900: getdents d5 0 2024-09-13T23:06:32.506 INFO:tasks.workunit.client.1.smithi152.stdout:0/832: mkdir d18/d1f/d33/d6e/df7/d111/d11c 0 2024-09-13T23:06:32.509 INFO:tasks.workunit.client.1.smithi152.stdout:8/746: dread d17/d19/f56 [0,4194304] 0 2024-09-13T23:06:32.513 INFO:tasks.workunit.client.1.smithi152.stdout:2/923: symlink d0/d4/d9/d14/df0/l144 0 2024-09-13T23:06:32.513 INFO:tasks.workunit.client.1.smithi152.stdout:2/924: fdatasync d0/d4/d9/d55/d8f/f96 0 2024-09-13T23:06:32.514 INFO:tasks.workunit.client.1.smithi152.stdout:2/925: dread - d0/d4/d9/d55/d12c/d12f/f13d zero size 2024-09-13T23:06:32.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/901: truncate d5/d26/d61/d68/f7b 943979 0 2024-09-13T23:06:32.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/902: dread - d5/dc/da3/db4/f125 zero size 2024-09-13T23:06:32.516 INFO:tasks.workunit.client.1.smithi152.stdout:0/833: creat d18/d1f/d33/d65/f11d x:0 0 0 2024-09-13T23:06:32.518 INFO:tasks.workunit.client.1.smithi152.stdout:8/747: rename d17/d25/d32/d4b/d84/db2/fb5 to d17/d25/d32/d50/dea/fee 0 2024-09-13T23:06:32.518 INFO:tasks.workunit.client.1.smithi152.stdout:8/748: chown d17/d25/d32/d4b/ccc 2198 1 2024-09-13T23:06:32.519 INFO:tasks.workunit.client.1.smithi152.stdout:2/926: symlink d0/d4/d9/d16/d99/l145 0 2024-09-13T23:06:32.521 INFO:tasks.workunit.client.1.smithi152.stdout:5/903: creat d5/dc/da3/db4/db3/d11c/f12a x:0 0 0 2024-09-13T23:06:32.521 INFO:tasks.workunit.client.1.smithi152.stdout:3/888: getdents de/d14/d47/d57/d93 0 2024-09-13T23:06:32.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/834: symlink d18/d1f/d29/d2f/dd3/df3/l11e 0 2024-09-13T23:06:32.525 INFO:tasks.workunit.client.1.smithi152.stdout:6/875: dwrite d4/de/d12/d8a/d118/dcc/fe1 [0,4194304] 0 2024-09-13T23:06:32.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/927: mkdir d0/d4/d9/d16/d30/d146 0 2024-09-13T23:06:32.528 INFO:tasks.workunit.client.1.smithi152.stdout:2/928: creat d0/d4/d9/d16/d30/f147 x:0 0 0 2024-09-13T23:06:32.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/749: dread d17/d19/f28 [0,4194304] 0 2024-09-13T23:06:32.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/750: readlink d17/d25/l72 0 2024-09-13T23:06:32.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/751: fdatasync d17/d25/d32/d9a/d8f/f96 0 2024-09-13T23:06:32.531 INFO:tasks.workunit.client.1.smithi152.stdout:0/835: creat d18/d1f/d29/d2f/dd3/d101/d74/da4/f11f x:0 0 0 2024-09-13T23:06:32.534 INFO:tasks.workunit.client.1.smithi152.stdout:2/929: dread d0/d4/d9/d16/d2b/f50 [0,4194304] 0 2024-09-13T23:06:32.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/752: getdents d17/d25/d32/dba 0 2024-09-13T23:06:32.537 INFO:tasks.workunit.client.1.smithi152.stdout:3/889: link de/d14/d47/d57/l82 de/l131 0 2024-09-13T23:06:32.537 INFO:tasks.workunit.client.1.smithi152.stdout:5/904: dwrite d5/dc/d19/d65/d99/da6/dad/ff1 [0,4194304] 0 2024-09-13T23:06:32.538 INFO:tasks.workunit.client.1.smithi152.stdout:5/905: fdatasync d5/da/f58 0 2024-09-13T23:06:32.538 INFO:tasks.workunit.client.1.smithi152.stdout:0/836: mkdir d18/d1f/d33/df5/d120 0 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:0/837: write d18/d1f/d29/d2f/d3d/da1/fd4 [142730,5181] 0 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:0/838: fdatasync d18/d1f/d29/d4e/f99 0 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/876: getdents d4/de/d12/d16/d2a/d3d/dcf/ddf/d104 0 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/877: write d4/de/d1d/f86 [4839716,116997] 0 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/878: dread - d4/de/d12/d8a/d118/dcc/f102 zero size 2024-09-13T23:06:32.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/879: chown d4/de/d12/d8a/c7d 7 1 2024-09-13T23:06:32.540 INFO:tasks.workunit.client.1.smithi152.stdout:3/890: creat de/d14/d47/d70/dca/f132 x:0 0 0 2024-09-13T23:06:32.544 INFO:tasks.workunit.client.1.smithi152.stdout:5/906: creat d5/dc/d19/d20/d55/d123/f12b x:0 0 0 2024-09-13T23:06:32.545 INFO:tasks.workunit.client.1.smithi152.stdout:6/880: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/d120 0 2024-09-13T23:06:32.549 INFO:tasks.workunit.client.1.smithi152.stdout:8/753: getdents d17/d25/d80/d8a 0 2024-09-13T23:06:32.550 INFO:tasks.workunit.client.1.smithi152.stdout:3/891: rmdir de/d14/d47/d57/d5d/d6e/df2 39 2024-09-13T23:06:32.557 INFO:tasks.workunit.client.1.smithi152.stdout:3/892: getdents de/d14/d47/d70/dca 0 2024-09-13T23:06:32.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/893: rmdir de/d63/dc1 39 2024-09-13T23:06:32.560 INFO:tasks.workunit.client.1.smithi152.stdout:3/894: dread de/d14/d76/f8e [0,4194304] 0 2024-09-13T23:06:32.562 INFO:tasks.workunit.client.1.smithi152.stdout:3/895: creat de/d14/d47/d57/d5d/f133 x:0 0 0 2024-09-13T23:06:32.563 INFO:tasks.workunit.client.1.smithi152.stdout:3/896: write de/d14/f4b [1010553,81682] 0 2024-09-13T23:06:32.563 INFO:tasks.workunit.client.1.smithi152.stdout:3/897: creat de/d14/d47/d57/d5d/f134 x:0 0 0 2024-09-13T23:06:32.563 INFO:tasks.workunit.client.1.smithi152.stdout:2/930: dwrite d0/d4/d9/d55/d8f/fcd [0,4194304] 0 2024-09-13T23:06:32.565 INFO:tasks.workunit.client.1.smithi152.stdout:2/931: link d0/d4/d9/d16/d2b/l82 d0/d4/d9/d16/d30/dc7/d13b/l148 0 2024-09-13T23:06:32.574 INFO:tasks.workunit.client.1.smithi152.stdout:0/839: dwrite d18/d1f/d33/f5a [0,4194304] 0 2024-09-13T23:06:32.574 INFO:tasks.workunit.client.1.smithi152.stdout:6/881: dwrite d4/de/d21/d5c/f6d [0,4194304] 0 2024-09-13T23:06:32.587 INFO:tasks.workunit.client.1.smithi152.stdout:6/882: dread d4/de/d12/d16/d2a/f2d [0,4194304] 0 2024-09-13T23:06:32.597 INFO:tasks.workunit.client.1.smithi152.stdout:3/898: dwrite de/d14/d47/d57/d5d/f7f [4194304,4194304] 0 2024-09-13T23:06:32.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/754: dwrite d17/d25/d32/d4b/d84/d91/fa8 [0,4194304] 0 2024-09-13T23:06:32.600 INFO:tasks.workunit.client.1.smithi152.stdout:0/840: dwrite d18/d1f/d29/d2f/dd3/d101/f67 [0,4194304] 0 2024-09-13T23:06:32.600 INFO:tasks.workunit.client.1.smithi152.stdout:3/899: rmdir de/d1f/d129 0 2024-09-13T23:06:32.600 INFO:tasks.workunit.client.1.smithi152.stdout:3/900: truncate de/d14/d47/d57/d93/f12f 607228 0 2024-09-13T23:06:32.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/755: mkdir d17/d25/d32/d4b/d84/db2/def 0 2024-09-13T23:06:32.604 INFO:tasks.workunit.client.1.smithi152.stdout:2/932: dwrite d0/d4/d9/d18/f121 [0,4194304] 0 2024-09-13T23:06:32.604 INFO:tasks.workunit.client.1.smithi152.stdout:2/933: creat d0/d4/d9/d16/dd7/f149 x:0 0 0 2024-09-13T23:06:32.605 INFO:tasks.workunit.client.1.smithi152.stdout:6/883: dwrite d4/de/d12/d8a/f77 [0,4194304] 0 2024-09-13T23:06:32.613 INFO:tasks.workunit.client.1.smithi152.stdout:3/901: rename de/d14/d47/d57/fe4 to de/f135 0 2024-09-13T23:06:32.615 INFO:tasks.workunit.client.1.smithi152.stdout:0/841: rename d18/d1f/d29/d3f/d4b/d66/d6a/d9f/lb0 to d18/d1f/d39/d7c/l121 0 2024-09-13T23:06:32.615 INFO:tasks.workunit.client.1.smithi152.stdout:3/902: rmdir de/d14/d47/d57/d5d/d6e/df2 39 2024-09-13T23:06:32.615 INFO:tasks.workunit.client.1.smithi152.stdout:3/903: chown de/d1f 7640293 1 2024-09-13T23:06:32.615 INFO:tasks.workunit.client.1.smithi152.stdout:3/904: fsync de/d14/d47/d57/d5d/d6e/df2/d10a/f10f 0 2024-09-13T23:06:32.616 INFO:tasks.workunit.client.1.smithi152.stdout:3/905: write de/d14/d47/d57/d5d/f134 [443250,26722] 0 2024-09-13T23:06:32.616 INFO:tasks.workunit.client.1.smithi152.stdout:4/993: sync 2024-09-13T23:06:32.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/996: sync 2024-09-13T23:06:32.616 INFO:tasks.workunit.client.1.smithi152.stdout:6/884: rename d4/de/d12/d16/d2a/d3d/dcf/ce8 to d4/de/d1d/deb/c121 0 2024-09-13T23:06:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:4/994: mknod d3/d4/d6/d8/c13d 0 2024-09-13T23:06:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:4/995: creat d3/d4/d6/d66/d1c/d5f/d8b/d124/f13e x:0 0 0 2024-09-13T23:06:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:4/996: creat d3/d4/d6/d8/d17/d5d/d94/d9b/de9/f13f x:0 0 0 2024-09-13T23:06:32.618 INFO:tasks.workunit.client.1.smithi152.stdout:7/997: creat d17/d24/d9f/d51/d5b/d90/d2b/d4b/f152 x:0 0 0 2024-09-13T23:06:32.619 INFO:tasks.workunit.client.1.smithi152.stdout:3/906: dread de/d14/f62 [0,4194304] 0 2024-09-13T23:06:32.619 INFO:tasks.workunit.client.1.smithi152.stdout:0/842: unlink d18/d1f/c63 0 2024-09-13T23:06:32.620 INFO:tasks.workunit.client.1.smithi152.stdout:4/997: symlink d3/d4/d6/d8/d4b/ddd/l140 0 2024-09-13T23:06:32.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/843: creat d18/d1f/d29/d2f/dd3/d101/d74/f122 x:0 0 0 2024-09-13T23:06:32.622 INFO:tasks.workunit.client.1.smithi152.stdout:3/907: getdents de/d1f/da2/dcb/dbc 0 2024-09-13T23:06:32.623 INFO:tasks.workunit.client.1.smithi152.stdout:0/844: unlink d18/f1a 0 2024-09-13T23:06:32.623 INFO:tasks.workunit.client.1.smithi152.stdout:0/845: readlink d18/d1f/d29/d3f/d4b/l8c 0 2024-09-13T23:06:32.623 INFO:tasks.workunit.client.1.smithi152.stdout:0/846: write d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fd6 [1306527,84518] 0 2024-09-13T23:06:32.623 INFO:tasks.workunit.client.1.smithi152.stdout:0/847: fdatasync d18/d1f/fa9 0 2024-09-13T23:06:32.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/908: mkdir de/d1f/da2/dcb/de6/d136 0 2024-09-13T23:06:32.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/909: write de/f98 [4490323,33400] 0 2024-09-13T23:06:32.627 INFO:tasks.workunit.client.1.smithi152.stdout:2/934: dwrite d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/f123 [0,4194304] 0 2024-09-13T23:06:32.627 INFO:tasks.workunit.client.1.smithi152.stdout:8/756: dwrite d17/d25/f35 [0,4194304] 0 2024-09-13T23:06:32.629 INFO:tasks.workunit.client.1.smithi152.stdout:6/885: dread d4/de/f6c [0,4194304] 0 2024-09-13T23:06:32.635 INFO:tasks.workunit.client.1.smithi152.stdout:8/757: creat d17/d25/d32/d50/dd9/ff0 x:0 0 0 2024-09-13T23:06:32.635 INFO:tasks.workunit.client.1.smithi152.stdout:6/886: rmdir d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/df7 39 2024-09-13T23:06:32.636 INFO:tasks.workunit.client.1.smithi152.stdout:8/758: mknod d17/d25/d32/d50/dea/cf1 0 2024-09-13T23:06:32.639 INFO:tasks.workunit.client.1.smithi152.stdout:3/910: read de/f17 [985577,1096] 0 2024-09-13T23:06:32.639 INFO:tasks.workunit.client.1.smithi152.stdout:4/998: dread d3/d4/d6/d8/d4b/ddd/f10e [0,4194304] 0 2024-09-13T23:06:32.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/887: rmdir d4/de/d12/d16/d2a/d3d/d57/d8d 39 2024-09-13T23:06:32.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/888: dread - d4/de/d12/d16/d2a/d3d/f10d zero size 2024-09-13T23:06:32.639 INFO:tasks.workunit.client.1.smithi152.stdout:6/889: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/fe2 670253 0 2024-09-13T23:06:32.641 INFO:tasks.workunit.client.1.smithi152.stdout:4/999: mkdir d3/d4/d6/d66/d1c/d5f/d141 0 2024-09-13T23:06:32.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/759: rename d17/d25/d32/d50/dcf to d17/d25/d32/d4b/d84/d91/df2 0 2024-09-13T23:06:32.643 INFO:tasks.workunit.client.1.smithi152.stdout:8/760: unlink d17/d25/d32/l60 0 2024-09-13T23:06:32.644 INFO:tasks.workunit.client.1.smithi152.stdout:6/890: rename d4/de/d12/d8a/l105 to d4/de/d21/d5c/l122 0 2024-09-13T23:06:32.644 INFO:tasks.workunit.client.1.smithi152.stdout:6/891: write d4/de/d12/d8a/f68 [1140442,24272] 0 2024-09-13T23:06:32.645 INFO:tasks.workunit.client.1.smithi152.stdout:6/892: unlink d4/de/d12/d16/d2a/d3d/d57/cb2 0 2024-09-13T23:06:32.646 INFO:tasks.workunit.client.1.smithi152.stdout:6/893: getdents d4/de/d12/d8a/d118 0 2024-09-13T23:06:32.646 INFO:tasks.workunit.client.1.smithi152.stdout:2/935: dread d0/d4/d9/d14/d48/fbf [0,4194304] 0 2024-09-13T23:06:32.646 INFO:tasks.workunit.client.1.smithi152.stdout:2/936: readlink d0/d4/d9/d16/d30/dde/ldd 0 2024-09-13T23:06:32.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/937: mkdir d0/d4/d9/d55/d12c/d14a 0 2024-09-13T23:06:32.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/938: write d0/d4/d9/d16/f21 [2647422,3120] 0 2024-09-13T23:06:32.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/939: truncate d0/d4/d9/d18/d32/fb6 3288896 0 2024-09-13T23:06:32.656 INFO:tasks.workunit.client.1.smithi152.stdout:8/761: dread d17/d25/d32/f3f [0,4194304] 0 2024-09-13T23:06:32.658 INFO:tasks.workunit.client.1.smithi152.stdout:8/762: rmdir d17/d25/d32/d4b/d84/d91/d9c 39 2024-09-13T23:06:32.658 INFO:tasks.workunit.client.1.smithi152.stdout:8/763: fsync d17/d25/d32/d4b/d84/d91/df2/feb 0 2024-09-13T23:06:32.659 INFO:tasks.workunit.client.1.smithi152.stdout:8/764: truncate d17/d25/d32/d50/fae 5396942 0 2024-09-13T23:06:32.660 INFO:tasks.workunit.client.1.smithi152.stdout:8/765: chown d17/d19/c1a 56055473 1 2024-09-13T23:06:32.662 INFO:tasks.workunit.client.1.smithi152.stdout:8/766: rename d17/d25/d32/fa1 to d17/d25/d32/ff3 0 2024-09-13T23:06:32.662 INFO:tasks.workunit.client.1.smithi152.stdout:8/767: fdatasync d17/f1d 0 2024-09-13T23:06:32.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/768: getdents d17 0 2024-09-13T23:06:32.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/769: write d17/f2c [6595514,118360] 0 2024-09-13T23:06:32.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/770: fsync d17/f43 0 2024-09-13T23:06:32.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/771: truncate d17/faf 732182 0 2024-09-13T23:06:32.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/772: creat d17/d19/dac/ff4 x:0 0 0 2024-09-13T23:06:32.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/848: dwrite d18/d1f/d29/d3f/d4b/d66/d6a/d9f/fcf [0,4194304] 0 2024-09-13T23:06:32.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/849: readlink d18/d1f/d29/d2f/d3d/l103 0 2024-09-13T23:06:32.667 INFO:tasks.workunit.client.1.smithi152.stdout:3/911: dwrite de/f3e [0,4194304] 0 2024-09-13T23:06:32.667 INFO:tasks.workunit.client.1.smithi152.stdout:6/894: dwrite d4/de/d1d/fc4 [0,4194304] 0 2024-09-13T23:06:32.667 INFO:tasks.workunit.client.1.smithi152.stdout:7/998: dwrite d17/d24/d9f/d51/d5b/d63/d7d/d14d/ff8 [0,4194304] 0 2024-09-13T23:06:32.668 INFO:tasks.workunit.client.1.smithi152.stdout:7/999: write d17/d6c/f10f [562151,118527] 0 2024-09-13T23:06:32.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/850: mknod d18/d8f/dc5/d108/c123 0 2024-09-13T23:06:32.674 INFO:tasks.workunit.client.1.smithi152.stdout:3/912: mknod de/d14/d47/c137 0 2024-09-13T23:06:32.674 INFO:tasks.workunit.client.1.smithi152.stdout:3/913: chown de/d14/cb2 123665 1 2024-09-13T23:06:32.674 INFO:tasks.workunit.client.1.smithi152.stdout:3/914: chown de/d14/d47/fe7 336668407 1 2024-09-13T23:06:32.675 INFO:tasks.workunit.client.1.smithi152.stdout:6/895: rmdir d4/de/d12/d8a/d118/dcc 39 2024-09-13T23:06:32.676 INFO:tasks.workunit.client.1.smithi152.stdout:5/907: sync 2024-09-13T23:06:32.679 INFO:tasks.workunit.client.1.smithi152.stdout:8/773: dwrite d17/d25/d32/d4b/d84/d91/d9c/faa [0,4194304] 0 2024-09-13T23:06:32.680 INFO:tasks.workunit.client.1.smithi152.stdout:0/851: rename d18/d1f/d29/d3f/d40/daa/lc8 to d18/d8f/dc5/l124 0 2024-09-13T23:06:32.681 INFO:tasks.workunit.client.1.smithi152.stdout:0/852: stat d18/d1f/d29 0 2024-09-13T23:06:32.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/915: unlink de/d1f/da2/dd3/f100 0 2024-09-13T23:06:32.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/916: chown de/d14/d47/d57/d93/f97 1678474 1 2024-09-13T23:06:32.683 INFO:tasks.workunit.client.1.smithi152.stdout:6/896: unlink d4/de/d12/d8a/d118/fd1 0 2024-09-13T23:06:32.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/908: symlink d5/dc/d19/d20/l12c 0 2024-09-13T23:06:32.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/909: truncate d5/dc/da3/db4/f7d 355808 0 2024-09-13T23:06:32.688 INFO:tasks.workunit.client.1.smithi152.stdout:8/774: unlink d17/d25/d80/f8d 0 2024-09-13T23:06:32.689 INFO:tasks.workunit.client.1.smithi152.stdout:0/853: mkdir d18/d1f/d29/d3f/d40/d125 0 2024-09-13T23:06:32.689 INFO:tasks.workunit.client.1.smithi152.stdout:0/854: stat d18/d1f/d29/d2f/l38 0 2024-09-13T23:06:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/917: symlink de/d1f/l138 0 2024-09-13T23:06:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/918: fsync de/d14/d47/d57/d93/f97 0 2024-09-13T23:06:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:3/919: write de/d14/d47/d57/d93/f12f [1251146,50443] 0 2024-09-13T23:06:32.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/910: creat d5/da/f12d x:0 0 0 2024-09-13T23:06:32.691 INFO:tasks.workunit.client.1.smithi152.stdout:5/911: dread - d5/dc/f54 zero size 2024-09-13T23:06:32.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/775: mkdir d17/ddb/df5 0 2024-09-13T23:06:32.694 INFO:tasks.workunit.client.1.smithi152.stdout:0/855: truncate d18/d1f/d29/f60 3606808 0 2024-09-13T23:06:32.699 INFO:tasks.workunit.client.1.smithi152.stdout:8/776: rmdir d17/d25/d32/d4b/d84/db2 39 2024-09-13T23:06:32.702 INFO:tasks.workunit.client.1.smithi152.stdout:0/856: unlink d18/d1f/d39/l50 0 2024-09-13T23:06:32.703 INFO:tasks.workunit.client.1.smithi152.stdout:8/777: truncate d17/d19/f98 529206 0 2024-09-13T23:06:32.705 INFO:tasks.workunit.client.1.smithi152.stdout:8/778: creat d17/d19/ff6 x:0 0 0 2024-09-13T23:06:32.707 INFO:tasks.workunit.client.1.smithi152.stdout:8/779: creat d17/d25/d32/d4b/d84/d91/ff7 x:0 0 0 2024-09-13T23:06:32.709 INFO:tasks.workunit.client.1.smithi152.stdout:8/780: write d17/d25/d32/f54 [4666181,82700] 0 2024-09-13T23:06:32.711 INFO:tasks.workunit.client.1.smithi152.stdout:8/781: creat d17/ddb/df5/ff8 x:0 0 0 2024-09-13T23:06:32.711 INFO:tasks.workunit.client.1.smithi152.stdout:8/782: write d17/f1c [7144130,127403] 0 2024-09-13T23:06:32.715 INFO:tasks.workunit.client.1.smithi152.stdout:8/783: rename d17/d25/f81 to d17/ddb/df5/ff9 0 2024-09-13T23:06:32.721 INFO:tasks.workunit.client.1.smithi152.stdout:8/784: mknod d17/d25/d32/d4b/d84/db2/def/cfa 0 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:6/897: dwrite d4/de/d12/d3e/fd6 [0,4194304] 0 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:6/898: chown d4/de/d12/d16/d2a/lec 86779 1 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/912: dwrite d5/f5a [0,4194304] 0 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/913: chown d5/dc/d19/d65/d99/d101 2 1 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/914: chown d5/dc/d19/d65/d99/da6/f8b 706 1 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:8/785: link d17/d25/d32/d4b/cbe d17/d25/d32/d44/cfb 0 2024-09-13T23:06:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:0/857: dwrite d18/d1f/d29/d3f/d40/f8b [0,4194304] 0 2024-09-13T23:06:32.727 INFO:tasks.workunit.client.1.smithi152.stdout:8/786: rename d17/d19/f3d to d17/d25/d32/dba/ddd/ffc 0 2024-09-13T23:06:32.731 INFO:tasks.workunit.client.1.smithi152.stdout:0/858: unlink d18/d1f/d29/d3f/d40/daa/dbd/fc0 0 2024-09-13T23:06:32.731 INFO:tasks.workunit.client.1.smithi152.stdout:6/899: getdents d4/de/d1d/dce 0 2024-09-13T23:06:32.731 INFO:tasks.workunit.client.1.smithi152.stdout:6/900: fdatasync d4/de/d12/f109 0 2024-09-13T23:06:32.732 INFO:tasks.workunit.client.1.smithi152.stdout:8/787: mkdir d17/d25/d32/d4b/d84/d91/d9c/dfd 0 2024-09-13T23:06:32.733 INFO:tasks.workunit.client.1.smithi152.stdout:8/788: dread d17/d25/d32/d4b/d84/fb0 [0,4194304] 0 2024-09-13T23:06:32.736 INFO:tasks.workunit.client.1.smithi152.stdout:6/901: rename d4/de/d1d/deb/ce7 to d4/de/c123 0 2024-09-13T23:06:32.738 INFO:tasks.workunit.client.1.smithi152.stdout:6/902: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/d124 0 2024-09-13T23:06:32.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/915: dwrite d5/dc/d19/d20/d55/f75 [4194304,4194304] 0 2024-09-13T23:06:32.745 INFO:tasks.workunit.client.1.smithi152.stdout:5/916: getdents d5/dc 0 2024-09-13T23:06:32.750 INFO:tasks.workunit.client.1.smithi152.stdout:6/903: write d4/de/d1d/f37 [656186,80825] 0 2024-09-13T23:06:32.752 INFO:tasks.workunit.client.1.smithi152.stdout:6/904: creat d4/de/d12/d16/d2a/d3d/dde/f125 x:0 0 0 2024-09-13T23:06:32.754 INFO:tasks.workunit.client.1.smithi152.stdout:6/905: creat d4/de/d21/d5c/f126 x:0 0 0 2024-09-13T23:06:32.754 INFO:tasks.workunit.client.1.smithi152.stdout:6/906: stat d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/df9 0 2024-09-13T23:06:32.755 INFO:tasks.workunit.client.1.smithi152.stdout:6/907: symlink d4/de/d12/d16/d2a/d3d/d57/dc7/l127 0 2024-09-13T23:06:32.755 INFO:tasks.workunit.client.1.smithi152.stdout:5/917: dread d5/dc/d19/d65/d99/d98/f9c [0,4194304] 0 2024-09-13T23:06:32.756 INFO:tasks.workunit.client.1.smithi152.stdout:6/908: mknod d4/de/d12/d16/d2a/d3d/dcf/ded/c128 0 2024-09-13T23:06:32.756 INFO:tasks.workunit.client.1.smithi152.stdout:6/909: truncate d4/de/d12/d16/d2a/d3d/dcf/ddf/d104/f11e 307564 0 2024-09-13T23:06:32.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/918: creat d5/dc/d19/d65/d99/d98/de2/f12e x:0 0 0 2024-09-13T23:06:32.761 INFO:tasks.workunit.client.1.smithi152.stdout:8/789: dwrite d17/d25/d32/d50/f65 [4194304,4194304] 0 2024-09-13T23:06:32.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/919: rename d5/dc/l59 to d5/dc/d5e/l12f 0 2024-09-13T23:06:32.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/920: dread - d5/dc/d19/d65/d99/d98/dc2/fa8 zero size 2024-09-13T23:06:32.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/920: dwrite de/f13 [0,4194304] 0 2024-09-13T23:06:32.764 INFO:tasks.workunit.client.1.smithi152.stdout:6/910: rmdir d4/de/d1d/d79 39 2024-09-13T23:06:32.766 INFO:tasks.workunit.client.1.smithi152.stdout:5/921: mkdir d5/dc/d19/d65/d130 0 2024-09-13T23:06:32.768 INFO:tasks.workunit.client.1.smithi152.stdout:6/911: mknod d4/de/d12/d16/d2a/d38/c129 0 2024-09-13T23:06:32.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/912: chown d4/de/d12/d3e/la8 148104534 1 2024-09-13T23:06:32.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/913: write d4/de/d12/d16/d2a/d3d/dcf/ddf/fe5 [282129,47816] 0 2024-09-13T23:06:32.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/921: write de/d1f/f67 [1826976,93281] 0 2024-09-13T23:06:32.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/922: chown de/d14/f6d 408 1 2024-09-13T23:06:32.773 INFO:tasks.workunit.client.1.smithi152.stdout:3/923: symlink de/d14/d47/d57/l139 0 2024-09-13T23:06:32.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/924: link de/l61 de/d14/d47/d70/d87/ddd/l13a 0 2024-09-13T23:06:32.777 INFO:tasks.workunit.client.1.smithi152.stdout:3/925: fdatasync de/d14/f96 0 2024-09-13T23:06:32.777 INFO:tasks.workunit.client.1.smithi152.stdout:2/940: sync 2024-09-13T23:06:32.777 INFO:tasks.workunit.client.1.smithi152.stdout:5/922: dread d5/dc/d19/d65/d99/da6/dad/ff1 [0,4194304] 0 2024-09-13T23:06:32.777 INFO:tasks.workunit.client.1.smithi152.stdout:5/923: write d5/da/f58 [1116061,114589] 0 2024-09-13T23:06:32.778 INFO:tasks.workunit.client.1.smithi152.stdout:6/914: dread d4/de/d12/d3e/fa0 [0,4194304] 0 2024-09-13T23:06:32.778 INFO:tasks.workunit.client.1.smithi152.stdout:3/926: symlink de/d14/d47/l13b 0 2024-09-13T23:06:32.780 INFO:tasks.workunit.client.1.smithi152.stdout:2/941: mknod d0/d4/d9/d16/d30/d10c/c14b 0 2024-09-13T23:06:32.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/915: getdents d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/df9 0 2024-09-13T23:06:32.786 INFO:tasks.workunit.client.1.smithi152.stdout:2/942: mknod d0/d4/c14c 0 2024-09-13T23:06:32.786 INFO:tasks.workunit.client.1.smithi152.stdout:2/943: creat d0/d4/d9/d14/f14d x:0 0 0 2024-09-13T23:06:32.787 INFO:tasks.workunit.client.1.smithi152.stdout:2/944: stat d0/d4/d9/d55/f57 0 2024-09-13T23:06:32.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/916: link d4/de/l70 d4/de/d12/d8a/d118/l12a 0 2024-09-13T23:06:32.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/945: rmdir d0/d4/d9/d14/d48/dd1 39 2024-09-13T23:06:32.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/946: chown d0/d4/d9/f10 46494084 1 2024-09-13T23:06:32.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/947: truncate d0/d4/d9/d18/d1e/d3c/ff3 4676231 0 2024-09-13T23:06:32.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/948: chown d0/d4/d8a/d11a/l11b 3694639 1 2024-09-13T23:06:32.791 INFO:tasks.workunit.client.1.smithi152.stdout:2/949: creat d0/d4/d9/d16/d30/dba/f14e x:0 0 0 2024-09-13T23:06:32.795 INFO:tasks.workunit.client.1.smithi152.stdout:2/950: rename d0/d4/d9/d16/f91 to d0/d4/d9/d18/d1e/d3c/f14f 0 2024-09-13T23:06:32.796 INFO:tasks.workunit.client.1.smithi152.stdout:2/951: mknod d0/d4/d9/d16/d30/d9e/db5/c150 0 2024-09-13T23:06:32.797 INFO:tasks.workunit.client.1.smithi152.stdout:2/952: creat d0/d4/d9/d55/d12c/d14a/f151 x:0 0 0 2024-09-13T23:06:32.798 INFO:tasks.workunit.client.1.smithi152.stdout:2/953: creat d0/d4/d9/d18/d1e/d8c/f152 x:0 0 0 2024-09-13T23:06:32.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:32 smithi115 ceph-mon[27601]: pgmap v12: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 267 MiB/s rd, 344 MiB/s wr, 562 op/s 2024-09-13T23:06:32.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/954: symlink d0/d4/d9/d16/d30/d10c/d120/l153 0 2024-09-13T23:06:32.800 INFO:tasks.workunit.client.1.smithi152.stdout:2/955: readlink d0/d4/d9/l23 0 2024-09-13T23:06:32.808 INFO:tasks.workunit.client.1.smithi152.stdout:3/927: dwrite de/d14/d47/d70/dec/f12a [0,4194304] 0 2024-09-13T23:06:32.808 INFO:tasks.workunit.client.1.smithi152.stdout:6/917: dwrite d4/de/f2c [0,4194304] 0 2024-09-13T23:06:32.809 INFO:tasks.workunit.client.1.smithi152.stdout:6/918: mknod d4/de/d12/d16/d2a/d3d/d57/d8d/db1/c12b 0 2024-09-13T23:06:32.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/956: write d0/d4/d9/d18/d32/f5a [2186883,31705] 0 2024-09-13T23:06:32.811 INFO:tasks.workunit.client.1.smithi152.stdout:6/919: truncate d4/de/d12/d3e/fd6 3039492 0 2024-09-13T23:06:32.818 INFO:tasks.workunit.client.1.smithi152.stdout:2/957: link d0/d4/d9/d18/d32/l6d d0/d4/d9/d14/d48/d4a/l154 0 2024-09-13T23:06:32.818 INFO:tasks.workunit.client.1.smithi152.stdout:2/958: chown d0/d4/d9/d16/dd7/f112 1 1 2024-09-13T23:06:32.820 INFO:tasks.workunit.client.1.smithi152.stdout:6/920: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/d92/l12c 0 2024-09-13T23:06:32.821 INFO:tasks.workunit.client.1.smithi152.stdout:6/921: write d4/de/d12/d16/d2a/d3d/d57/f60 [7572410,71460] 0 2024-09-13T23:06:32.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/959: creat d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/f155 x:0 0 0 2024-09-13T23:06:32.826 INFO:tasks.workunit.client.1.smithi152.stdout:6/922: symlink d4/de/d12/d16/d2a/d3d/d11f/l12d 0 2024-09-13T23:06:32.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/923: mkdir d4/de/d1d/dce/d12e 0 2024-09-13T23:06:32.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/924: truncate d4/de/d21/fa3 1099489 0 2024-09-13T23:06:32.832 INFO:tasks.workunit.client.1.smithi152.stdout:6/925: creat d4/de/d12/f12f x:0 0 0 2024-09-13T23:06:32.838 INFO:tasks.workunit.client.1.smithi152.stdout:2/960: dwrite d0/d4/d9/d18/d1e/d3c/d4d/ddc/ffe [0,4194304] 0 2024-09-13T23:06:32.839 INFO:tasks.workunit.client.1.smithi152.stdout:6/926: mkdir d4/de/d12/d16/d2a/d3d/d130 0 2024-09-13T23:06:32.839 INFO:tasks.workunit.client.1.smithi152.stdout:6/927: dread - d4/de/d12/d8a/d118/dcc/f102 zero size 2024-09-13T23:06:32.855 INFO:tasks.workunit.client.1.smithi152.stdout:2/961: getdents d0/d4/d9/d18/d32 0 2024-09-13T23:06:32.857 INFO:tasks.workunit.client.1.smithi152.stdout:6/928: rename d4/de/d12/d16/d2a/l88 to d4/de/d12/d16/d2a/d3d/daa/l131 0 2024-09-13T23:06:32.858 INFO:tasks.workunit.client.1.smithi152.stdout:2/962: mkdir d0/d4/dca/d156 0 2024-09-13T23:06:32.860 INFO:tasks.workunit.client.1.smithi152.stdout:6/929: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/db1/l132 0 2024-09-13T23:06:32.860 INFO:tasks.workunit.client.1.smithi152.stdout:6/930: dread - d4/de/d1d/d79/ff0 zero size 2024-09-13T23:06:32.860 INFO:tasks.workunit.client.1.smithi152.stdout:6/931: truncate d4/de/d12/d16/d2a/d3d/d57/f81 1531023 0 2024-09-13T23:06:32.860 INFO:tasks.workunit.client.1.smithi152.stdout:6/932: creat d4/f133 x:0 0 0 2024-09-13T23:06:32.860 INFO:tasks.workunit.client.1.smithi152.stdout:2/963: mkdir d0/d4/dca/d156/d157 0 2024-09-13T23:06:32.861 INFO:tasks.workunit.client.1.smithi152.stdout:2/964: fdatasync d0/d4/d9/d16/d30/f3e 0 2024-09-13T23:06:32.867 INFO:tasks.workunit.client.1.smithi152.stdout:2/965: dread d0/d4/d9/d18/d1e/f1c [0,4194304] 0 2024-09-13T23:06:32.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/859: sync 2024-09-13T23:06:32.871 INFO:tasks.workunit.client.1.smithi152.stdout:0/860: fdatasync d18/d1f/d29/d2f/dd3/d101/d2c/f6d 0 2024-09-13T23:06:32.876 INFO:tasks.workunit.client.1.smithi152.stdout:2/966: write d0/d4/d9/d18/d1e/d3c/f8e [290160,96024] 0 2024-09-13T23:06:32.880 INFO:tasks.workunit.client.1.smithi152.stdout:0/861: dread d18/d8f/dc5/dd0/dd9/de3/fe8 [0,4194304] 0 2024-09-13T23:06:32.884 INFO:tasks.workunit.client.1.smithi152.stdout:0/862: mknod d18/d1f/d39/d106/c126 0 2024-09-13T23:06:32.886 INFO:tasks.workunit.client.1.smithi152.stdout:0/863: mkdir d18/d1f/d29/d3f/da0/d127 0 2024-09-13T23:06:32.886 INFO:tasks.workunit.client.1.smithi152.stdout:0/864: chown d18/f25 4587 1 2024-09-13T23:06:32.900 INFO:tasks.workunit.client.1.smithi152.stdout:2/967: dwrite d0/d4/d9/d18/d1e/d3c/f58 [0,4194304] 0 2024-09-13T23:06:32.900 INFO:tasks.workunit.client.1.smithi152.stdout:2/968: write d0/d4/d9/d14/d48/f118 [485899,9995] 0 2024-09-13T23:06:32.902 INFO:tasks.workunit.client.1.smithi152.stdout:2/969: link d0/d4/d9/d18/d1e/d3c/d88/db9/l134 d0/d4/d9/d14/d48/d49/l158 0 2024-09-13T23:06:32.908 INFO:tasks.workunit.client.1.smithi152.stdout:0/865: dwrite d18/d1f/d39/f43 [0,4194304] 0 2024-09-13T23:06:32.910 INFO:tasks.workunit.client.1.smithi152.stdout:8/790: sync 2024-09-13T23:06:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/970: write d0/d8/f138 [4590244,63259] 0 2024-09-13T23:06:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:8/791: dread d17/d25/d32/ff3 [0,4194304] 0 2024-09-13T23:06:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:8/792: write d17/d19/dac/fb9 [695486,63606] 0 2024-09-13T23:06:32.915 INFO:tasks.workunit.client.1.smithi152.stdout:0/866: write d18/d1f/d29/d3f/d4b/d66/d6a/f6b [3919489,90752] 0 2024-09-13T23:06:32.915 INFO:tasks.workunit.client.1.smithi152.stdout:0/867: chown d18/d1f/d29/d2f/dd3/d101/d74/da4/fab 431455726 1 2024-09-13T23:06:32.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/971: rename d0/d4/d9/d16/d30/fa9 to d0/f159 0 2024-09-13T23:06:32.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/972: readlink d0/d4/d9/d18/d1e/d3c/l111 0 2024-09-13T23:06:32.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/973: write d0/d4/d9/d18/d1e/d3c/d88/db9/f125 [200637,7918] 0 2024-09-13T23:06:32.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/974: chown d0/d4/d9/d16/dd7/f149 1541 1 2024-09-13T23:06:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/868: rename d18/d1f/d29/d2f/d3d/l103 to d18/d1f/d33/d6e/df7/d111/l128 0 2024-09-13T23:06:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:8/793: dread d17/d25/d32/d4b/f74 [0,4194304] 0 2024-09-13T23:06:32.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/975: mkdir d0/d4/d9/d55/d8f/d15a 0 2024-09-13T23:06:32.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/976: dread - d0/d4/d9/d55/fd2 zero size 2024-09-13T23:06:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:0/869: mknod d18/d1f/d33/d6e/df7/d111/d11c/c129 0 2024-09-13T23:06:32.925 INFO:tasks.workunit.client.1.smithi152.stdout:8/794: symlink d17/d25/d32/d4b/d84/lfe 0 2024-09-13T23:06:32.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/870: symlink d18/d1f/d33/d65/l12a 0 2024-09-13T23:06:32.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/871: write d18/d1f/fa9 [10013,70933] 0 2024-09-13T23:06:32.928 INFO:tasks.workunit.client.1.smithi152.stdout:0/872: write d18/d1f/d33/d65/d7a/d83/f86 [1978022,12476] 0 2024-09-13T23:06:32.933 INFO:tasks.workunit.client.1.smithi152.stdout:2/977: write d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/f123 [2152688,28728] 0 2024-09-13T23:06:32.937 INFO:tasks.workunit.client.1.smithi152.stdout:2/978: rename d0/d4/d9/d16/d9f/fe3 to d0/d4/d8a/d11a/f15b 0 2024-09-13T23:06:32.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/873: dread d18/d1f/d29/d2f/d3d/fa7 [0,4194304] 0 2024-09-13T23:06:32.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/874: truncate d18/d1f/d29/d2f/d3d/fa7 4645493 0 2024-09-13T23:06:32.940 INFO:tasks.workunit.client.1.smithi152.stdout:0/875: chown d18/d1f/d33/d65/d7a/d83/f86 100 1 2024-09-13T23:06:32.942 INFO:tasks.workunit.client.1.smithi152.stdout:8/795: dwrite d17/d25/d32/f38 [0,4194304] 0 2024-09-13T23:06:32.943 INFO:tasks.workunit.client.1.smithi152.stdout:0/876: rename d18/d8f/dc5 to d18/d1f/d29/d3f/d40/daa/d12b 0 2024-09-13T23:06:32.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/877: dread d18/d1f/fb1 [0,4194304] 0 2024-09-13T23:06:32.947 INFO:tasks.workunit.client.1.smithi152.stdout:8/796: rename d17/d25/d32/cc9 to d17/d25/d32/d50/dc2/cff 0 2024-09-13T23:06:32.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/797: write d17/f61 [4810311,84902] 0 2024-09-13T23:06:32.961 INFO:tasks.workunit.client.1.smithi152.stdout:2/979: dwrite d0/d8/f108 [0,4194304] 0 2024-09-13T23:06:32.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:32 smithi152 ceph-mon[34465]: pgmap v12: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 267 MiB/s rd, 344 MiB/s wr, 562 op/s 2024-09-13T23:06:32.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:32.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/980: dread d0/d4/d9/f9c [0,4194304] 0 2024-09-13T23:06:32.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/981: stat d0/d4/d9/d18/d1e/d3c/d4d/ddc/dee/f141 0 2024-09-13T23:06:32.977 INFO:tasks.workunit.client.1.smithi152.stdout:2/982: creat d0/d4/f15c x:0 0 0 2024-09-13T23:06:32.979 INFO:tasks.workunit.client.1.smithi152.stdout:2/983: mkdir d0/d4/d9/d18/d1e/d3c/d88/d15d 0 2024-09-13T23:06:32.979 INFO:tasks.workunit.client.1.smithi152.stdout:2/984: truncate d0/d4/d9/d18/d32/fb6 3363471 0 2024-09-13T23:06:32.979 INFO:tasks.workunit.client.1.smithi152.stdout:8/798: dwrite d17/d19/dac/fe6 [0,4194304] 0 2024-09-13T23:06:32.980 INFO:tasks.workunit.client.1.smithi152.stdout:2/985: stat d0/d4/d9/d14/d48/d49/l158 0 2024-09-13T23:06:32.991 INFO:tasks.workunit.client.1.smithi152.stdout:2/986: write d0/d4/d9/d55/d8f/fcd [866946,32939] 0 2024-09-13T23:06:32.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/799: symlink d17/d25/d32/d50/dea/l100 0 2024-09-13T23:06:32.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/800: dread - d17/d25/d32/d4b/d84/db2/fc0 zero size 2024-09-13T23:06:32.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/801: chown d17/d25/c40 1365 1 2024-09-13T23:06:32.996 INFO:tasks.workunit.client.1.smithi152.stdout:2/987: rename d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7/l122 to d0/d4/d9/d16/d30/d146/l15e 0 2024-09-13T23:06:33.006 INFO:tasks.workunit.client.1.smithi152.stdout:2/988: dread d0/d4/d9/d14/d48/d49/feb [0,4194304] 0 2024-09-13T23:06:33.015 INFO:tasks.workunit.client.1.smithi152.stdout:8/802: dwrite d17/d19/f56 [0,4194304] 0 2024-09-13T23:06:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/803: readlink d17/d19/l21 0 2024-09-13T23:06:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/804: readlink d17/d19/l21 0 2024-09-13T23:06:33.027 INFO:tasks.workunit.client.1.smithi152.stdout:8/805: dread d17/d25/d32/f4e [0,4194304] 0 2024-09-13T23:06:33.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/806: unlink d17/d19/f89 0 2024-09-13T23:06:33.029 INFO:tasks.workunit.client.1.smithi152.stdout:8/807: truncate d17/d25/d32/f38 3194832 0 2024-09-13T23:06:33.033 INFO:tasks.workunit.client.1.smithi152.stdout:0/878: dwrite d18/d1f/d29/d3f/d40/f4f [0,4194304] 0 2024-09-13T23:06:33.034 INFO:tasks.workunit.client.1.smithi152.stdout:2/989: dwrite d0/d4/d9/d18/d32/f5a [0,4194304] 0 2024-09-13T23:06:33.036 INFO:tasks.workunit.client.1.smithi152.stdout:0/879: mknod d18/d1f/d33/df5/c12c 0 2024-09-13T23:06:33.038 INFO:tasks.workunit.client.1.smithi152.stdout:0/880: dread d18/d1f/d29/f6f [0,4194304] 0 2024-09-13T23:06:33.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/881: rename d18/d1f/d29/d3f/d4b/d66/d6a/dc1/f100 to d18/d1f/d29/d3f/d4b/d66/d6a/d9f/d112/f12d 0 2024-09-13T23:06:33.058 INFO:tasks.workunit.client.1.smithi152.stdout:0/882: dread d18/d1f/d29/d2f/d3d/f49 [0,4194304] 0 2024-09-13T23:06:33.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/990: dwrite d0/d4/d9/d14/f34 [0,4194304] 0 2024-09-13T23:06:33.059 INFO:tasks.workunit.client.1.smithi152.stdout:2/991: read d0/d8/f138 [1662910,57305] 0 2024-09-13T23:06:33.061 INFO:tasks.workunit.client.1.smithi152.stdout:0/883: creat d18/d1f/d29/d2f/dd3/d101/d2c/f12e x:0 0 0 2024-09-13T23:06:33.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/992: mknod d0/d4/d9/d16/d30/d10c/d120/c15f 0 2024-09-13T23:06:33.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/993: fsync d0/d4/d9/d14/f14d 0 2024-09-13T23:06:33.064 INFO:tasks.workunit.client.1.smithi152.stdout:0/884: creat d18/d1f/d39/d7c/f12f x:0 0 0 2024-09-13T23:06:33.068 INFO:tasks.workunit.client.1.smithi152.stdout:2/994: unlink d0/c66 0 2024-09-13T23:06:33.070 INFO:tasks.workunit.client.1.smithi152.stdout:0/885: rmdir d18/d1f/d29/d3f/d40/d125 0 2024-09-13T23:06:33.075 INFO:tasks.workunit.client.1.smithi152.stdout:0/886: mkdir d18/d1f/d29/d3f/d4b/d66/d130 0 2024-09-13T23:06:33.080 INFO:tasks.workunit.client.1.smithi152.stdout:0/887: mkdir d18/d1f/d29/d131 0 2024-09-13T23:06:33.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/888: creat d18/d1f/d29/d3f/d40/daa/dbd/f132 x:0 0 0 2024-09-13T23:06:33.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/889: symlink d18/d1f/d29/d4e/d105/l133 0 2024-09-13T23:06:33.084 INFO:tasks.workunit.client.1.smithi152.stdout:0/890: mknod d18/d1f/d33/d65/c134 0 2024-09-13T23:06:33.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/891: creat d18/d1f/d33/d6e/df7/d111/f135 x:0 0 0 2024-09-13T23:06:33.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/892: stat d18/d1f/d29/f46 0 2024-09-13T23:06:33.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/893: chown la 30477 1 2024-09-13T23:06:33.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/995: dwrite d0/d4/d9/d14/f14d [0,4194304] 0 2024-09-13T23:06:33.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/996: rename d0/d4/d9/d18/d1e/d3c/d4d/ddc/df7 to d0/d4/d9/d55/d160 0 2024-09-13T23:06:33.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/997: fsync d0/d4/d9/d18/d32/fcb 0 2024-09-13T23:06:33.108 INFO:tasks.workunit.client.1.smithi152.stdout:0/894: dwrite d18/d1f/d29/d4e/fbe [0,4194304] 0 2024-09-13T23:06:33.110 INFO:tasks.workunit.client.1.smithi152.stdout:0/895: mknod d18/d1f/d33/d65/c136 0 2024-09-13T23:06:33.112 INFO:tasks.workunit.client.1.smithi152.stdout:0/896: mkdir d18/d1f/d29/d3f/d40/d137 0 2024-09-13T23:06:33.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/897: mknod d18/d1f/d29/d4e/dec/d102/c138 0 2024-09-13T23:06:33.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/898: fsync d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/fff 0 2024-09-13T23:06:33.114 INFO:tasks.workunit.client.1.smithi152.stdout:5/924: sync 2024-09-13T23:06:33.114 INFO:tasks.workunit.client.1.smithi152.stdout:3/928: sync 2024-09-13T23:06:33.114 INFO:tasks.workunit.client.1.smithi152.stdout:6/933: sync 2024-09-13T23:06:33.115 INFO:tasks.workunit.client.1.smithi152.stdout:6/934: stat d4/de/d1d/deb/d101 0 2024-09-13T23:06:33.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/998: dwrite d0/d4/d9/d55/f5f [4194304,4194304] 0 2024-09-13T23:06:33.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/999: read - d0/d4/d9/d18/d1e/d8c/fbb zero size 2024-09-13T23:06:33.120 INFO:tasks.workunit.client.1.smithi152.stdout:3/929: rename de/d14/d47/d70/d105 to de/d14/d38/d13c 0 2024-09-13T23:06:33.122 INFO:tasks.workunit.client.1.smithi152.stdout:5/925: truncate d5/dc/d19/d65/d99/d98/dc2/d80/fbf 103705 0 2024-09-13T23:06:33.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/935: mkdir d4/de/d12/d16/d134 0 2024-09-13T23:06:33.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/936: chown d4/f6 0 1 2024-09-13T23:06:33.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/937: mknod d4/de/d12/c135 0 2024-09-13T23:06:33.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/938: truncate d4/de/d12/d16/d2a/d3d/d57/d8d/fa1 544142 0 2024-09-13T23:06:33.129 INFO:tasks.workunit.client.1.smithi152.stdout:3/930: getdents de/d14/d47/d57/dc9 0 2024-09-13T23:06:33.129 INFO:tasks.workunit.client.1.smithi152.stdout:3/931: truncate de/d14/d47/d57/d5d/fb3 720895 0 2024-09-13T23:06:33.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/932: chown de/d14/d47/d70/d87/ddd/d128 7167 1 2024-09-13T23:06:33.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/933: truncate de/d63/f7d 4628440 0 2024-09-13T23:06:33.141 INFO:tasks.workunit.client.1.smithi152.stdout:5/926: dread d5/dc/d19/d65/d99/d98/dc2/d80/fbf [0,4194304] 0 2024-09-13T23:06:33.142 INFO:tasks.workunit.client.1.smithi152.stdout:0/899: dwrite d18/d1f/d33/f36 [0,4194304] 0 2024-09-13T23:06:33.146 INFO:tasks.workunit.client.1.smithi152.stdout:5/927: creat d5/dc/d19/d65/d130/f131 x:0 0 0 2024-09-13T23:06:33.148 INFO:tasks.workunit.client.1.smithi152.stdout:0/900: creat d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/d11b/f139 x:0 0 0 2024-09-13T23:06:33.149 INFO:tasks.workunit.client.1.smithi152.stdout:5/928: mknod d5/dc/d19/d65/d99/d98/dc2/c132 0 2024-09-13T23:06:33.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/901: mknod d18/d1f/d29/d3f/d40/c13a 0 2024-09-13T23:06:33.152 INFO:tasks.workunit.client.1.smithi152.stdout:5/929: creat d5/dc/d19/d65/d99/f133 x:0 0 0 2024-09-13T23:06:33.153 INFO:tasks.workunit.client.1.smithi152.stdout:0/902: mknod d18/d1f/d29/d131/c13b 0 2024-09-13T23:06:33.153 INFO:tasks.workunit.client.1.smithi152.stdout:0/903: dread - d18/d1f/d39/d7c/f12f zero size 2024-09-13T23:06:33.156 INFO:tasks.workunit.client.1.smithi152.stdout:0/904: link d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/de3/c10d d18/d1f/d29/d3f/d40/c13c 0 2024-09-13T23:06:33.159 INFO:tasks.workunit.client.1.smithi152.stdout:5/930: write d5/dc/d19/d20/d55/f9d [1101015,46185] 0 2024-09-13T23:06:33.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/931: fsync d5/f8 0 2024-09-13T23:06:33.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/932: creat d5/dc/da3/db4/db3/f134 x:0 0 0 2024-09-13T23:06:33.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/939: dwrite d4/de/d12/f5f [0,4194304] 0 2024-09-13T23:06:33.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/940: rename d4/de to d4/de/d12/d16/d2a/d3d/d57/d136 22 2024-09-13T23:06:33.160 INFO:tasks.workunit.client.1.smithi152.stdout:3/934: dwrite de/d14/d47/d57/d5d/fb3 [0,4194304] 0 2024-09-13T23:06:33.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/941: dread d4/de/d12/d16/d2a/d3d/d57/f81 [0,4194304] 0 2024-09-13T23:06:33.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/942: fdatasync d4/de/d12/d8a/f5e 0 2024-09-13T23:06:33.162 INFO:tasks.workunit.client.1.smithi152.stdout:5/933: symlink d5/d26/d61/d68/l135 0 2024-09-13T23:06:33.164 INFO:tasks.workunit.client.1.smithi152.stdout:0/905: dread f0 [0,4194304] 0 2024-09-13T23:06:33.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/943: symlink d4/de/d12/d16/d2a/d3d/dcf/ded/l137 0 2024-09-13T23:06:33.168 INFO:tasks.workunit.client.1.smithi152.stdout:3/935: dread de/d14/d47/d57/d93/f12f [0,4194304] 0 2024-09-13T23:06:33.169 INFO:tasks.workunit.client.1.smithi152.stdout:5/934: truncate d5/dc/d19/d20/d2e/d28/d92/f87 1172849 0 2024-09-13T23:06:33.170 INFO:tasks.workunit.client.1.smithi152.stdout:0/906: mkdir d18/d1f/d33/d6e/df7/d13d 0 2024-09-13T23:06:33.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/944: mkdir d4/de/d12/d16/d2a/d3d/dcf/d138 0 2024-09-13T23:06:33.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/945: truncate d4/de/d12/d8a/f5e 3307061 0 2024-09-13T23:06:33.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/946: symlink d4/de/d12/d16/d2a/d3d/l139 0 2024-09-13T23:06:33.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/947: readlink d4/de/d12/d16/d2a/d3d/d57/d8d/d92/l12c 0 2024-09-13T23:06:33.180 INFO:tasks.workunit.client.1.smithi152.stdout:0/907: getdents d18 0 2024-09-13T23:06:33.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/948: truncate d4/de/d21/f14 4538190 0 2024-09-13T23:06:33.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/949: readlink d4/de/d12/d16/d2a/d3d/d57/d8d/d92/lc8 0 2024-09-13T23:06:33.185 INFO:tasks.workunit.client.1.smithi152.stdout:6/950: getdents d4/de/d12/d16/d2a 0 2024-09-13T23:06:33.187 INFO:tasks.workunit.client.1.smithi152.stdout:5/935: dwrite d5/dc/d19/d65/d70/fd5 [0,4194304] 0 2024-09-13T23:06:33.189 INFO:tasks.workunit.client.1.smithi152.stdout:6/951: rename d4/de/d12/f1a to d4/de/d12/d3e/db3/f13a 0 2024-09-13T23:06:33.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/952: dwrite d4/de/d12/fd9 [0,4194304] 0 2024-09-13T23:06:33.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/953: chown d4/de/d12/d16/d2a/d3d/d11f/l12d 1018100 1 2024-09-13T23:06:33.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/936: dwrite d5/dc/d19/d65/d99/d98/da0/dc1/feb [0,4194304] 0 2024-09-13T23:06:33.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/937: fdatasync d5/dc/d19/d20/d2e/f34 0 2024-09-13T23:06:33.217 INFO:tasks.workunit.client.1.smithi152.stdout:6/954: mknod d4/de/d12/d16/d2a/d3d/dcf/c13b 0 2024-09-13T23:06:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/938: link d5/dc/da3/fc4 d5/d26/d61/de0/f136 0 2024-09-13T23:06:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/939: fsync d5/dc/da3/db4/db3/fcc 0 2024-09-13T23:06:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/940: creat d5/dc/d19/d65/d99/d98/da0/dc1/ddc/f137 x:0 0 0 2024-09-13T23:06:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/941: fdatasync d5/dc/d19/d65/d99/d98/da0/f105 0 2024-09-13T23:06:33.219 INFO:tasks.workunit.client.1.smithi152.stdout:5/942: write d5/dc/d19/d65/d70/f104 [441939,22120] 0 2024-09-13T23:06:33.220 INFO:tasks.workunit.client.1.smithi152.stdout:6/955: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/d13c 0 2024-09-13T23:06:33.220 INFO:tasks.workunit.client.1.smithi152.stdout:6/956: dread - d4/de/d12/d16/d2a/d38/d3c/fba zero size 2024-09-13T23:06:33.223 INFO:tasks.workunit.client.1.smithi152.stdout:5/943: mknod d5/dc/d19/c138 0 2024-09-13T23:06:33.225 INFO:tasks.workunit.client.1.smithi152.stdout:6/957: rename d4/de/d12/d8a/d118/dcc/f102 to d4/de/d1d/dce/f13d 0 2024-09-13T23:06:33.225 INFO:tasks.workunit.client.1.smithi152.stdout:6/958: write d4/de/d12/d16/d2a/d38/d3c/fba [540337,61702] 0 2024-09-13T23:06:33.225 INFO:tasks.workunit.client.1.smithi152.stdout:6/959: creat d4/de/d12/d16/d2a/d3d/daa/f13e x:0 0 0 2024-09-13T23:06:33.227 INFO:tasks.workunit.client.1.smithi152.stdout:5/944: mknod d5/dc/d19/d65/d99/da6/dad/dd8/df6/c139 0 2024-09-13T23:06:33.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/960: mkdir d4/de/d12/d16/d2a/d38/d13f 0 2024-09-13T23:06:33.232 INFO:tasks.workunit.client.1.smithi152.stdout:5/945: symlink d5/dc/d19/d65/d99/d98/dc2/l13a 0 2024-09-13T23:06:33.239 INFO:tasks.workunit.client.1.smithi152.stdout:5/946: mkdir d5/dc/da3/db4/d7f/d13b 0 2024-09-13T23:06:33.241 INFO:tasks.workunit.client.1.smithi152.stdout:6/961: link d4/de/d12/f28 d4/de/d12/d16/d2a/d3d/d57/d8d/f140 0 2024-09-13T23:06:33.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/947: dread d5/f5a [0,4194304] 0 2024-09-13T23:06:33.247 INFO:tasks.workunit.client.1.smithi152.stdout:6/962: dread d4/de/d12/d16/d2a/d38/d3c/fba [0,4194304] 0 2024-09-13T23:06:33.263 INFO:tasks.workunit.client.1.smithi152.stdout:5/948: dwrite d5/dc/da3/db4/f125 [0,4194304] 0 2024-09-13T23:06:33.263 INFO:tasks.workunit.client.1.smithi152.stdout:5/949: chown d5/dc/d19/d65/d99/da6/c3b 16523755 1 2024-09-13T23:06:33.263 INFO:tasks.workunit.client.1.smithi152.stdout:5/950: chown d5/dc/f5b 109803274 1 2024-09-13T23:06:33.263 INFO:tasks.workunit.client.1.smithi152.stdout:5/951: fdatasync d5/dc/fe 0 2024-09-13T23:06:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:5/952: mkdir d5/dc/d19/d13c 0 2024-09-13T23:06:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:5/953: write d5/dc/d19/d65/d99/da6/f7a [507438,25608] 0 2024-09-13T23:06:33.282 INFO:tasks.workunit.client.1.smithi152.stdout:5/954: dwrite d5/dc/d19/d65/d99/d98/da0/f105 [0,4194304] 0 2024-09-13T23:06:33.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/955: dwrite d5/dc/d19/d65/d99/d98/da0/dc1/feb [0,4194304] 0 2024-09-13T23:06:33.321 INFO:tasks.workunit.client.1.smithi152.stdout:5/956: dwrite d5/dc/d19/d65/d99/da6/dad/fb0 [0,4194304] 0 2024-09-13T23:06:33.322 INFO:tasks.workunit.client.1.smithi152.stdout:5/957: rmdir d5/d26/d61/de0 39 2024-09-13T23:06:33.322 INFO:tasks.workunit.client.1.smithi152.stdout:5/958: dread - d5/dc/d19/d65/d99/d98/de2/f12e zero size 2024-09-13T23:06:33.336 INFO:tasks.workunit.client.1.smithi152.stdout:5/959: dwrite d5/dc/d19/d65/d99/d98/da0/dc1/feb [0,4194304] 0 2024-09-13T23:06:33.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/960: rmdir d5/dc/d19/d20/d2e/d28/d92 39 2024-09-13T23:06:33.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/961: fdatasync d5/ff0 0 2024-09-13T23:06:33.351 INFO:tasks.workunit.client.1.smithi152.stdout:5/962: dwrite d5/d26/d61/de0/f136 [0,4194304] 0 2024-09-13T23:06:33.352 INFO:tasks.workunit.client.1.smithi152.stdout:8/808: sync 2024-09-13T23:06:33.354 INFO:tasks.workunit.client.1.smithi152.stdout:5/963: rmdir d5/dc/d19/d65/d99/da6 39 2024-09-13T23:06:33.355 INFO:tasks.workunit.client.1.smithi152.stdout:8/809: symlink d17/d25/d80/l101 0 2024-09-13T23:06:33.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/964: rename f0 to d5/dc/d19/d65/d99/da6/f13d 0 2024-09-13T23:06:33.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/965: chown d5/dc/d19/d20/d2e/d28/d92/c102 5 1 2024-09-13T23:06:33.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/966: chown d5/dc/d19/d65/d130 1000140 1 2024-09-13T23:06:33.358 INFO:tasks.workunit.client.1.smithi152.stdout:8/810: symlink d17/d25/d32/d4b/d84/d91/l102 0 2024-09-13T23:06:33.358 INFO:tasks.workunit.client.1.smithi152.stdout:8/811: fsync d17/d25/d32/d50/dc2/f9f 0 2024-09-13T23:06:33.359 INFO:tasks.workunit.client.1.smithi152.stdout:5/967: getdents d5/dc/d19/d65/d99/d98/dc2/d80 0 2024-09-13T23:06:33.361 INFO:tasks.workunit.client.1.smithi152.stdout:8/812: creat d17/d25/d32/d4b/d84/d91/d9c/dfd/f103 x:0 0 0 2024-09-13T23:06:33.361 INFO:tasks.workunit.client.1.smithi152.stdout:8/813: readlink d17/d25/d32/dba/le5 0 2024-09-13T23:06:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:8/814: mknod d17/d25/d32/d50/dea/c104 0 2024-09-13T23:06:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:8/815: readlink d17/d25/d32/d4b/ld2 0 2024-09-13T23:06:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:8/816: write d17/ddb/fda [971,119460] 0 2024-09-13T23:06:33.364 INFO:tasks.workunit.client.1.smithi152.stdout:8/817: rename d17/f2c to d17/d25/d32/d50/dc2/f105 0 2024-09-13T23:06:33.365 INFO:tasks.workunit.client.1.smithi152.stdout:8/818: creat d17/d19/f106 x:0 0 0 2024-09-13T23:06:33.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/968: write d5/dc/d19/d65/d70/fd5 [1612952,29401] 0 2024-09-13T23:06:33.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/969: readlink d5/dc/d19/d65/d70/ld6 0 2024-09-13T23:06:33.368 INFO:tasks.workunit.client.1.smithi152.stdout:5/970: symlink d5/dc/da3/db4/db3/l13e 0 2024-09-13T23:06:33.368 INFO:tasks.workunit.client.1.smithi152.stdout:5/971: fsync d5/d26/d61/de0/f136 0 2024-09-13T23:06:33.368 INFO:tasks.workunit.client.1.smithi152.stdout:8/819: getdents d17/d19/dac 0 2024-09-13T23:06:33.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/972: truncate d5/ff0 3903858 0 2024-09-13T23:06:33.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/973: chown d5/dc/d19/d20/d2e/d28/f2f 4 1 2024-09-13T23:06:33.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/974: chown d5/dc/d19/d65/d130 262925 1 2024-09-13T23:06:33.371 INFO:tasks.workunit.client.1.smithi152.stdout:8/820: creat d17/d25/d32/d4b/d84/f107 x:0 0 0 2024-09-13T23:06:33.372 INFO:tasks.workunit.client.1.smithi152.stdout:8/821: write d17/d25/d32/f54 [5501304,111102] 0 2024-09-13T23:06:33.374 INFO:tasks.workunit.client.1.smithi152.stdout:5/975: rename d5/dc/da3/db4/d7f to d5/dc/d19/d65/d99/d98/dc2/d80/dfc/d13f 0 2024-09-13T23:06:33.374 INFO:tasks.workunit.client.1.smithi152.stdout:5/976: creat d5/dc/d19/d20/d2e/d28/f140 x:0 0 0 2024-09-13T23:06:33.375 INFO:tasks.workunit.client.1.smithi152.stdout:8/822: creat d17/ddb/f108 x:0 0 0 2024-09-13T23:06:33.379 INFO:tasks.workunit.client.1.smithi152.stdout:8/823: link d17/d25/d32/d50/dd9/ff0 d17/d25/d32/d50/f109 0 2024-09-13T23:06:33.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/824: dread d17/d25/d32/f54 [0,4194304] 0 2024-09-13T23:06:33.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/825: dread - d17/d25/d32/d4b/d84/d91/ff7 zero size 2024-09-13T23:06:33.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/826: write d17/d25/d32/f63 [4235224,70519] 0 2024-09-13T23:06:33.391 INFO:tasks.workunit.client.1.smithi152.stdout:8/827: fsync d17/d25/d32/dba/ddd/ffc 0 2024-09-13T23:06:33.393 INFO:tasks.workunit.client.1.smithi152.stdout:5/977: dwrite d5/dc/d19/d65/d70/fd5 [0,4194304] 0 2024-09-13T23:06:33.393 INFO:tasks.workunit.client.1.smithi152.stdout:5/978: truncate d5/dc/d19/d20/d2e/d28/d92/fce 1526730 0 2024-09-13T23:06:33.397 INFO:tasks.workunit.client.1.smithi152.stdout:5/979: mkdir d5/dc/d19/d65/d99/d98/da0/d10f/d141 0 2024-09-13T23:06:33.402 INFO:tasks.workunit.client.1.smithi152.stdout:8/828: write d17/d25/d32/d50/dc2/f105 [3238436,46956] 0 2024-09-13T23:06:33.403 INFO:tasks.workunit.client.1.smithi152.stdout:8/829: fdatasync d17/faf 0 2024-09-13T23:06:33.403 INFO:tasks.workunit.client.1.smithi152.stdout:8/830: chown d17/ddb/df5/ff8 3 1 2024-09-13T23:06:33.403 INFO:tasks.workunit.client.1.smithi152.stdout:8/831: stat d17/d25/d32/d9a/l36 0 2024-09-13T23:06:33.404 INFO:tasks.workunit.client.1.smithi152.stdout:8/832: creat d17/d25/d32/d50/dc2/f10a x:0 0 0 2024-09-13T23:06:33.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/908: sync 2024-09-13T23:06:33.405 INFO:tasks.workunit.client.1.smithi152.stdout:6/963: sync 2024-09-13T23:06:33.405 INFO:tasks.workunit.client.1.smithi152.stdout:0/909: chown l7 0 1 2024-09-13T23:06:33.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/936: sync 2024-09-13T23:06:33.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/937: chown de/d14/d38/f1a 944 1 2024-09-13T23:06:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/910: creat d18/d1f/d33/d6e/df7/d111/d11c/f13e x:0 0 0 2024-09-13T23:06:33.408 INFO:tasks.workunit.client.1.smithi152.stdout:3/938: rename de/d1f/da2/dcb/lf6 to de/d14/d47/d70/dca/df5/d12c/l13d 0 2024-09-13T23:06:33.418 INFO:tasks.workunit.client.1.smithi152.stdout:3/939: dread de/d14/d47/d57/f80 [0,4194304] 0 2024-09-13T23:06:33.419 INFO:tasks.workunit.client.1.smithi152.stdout:3/940: dread de/d14/d47/d70/f73 [0,4194304] 0 2024-09-13T23:06:33.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/941: link de/d1f/l138 de/d14/d47/d70/d87/ddd/l13e 0 2024-09-13T23:06:33.424 INFO:tasks.workunit.client.1.smithi152.stdout:0/911: dread d18/d1f/d29/d2f/d3d/f49 [0,4194304] 0 2024-09-13T23:06:33.428 INFO:tasks.workunit.client.1.smithi152.stdout:0/912: dread d18/d1f/d29/d2f/dd3/d101/d2c/f5d [4194304,4194304] 0 2024-09-13T23:06:33.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/833: dwrite d17/d25/d32/d4b/f7d [0,4194304] 0 2024-09-13T23:06:33.430 INFO:tasks.workunit.client.1.smithi152.stdout:5/980: dwrite d5/dc/d19/d65/d99/da6/fb7 [0,4194304] 0 2024-09-13T23:06:33.431 INFO:tasks.workunit.client.1.smithi152.stdout:5/981: fsync d5/f8 0 2024-09-13T23:06:33.431 INFO:tasks.workunit.client.1.smithi152.stdout:5/982: chown d5/dc/d19/d65/d99/d98/dc2/d80/dfc/d13f 3400455 1 2024-09-13T23:06:33.431 INFO:tasks.workunit.client.1.smithi152.stdout:6/964: dwrite d4/de/d12/d16/d2a/d38/f42 [0,4194304] 0 2024-09-13T23:06:33.431 INFO:tasks.workunit.client.1.smithi152.stdout:6/965: truncate d4/de/d12/d16/d2a/d3d/d57/f81 2144051 0 2024-09-13T23:06:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/983: mknod d5/dc/da3/db4/db3/d11c/c142 0 2024-09-13T23:06:33.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/966: creat d4/de/d21/d5c/dc9/f141 x:0 0 0 2024-09-13T23:06:33.437 INFO:tasks.workunit.client.1.smithi152.stdout:5/984: symlink d5/d26/l143 0 2024-09-13T23:06:33.437 INFO:tasks.workunit.client.1.smithi152.stdout:5/985: chown d5/l90 185795 1 2024-09-13T23:06:33.438 INFO:tasks.workunit.client.1.smithi152.stdout:6/967: creat d4/de/d12/d3e/f142 x:0 0 0 2024-09-13T23:06:33.444 INFO:tasks.workunit.client.1.smithi152.stdout:5/986: dread d5/dc/d19/d20/d2e/d28/d92/f87 [0,4194304] 0 2024-09-13T23:06:33.445 INFO:tasks.workunit.client.1.smithi152.stdout:5/987: mkdir d5/dc/d19/d65/d99/da6/dad/d144 0 2024-09-13T23:06:33.446 INFO:tasks.workunit.client.1.smithi152.stdout:5/988: write d5/dc/d19/d65/d70/f104 [223113,65539] 0 2024-09-13T23:06:33.446 INFO:tasks.workunit.client.1.smithi152.stdout:3/942: dwrite de/d14/d47/d57/f64 [0,4194304] 0 2024-09-13T23:06:33.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/943: write de/d14/d47/d57/f8f [216228,101004] 0 2024-09-13T23:06:33.447 INFO:tasks.workunit.client.1.smithi152.stdout:5/989: mkdir d5/dc/d19/d20/d2e/d28/d92/d145 0 2024-09-13T23:06:33.450 INFO:tasks.workunit.client.1.smithi152.stdout:3/944: symlink de/d14/d38/l13f 0 2024-09-13T23:06:33.452 INFO:tasks.workunit.client.1.smithi152.stdout:5/990: rename d5/dc/d19/d65/l3e to d5/dc/d19/d65/d99/d98/dc2/d82/l146 0 2024-09-13T23:06:33.454 INFO:tasks.workunit.client.1.smithi152.stdout:5/991: creat d5/dc/d19/d65/d99/d98/dc2/d80/dfc/f147 x:0 0 0 2024-09-13T23:06:33.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/992: mknod d5/d26/d61/de0/c148 0 2024-09-13T23:06:33.457 INFO:tasks.workunit.client.1.smithi152.stdout:0/913: dwrite d18/f26 [0,4194304] 0 2024-09-13T23:06:33.457 INFO:tasks.workunit.client.1.smithi152.stdout:0/914: dread - d18/d1f/d29/d2f/dd3/d101/d74/f122 zero size 2024-09-13T23:06:33.457 INFO:tasks.workunit.client.1.smithi152.stdout:5/993: symlink d5/d26/d61/l149 0 2024-09-13T23:06:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:0/915: unlink d18/d8f/cca 0 2024-09-13T23:06:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:8/834: dwrite d17/d19/ff6 [0,4194304] 0 2024-09-13T23:06:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:8/835: write d17/fd5 [838209,121615] 0 2024-09-13T23:06:33.461 INFO:tasks.workunit.client.1.smithi152.stdout:6/968: dwrite d4/de/f39 [0,4194304] 0 2024-09-13T23:06:33.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/916: symlink d18/d1f/d29/d2f/dd3/d101/d74/da4/l13f 0 2024-09-13T23:06:33.467 INFO:tasks.workunit.client.1.smithi152.stdout:6/969: creat d4/de/d12/d16/d2a/d3d/f143 x:0 0 0 2024-09-13T23:06:33.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/970: truncate d4/de/d12/d3e/f91 1568053 0 2024-09-13T23:06:33.469 INFO:tasks.workunit.client.1.smithi152.stdout:5/994: dread d5/dc/d19/d65/d99/d98/da0/f105 [0,4194304] 0 2024-09-13T23:06:33.472 INFO:tasks.workunit.client.1.smithi152.stdout:6/971: mkdir d4/de/d12/d16/d144 0 2024-09-13T23:06:33.472 INFO:tasks.workunit.client.1.smithi152.stdout:6/972: dread - d4/de/d12/f12f zero size 2024-09-13T23:06:33.473 INFO:tasks.workunit.client.1.smithi152.stdout:0/917: write d18/d1f/d29/d2f/dd3/d101/d2c/f5d [2360976,78422] 0 2024-09-13T23:06:33.474 INFO:tasks.workunit.client.1.smithi152.stdout:6/973: creat d4/de/d12/d16/d2a/d3d/d57/d8d/d92/f145 x:0 0 0 2024-09-13T23:06:33.474 INFO:tasks.workunit.client.1.smithi152.stdout:6/974: readlink d4/de/d12/d8a/d118/l12a 0 2024-09-13T23:06:33.477 INFO:tasks.workunit.client.1.smithi152.stdout:6/975: creat d4/de/d12/d16/d134/f146 x:0 0 0 2024-09-13T23:06:33.478 INFO:tasks.workunit.client.1.smithi152.stdout:0/918: rmdir d18/d1f/d29/d3f/d4b/d66/d6a 39 2024-09-13T23:06:33.479 INFO:tasks.workunit.client.1.smithi152.stdout:6/976: symlink d4/de/d21/d5c/l147 0 2024-09-13T23:06:33.487 INFO:tasks.workunit.client.1.smithi152.stdout:6/977: dread d4/f6 [0,4194304] 0 2024-09-13T23:06:33.487 INFO:tasks.workunit.client.1.smithi152.stdout:6/978: fsync d4/de/d21/f14 0 2024-09-13T23:06:33.487 INFO:tasks.workunit.client.1.smithi152.stdout:6/979: readlink d4/de/d12/d16/d2a/d3d/d57/d8d/db1/l132 0 2024-09-13T23:06:33.491 INFO:tasks.workunit.client.1.smithi152.stdout:6/980: mknod d4/de/d12/c148 0 2024-09-13T23:06:33.491 INFO:tasks.workunit.client.1.smithi152.stdout:6/981: write d4/de/d12/d16/d2a/d38/d3c/f45 [9426146,87231] 0 2024-09-13T23:06:33.494 INFO:tasks.workunit.client.1.smithi152.stdout:6/982: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/db1/ddd/d120/d149 0 2024-09-13T23:06:33.518 INFO:tasks.workunit.client.1.smithi152.stdout:6/983: dwrite d4/de/d12/d16/d2a/d3d/d57/d8d/f140 [0,4194304] 0 2024-09-13T23:06:33.519 INFO:tasks.workunit.client.1.smithi152.stdout:6/984: mkdir d4/de/d1d/deb/d14a 0 2024-09-13T23:06:33.533 INFO:tasks.workunit.client.1.smithi152.stdout:6/985: dwrite d4/de/d12/d16/f9c [0,4194304] 0 2024-09-13T23:06:33.535 INFO:tasks.workunit.client.1.smithi152.stdout:6/986: symlink d4/de/d12/d16/d2a/d3d/d57/d8d/l14b 0 2024-09-13T23:06:33.536 INFO:tasks.workunit.client.1.smithi152.stdout:6/987: truncate d4/de/d12/d16/d2a/d38/d3c/fba 371644 0 2024-09-13T23:06:33.537 INFO:tasks.workunit.client.1.smithi152.stdout:6/988: creat d4/de/d12/d16/d2a/d38/d13f/f14c x:0 0 0 2024-09-13T23:06:33.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/989: mknod d4/de/d12/d16/d2a/d3d/dcf/ded/c14d 0 2024-09-13T23:06:33.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/990: chown d4/de/d21/f7c 859900 1 2024-09-13T23:06:33.542 INFO:tasks.workunit.client.1.smithi152.stdout:6/991: rename d4/de/d12/d16/d2a/d3d/d57/d8d/ddc/ce4 to d4/de/d12/d16/d134/c14e 0 2024-09-13T23:06:33.556 INFO:tasks.workunit.client.1.smithi152.stdout:6/992: dwrite d4/de/d12/d16/d2a/d3d/d57/d8d/db1/fb7 [0,4194304] 0 2024-09-13T23:06:33.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/993: dwrite d4/de/d12/d16/d2a/d3d/dcf/ddf/f10f [0,4194304] 0 2024-09-13T23:06:33.574 INFO:tasks.workunit.client.1.smithi152.stdout:6/994: mkdir d4/de/d12/d16/d2a/d3d/d57/d8d/d14f 0 2024-09-13T23:06:33.574 INFO:tasks.workunit.client.1.smithi152.stdout:6/995: creat d4/de/d12/d16/d2a/d3d/dde/f150 x:0 0 0 2024-09-13T23:06:33.576 INFO:tasks.workunit.client.1.smithi152.stdout:6/996: symlink d4/de/d1d/d79/l151 0 2024-09-13T23:06:33.592 INFO:tasks.workunit.client.1.smithi152.stdout:6/997: dwrite d4/de/fcd [0,4194304] 0 2024-09-13T23:06:33.592 INFO:tasks.workunit.client.1.smithi152.stdout:6/998: creat d4/de/d12/d16/d2a/d3d/d57/dc7/f152 x:0 0 0 2024-09-13T23:06:33.592 INFO:tasks.workunit.client.1.smithi152.stdout:6/999: fsync d4/de/d12/d16/d2a/d3d/dcf/ddf/d104/f11e 0 2024-09-13T23:06:33.619 INFO:tasks.workunit.client.1.smithi152.stdout:3/945: sync 2024-09-13T23:06:33.625 INFO:tasks.workunit.client.1.smithi152.stdout:3/946: read de/d14/d47/d70/d87/fc3 [1829741,80833] 0 2024-09-13T23:06:33.642 INFO:tasks.workunit.client.1.smithi152.stdout:5/995: sync 2024-09-13T23:06:33.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/836: sync 2024-09-13T23:06:33.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/837: fsync d17/d19/dac/fe6 0 2024-09-13T23:06:33.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/838: stat d17/f77 0 2024-09-13T23:06:33.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/839: dread - d17/d25/d80/da3/fb1 zero size 2024-09-13T23:06:33.643 INFO:tasks.workunit.client.1.smithi152.stdout:5/996: write d5/dc/d19/d65/d70/f73 [3035339,45550] 0 2024-09-13T23:06:33.643 INFO:tasks.workunit.client.1.smithi152.stdout:5/997: fsync d5/dc/d19/d65/d99/da6/f56 0 2024-09-13T23:06:33.644 INFO:tasks.workunit.client.1.smithi152.stdout:8/840: dread d17/d19/f4d [0,4194304] 0 2024-09-13T23:06:33.646 INFO:tasks.workunit.client.1.smithi152.stdout:8/841: mkdir d17/d25/d80/d10b 0 2024-09-13T23:06:33.653 INFO:tasks.workunit.client.1.smithi152.stdout:8/842: write d17/d25/d32/d4b/d84/d91/d9c/fc7 [1811652,21490] 0 2024-09-13T23:06:33.661 INFO:tasks.workunit.client.1.smithi152.stdout:8/843: dread d17/d25/d32/d9a/f2b [0,4194304] 0 2024-09-13T23:06:33.671 INFO:tasks.workunit.client.1.smithi152.stdout:5/998: dwrite d5/dc/f30 [0,4194304] 0 2024-09-13T23:06:33.673 INFO:tasks.workunit.client.1.smithi152.stdout:5/999: symlink d5/dc/d19/d65/d99/l14a 0 2024-09-13T23:06:33.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/844: dwrite d17/d25/d32/f63 [0,4194304] 0 2024-09-13T23:06:33.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/845: fsync d17/d25/d32/dba/ddd/fe2 0 2024-09-13T23:06:33.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/846: chown d17/d25/d32/d4b/d84/d91/l102 531111219 1 2024-09-13T23:06:33.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/847: chown d17/d19/l21 8770 1 2024-09-13T23:06:33.690 INFO:tasks.workunit.client.1.smithi152.stdout:8/848: dwrite d17/d25/d32/d4b/d84/d91/d9c/dfd/f103 [0,4194304] 0 2024-09-13T23:06:33.695 INFO:tasks.workunit.client.1.smithi152.stdout:8/849: getdents d17/d25/d32/d50/dd9 0 2024-09-13T23:06:33.696 INFO:tasks.workunit.client.1.smithi152.stdout:8/850: mkdir d17/d25/d32/dba/ddd/d10c 0 2024-09-13T23:06:33.698 INFO:tasks.workunit.client.1.smithi152.stdout:8/851: dread d17/d25/d32/d4b/d84/db2/fc5 [0,4194304] 0 2024-09-13T23:06:33.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/852: symlink d17/d25/d32/d4b/d84/d91/df2/de9/l10d 0 2024-09-13T23:06:33.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/853: truncate d17/d25/d32/d50/dd9/ff0 144977 0 2024-09-13T23:06:33.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/854: mkdir d17/d25/d32/d44/d10e 0 2024-09-13T23:06:33.709 INFO:tasks.workunit.client.1.smithi152.stdout:8/855: dread d17/d25/d32/d4b/d84/d91/d9c/dfd/f103 [0,4194304] 0 2024-09-13T23:06:33.710 INFO:tasks.workunit.client.1.smithi152.stdout:0/919: sync 2024-09-13T23:06:33.712 INFO:tasks.workunit.client.1.smithi152.stdout:0/920: symlink d18/d1f/d29/d2f/dd3/l140 0 2024-09-13T23:06:33.713 INFO:tasks.workunit.client.1.smithi152.stdout:0/921: symlink d18/d1f/d39/d106/l141 0 2024-09-13T23:06:33.715 INFO:tasks.workunit.client.1.smithi152.stdout:0/922: mkdir d18/d1f/d29/d3f/d40/daa/d12b/dd0/d142 0 2024-09-13T23:06:33.716 INFO:tasks.workunit.client.1.smithi152.stdout:0/923: mkdir d18/d1f/d29/d2f/d3d/da1/d143 0 2024-09-13T23:06:33.716 INFO:tasks.workunit.client.1.smithi152.stdout:0/924: fsync f13 0 2024-09-13T23:06:33.716 INFO:tasks.workunit.client.1.smithi152.stdout:0/925: chown d18/d1f/f20 11897 1 2024-09-13T23:06:33.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/926: symlink d18/d1f/d29/d2f/dd3/d101/d2c/l144 0 2024-09-13T23:06:33.723 INFO:tasks.workunit.client.1.smithi152.stdout:8/856: dwrite d17/d25/d32/dba/ddd/fe2 [0,4194304] 0 2024-09-13T23:06:33.728 INFO:tasks.workunit.client.1.smithi152.stdout:0/927: dread d18/d1f/d39/f76 [0,4194304] 0 2024-09-13T23:06:33.729 INFO:tasks.workunit.client.1.smithi152.stdout:0/928: getdents d18/d1f/d33/d6e/df7 0 2024-09-13T23:06:33.730 INFO:tasks.workunit.client.1.smithi152.stdout:0/929: mkdir d18/d1f/d29/d3f/d4b/d145 0 2024-09-13T23:06:33.731 INFO:tasks.workunit.client.1.smithi152.stdout:0/930: mkdir d18/d1f/d29/d2f/dd3/d101/d74/d146 0 2024-09-13T23:06:33.733 INFO:tasks.workunit.client.1.smithi152.stdout:3/947: sync 2024-09-13T23:06:33.733 INFO:tasks.workunit.client.1.smithi152.stdout:3/948: fdatasync de/d14/f5b 0 2024-09-13T23:06:33.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/931: rmdir d18/d1f/d29/d4e 39 2024-09-13T23:06:33.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/932: fdatasync d18/d1f/d29/d3f/d4b/f57 0 2024-09-13T23:06:33.734 INFO:tasks.workunit.client.1.smithi152.stdout:3/949: unlink de/d14/d47/d70/dca/f132 0 2024-09-13T23:06:33.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/933: symlink d18/d1f/d29/d2f/d3d/da1/l147 0 2024-09-13T23:06:33.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/934: write d18/d1f/d33/df5/ffd [51338,76139] 0 2024-09-13T23:06:33.735 INFO:tasks.workunit.client.1.smithi152.stdout:3/950: mknod de/d14/d47/d70/dca/d11e/c140 0 2024-09-13T23:06:33.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/935: mknod d18/d1f/d29/d131/c148 0 2024-09-13T23:06:33.736 INFO:tasks.workunit.client.1.smithi152.stdout:3/951: mknod de/d14/d47/d70/dca/df5/c141 0 2024-09-13T23:06:33.736 INFO:tasks.workunit.client.1.smithi152.stdout:8/857: dwrite d17/d19/f98 [0,4194304] 0 2024-09-13T23:06:33.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/936: symlink d18/d1f/d33/d65/d7a/d83/l149 0 2024-09-13T23:06:33.740 INFO:tasks.workunit.client.1.smithi152.stdout:8/858: dread d17/d25/d32/f54 [4194304,4194304] 0 2024-09-13T23:06:33.740 INFO:tasks.workunit.client.1.smithi152.stdout:3/952: mkdir de/d14/d47/d57/d5d/d6e/df2/d142 0 2024-09-13T23:06:33.740 INFO:tasks.workunit.client.1.smithi152.stdout:3/953: fdatasync de/d14/d47/d70/f78 0 2024-09-13T23:06:33.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/954: creat de/d1f/da2/dcb/de6/f143 x:0 0 0 2024-09-13T23:06:33.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/955: getdents de/d14/d47/d57/d5d/dcc 0 2024-09-13T23:06:33.746 INFO:tasks.workunit.client.1.smithi152.stdout:8/859: mkdir d17/d19/d10f 0 2024-09-13T23:06:33.760 INFO:tasks.workunit.client.1.smithi152.stdout:0/937: dwrite d18/d1f/d29/d3f/d40/daa/fcb [0,4194304] 0 2024-09-13T23:06:33.760 INFO:tasks.workunit.client.1.smithi152.stdout:0/938: chown d18/d1f/d39/d7c/l121 11654 1 2024-09-13T23:06:33.762 INFO:tasks.workunit.client.1.smithi152.stdout:0/939: creat d18/d1f/d29/d131/f14a x:0 0 0 2024-09-13T23:06:33.762 INFO:tasks.workunit.client.1.smithi152.stdout:0/940: rename d18 to d18/d1f/d29/d131/d14b 22 2024-09-13T23:06:33.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/860: dwrite d17/faf [0,4194304] 0 2024-09-13T23:06:33.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/956: dwrite de/d14/d47/d70/d72/fbf [0,4194304] 0 2024-09-13T23:06:33.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/957: fsync de/d14/d38/fa3 0 2024-09-13T23:06:33.771 INFO:tasks.workunit.client.1.smithi152.stdout:8/861: truncate d17/d25/d32/dba/ddd/fe2 3035606 0 2024-09-13T23:06:33.774 INFO:tasks.workunit.client.1.smithi152.stdout:3/958: unlink de/l131 0 2024-09-13T23:06:33.775 INFO:tasks.workunit.client.1.smithi152.stdout:0/941: dwrite d18/d1f/d29/d3f/d40/daa/dbd/f132 [0,4194304] 0 2024-09-13T23:06:33.775 INFO:tasks.workunit.client.1.smithi152.stdout:0/942: read - d18/d1f/d29/d2f/d3d/da1/feb zero size 2024-09-13T23:06:33.778 INFO:tasks.workunit.client.1.smithi152.stdout:3/959: rename de/d1f/l23 to de/d14/d47/d70/d72/l144 0 2024-09-13T23:06:33.784 INFO:tasks.workunit.client.1.smithi152.stdout:0/943: mkdir d18/d1f/d29/d3f/d4b/d66/d6a/d14c 0 2024-09-13T23:06:33.784 INFO:tasks.workunit.client.1.smithi152.stdout:3/960: mkdir de/d14/d47/d145 0 2024-09-13T23:06:33.784 INFO:tasks.workunit.client.1.smithi152.stdout:3/961: creat de/d14/d47/d57/d99/f146 x:0 0 0 2024-09-13T23:06:33.790 INFO:tasks.workunit.client.1.smithi152.stdout:8/862: dwrite d17/d25/d32/d44/f6c [0,4194304] 0 2024-09-13T23:06:33.790 INFO:tasks.workunit.client.1.smithi152.stdout:8/863: getdents d17/d25/d32/d44/d10e 0 2024-09-13T23:06:33.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/864: dwrite d17/d25/d80/f93 [0,4194304] 0 2024-09-13T23:06:33.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/865: creat d17/d25/d32/dba/ddd/f110 x:0 0 0 2024-09-13T23:06:33.820 INFO:tasks.workunit.client.1.smithi152.stdout:0/944: dwrite d18/d1f/d29/d2f/d3d/fa7 [0,4194304] 0 2024-09-13T23:06:33.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/866: dread d17/d25/d32/f3f [0,4194304] 0 2024-09-13T23:06:33.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/867: chown d17/ddb/ld3 13 1 2024-09-13T23:06:33.823 INFO:tasks.workunit.client.1.smithi152.stdout:3/962: dwrite de/d14/d47/d70/d72/fbf [0,4194304] 0 2024-09-13T23:06:33.825 INFO:tasks.workunit.client.1.smithi152.stdout:8/868: dread d17/d25/d32/d9a/f8c [0,4194304] 0 2024-09-13T23:06:33.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/945: rmdir d18/d1f/d29/d2f/dd3/df3/df6 0 2024-09-13T23:06:33.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/946: write d18/d1f/d29/d3f/d40/daa/faf [992810,52429] 0 2024-09-13T23:06:33.835 INFO:tasks.workunit.client.1.smithi152.stdout:0/947: mkdir d18/d1f/d29/d2f/d3d/da1/d143/d14d 0 2024-09-13T23:06:33.840 INFO:tasks.workunit.client.1.smithi152.stdout:8/869: write d17/d25/d32/d44/f6c [2668397,39243] 0 2024-09-13T23:06:33.840 INFO:tasks.workunit.client.1.smithi152.stdout:0/948: creat d18/d1f/d33/d90/f14e x:0 0 0 2024-09-13T23:06:33.843 INFO:tasks.workunit.client.1.smithi152.stdout:0/949: mknod d18/d1f/c14f 0 2024-09-13T23:06:33.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/963: dwrite de/d14/d38/fa3 [0,4194304] 0 2024-09-13T23:06:33.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/950: unlink d18/d1f/d33/d65/l12a 0 2024-09-13T23:06:33.851 INFO:tasks.workunit.client.1.smithi152.stdout:3/964: mknod de/d1f/da2/dcb/de6/c147 0 2024-09-13T23:06:33.851 INFO:tasks.workunit.client.1.smithi152.stdout:8/870: rename d17/d25/d32/d4b/d84/d91/d9c/dfd to d17/d25/d32/d4b/d84/d111 0 2024-09-13T23:06:33.856 INFO:tasks.workunit.client.1.smithi152.stdout:3/965: getdents de/d14/d47/d70/dca/d11e 0 2024-09-13T23:06:33.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/871: creat d17/d25/d32/d4b/d84/d91/df2/de9/f112 x:0 0 0 2024-09-13T23:06:33.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/872: chown d17/d25/d80/da3/fb1 82998412 1 2024-09-13T23:06:33.857 INFO:tasks.workunit.client.1.smithi152.stdout:8/873: getdents d17/d25/d32/dba/ddd/d10c 0 2024-09-13T23:06:33.872 INFO:tasks.workunit.client.1.smithi152.stdout:3/966: read de/f45 [11336506,20584] 0 2024-09-13T23:06:33.872 INFO:tasks.workunit.client.1.smithi152.stdout:3/967: creat de/d14/d47/d57/d5d/d6e/f148 x:0 0 0 2024-09-13T23:06:33.872 INFO:tasks.workunit.client.1.smithi152.stdout:0/951: dwrite d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/fff [0,4194304] 0 2024-09-13T23:06:33.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/952: mkdir d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/d11b/d150 0 2024-09-13T23:06:33.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/874: dwrite d17/d25/d32/d50/dc2/f9f [0,4194304] 0 2024-09-13T23:06:33.880 INFO:tasks.workunit.client.1.smithi152.stdout:3/968: rmdir de/d14/d76 39 2024-09-13T23:06:33.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/953: getdents d18/d1f/d29/d4e/dec 0 2024-09-13T23:06:33.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/969: rename de/d14/d47/d57/fc6 to de/d1f/da2/dd3/f149 0 2024-09-13T23:06:33.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/970: readlink de/d14/l59 0 2024-09-13T23:06:33.891 INFO:tasks.workunit.client.1.smithi152.stdout:0/954: link d18/d1f/d29/d4e/dec/d102/f104 d18/d1f/d29/d2f/dd3/df3/f151 0 2024-09-13T23:06:33.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/971: creat de/d1f/da2/dcb/dbc/f14a x:0 0 0 2024-09-13T23:06:33.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/875: dread d17/d25/d32/d50/dc2/f9f [0,4194304] 0 2024-09-13T23:06:33.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/876: dread - d17/d25/d32/d4b/d84/db2/fe0 zero size 2024-09-13T23:06:33.897 INFO:tasks.workunit.client.1.smithi152.stdout:0/955: dread d18/d1f/d29/d4e/f99 [0,4194304] 0 2024-09-13T23:06:33.898 INFO:tasks.workunit.client.1.smithi152.stdout:0/956: creat d18/d1f/d29/d2f/d3d/da1/d143/f152 x:0 0 0 2024-09-13T23:06:33.901 INFO:tasks.workunit.client.1.smithi152.stdout:3/972: dread de/d1f/f67 [0,4194304] 0 2024-09-13T23:06:33.910 INFO:tasks.workunit.client.1.smithi152.stdout:8/877: write d17/d25/d32/d50/f78 [3565494,47463] 0 2024-09-13T23:06:33.910 INFO:tasks.workunit.client.1.smithi152.stdout:8/878: truncate d17/d25/d32/d50/f57 9096231 0 2024-09-13T23:06:33.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/879: symlink d17/l113 0 2024-09-13T23:06:33.918 INFO:tasks.workunit.client.1.smithi152.stdout:0/957: dread d18/f1b [0,4194304] 0 2024-09-13T23:06:33.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/958: mkdir d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/de3/d153 0 2024-09-13T23:06:33.920 INFO:tasks.workunit.client.1.smithi152.stdout:0/959: fdatasync d18/d1f/d29/d3f/d40/f4f 0 2024-09-13T23:06:33.931 INFO:tasks.workunit.client.1.smithi152.stdout:0/960: dread d18/f25 [0,4194304] 0 2024-09-13T23:06:33.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/961: mkdir d18/d1f/d29/d3f/d40/daa/d12b/dd0/d142/d154 0 2024-09-13T23:06:33.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/962: creat d18/d1f/d33/d6e/df7/d111/d11c/f155 x:0 0 0 2024-09-13T23:06:33.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/963: rmdir d18/d1f/d29/d3f/d40/d94 39 2024-09-13T23:06:33.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/964: chown d18/d1f/d33/d65/l97 8282606 1 2024-09-13T23:06:33.933 INFO:tasks.workunit.client.1.smithi152.stdout:0/965: truncate d18/d1f/d29/d3f/d40/f4f 2280546 0 2024-09-13T23:06:33.935 INFO:tasks.workunit.client.1.smithi152.stdout:0/966: rename d18/d1f/d33/d65/d7a/c114 to d18/d1f/d29/d3f/d40/daa/d12b/dd0/c156 0 2024-09-13T23:06:33.937 INFO:tasks.workunit.client.1.smithi152.stdout:3/973: dwrite de/d14/d38/fa3 [8388608,4194304] 0 2024-09-13T23:06:33.937 INFO:tasks.workunit.client.1.smithi152.stdout:0/967: mknod d18/d1f/d29/d2f/dd3/d101/c157 0 2024-09-13T23:06:33.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/968: truncate d18/d1f/d29/d2f/d3d/f5e 509066 0 2024-09-13T23:06:33.939 INFO:tasks.workunit.client.1.smithi152.stdout:8/880: dwrite d17/d25/d32/d4b/d84/db2/fe0 [0,4194304] 0 2024-09-13T23:06:33.941 INFO:tasks.workunit.client.1.smithi152.stdout:0/969: rename f13 to d18/d1f/d29/d2f/dd3/d101/d74/da4/f158 0 2024-09-13T23:06:33.941 INFO:tasks.workunit.client.1.smithi152.stdout:0/970: readlink d18/d1f/d29/d3f/d4b/l8c 0 2024-09-13T23:06:33.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/974: dread de/d14/d76/f8e [0,4194304] 0 2024-09-13T23:06:33.943 INFO:tasks.workunit.client.1.smithi152.stdout:8/881: dread d17/d25/d32/d4b/d84/d111/f103 [0,4194304] 0 2024-09-13T23:06:33.944 INFO:tasks.workunit.client.1.smithi152.stdout:0/971: truncate d18/d1f/d29/d3f/f5c 941587 0 2024-09-13T23:06:33.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/882: symlink d17/d25/d32/d4b/d84/d91/df2/l114 0 2024-09-13T23:06:33.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/883: chown d17/d25/d32/d4b/f6e 13108 1 2024-09-13T23:06:33.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/972: rmdir d18/d1f/d33/d65/d7a/d83 39 2024-09-13T23:06:33.947 INFO:tasks.workunit.client.1.smithi152.stdout:8/884: rmdir d17 39 2024-09-13T23:06:33.948 INFO:tasks.workunit.client.1.smithi152.stdout:0/973: symlink d18/d1f/d29/d2f/dd3/d101/d74/l159 0 2024-09-13T23:06:33.951 INFO:tasks.workunit.client.1.smithi152.stdout:0/974: symlink d18/d1f/d33/d65/d7a/l15a 0 2024-09-13T23:06:33.952 INFO:tasks.workunit.client.1.smithi152.stdout:0/975: truncate d18/d1f/d39/d7c/fad 422044 0 2024-09-13T23:06:33.953 INFO:tasks.workunit.client.1.smithi152.stdout:0/976: stat d18/d1f/d29/f46 0 2024-09-13T23:06:33.955 INFO:tasks.workunit.client.1.smithi152.stdout:0/977: link d18/d1f/d29/f60 d18/d1f/d29/d3f/da0/d127/f15b 0 2024-09-13T23:06:33.955 INFO:tasks.workunit.client.1.smithi152.stdout:0/978: write d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/d11b/f139 [201173,65135] 0 2024-09-13T23:06:33.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/885: write d17/d25/d32/d50/fae [4055653,103331] 0 2024-09-13T23:06:33.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/886: truncate d17/d25/d32/d9a/f67 1112892 0 2024-09-13T23:06:33.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/887: chown d17/d25/d32/dba/le5 778154 1 2024-09-13T23:06:33.966 INFO:tasks.workunit.client.1.smithi152.stdout:0/979: read d18/d1f/d29/d4e/f62 [1711799,64239] 0 2024-09-13T23:06:33.968 INFO:tasks.workunit.client.1.smithi152.stdout:0/980: creat d18/d1f/d29/d3f/da0/f15c x:0 0 0 2024-09-13T23:06:33.970 INFO:tasks.workunit.client.1.smithi152.stdout:0/981: creat d18/d1f/d29/d3f/d40/daa/f15d x:0 0 0 2024-09-13T23:06:33.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/982: mknod d18/d1f/d33/d117/c15e 0 2024-09-13T23:06:33.973 INFO:tasks.workunit.client.1.smithi152.stdout:0/983: rename d18/d1f/d29/d3f/l96 to d18/d1f/d33/df5/l15f 0 2024-09-13T23:06:33.976 INFO:tasks.workunit.client.1.smithi152.stdout:0/984: creat d18/d1f/d33/df5/d120/f160 x:0 0 0 2024-09-13T23:06:33.976 INFO:tasks.workunit.client.1.smithi152.stdout:8/888: dwrite d17/f22 [0,4194304] 0 2024-09-13T23:06:33.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/889: mkdir d17/d19/d10f/d115 0 2024-09-13T23:06:33.989 INFO:tasks.workunit.client.1.smithi152.stdout:8/890: symlink d17/d25/d32/d9a/d8f/l116 0 2024-09-13T23:06:34.001 INFO:tasks.workunit.client.1.smithi152.stdout:0/985: dwrite d18/d1f/f34 [0,4194304] 0 2024-09-13T23:06:34.002 INFO:tasks.workunit.client.1.smithi152.stdout:8/891: dread d17/d25/d32/dba/ddd/fe2 [0,4194304] 0 2024-09-13T23:06:34.006 INFO:tasks.workunit.client.1.smithi152.stdout:0/986: unlink d18/d1f/d29/d3f/d40/daa/cf8 0 2024-09-13T23:06:34.006 INFO:tasks.workunit.client.1.smithi152.stdout:0/987: fsync d18/d1f/d29/d3f/d4b/d66/d6a/d9f/d112/f12d 0 2024-09-13T23:06:34.007 INFO:tasks.workunit.client.1.smithi152.stdout:0/988: truncate d18/d1f/d39/d7c/f12f 277772 0 2024-09-13T23:06:34.007 INFO:tasks.workunit.client.1.smithi152.stdout:0/989: chown d18/d1f/d29/d3f/d40/ld5 53483957 1 2024-09-13T23:06:34.007 INFO:tasks.workunit.client.1.smithi152.stdout:8/892: mkdir d17/d25/d32/d4b/d84/d91/d117 0 2024-09-13T23:06:34.009 INFO:tasks.workunit.client.1.smithi152.stdout:0/990: creat d18/d1f/d29/d3f/d4b/f161 x:0 0 0 2024-09-13T23:06:34.013 INFO:tasks.workunit.client.1.smithi152.stdout:0/991: unlink d18/d1f/d29/d2f/d3d/da1/l147 0 2024-09-13T23:06:34.014 INFO:tasks.workunit.client.1.smithi152.stdout:0/992: creat d18/d1f/d29/d2f/dd3/d101/d74/f162 x:0 0 0 2024-09-13T23:06:34.014 INFO:tasks.workunit.client.1.smithi152.stdout:0/993: truncate d18/d1f/d29/fb3 266705 0 2024-09-13T23:06:34.014 INFO:tasks.workunit.client.1.smithi152.stdout:0/994: truncate d18/d1f/d29/fb3 356443 0 2024-09-13T23:06:34.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/893: rmdir d17/ddb 39 2024-09-13T23:06:34.020 INFO:tasks.workunit.client.1.smithi152.stdout:0/995: mkdir d18/d1f/d29/d2f/d163 0 2024-09-13T23:06:34.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/894: dread d17/d19/dac/fe6 [0,4194304] 0 2024-09-13T23:06:34.040 INFO:tasks.workunit.client.1.smithi152.stdout:0/996: creat d18/d1f/d29/d3f/d40/daa/d12b/dd0/dd9/de3/d153/f164 x:0 0 0 2024-09-13T23:06:34.041 INFO:tasks.workunit.client.1.smithi152.stdout:8/895: symlink d17/d25/d32/d4b/d84/l118 0 2024-09-13T23:06:34.045 INFO:tasks.workunit.client.1.smithi152.stdout:8/896: mknod d17/d25/d32/d4b/d84/d91/df2/de9/c119 0 2024-09-13T23:06:34.047 INFO:tasks.workunit.client.1.smithi152.stdout:0/997: creat d18/d1f/d29/d3f/d4b/d66/d6a/d9f/f165 x:0 0 0 2024-09-13T23:06:34.050 INFO:tasks.workunit.client.1.smithi152.stdout:8/897: rename d17/d25/d32/d9a/d8f/f96 to d17/d25/d32/d4b/d84/d91/df2/de9/f11a 0 2024-09-13T23:06:34.052 INFO:tasks.workunit.client.1.smithi152.stdout:8/898: unlink d17/d25/d32/d9a/l62 0 2024-09-13T23:06:34.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/899: creat d17/d19/dac/f11b x:0 0 0 2024-09-13T23:06:34.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/900: fdatasync d17/d25/d32/f5d 0 2024-09-13T23:06:34.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/901: truncate d17/d25/d32/d50/dc2/f10a 513996 0 2024-09-13T23:06:34.055 INFO:tasks.workunit.client.1.smithi152.stdout:8/902: readlink d17/d25/d32/d44/lbb 0 2024-09-13T23:06:34.057 INFO:tasks.workunit.client.1.smithi152.stdout:8/903: creat d17/d25/d32/d4b/d84/d91/d9c/f11c x:0 0 0 2024-09-13T23:06:34.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/904: link d17/d25/d32/d4b/la7 d17/d25/d80/d10b/l11d 0 2024-09-13T23:06:34.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/905: fdatasync d17/d25/d32/d4b/d84/d91/d9c/faa 0 2024-09-13T23:06:34.059 INFO:tasks.workunit.client.1.smithi152.stdout:8/906: fdatasync d17/d25/d32/dba/ddd/f110 0 2024-09-13T23:06:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/907: creat d17/d25/d32/d4b/d84/d91/d117/f11e x:0 0 0 2024-09-13T23:06:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/908: fdatasync d17/d25/d32/d4b/d84/fb0 0 2024-09-13T23:06:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/909: creat d17/d25/d32/d4b/d95/f11f x:0 0 0 2024-09-13T23:06:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:0/998: dread f14 [4194304,4194304] 0 2024-09-13T23:06:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:0/999: chown d18/d1f/d29/d3f/d40/daa/faf 47 1 2024-09-13T23:06:34.079 INFO:tasks.workunit.client.1.smithi152.stdout:8/910: dwrite d17/d25/d80/f93 [0,4194304] 0 2024-09-13T23:06:34.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/911: dread d17/d25/d32/d50/f78 [4194304,4194304] 0 2024-09-13T23:06:34.092 INFO:tasks.workunit.client.1.smithi152.stdout:8/912: symlink d17/d25/d32/d4b/d84/l120 0 2024-09-13T23:06:34.096 INFO:tasks.workunit.client.1.smithi152.stdout:8/913: dread d17/d25/d32/d50/fae [0,4194304] 0 2024-09-13T23:06:34.097 INFO:tasks.workunit.client.1.smithi152.stdout:8/914: unlink d17/d25/d32/d9a/f67 0 2024-09-13T23:06:34.097 INFO:tasks.workunit.client.1.smithi152.stdout:8/915: read d17/d25/d32/d50/f78 [4359200,40556] 0 2024-09-13T23:06:34.097 INFO:tasks.workunit.client.1.smithi152.stdout:8/916: unlink d17/d25/d32/d4b/cbe 0 2024-09-13T23:06:34.115 INFO:tasks.workunit.client.1.smithi152.stdout:8/917: dwrite d17/d25/d32/d4b/d84/d91/d117/f11e [0,4194304] 0 2024-09-13T23:06:34.115 INFO:tasks.workunit.client.1.smithi152.stdout:8/918: chown d17/d25/d80/d8a/cc8 62336103 1 2024-09-13T23:06:34.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/919: creat d17/d25/d32/d44/d10e/f121 x:0 0 0 2024-09-13T23:06:34.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/920: creat d17/d25/d32/f122 x:0 0 0 2024-09-13T23:06:34.118 INFO:tasks.workunit.client.1.smithi152.stdout:8/921: truncate d17/d25/d32/d50/f78 13335915 0 2024-09-13T23:06:34.120 INFO:tasks.workunit.client.1.smithi152.stdout:8/922: truncate d17/d25/d32/f3f 1310501 0 2024-09-13T23:06:34.120 INFO:tasks.workunit.client.1.smithi152.stdout:8/923: dread d17/d25/d32/ff3 [0,4194304] 0 2024-09-13T23:06:34.121 INFO:tasks.workunit.client.1.smithi152.stdout:8/924: truncate d17/d25/d32/d4b/d95/fad 4012913 0 2024-09-13T23:06:34.122 INFO:tasks.workunit.client.1.smithi152.stdout:8/925: creat d17/d25/d32/d4b/d84/d91/f123 x:0 0 0 2024-09-13T23:06:34.139 INFO:tasks.workunit.client.1.smithi152.stdout:8/926: dwrite d17/d25/f85 [4194304,4194304] 0 2024-09-13T23:06:34.140 INFO:tasks.workunit.client.1.smithi152.stdout:8/927: unlink d17/d25/d32/d50/cd1 0 2024-09-13T23:06:34.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/928: dwrite d17/d25/d32/d44/f6c [0,4194304] 0 2024-09-13T23:06:34.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/929: write d17/d25/d32/d4b/d84/f107 [520093,93362] 0 2024-09-13T23:06:34.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/930: stat d17/d25/d32/f4e 0 2024-09-13T23:06:34.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/931: dread - d17/d19/dac/f11b zero size 2024-09-13T23:06:34.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/932: readlink d17/ddb/lec 0 2024-09-13T23:06:34.173 INFO:tasks.workunit.client.1.smithi152.stdout:8/933: dwrite d17/d19/f98 [0,4194304] 0 2024-09-13T23:06:34.177 INFO:tasks.workunit.client.1.smithi152.stdout:8/934: rmdir d17/d25/d32/d4b/d84/d91 39 2024-09-13T23:06:34.178 INFO:tasks.workunit.client.1.smithi152.stdout:8/935: getdents d17/d25/d32/d4b/d84/db2/def 0 2024-09-13T23:06:34.179 INFO:tasks.workunit.client.1.smithi152.stdout:8/936: truncate d17/f61 5831732 0 2024-09-13T23:06:34.181 INFO:tasks.workunit.client.1.smithi152.stdout:8/937: write d17/d19/f33 [1506589,107168] 0 2024-09-13T23:06:34.185 INFO:tasks.workunit.client.1.smithi152.stdout:8/938: dread d17/d25/d32/d50/fae [0,4194304] 0 2024-09-13T23:06:34.186 INFO:tasks.workunit.client.1.smithi152.stdout:3/975: sync 2024-09-13T23:06:34.186 INFO:tasks.workunit.client.1.smithi152.stdout:3/976: mknod de/d14/d47/d70/dca/df5/c14b 0 2024-09-13T23:06:34.189 INFO:tasks.workunit.client.1.smithi152.stdout:3/977: dread de/d14/f4b [0,4194304] 0 2024-09-13T23:06:34.190 INFO:tasks.workunit.client.1.smithi152.stdout:3/978: unlink de/d14/d47/d57/l82 0 2024-09-13T23:06:34.191 INFO:tasks.workunit.client.1.smithi152.stdout:8/939: write d17/d25/d32/f3f [865989,77819] 0 2024-09-13T23:06:34.191 INFO:tasks.workunit.client.1.smithi152.stdout:8/940: truncate d17/d25/d32/f4e 5177261 0 2024-09-13T23:06:34.199 INFO:tasks.workunit.client.1.smithi152.stdout:8/941: dread d17/d25/d32/d44/f5f [0,4194304] 0 2024-09-13T23:06:34.199 INFO:tasks.workunit.client.1.smithi152.stdout:8/942: readlink d17/d25/d80/d10b/l11d 0 2024-09-13T23:06:34.199 INFO:tasks.workunit.client.1.smithi152.stdout:3/979: dread de/d14/d47/d57/d5d/f56 [0,4194304] 0 2024-09-13T23:06:34.200 INFO:tasks.workunit.client.1.smithi152.stdout:8/943: rename l7 to d17/d25/d80/d10b/l124 0 2024-09-13T23:06:34.200 INFO:tasks.workunit.client.1.smithi152.stdout:8/944: chown d17/l113 1111634496 1 2024-09-13T23:06:34.201 INFO:tasks.workunit.client.1.smithi152.stdout:3/980: mkdir de/d63/dc1/d14c 0 2024-09-13T23:06:34.201 INFO:tasks.workunit.client.1.smithi152.stdout:3/981: mkdir de/d14/d47/d70/d72/da7/d14d 0 2024-09-13T23:06:34.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/982: truncate de/d1f/f20 3700953 0 2024-09-13T23:06:34.202 INFO:tasks.workunit.client.1.smithi152.stdout:3/983: truncate de/d14/d47/d57/d5d/f133 678923 0 2024-09-13T23:06:34.204 INFO:tasks.workunit.client.1.smithi152.stdout:3/984: dread de/d14/d76/f8e [0,4194304] 0 2024-09-13T23:06:34.204 INFO:tasks.workunit.client.1.smithi152.stdout:3/985: readlink de/d1f/da2/dcb/l125 0 2024-09-13T23:06:34.204 INFO:tasks.workunit.client.1.smithi152.stdout:3/986: fdatasync de/f45 0 2024-09-13T23:06:34.205 INFO:tasks.workunit.client.1.smithi152.stdout:3/987: truncate de/d14/d47/d57/feb 1154879 0 2024-09-13T23:06:34.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/945: dread d17/d25/d32/d4b/d95/fad [0,4194304] 0 2024-09-13T23:06:34.208 INFO:tasks.workunit.client.1.smithi152.stdout:8/946: dread - d17/d25/d32/d4b/d84/d91/d9c/f11c zero size 2024-09-13T23:06:34.268 INFO:tasks.workunit.client.1.smithi152.stdout:8/947: dwrite d17/ddb/fda [0,4194304] 0 2024-09-13T23:06:34.285 INFO:tasks.workunit.client.1.smithi152.stdout:8/948: dwrite d17/d25/d32/f4e [0,4194304] 0 2024-09-13T23:06:34.285 INFO:tasks.workunit.client.1.smithi152.stdout:8/949: fsync d17/d25/d32/d44/f6b 0 2024-09-13T23:06:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:8/950: truncate d17/d25/d32/f3f 812980 0 2024-09-13T23:06:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:8/951: write d17/ddb/df5/ff9 [270755,30829] 0 2024-09-13T23:06:34.570 INFO:tasks.workunit.client.1.smithi152.stdout:3/988: sync 2024-09-13T23:06:34.570 INFO:tasks.workunit.client.1.smithi152.stdout:3/989: write de/d1f/f91 [4766610,107498] 0 2024-09-13T23:06:34.570 INFO:tasks.workunit.client.1.smithi152.stdout:3/990: chown de/f45 15555505 1 2024-09-13T23:06:34.570 INFO:tasks.workunit.client.1.smithi152.stdout:3/991: write de/d14/f4f [4530875,70119] 0 2024-09-13T23:06:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:3/992: rename de/d14/d38/f19 to de/d14/d47/d70/d87/ddd/d128/f14e 0 2024-09-13T23:06:34.572 INFO:tasks.workunit.client.1.smithi152.stdout:3/993: creat de/d14/d47/d70/dca/df5/f14f x:0 0 0 2024-09-13T23:06:34.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/994: creat de/d14/d47/d57/dc9/f150 x:0 0 0 2024-09-13T23:06:34.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/995: dwrite de/d14/f62 [0,4194304] 0 2024-09-13T23:06:34.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/996: rmdir de/d14/d47/d70/d87/ddd/d128 39 2024-09-13T23:06:34.589 INFO:tasks.workunit.client.1.smithi152.stdout:3/997: stat de/d1f/l126 0 2024-09-13T23:06:34.590 INFO:tasks.workunit.client.1.smithi152.stdout:3/998: mknod de/d14/d47/d70/dca/df5/d12c/c151 0 2024-09-13T23:06:34.603 INFO:tasks.workunit.client.1.smithi152.stdout:3/999: dwrite de/d14/d47/d57/d5d/d6e/f122 [0,4194304] 0 2024-09-13T23:06:34.639 INFO:tasks.workunit.client.1.smithi152.stdout:8/952: sync 2024-09-13T23:06:34.640 INFO:tasks.workunit.client.1.smithi152.stdout:8/953: link d17/d25/d32/d50/f57 d17/d25/d80/da3/f125 0 2024-09-13T23:06:34.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/954: rmdir d17/d25/d32/d50 39 2024-09-13T23:06:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:8/955: rmdir d17/d25 39 2024-09-13T23:06:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/956: dread d17/d19/f33 [0,4194304] 0 2024-09-13T23:06:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/957: rmdir d17/d25/d32/d44 39 2024-09-13T23:06:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/958: fdatasync d17/d25/d32/d50/dc2/f105 0 2024-09-13T23:06:34.648 INFO:tasks.workunit.client.1.smithi152.stdout:8/959: rename d17/d25/d32/d4b/la7 to d17/d25/d32/d4b/d84/l126 0 2024-09-13T23:06:34.649 INFO:tasks.workunit.client.1.smithi152.stdout:8/960: rename d17/d25/d32/f3e to d17/d25/d32/d4b/d84/d91/d9c/f127 0 2024-09-13T23:06:34.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/961: dwrite d17/d25/d32/d4b/f5b [0,4194304] 0 2024-09-13T23:06:34.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/962: write d17/f77 [4663425,114998] 0 2024-09-13T23:06:34.690 INFO:tasks.workunit.client.1.smithi152.stdout:8/963: dwrite d17/d19/f106 [0,4194304] 0 2024-09-13T23:06:34.710 INFO:tasks.workunit.client.1.smithi152.stdout:8/964: unlink d17/d25/d80/d8a/cc8 0 2024-09-13T23:06:34.710 INFO:tasks.workunit.client.1.smithi152.stdout:8/965: rename d17/d25/d32/d4b to d17/d25/d32/d4b/d84/d91/d9c/d128 22 2024-09-13T23:06:34.720 INFO:tasks.workunit.client.1.smithi152.stdout:8/966: write d17/d25/d32/d4b/d84/db2/fe0 [2772868,104763] 0 2024-09-13T23:06:34.721 INFO:tasks.workunit.client.1.smithi152.stdout:8/967: dread d17/d25/d32/ff3 [0,4194304] 0 2024-09-13T23:06:34.721 INFO:tasks.workunit.client.1.smithi152.stdout:8/968: dread - d17/d25/d32/d4b/d84/d91/d9c/f11c zero size 2024-09-13T23:06:34.759 INFO:tasks.workunit.client.1.smithi152.stdout:8/969: mknod d17/d25/d32/d4b/d84/d111/c129 0 2024-09-13T23:06:34.760 INFO:tasks.workunit.client.1.smithi152.stdout:8/970: rmdir d17/d19/dac 39 2024-09-13T23:06:34.762 INFO:tasks.workunit.client.1.smithi152.stdout:8/971: symlink d17/d25/d32/d4b/d84/l12a 0 2024-09-13T23:06:34.782 INFO:tasks.workunit.client.1.smithi152.stdout:8/972: dwrite d17/d25/d32/d4b/f6e [0,4194304] 0 2024-09-13T23:06:34.785 INFO:tasks.workunit.client.1.smithi152.stdout:8/973: mknod d17/d25/c12b 0 2024-09-13T23:06:34.785 INFO:tasks.workunit.client.1.smithi152.stdout:8/974: mknod d17/d25/d32/dba/ddd/d10c/c12c 0 2024-09-13T23:06:34.786 INFO:tasks.workunit.client.1.smithi152.stdout:8/975: mknod d17/d25/d32/d4b/d95/c12d 0 2024-09-13T23:06:34.787 INFO:tasks.workunit.client.1.smithi152.stdout:8/976: dread - d17/d25/d32/d4b/d95/f11f zero size 2024-09-13T23:06:34.787 INFO:tasks.workunit.client.1.smithi152.stdout:8/977: creat d17/d25/d80/d10b/f12e x:0 0 0 2024-09-13T23:06:34.788 INFO:tasks.workunit.client.1.smithi152.stdout:8/978: chown d17/d25/d32/d4b/d84/d111/f103 371 1 2024-09-13T23:06:34.788 INFO:tasks.workunit.client.1.smithi152.stdout:8/979: stat la 0 2024-09-13T23:06:34.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:34 smithi115 ceph-mon[27601]: pgmap v13: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 138 MiB/s rd, 173 MiB/s wr, 331 op/s 2024-09-13T23:06:34.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/980: dwrite d17/f77 [0,4194304] 0 2024-09-13T23:06:34.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/981: readlink d17/l1f 0 2024-09-13T23:06:34.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/982: chown c16 58 1 2024-09-13T23:06:34.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/983: creat d17/d25/d32/d4b/f12f x:0 0 0 2024-09-13T23:06:34.817 INFO:tasks.workunit.client.1.smithi152.stdout:8/984: rename d17/d25/d32/d4b/d84/d91/ced to d17/d25/d32/d50/dc2/c130 0 2024-09-13T23:06:34.820 INFO:tasks.workunit.client.1.smithi152.stdout:8/985: mknod d17/d19/dac/c131 0 2024-09-13T23:06:34.823 INFO:tasks.workunit.client.1.smithi152.stdout:8/986: dread d17/d25/d32/d4b/d84/d111/f103 [0,4194304] 0 2024-09-13T23:06:34.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/987: readlink d17/d25/d32/d44/lbb 0 2024-09-13T23:06:34.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/988: creat d17/d25/d80/d10b/f132 x:0 0 0 2024-09-13T23:06:34.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/989: dread - d17/d25/d32/dba/ddd/f110 zero size 2024-09-13T23:06:34.825 INFO:tasks.workunit.client.1.smithi152.stdout:8/990: creat d17/d25/d80/d8a/f133 x:0 0 0 2024-09-13T23:06:34.831 INFO:tasks.workunit.client.1.smithi152.stdout:8/991: write d17/d25/d32/d50/fae [4366261,6156] 0 2024-09-13T23:06:34.831 INFO:tasks.workunit.client.1.smithi152.stdout:8/992: readlink d17/d25/d80/ld0 0 2024-09-13T23:06:34.833 INFO:tasks.workunit.client.1.smithi152.stdout:8/993: creat d17/d25/d32/dba/ddd/d10c/f134 x:0 0 0 2024-09-13T23:06:34.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/994: unlink d17/ddb/le1 0 2024-09-13T23:06:34.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/995: truncate d17/d25/d32/d9a/d8f/fe3 93960 0 2024-09-13T23:06:34.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/996: chown d17/d19/f106 1123022831 1 2024-09-13T23:06:34.834 INFO:tasks.workunit.client.1.smithi152.stdout:8/997: chown d17/d25/d32/d9a 625095 1 2024-09-13T23:06:34.853 INFO:tasks.workunit.client.1.smithi152.stdout:8/998: dwrite d17/d25/d32/d44/f82 [0,4194304] 0 2024-09-13T23:06:34.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/999: dwrite d17/ddb/f108 [0,4194304] 0 2024-09-13T23:06:34.879 INFO:tasks.workunit.client.1.smithi152.stderr:+ rm -rf -- ./tmp.mlr0wowVNt 2024-09-13T23:06:34.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:34 smithi152 ceph-mon[34465]: pgmap v13: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 138 MiB/s rd, 173 MiB/s wr, 331 op/s 2024-09-13T23:06:35.649 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T23:06:35.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T23:06:36.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:36 smithi115 ceph-mon[27601]: pgmap v14: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 210 MiB/s rd, 272 MiB/s wr, 502 op/s 2024-09-13T23:06:36.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:36 smithi152 ceph-mon[34465]: pgmap v14: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 210 MiB/s rd, 272 MiB/s wr, 502 op/s 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: pgmap v15: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 171 MiB/s wr, 330 op/s 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: Adjusting osd_memory_target on smithi152 to 2581M 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:06:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:38 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:06:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: pgmap v15: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 171 MiB/s wr, 330 op/s 2024-09-13T23:06:39.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: Adjusting osd_memory_target on smithi152 to 2581M 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:06:39.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:38 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:06:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:06:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:39 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:06:39.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:06:39.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:06:39.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:06:39.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:06:39.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:39.971 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:39 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:41.065 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:40 smithi115 ceph-mon[27601]: Reconfiguring node-exporter.smithi115 (dependencies changed)... 2024-09-13T23:06:41.066 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:40 smithi115 ceph-mon[27601]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T23:06:41.066 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:40 smithi115 ceph-mon[27601]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 171 MiB/s wr, 330 op/s 2024-09-13T23:06:41.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:40 smithi152 ceph-mon[34465]: Reconfiguring node-exporter.smithi115 (dependencies changed)... 2024-09-13T23:06:41.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:40 smithi152 ceph-mon[34465]: Deploying daemon node-exporter.smithi115 on smithi115 2024-09-13T23:06:41.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:40 smithi152 ceph-mon[34465]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 127 MiB/s rd, 171 MiB/s wr, 330 op/s 2024-09-13T23:06:43.134 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:42 smithi115 ceph-mon[27601]: pgmap v17: 65 pgs: 65 active+clean; 1.4 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 129 MiB/s rd, 174 MiB/s wr, 508 op/s 2024-09-13T23:06:43.134 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:42 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:43.134 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:42 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:42 smithi152 ceph-mon[34465]: pgmap v17: 65 pgs: 65 active+clean; 1.4 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 129 MiB/s rd, 174 MiB/s wr, 508 op/s 2024-09-13T23:06:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:42 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:43.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:42 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:06:43.726 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T23:06:43.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T23:06:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:43 smithi152 ceph-mon[34465]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T23:06:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:43 smithi152 ceph-mon[34465]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T23:06:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:43 smithi152 ceph-mon[34465]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 103 MiB/s wr, 349 op/s 2024-09-13T23:06:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:43 smithi115 ceph-mon[27601]: Reconfiguring alertmanager.smithi115 (dependencies changed)... 2024-09-13T23:06:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:43 smithi115 ceph-mon[27601]: Deploying daemon alertmanager.smithi115 on smithi115 2024-09-13T23:06:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:43 smithi115 ceph-mon[27601]: pgmap v18: 65 pgs: 65 active+clean; 1.4 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 103 MiB/s wr, 349 op/s 2024-09-13T23:06:45.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:44 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:44 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:45 smithi115 ceph-mon[27601]: pgmap v19: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 76 MiB/s rd, 104 MiB/s wr, 563 op/s 2024-09-13T23:06:46.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:45 smithi152 ceph-mon[34465]: pgmap v19: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 76 MiB/s rd, 104 MiB/s wr, 563 op/s 2024-09-13T23:06:48.677 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:48 smithi152 ceph-mon[34465]: pgmap v20: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 391 op/s 2024-09-13T23:06:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:48 smithi115 ceph-mon[27601]: pgmap v20: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 391 op/s 2024-09-13T23:06:50.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:50 smithi152 ceph-mon[34465]: pgmap v21: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 391 op/s 2024-09-13T23:06:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:50 smithi115 ceph-mon[27601]: pgmap v21: 65 pgs: 65 active+clean; 349 MiB data, 3.6 GiB used, 533 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.8 MiB/s wr, 391 op/s 2024-09-13T23:06:52.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:52 smithi152 ceph-mon[34465]: pgmap v22: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 6.0 MiB/s wr, 667 op/s 2024-09-13T23:06:52.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:52 smithi115 ceph-mon[27601]: pgmap v22: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 6.0 MiB/s wr, 667 op/s 2024-09-13T23:06:54.661 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:54 smithi115 ceph-mon[27601]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 489 op/s 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 -- 172.21.15.115:0/2074870420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 msgr2=0x7fd4b80fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/2074870420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b80fe040 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009c50 tx=0x7fd4b0004d10 comp rx=0 tx=0).stop 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 -- 172.21.15.115:0/2074870420 shutdown_connections 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/2074870420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b80fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/2074870420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b80fe040 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 -- 172.21.15.115:0/2074870420 >> 172.21.15.115:0/2074870420 conn(0x7fd4b80f6390 msgr2=0x7fd4b80f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 -- 172.21.15.115:0/2074870420 shutdown_connections 2024-09-13T23:06:54.664 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.662+0000 7fd4be3a6640 1 -- 172.21.15.115:0/2074870420 wait complete. 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 Processor -- start 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 -- start start 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b810d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b810dc80 con 0x7fd4b80fe580 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4be3a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b810e4a0 con 0x7fd4b80fdc30 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b810d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:48080/0 (socket says 172.21.15.115:48080) 2024-09-13T23:06:54.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b810d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.664+0000 7fd4b7fff640 1 -- 172.21.15.115:0/1944300283 learned_addr learned my addr 172.21.15.115:0/1944300283 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b77fe640 1 -- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 msgr2=0x7fd4b810d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b77fe640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b810d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b77fe640 1 -- 172.21.15.115:0/1944300283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac005040 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b77fe640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b810d630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009350 tx=0x7fd4ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ac009940 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b00098b0 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b810ea80 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd4ac00f040 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.665+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ac013cf0 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.666+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a4005240 con 0x7fd4b80fe580 2024-09-13T23:06:54.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.667+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd4ac013400 con 0x7fd4b80fe580 2024-09-13T23:06:54.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.667+0000 7fd4b4ff9640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 0x7fd4a0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:54.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.668+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd4ac08dca0 con 0x7fd4b80fe580 2024-09-13T23:06:54.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.668+0000 7fd4b7fff640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 0x7fd4a0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:54.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.668+0000 7fd4b7fff640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 0x7fd4a0070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000f80 tx=0x7fd4b0004d10 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:54.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.676+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd4ac0575e0 con 0x7fd4b80fe580 2024-09-13T23:06:54.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:54 smithi152 ceph-mon[34465]: pgmap v23: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 489 op/s 2024-09-13T23:06:54.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.921+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4a4000bf0 con 0x7fd4a006e6e0 2024-09-13T23:06:54.924 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.923+0000 7fd4b4ff9640 1 -- 172.21.15.115:0/1944300283 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd4a4000bf0 con 0x7fd4a006e6e0 2024-09-13T23:06:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.926+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 msgr2=0x7fd4a0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.926+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 0x7fd4a0070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000f80 tx=0x7fd4b0004d10 comp rx=0 tx=0).stop 2024-09-13T23:06:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.926+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 msgr2=0x7fd4b810d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:54.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.926+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b810d630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009350 tx=0x7fd4ac009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 shutdown_connections 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd4a006e6e0 0x7fd4a0070b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4b80fe580 0x7fd4b810d630 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 --2- 172.21.15.115:0/1944300283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4b80fdc30 0x7fd4b810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 >> 172.21.15.115:0/1944300283 conn(0x7fd4b80f6390 msgr2=0x7fd4b80f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 shutdown_connections 2024-09-13T23:06:54.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:54.927+0000 7fd4be3a6640 1 -- 172.21.15.115:0/1944300283 wait complete. 2024-09-13T23:06:54.940 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 -- 172.21.15.115:0/634641690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fb430 msgr2=0x7fa6800fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 --2- 172.21.15.115:0/634641690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fb430 0x7fa6800fb840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0048d0 tx=0x7fa67c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 -- 172.21.15.115:0/634641690 shutdown_connections 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 --2- 172.21.15.115:0/634641690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fc700 0x7fa6800fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 --2- 172.21.15.115:0/634641690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fb430 0x7fa6800fb840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.049+0000 7fa6882ba640 1 -- 172.21.15.115:0/634641690 >> 172.21.15.115:0/634641690 conn(0x7fa6800f6c10 msgr2=0x7fa6800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 -- 172.21.15.115:0/634641690 shutdown_connections 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 -- 172.21.15.115:0/634641690 wait complete. 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 Processor -- start 2024-09-13T23:06:55.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 -- start start 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 0x7fa68010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68010dc30 con 0x7fa6800fc700 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.050+0000 7fa6882ba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68010e450 con 0x7fa6800fb430 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa685855640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 0x7fa68010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:48102/0 (socket says 172.21.15.115:48102) 2024-09-13T23:06:55.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 -- 172.21.15.115:0/1826225462 learned_addr learned my addr 172.21.15.115:0/1826225462 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa685855640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 0x7fa68010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34212/0 (socket says 172.21.15.115:34212) 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 -- 172.21.15.115:0/1826225462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 msgr2=0x7fa68010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 0x7fa68010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 -- 172.21.15.115:0/1826225462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c005040 con 0x7fa6800fb430 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa686056640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0048a0 tx=0x7fa67c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c03c070 con 0x7fa6800fb430 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.051+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68010e680 con 0x7fa6800fb430 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.052+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa67c009800 con 0x7fa6800fb430 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.052+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c02c350 con 0x7fa6800fb430 2024-09-13T23:06:55.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.052+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68010ec20 con 0x7fa6800fb430 2024-09-13T23:06:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.053+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800fa890 con 0x7fa6800fb430 2024-09-13T23:06:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.053+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa67c030020 con 0x7fa6800fb430 2024-09-13T23:06:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.054+0000 7fa676ffd640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.054+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa67c0b2290 con 0x7fa6800fb430 2024-09-13T23:06:55.056 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.054+0000 7fa685855640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.056 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.055+0000 7fa685855640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 0x7fa66c070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa68010ce50 tx=0x7fa67000b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.063+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa67c07bcd0 con 0x7fa6800fb430 2024-09-13T23:06:55.404 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.403+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa68002ab50 con 0x7fa66c06e6e0 2024-09-13T23:06:55.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.404+0000 7fa676ffd640 1 -- 172.21.15.115:0/1826225462 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa68002ab50 con 0x7fa66c06e6e0 2024-09-13T23:06:55.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 msgr2=0x7fa66c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 0x7fa66c070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa68010ce50 tx=0x7fa67000b040 comp rx=0 tx=0).stop 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 msgr2=0x7fa68010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0048a0 tx=0x7fa67c009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 shutdown_connections 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6800fc700 0x7fa68010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 --2- 172.21.15.115:0/1826225462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6800fb430 0x7fa68010d0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 >> 172.21.15.115:0/1826225462 conn(0x7fa6800f6c10 msgr2=0x7fa680065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:55.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 shutdown_connections 2024-09-13T23:06:55.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.407+0000 7fa6882ba640 1 -- 172.21.15.115:0/1826225462 wait complete. 2024-09-13T23:06:55.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.497+0000 7f414d925640 1 -- 172.21.15.115:0/1526507062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148065c40 msgr2=0x7f41480ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.497+0000 7f414d925640 1 --2- 172.21.15.115:0/1526507062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148065c40 0x7f41480ff140 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f41380048d0 tx=0x7f4138009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 -- 172.21.15.115:0/1526507062 shutdown_connections 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 --2- 172.21.15.115:0/1526507062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41480ff680 0x7f4148101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 --2- 172.21.15.115:0/1526507062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4148065c40 0x7f41480ff140 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 -- 172.21.15.115:0/1526507062 >> 172.21.15.115:0/1526507062 conn(0x7f41480f6c10 msgr2=0x7f41480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 -- 172.21.15.115:0/1526507062 shutdown_connections 2024-09-13T23:06:55.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 -- 172.21.15.115:0/1526507062 wait complete. 2024-09-13T23:06:55.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.498+0000 7f414d925640 1 Processor -- start 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f414d925640 1 -- start start 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f414d925640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4148065c40 0x7f414810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f414d925640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f414d925640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414810dca0 con 0x7f41480ff680 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f414d925640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414810e470 con 0x7f4148065c40 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34234/0 (socket says 172.21.15.115:34234) 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 -- 172.21.15.115:0/2418638488 learned_addr learned my addr 172.21.15.115:0/2418638488 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f4146ffd640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4148065c40 0x7f414810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 -- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4148065c40 msgr2=0x7f414810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4148065c40 0x7f414810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.499+0000 7f41467fc640 1 -- 172.21.15.115:0/2418638488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138005040 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f41467fc640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f413c00eb70 tx=0x7f413c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413c007c30 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f413c00f040 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414810e6a0 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413c00ca60 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.500+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414810ec40 con 0x7f41480ff680 2024-09-13T23:06:55.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.502+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41480fa890 con 0x7f41480ff680 2024-09-13T23:06:55.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.502+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f413c00cbc0 con 0x7f41480ff680 2024-09-13T23:06:55.503 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.503+0000 7f412f7fe640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 0x7f4130070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.503+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f413c08db80 con 0x7f41480ff680 2024-09-13T23:06:55.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.503+0000 7f4146ffd640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 0x7f4130070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.504+0000 7f4146ffd640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 0x7f4130070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4138007ac0 tx=0x7f4138035040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.507+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f413c0575b0 con 0x7f41480ff680 2024-09-13T23:06:55.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.736+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f414810efc0 con 0x7f413006e6e0 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.745+0000 7f412f7fe640 1 -- 172.21.15.115:0/2418638488 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f414810efc0 con 0x7f413006e6e0 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 30s ago 8m 25.6M - 0.25.0 c8568f914cd2 7ef9fd69028d 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (8m) 30s ago 8m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (7m) 24s ago 7m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 30s ago 8m 86.7M - 9.4.7 954c08fa6188 6d06f4619a0c 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (2m) 30s ago 2m 115M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (3m) 30s ago 3m 70.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (3m) 24s ago 3m 146M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:06:55.746 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (2m) 24s ago 2m 91.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (9m) 30s ago 9m 277M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (74s) 24s ago 7m 481M - 19.1.1-324-gecab7be5 0652ff2b5d78 718f6398c5ee 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (9m) 30s ago 9m 48.7M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (7m) 24s ago 7m 41.6M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 starting - - - - 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 24s ago 7m 17.1M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (6m) 30s ago 6m 229M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (6m) 30s ago 6m 233M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:06:55.747 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 30s ago 5m 210M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:06:55.748 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (5m) 24s ago 5m 272M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:06:55.748 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (4m) 24s ago 4m 223M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:06:55.748 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (4m) 24s ago 4m 287M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:06:55.748 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 30s ago 7m 60.1M - 2.43.0 a07b618ecd1d 4787d7eca06f 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 msgr2=0x7f4130070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 0x7f4130070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4138007ac0 tx=0x7f4138035040 comp rx=0 tx=0).stop 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 msgr2=0x7f414810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f413c00eb70 tx=0x7f413c00b040 comp rx=0 tx=0).stop 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 shutdown_connections 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f413006e6e0 0x7f4130070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f41480ff680 0x7f414810d650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 --2- 172.21.15.115:0/2418638488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4148065c40 0x7f414810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 >> 172.21.15.115:0/2418638488 conn(0x7f41480f6c10 msgr2=0x7f41480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.747+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 shutdown_connections 2024-09-13T23:06:55.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.748+0000 7f414d925640 1 -- 172.21.15.115:0/2418638488 wait complete. 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 -- 172.21.15.115:0/3690526722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 msgr2=0x7f5e480fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 --2- 172.21.15.115:0/3690526722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e480fb840 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e440048d0 tx=0x7f5e44009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 -- 172.21.15.115:0/3690526722 shutdown_connections 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 --2- 172.21.15.115:0/3690526722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e480fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 --2- 172.21.15.115:0/3690526722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e480fb840 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 -- 172.21.15.115:0/3690526722 >> 172.21.15.115:0/3690526722 conn(0x7f5e480f6c10 msgr2=0x7f5e480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 -- 172.21.15.115:0/3690526722 shutdown_connections 2024-09-13T23:06:55.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.841+0000 7f5e50737640 1 -- 172.21.15.115:0/3690526722 wait complete. 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 Processor -- start 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 -- start start 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e4810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4810cb10 con 0x7f5e480fb430 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e50737640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4810d330 con 0x7f5e480fc700 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34264/0 (socket says 172.21.15.115:34264) 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 -- 172.21.15.115:0/623063602 learned_addr learned my addr 172.21.15.115:0/623063602 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4dcd2640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e4810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 -- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 msgr2=0x7f5e4810c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e4810c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:55.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 -- 172.21.15.115:0/623063602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44005040 con 0x7f5e480fb430 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4dcd2640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e4810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.842+0000 7f5e4e4d3640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e440043d0 tx=0x7f5e44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.843+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e44038070 con 0x7f5e480fb430 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.843+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e4402ae90 con 0x7f5e480fb430 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.843+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4403e670 con 0x7f5e480fb430 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.843+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4810d560 con 0x7f5e480fb430 2024-09-13T23:06:55.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.843+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4810db00 con 0x7f5e480fb430 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.844+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e480fa890 con 0x7f5e480fb430 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.844+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f5e44030020 con 0x7f5e480fb430 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.844+0000 7f5e3effd640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 0x7f5e34070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.845+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5e440ae0d0 con 0x7f5e480fb430 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.845+0000 7f5e4dcd2640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 0x7f5e34070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:55.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.845+0000 7f5e4dcd2640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 0x7f5e34070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007fd0 tx=0x7f5e38009e90 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:55.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:55.849+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5e44077a60 con 0x7f5e480fb430 2024-09-13T23:06:56.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.201+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e48103e50 con 0x7f5e480fb430 2024-09-13T23:06:56.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.202+0000 7f5e3effd640 1 -- 172.21.15.115:0/623063602 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f5e4407b120 con 0x7f5e480fb430 2024-09-13T23:06:56.202 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:06:56.203 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:06:56.204 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T23:06:56.204 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:06:56.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:06:56.204 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 msgr2=0x7f5e34070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 0x7f5e34070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007fd0 tx=0x7f5e38009e90 comp rx=0 tx=0).stop 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 msgr2=0x7f5e4810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e440043d0 tx=0x7f5e44009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 shutdown_connections 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f5e3406e6e0 0x7f5e34070b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e480fc700 0x7f5e4810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 --2- 172.21.15.115:0/623063602 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e480fb430 0x7f5e4810bf80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 >> 172.21.15.115:0/623063602 conn(0x7f5e480f6c10 msgr2=0x7f5e480f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 shutdown_connections 2024-09-13T23:06:56.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.204+0000 7f5e50737640 1 -- 172.21.15.115:0/623063602 wait complete. 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.328+0000 7f00c2cf2640 1 -- 172.21.15.115:0/1643394849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 msgr2=0x7f00b409c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.328+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/1643394849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b409c7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f00b8004810 tx=0x7f00b8009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 -- 172.21.15.115:0/1643394849 shutdown_connections 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/1643394849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b409c7d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/1643394849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b409b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 -- 172.21.15.115:0/1643394849 >> 172.21.15.115:0/1643394849 conn(0x7f00b400a270 msgr2=0x7f00b400c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 -- 172.21.15.115:0/1643394849 shutdown_connections 2024-09-13T23:06:56.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.329+0000 7f00c2cf2640 1 -- 172.21.15.115:0/1643394849 wait complete. 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 Processor -- start 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 -- start start 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b40abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40ac600 con 0x7f00b409b090 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c2cf2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40b1000 con 0x7f00b409c360 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c1cf0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c1cf0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51834/0 (socket says 172.21.15.115:51834) 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c1cf0640 1 -- 172.21.15.115:0/2229567231 learned_addr learned my addr 172.21.15.115:0/2229567231 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.330+0000 7f00c14ef640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b40abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c1cf0640 1 -- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 msgr2=0x7f00b40abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c1cf0640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b40abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c1cf0640 1 -- 172.21.15.115:0/2229567231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8005040 con 0x7f00b409b090 2024-09-13T23:06:56.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c14ef640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b40abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:06:56.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c1cf0640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb40 tx=0x7f00ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ac007c30 con 0x7f00b409b090 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.331+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b40b1140 con 0x7f00b409b090 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.332+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b40b16b0 con 0x7f00b409b090 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.332+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f00ac00f040 con 0x7f00b409b090 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.332+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00ac00caa0 con 0x7f00b409b090 2024-09-13T23:06:56.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.333+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0005240 con 0x7f00b409b090 2024-09-13T23:06:56.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.333+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f00ac00cc00 con 0x7f00b409b090 2024-09-13T23:06:56.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.334+0000 7f00b27fc640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 0x7f00a8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.334+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f00ac08db80 con 0x7f00b409b090 2024-09-13T23:06:56.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.335+0000 7f00c14ef640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 0x7f00a8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.336+0000 7f00c14ef640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 0x7f00a8070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007ac0 tx=0x7f00b8035040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:56.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.343+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f00ac050670 con 0x7f00b409b090 2024-09-13T23:06:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:56 smithi115 ceph-mon[27601]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:56 smithi115 ceph-mon[27601]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 746 op/s 2024-09-13T23:06:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:56 smithi115 ceph-mon[27601]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:56 smithi115 ceph-mon[27601]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:56 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/623063602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:56.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.581+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00a00057c0 con 0x7f00b409b090 2024-09-13T23:06:56.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.582+0000 7f00b27fc640 1 -- 172.21.15.115:0/2229567231 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f00ac019760 con 0x7f00b409b090 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:06:56.583 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:06:56.584 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:06:56.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 msgr2=0x7f00a8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 0x7f00a8070c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007ac0 tx=0x7f00b8035040 comp rx=0 tx=0).stop 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 msgr2=0x7f00b40aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb40 tx=0x7f00ac00b040 comp rx=0 tx=0).stop 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 shutdown_connections 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f00a806e7b0 0x7f00a8070c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00b409c360 0x7f00b40abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 --2- 172.21.15.115:0/2229567231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00b409b090 0x7f00b40aba70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 >> 172.21.15.115:0/2229567231 conn(0x7f00b400a270 msgr2=0x7f00b400bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 shutdown_connections 2024-09-13T23:06:56.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.585+0000 7f00c2cf2640 1 -- 172.21.15.115:0/2229567231 wait complete. 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.685+0000 7f8301f8e640 1 -- 172.21.15.115:0/4271818082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 msgr2=0x7f82fc0feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.685+0000 7f8301f8e640 1 --2- 172.21.15.115:0/4271818082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc0feb70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0048d0 tx=0x7f82ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 -- 172.21.15.115:0/4271818082 shutdown_connections 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 --2- 172.21.15.115:0/4271818082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 0x7f82fc0ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 --2- 172.21.15.115:0/4271818082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc0feb70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 -- 172.21.15.115:0/4271818082 >> 172.21.15.115:0/4271818082 conn(0x7f82fc0fa060 msgr2=0x7f82fc0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:56.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 -- 172.21.15.115:0/4271818082 shutdown_connections 2024-09-13T23:06:56.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 -- 172.21.15.115:0/4271818082 wait complete. 2024-09-13T23:06:56.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 Processor -- start 2024-09-13T23:06:56.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.686+0000 7f8301f8e640 1 -- start start 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f8301f8e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f8301f8e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 0x7f82fc10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f8301f8e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc10fdf0 con 0x7f82fc0fe760 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f8301f8e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc110610 con 0x7f82fc0ffa30 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51858/0 (socket says 172.21.15.115:51858) 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 -- 172.21.15.115:0/2450096329 learned_addr learned my addr 172.21.15.115:0/2450096329 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82faffd640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 0x7f82fc10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 -- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 msgr2=0x7f82fc10f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 0x7f82fc10f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 -- 172.21.15.115:0/2450096329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec005040 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.687+0000 7f82fb7fe640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0048a0 tx=0x7f82ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.688+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ec038070 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.688+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc110840 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.688+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82ec004290 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.688+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ec033660 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.688+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc110de0 con 0x7f82fc0fe760 2024-09-13T23:06:56.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.689+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc0fdbc0 con 0x7f82fc0fe760 2024-09-13T23:06:56.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.690+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f82ec030020 con 0x7f82fc0fe760 2024-09-13T23:06:56.691 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.691+0000 7f82e3fff640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 0x7f82e4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:56.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.691+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f82ec0adff0 con 0x7f82fc0fe760 2024-09-13T23:06:56.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.691+0000 7f82faffd640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 0x7f82e4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:56.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.692+0000 7f82faffd640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 0x7f82e4070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82fc10f010 tx=0x7f82f000b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:56.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.695+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f82ec077ab0 con 0x7f82fc0fe760 2024-09-13T23:06:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:56 smithi152 ceph-mon[34465]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:56 smithi152 ceph-mon[34465]: pgmap v24: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 746 op/s 2024-09-13T23:06:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:56 smithi152 ceph-mon[34465]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:56 smithi152 ceph-mon[34465]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:56 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/623063602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:56.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.955+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82fc1111b0 con 0x7f82e406e6e0 2024-09-13T23:06:56.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.957+0000 7f82e3fff640 1 -- 172.21.15.115:0/2450096329 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f82fc1111b0 con 0x7f82e406e6e0 2024-09-13T23:06:56.957 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:06:56.958 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:06:56.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 msgr2=0x7f82e4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 0x7f82e4070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82fc10f010 tx=0x7f82f000b040 comp rx=0 tx=0).stop 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 msgr2=0x7f82fc10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0048a0 tx=0x7f82ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 shutdown_connections 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f82e406e6e0 0x7f82e4070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82fc0ffa30 0x7f82fc10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 --2- 172.21.15.115:0/2450096329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82fc0fe760 0x7f82fc10f260 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 >> 172.21.15.115:0/2450096329 conn(0x7f82fc0fa060 msgr2=0x7f82fc0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 shutdown_connections 2024-09-13T23:06:56.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:56.960+0000 7f8301f8e640 1 -- 172.21.15.115:0/2450096329 wait complete. 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.083+0000 7f32e7a93640 1 -- 172.21.15.115:0/2895444694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fd7f0 msgr2=0x7f32e00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.083+0000 7f32e7a93640 1 --2- 172.21.15.115:0/2895444694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fd7f0 0x7f32e00fdc60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32d0004950 tx=0x7f32d0009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.084+0000 7f32e7a93640 1 -- 172.21.15.115:0/2895444694 shutdown_connections 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.084+0000 7f32e7a93640 1 --2- 172.21.15.115:0/2895444694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fd7f0 0x7f32e00fdc60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.084+0000 7f32e7a93640 1 --2- 172.21.15.115:0/2895444694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fc520 0x7f32e00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.084+0000 7f32e7a93640 1 -- 172.21.15.115:0/2895444694 >> 172.21.15.115:0/2895444694 conn(0x7f32e00f7ce0 msgr2=0x7f32e00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:57.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.085+0000 7f32e7a93640 1 -- 172.21.15.115:0/2895444694 shutdown_connections 2024-09-13T23:06:57.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.085+0000 7f32e7a93640 1 -- 172.21.15.115:0/2895444694 wait complete. 2024-09-13T23:06:57.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 Processor -- start 2024-09-13T23:06:57.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 -- start start 2024-09-13T23:06:57.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fd7f0 0x7f32e0113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0114240 con 0x7f32e00fc520 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e7a93640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0114a60 con 0x7f32e00fd7f0 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e582f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e582f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51880/0 (socket says 172.21.15.115:51880) 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e582f640 1 -- 172.21.15.115:0/1231988950 learned_addr learned my addr 172.21.15.115:0/1231988950 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.086+0000 7f32e502e640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fd7f0 0x7f32e0113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.087+0000 7f32e582f640 1 -- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fd7f0 msgr2=0x7f32e0113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.087+0000 7f32e582f640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fd7f0 0x7f32e0113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.087+0000 7f32e582f640 1 -- 172.21.15.115:0/1231988950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc005040 con 0x7f32e00fc520 2024-09-13T23:06:57.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.087+0000 7f32e582f640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009700 tx=0x7f32dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:57.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.087+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x7f32e00fc520 2024-09-13T23:06:57.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.088+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d0005040 con 0x7f32e00fc520 2024-09-13T23:06:57.089 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.088+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f32dc00f040 con 0x7f32e00fc520 2024-09-13T23:06:57.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.088+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e0114fe0 con 0x7f32e00fc520 2024-09-13T23:06:57.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.088+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32dc01cbc0 con 0x7f32e00fc520 2024-09-13T23:06:57.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.089+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e00fb980 con 0x7f32e00fc520 2024-09-13T23:06:57.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.090+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f32dc00e930 con 0x7f32e00fc520 2024-09-13T23:06:57.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.091+0000 7f32d67fc640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 0x7f32cc070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:57.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.091+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f32dc08de60 con 0x7f32e00fc520 2024-09-13T23:06:57.092 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.091+0000 7f32e502e640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 0x7f32cc070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:57.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.094+0000 7f32e502e640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 0x7f32cc070be0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0009da0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:57.099 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.098+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f32dc057720 con 0x7f32e00fc520 2024-09-13T23:06:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.450+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f32e004b720 con 0x7f32e00fc520 2024-09-13T23:06:57.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.450+0000 7f32d67fc640 1 -- 172.21.15.115:0/1231988950 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f32dc01ce60 con 0x7f32e00fc520 2024-09-13T23:06:57.451 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 msgr2=0x7f32cc070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 0x7f32cc070be0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 msgr2=0x7f32e01136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009700 tx=0x7f32dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 shutdown_connections 2024-09-13T23:06:57.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f32cc06e730 0x7f32cc070be0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32e00fd7f0 0x7f32e0113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 --2- 172.21.15.115:0/1231988950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e00fc520 0x7f32e01136b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:57.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.452+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 >> 172.21.15.115:0/1231988950 conn(0x7f32e00f7ce0 msgr2=0x7f32e00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.453+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 shutdown_connections 2024-09-13T23:06:57.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:06:57.453+0000 7f32e7a93640 1 -- 172.21.15.115:0/1231988950 wait complete. 2024-09-13T23:06:57.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:57 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2229567231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:06:57.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:57 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2229567231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:06:58.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:58 smithi152 ceph-mon[34465]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:58.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:58 smithi152 ceph-mon[34465]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-13T23:06:58.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:58 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1231988950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:58.750 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:58 smithi115 ceph-mon[27601]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:58.750 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:58 smithi115 ceph-mon[27601]: pgmap v25: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-13T23:06:58.750 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:58 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1231988950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:59.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:06:59 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:59.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:06:59 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:00.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:00 smithi152 ceph-mon[34465]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-13T23:07:00.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:00 smithi115 ceph-mon[27601]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 532 op/s 2024-09-13T23:07:02.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:02 smithi152 ceph-mon[34465]: pgmap v27: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 839 op/s 2024-09-13T23:07:02.792 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:02 smithi115 ceph-mon[27601]: pgmap v27: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 839 op/s 2024-09-13T23:07:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:04 smithi115 ceph-mon[27601]: pgmap v28: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 563 op/s 2024-09-13T23:07:04.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:04 smithi152 ceph-mon[34465]: pgmap v28: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 563 op/s 2024-09-13T23:07:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:06 smithi152 ceph-mon[34465]: pgmap v29: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 822 op/s 2024-09-13T23:07:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:06 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:06.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:06 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:06 smithi115 ceph-mon[27601]: pgmap v29: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 822 op/s 2024-09-13T23:07:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:06 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:06 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:07 smithi152 ceph-mon[34465]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T23:07:07.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:07 smithi152 ceph-mon[34465]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T23:07:07.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:07 smithi115 ceph-mon[27601]: Reconfiguring grafana.smithi115 (dependencies changed)... 2024-09-13T23:07:07.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:07 smithi115 ceph-mon[27601]: Reconfiguring daemon grafana.smithi115 on smithi115 2024-09-13T23:07:08.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:08 smithi152 ceph-mon[34465]: pgmap v30: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 565 op/s 2024-09-13T23:07:08.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:08 smithi115 ceph-mon[27601]: pgmap v30: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 565 op/s 2024-09-13T23:07:10.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:10 smithi152 ceph-mon[34465]: pgmap v31: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 565 op/s 2024-09-13T23:07:10.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:10 smithi115 ceph-mon[27601]: pgmap v31: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 565 op/s 2024-09-13T23:07:12.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:12 smithi152 ceph-mon[34465]: pgmap v32: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 833 op/s 2024-09-13T23:07:12.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:12 smithi115 ceph-mon[27601]: pgmap v32: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 833 op/s 2024-09-13T23:07:14.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:14 smithi115 ceph-mon[27601]: pgmap v33: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 526 op/s 2024-09-13T23:07:14.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:14 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:14.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:14 smithi152 ceph-mon[34465]: pgmap v33: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 526 op/s 2024-09-13T23:07:14.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:14 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:16.466 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:16 smithi115 ceph-mon[27601]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 800 op/s 2024-09-13T23:07:16.466 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:16 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:16.466 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:16 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:16.700 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T23:07:16.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T23:07:16.721 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:16 smithi152 ceph-mon[34465]: pgmap v34: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 800 op/s 2024-09-13T23:07:16.721 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:16 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:16.721 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:16 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:17.172 DEBUG:teuthology.parallel:result is None 2024-09-13T23:07:17.620 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:17 smithi152 ceph-mon[34465]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:07:17.621 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:17 smithi152 ceph-mon[34465]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T23:07:17.755 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:17 smithi115 ceph-mon[27601]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:07:17.755 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:17 smithi115 ceph-mon[27601]: Deploying daemon prometheus.smithi115 on smithi115 2024-09-13T23:07:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:18 smithi152 ceph-mon[34465]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 541 op/s 2024-09-13T23:07:18.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:18 smithi115 ceph-mon[27601]: pgmap v35: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 541 op/s 2024-09-13T23:07:20.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:20 smithi152 ceph-mon[34465]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 541 op/s 2024-09-13T23:07:20.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:20 smithi115 ceph-mon[27601]: pgmap v36: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 541 op/s 2024-09-13T23:07:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:22 smithi152 ceph-mon[34465]: pgmap v37: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 776 op/s 2024-09-13T23:07:22.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:22 smithi115 ceph-mon[27601]: pgmap v37: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 776 op/s 2024-09-13T23:07:23.326 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T23:07:23.326 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T23:07:23.621 DEBUG:teuthology.parallel:result is None 2024-09-13T23:07:23.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T23:07:23.661 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T23:07:23.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T23:07:23.689 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T23:07:23.690 DEBUG:teuthology.parallel:result is None 2024-09-13T23:07:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:24 smithi152 ceph-mon[34465]: pgmap v38: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 508 op/s 2024-09-13T23:07:24.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:24 smithi115 ceph-mon[27601]: pgmap v38: 65 pgs: 65 active+clean; 297 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 508 op/s 2024-09-13T23:07:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:26 smithi115 ceph-mon[27601]: pgmap v39: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 674 op/s 2024-09-13T23:07:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:26 smithi152 ceph-mon[34465]: pgmap v39: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 674 op/s 2024-09-13T23:07:27.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/200482235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fc550 msgr2=0x7fd5ec0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/200482235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec0fc960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0048d0 tx=0x7fd5dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/200482235 shutdown_connections 2024-09-13T23:07:27.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/200482235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/200482235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec0fc960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/200482235 >> 172.21.15.115:0/200482235 conn(0x7fd5ec0f7d30 msgr2=0x7fd5ec0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/200482235 shutdown_connections 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.535+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/200482235 wait complete. 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 Processor -- start 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 -- start start 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec10dc10 con 0x7fd5ec0fd820 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5f1b9c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec10e3c0 con 0x7fd5ec0fc550 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5eaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50176/0 (socket says 172.21.15.115:50176) 2024-09-13T23:07:27.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5eaffd640 1 -- 172.21.15.115:0/3642695263 learned_addr learned my addr 172.21.15.115:0/3642695263 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.536+0000 7fd5eb7fe640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5eaffd640 1 -- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fc550 msgr2=0x7fd5ec10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5eaffd640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5eaffd640 1 -- 172.21.15.115:0/3642695263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc005040 con 0x7fd5ec0fd820 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5eaffd640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002a50 tx=0x7fd5e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e0007c30 con 0x7fd5ec0fd820 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5e000f040 con 0x7fd5ec0fd820 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec10e650 con 0x7fd5ec0fd820 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e000da90 con 0x7fd5ec0fd820 2024-09-13T23:07:27.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.537+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec10ebf0 con 0x7fd5ec0fd820 2024-09-13T23:07:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.538+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec0fb9b0 con 0x7fd5ec0fd820 2024-09-13T23:07:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.538+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd5e000dd00 con 0x7fd5ec0fd820 2024-09-13T23:07:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.539+0000 7fd5d3fff640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 0x7fd5d4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.539+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd5e008d800 con 0x7fd5ec0fd820 2024-09-13T23:07:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.539+0000 7fd5eb7fe640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 0x7fd5d4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.540+0000 7fd5eb7fe640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 0x7fd5d4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc007ac0 tx=0x7fd5dc035040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:27.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.543+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd5e004f670 con 0x7fd5ec0fd820 2024-09-13T23:07:27.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.723+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5ec10ef20 con 0x7fd5d406e6e0 2024-09-13T23:07:27.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.725+0000 7fd5d3fff640 1 -- 172.21.15.115:0/3642695263 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd5ec10ef20 con 0x7fd5d406e6e0 2024-09-13T23:07:27.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 msgr2=0x7fd5d4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 0x7fd5d4070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc007ac0 tx=0x7fd5dc035040 comp rx=0 tx=0).stop 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 msgr2=0x7fd5ec10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002a50 tx=0x7fd5e0004600 comp rx=0 tx=0).stop 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 shutdown_connections 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fd5d406e6e0 0x7fd5d4070b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5ec0fd820 0x7fd5ec10d5c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 --2- 172.21.15.115:0/3642695263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5ec0fc550 0x7fd5ec10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 >> 172.21.15.115:0/3642695263 conn(0x7fd5ec0f7d30 msgr2=0x7fd5ec0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:27.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 shutdown_connections 2024-09-13T23:07:27.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.727+0000 7fd5f1b9c640 1 -- 172.21.15.115:0/3642695263 wait complete. 2024-09-13T23:07:27.736 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:07:27.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- 172.21.15.115:0/258348511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 msgr2=0x7f14680fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 --2- 172.21.15.115:0/258348511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f14680fcb70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1458009c50 tx=0x7f1458004d10 comp rx=0 tx=0).stop 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- 172.21.15.115:0/258348511 shutdown_connections 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 --2- 172.21.15.115:0/258348511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f14680fcb70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 --2- 172.21.15.115:0/258348511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f14680fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- 172.21.15.115:0/258348511 >> 172.21.15.115:0/258348511 conn(0x7f14680f6c10 msgr2=0x7f14680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:27.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- 172.21.15.115:0/258348511 shutdown_connections 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- 172.21.15.115:0/258348511 wait complete. 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 Processor -- start 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.807+0000 7f146f0ee640 1 -- start start 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146f0ee640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f146810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146f0ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146f0ee640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146810cb10 con 0x7f14680fc700 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146f0ee640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146810d330 con 0x7f14680fb430 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f1467fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146ce8a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f146810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f1467fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50186/0 (socket says 172.21.15.115:50186) 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f1467fff640 1 -- 172.21.15.115:0/922307586 learned_addr learned my addr 172.21.15.115:0/922307586 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146ce8a640 1 -- 172.21.15.115:0/922307586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 msgr2=0x7f146810c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:27.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146ce8a640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146ce8a640 1 -- 172.21.15.115:0/922307586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580098b0 con 0x7f14680fb430 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f1467fff640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146ce8a640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f146810bf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14600027d0 tx=0x7f1460009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460002dc0 con 0x7f14680fb430 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146810d5c0 con 0x7f14680fb430 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.808+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f146000f040 con 0x7f14680fb430 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.809+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460009530 con 0x7f14680fb430 2024-09-13T23:07:27.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.809+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146810db60 con 0x7f14680fb430 2024-09-13T23:07:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.809+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14680fa890 con 0x7f14680fb430 2024-09-13T23:07:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.810+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1460007c30 con 0x7f14680fb430 2024-09-13T23:07:27.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.810+0000 7f14657fa640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 0x7f1454070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:27.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.811+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f146008d660 con 0x7f14680fb430 2024-09-13T23:07:27.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.811+0000 7f1467fff640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 0x7f1454070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:27.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.811+0000 7f1467fff640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 0x7f1454070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14580048c0 tx=0x7f1458004d10 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:27.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.815+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f146004f670 con 0x7f14680fb430 2024-09-13T23:07:27.998 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.997+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f146810de90 con 0x7f145406e6e0 2024-09-13T23:07:27.999 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:27.999+0000 7f14657fa640 1 -- 172.21.15.115:0/922307586 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f146810de90 con 0x7f145406e6e0 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 msgr2=0x7f1454070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 0x7f1454070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f14580048c0 tx=0x7f1458004d10 comp rx=0 tx=0).stop 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 msgr2=0x7f146810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f146810bf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14600027d0 tx=0x7f1460009f70 comp rx=0 tx=0).stop 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 shutdown_connections 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f145406e6e0 0x7f1454070b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14680fc700 0x7f146810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 --2- 172.21.15.115:0/922307586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14680fb430 0x7f146810bf80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 >> 172.21.15.115:0/922307586 conn(0x7f14680f6c10 msgr2=0x7f14680f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 shutdown_connections 2024-09-13T23:07:28.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.001+0000 7f146f0ee640 1 -- 172.21.15.115:0/922307586 wait complete. 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.079+0000 7f2f42173640 1 -- 172.21.15.115:0/3082340858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fc720 msgr2=0x7f2f3c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 --2- 172.21.15.115:0/3082340858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c0fcb90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2f300048d0 tx=0x7f2f30009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- 172.21.15.115:0/3082340858 shutdown_connections 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 --2- 172.21.15.115:0/3082340858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c0fcb90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 --2- 172.21.15.115:0/3082340858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- 172.21.15.115:0/3082340858 >> 172.21.15.115:0/3082340858 conn(0x7f2f3c0f6c10 msgr2=0x7f2f3c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- 172.21.15.115:0/3082340858 shutdown_connections 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- 172.21.15.115:0/3082340858 wait complete. 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 Processor -- start 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- start start 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c10d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c10e510 con 0x7f2f3c0fb450 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.080+0000 7f2f42173640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c10e680 con 0x7f2f3c0fc720 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50200/0 (socket says 172.21.15.115:50200) 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 -- 172.21.15.115:0/2317484003 learned_addr learned my addr 172.21.15.115:0/2317484003 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3affd640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c10d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 -- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 msgr2=0x7f2f3c10d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c10d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 -- 172.21.15.115:0/2317484003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30005040 con 0x7f2f3c0fb450 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3affd640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c10d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f3b7fe640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00b790 tx=0x7f2f2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c00c700 con 0x7f2f3c0fb450 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c10e960 con 0x7f2f3c0fb450 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f2c00cd00 con 0x7f2f3c0fb450 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2c015e70 con 0x7f2f3c0fb450 2024-09-13T23:07:28.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.081+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c10ee80 con 0x7f2f3c0fb450 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.082+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c1046e0 con 0x7f2f3c0fb450 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.083+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f2f2c012070 con 0x7f2f3c0fb450 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.083+0000 7f2f23fff640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 0x7f2f24070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.083+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2f2c08d9b0 con 0x7f2f3c0fb450 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.084+0000 7f2f3affd640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 0x7f2f24070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.084+0000 7f2f3affd640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 0x7f2f24070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f30007ac0 tx=0x7f2f30035040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.088+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2f2c057340 con 0x7f2f3c0fb450 2024-09-13T23:07:28.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.261+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3c103f40 con 0x7f2f2406e6e0 2024-09-13T23:07:28.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.270+0000 7f2f23fff640 1 -- 172.21.15.115:0/2317484003 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2f3c103f40 con 0x7f2f2406e6e0 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 starting - - - - 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (9m) 62s ago 9m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (8m) 56s ago 8m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 starting - - - - 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (3m) 62s ago 3m 115M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (3m) 62s ago 3m 70.0M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (3m) 56s ago 3m 146M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (3m) 56s ago 3m 91.1M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:07:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:9283,8765,8443 running (10m) 62s ago 10m 277M - 17.2.7-1629-geb16b97b ab51d1bebd12 2bbc19eb1b9c 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (106s) 56s ago 8m 481M - 19.1.1-324-gecab7be5 0652ff2b5d78 718f6398c5ee 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (10m) 62s ago 10m 48.7M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (7m) 56s ago 7m 41.6M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 starting - - - - 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (8m) 56s ago 8m 17.1M - 1.5.0 0da6a335fe13 4807a7ae6212 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (7m) 62s ago 7m 229M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (6m) 62s ago 6m 233M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (6m) 62s ago 6m 210M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (5m) 56s ago 5m 272M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (5m) 56s ago 5m 223M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (5m) 56s ago 5m 287M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:07:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 starting - - - - 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 msgr2=0x7f2f24070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 0x7f2f24070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2f30007ac0 tx=0x7f2f30035040 comp rx=0 tx=0).stop 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 msgr2=0x7f2f3c10d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c00b790 tx=0x7f2f2c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 shutdown_connections 2024-09-13T23:07:28.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f2f2406e6e0 0x7f2f24070b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f3c0fc720 0x7f2f3c10d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 --2- 172.21.15.115:0/2317484003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f3c0fb450 0x7f2f3c10d200 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 >> 172.21.15.115:0/2317484003 conn(0x7f2f3c0f6c10 msgr2=0x7f2f3c066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 shutdown_connections 2024-09-13T23:07:28.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.272+0000 7f2f42173640 1 -- 172.21.15.115:0/2317484003 wait complete. 2024-09-13T23:07:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 -- 172.21.15.115:0/2393856091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fdba0 msgr2=0x7f8db00fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 --2- 172.21.15.115:0/2393856091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fdba0 0x7f8db00fdfb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8da00048d0 tx=0x7f8da0009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 -- 172.21.15.115:0/2393856091 shutdown_connections 2024-09-13T23:07:28.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 --2- 172.21.15.115:0/2393856091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fe4f0 0x7f8db00fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 --2- 172.21.15.115:0/2393856091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fdba0 0x7f8db00fdfb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 -- 172.21.15.115:0/2393856091 >> 172.21.15.115:0/2393856091 conn(0x7f8db00f63a0 msgr2=0x7f8db00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 -- 172.21.15.115:0/2393856091 shutdown_connections 2024-09-13T23:07:28.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.349+0000 7f8db6214640 1 -- 172.21.15.115:0/2393856091 wait complete. 2024-09-13T23:07:28.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:28.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:28.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2024-09-13T23:07:28.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-13T23:07:28.351 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: pgmap v40: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-13T23:07:28.352 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:28 smithi115 ceph-mon[27601]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 Processor -- start 2024-09-13T23:07:28.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 -- start start 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fdba0 0x7f8db010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db010dc70 con 0x7f8db00fe4f0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8db6214640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db010e420 con 0x7f8db00fdba0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50220/0 (socket says 172.21.15.115:50220) 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 -- 172.21.15.115:0/3568649278 learned_addr learned my addr 172.21.15.115:0/3568649278 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8daf7fe640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fdba0 0x7f8db010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 -- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fdba0 msgr2=0x7f8db010d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fdba0 0x7f8db010d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 -- 172.21.15.115:0/3568649278 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da0005040 con 0x7f8db00fe4f0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.350+0000 7f8da7fff640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d98002f40 tx=0x7f8d9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.351+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d98007c30 con 0x7f8db00fe4f0 2024-09-13T23:07:28.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.351+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d9800f040 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.351+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db010e650 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.351+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9800cb60 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.351+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db010ebf0 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.352+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db00fa040 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.352+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f8d9800ccc0 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.353+0000 7f8dacff9640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 0x7f8d9c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.353+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8d9808dae0 con 0x7f8db00fe4f0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.353+0000 7f8daf7fe640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 0x7f8d9c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.353+0000 7f8daf7fe640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 0x7f8d9c070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8da0004540 tx=0x7f8da0035040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.357 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.357+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8d98057410 con 0x7f8db00fe4f0 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: Deploying daemon node-exporter.smithi152 on smithi152 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: pgmap v40: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-13T23:07:28.455 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:28 smithi152 ceph-mon[34465]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:28.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.589+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8db004b720 con 0x7f8db00fe4f0 2024-09-13T23:07:28.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.589+0000 7f8dacff9640 1 -- 172.21.15.115:0/3568649278 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f8d9805aad0 con 0x7f8db00fe4f0 2024-09-13T23:07:28.590 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:07:28.590 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:07:28.591 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 13, 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 msgr2=0x7f8d9c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 0x7f8d9c070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8da0004540 tx=0x7f8da0035040 comp rx=0 tx=0).stop 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 msgr2=0x7f8db010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d98002f40 tx=0x7f8d9800b040 comp rx=0 tx=0).stop 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 shutdown_connections 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f8d9c06e6e0 0x7f8d9c070b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db00fe4f0 0x7f8db010d620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 --2- 172.21.15.115:0/3568649278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8db00fdba0 0x7f8db010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.591+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 >> 172.21.15.115:0/3568649278 conn(0x7f8db00f63a0 msgr2=0x7f8db00f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.592+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 shutdown_connections 2024-09-13T23:07:28.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.592+0000 7f8db6214640 1 -- 172.21.15.115:0/3568649278 wait complete. 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 -- 172.21.15.115:0/1606394356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 msgr2=0x7fbb700fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1606394356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb700fb840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0048d0 tx=0x7fbb6c009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 -- 172.21.15.115:0/1606394356 shutdown_connections 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1606394356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb700fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1606394356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb700fb840 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 -- 172.21.15.115:0/1606394356 >> 172.21.15.115:0/1606394356 conn(0x7fbb700f6c10 msgr2=0x7fbb700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 -- 172.21.15.115:0/1606394356 shutdown_connections 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.670+0000 7fbb782a7640 1 -- 172.21.15.115:0/1606394356 wait complete. 2024-09-13T23:07:28.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 Processor -- start 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 -- start start 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb701122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70065c60 con 0x7fbb700fb430 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb782a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70065dd0 con 0x7fbb700fc700 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb76043640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb76043640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50244/0 (socket says 172.21.15.115:50244) 2024-09-13T23:07:28.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb76043640 1 -- 172.21.15.115:0/1440632846 learned_addr learned my addr 172.21.15.115:0/1440632846 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:28.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb76043640 1 -- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 msgr2=0x7fbb701122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.671+0000 7fbb75842640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb701122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb76043640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb701122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb76043640 1 -- 172.21.15.115:0/1440632846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c005040 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb75842640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb701122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb76043640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c003080 tx=0x7fbb6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6c038070 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbb6c02abd0 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70112830 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb70112da0 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.672+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb6c03e670 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.673+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb700fa890 con 0x7fbb700fb430 2024-09-13T23:07:28.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.674+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fbb6c030020 con 0x7fbb700fb430 2024-09-13T23:07:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.674+0000 7fbb66ffd640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 0x7fbb5c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.674+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbb6c0ae150 con 0x7fbb700fb430 2024-09-13T23:07:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.675+0000 7fbb75842640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 0x7fbb5c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.675+0000 7fbb75842640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 0x7fbb5c070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb600041d0 tx=0x7fbb60009040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.679+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbb6c077b60 con 0x7fbb700fb430 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.875+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbb70103e30 con 0x7fbb700fb430 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.875+0000 7fbb66ffd640 1 -- 172.21.15.115:0/1440632846 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7fbb6c07b220 con 0x7fbb700fb430 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:07:28.876 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:07:28.877 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:07:28.878 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:07:28.879 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 msgr2=0x7fbb5c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 0x7fbb5c070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbb600041d0 tx=0x7fbb60009040 comp rx=0 tx=0).stop 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 msgr2=0x7fbb7010fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c003080 tx=0x7fbb6c009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 shutdown_connections 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fbb5c06e6e0 0x7fbb5c070b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb700fc700 0x7fbb701122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 --2- 172.21.15.115:0/1440632846 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb700fb430 0x7fbb7010fda0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.877+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 >> 172.21.15.115:0/1440632846 conn(0x7fbb700f6c10 msgr2=0x7fbb700f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.878+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 shutdown_connections 2024-09-13T23:07:28.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.878+0000 7fbb782a7640 1 -- 172.21.15.115:0/1440632846 wait complete. 2024-09-13T23:07:28.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/1384728598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc065b80 msgr2=0x7f4fbc0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/1384728598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc065b80 0x7f4fbc0ff200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0048d0 tx=0x7f4fac009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/1384728598 shutdown_connections 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/1384728598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/1384728598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc065b80 0x7f4fbc0ff200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/1384728598 >> 172.21.15.115:0/1384728598 conn(0x7f4fbc0f6c10 msgr2=0x7f4fbc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/1384728598 shutdown_connections 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.956+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/1384728598 wait complete. 2024-09-13T23:07:28.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.957+0000 7f4fc1dc5640 1 Processor -- start 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.957+0000 7f4fc1dc5640 1 -- start start 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fc1dc5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fc1dc5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fc1dc5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc10dc20 con 0x7f4fbc0ff740 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fc1dc5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc10e380 con 0x7f4fbc065b80 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50264/0 (socket says 172.21.15.115:50264) 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:38884/0 (socket says 172.21.15.115:38884) 2024-09-13T23:07:28.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbaffd640 1 -- 172.21.15.115:0/406559460 learned_addr learned my addr 172.21.15.115:0/406559460 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 -- 172.21.15.115:0/406559460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 msgr2=0x7f4fbc10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 -- 172.21.15.115:0/406559460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac005040 con 0x7f4fbc065b80 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbaffd640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.958+0000 7f4fbb7fe640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0048a0 tx=0x7f4fac009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.959+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac038070 con 0x7f4fbc065b80 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.959+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4fac02ae90 con 0x7f4fbc065b80 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.959+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc10e5b0 con 0x7f4fbc065b80 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.959+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac033660 con 0x7f4fbc065b80 2024-09-13T23:07:28.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.959+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc10eaa0 con 0x7f4fbc065b80 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.960+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc105740 con 0x7f4fbc065b80 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.960+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f4fac030020 con 0x7f4fbc065b80 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.961+0000 7f4fa3fff640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 0x7f4fa4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.961+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4fac0adfa0 con 0x7f4fbc065b80 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.961+0000 7f4fbaffd640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 0x7f4fa4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:28.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.961+0000 7f4fbaffd640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 0x7f4fa4070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0004fd0 tx=0x7f4fb000b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:28.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:28.965+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4fac077960 con 0x7f4fbc065b80 2024-09-13T23:07:29.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.145+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 --> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fbc10edd0 con 0x7f4fa406e6e0 2024-09-13T23:07:29.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.146+0000 7f4fa3fff640 1 -- 172.21.15.115:0/406559460 <== mgr.24359 v2:172.21.15.152:6828/3157283215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4fbc10edd0 con 0x7f4fa406e6e0 2024-09-13T23:07:29.147 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:07:29.147 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:07:29.147 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:07:29.148 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 msgr2=0x7f4fa4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 0x7f4fa4070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0004fd0 tx=0x7f4fb000b040 comp rx=0 tx=0).stop 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 msgr2=0x7f4fbc10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0048a0 tx=0x7f4fac009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 shutdown_connections 2024-09-13T23:07:29.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7f4fa406e6e0 0x7f4fa4070b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fbc0ff740 0x7f4fbc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 --2- 172.21.15.115:0/406559460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fbc065b80 0x7f4fbc10d090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 >> 172.21.15.115:0/406559460 conn(0x7f4fbc0f6c10 msgr2=0x7f4fbc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:29.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 shutdown_connections 2024-09-13T23:07:29.150 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.148+0000 7f4fc1dc5640 1 -- 172.21.15.115:0/406559460 wait complete. 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 -- 172.21.15.115:0/2536359878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 msgr2=0x7fce440fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 --2- 172.21.15.115:0/2536359878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce440fc940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce340048d0 tx=0x7fce34009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 -- 172.21.15.115:0/2536359878 shutdown_connections 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 --2- 172.21.15.115:0/2536359878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 0x7fce440fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 --2- 172.21.15.115:0/2536359878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce440fc940 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 -- 172.21.15.115:0/2536359878 >> 172.21.15.115:0/2536359878 conn(0x7fce440f7d10 msgr2=0x7fce440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 -- 172.21.15.115:0/2536359878 shutdown_connections 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.226+0000 7fce4982a640 1 -- 172.21.15.115:0/2536359878 wait complete. 2024-09-13T23:07:29.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 Processor -- start 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 -- start start 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 0x7fce4406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4406fff0 con 0x7fce440fc530 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce4982a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44070130 con 0x7fce440fd800 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50284/0 (socket says 172.21.15.115:50284) 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 -- 172.21.15.115:0/2759759673 learned_addr learned my addr 172.21.15.115:0/2759759673 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce3bfff640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 0x7fce4406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 -- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 msgr2=0x7fce4406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 0x7fce4406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.227+0000 7fce42ffd640 1 -- 172.21.15.115:0/2759759673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34005040 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce42ffd640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce340043d0 tx=0x7fce34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce34038070 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce3402ae90 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce440703b0 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3403e670 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.228+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce441150e0 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.229+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4404b720 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.229+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fce34030020 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.230+0000 7fce3b7fe640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 0x7fce30070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.230+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fce340ae030 con 0x7fce440fc530 2024-09-13T23:07:29.231 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.230+0000 7fce3bfff640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 0x7fce30070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:29.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.231+0000 7fce3bfff640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 0x7fce30070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce2c004ed0 tx=0x7fce2c00b040 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:29.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.235+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fce34077a70 con 0x7fce440fc530 2024-09-13T23:07:29.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:29 smithi152 ceph-mon[34465]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:29 smithi152 ceph-mon[34465]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:29 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3568649278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:29.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:29 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:29.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:29 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/1440632846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:07:29.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.466+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fce44070540 con 0x7fce440fc530 2024-09-13T23:07:29.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.466+0000 7fce3b7fe640 1 -- 172.21.15.115:0/2759759673 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fce44070540 con 0x7fce440fc530 2024-09-13T23:07:29.467 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:07:29.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 msgr2=0x7fce30070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 0x7fce30070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce2c004ed0 tx=0x7fce2c00b040 comp rx=0 tx=0).stop 2024-09-13T23:07:29.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 msgr2=0x7fce44071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:29.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce340043d0 tx=0x7fce34009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 shutdown_connections 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:6828/3157283215,v1:172.21.15.152:6829/3157283215] conn(0x7fce3006e6e0 0x7fce30070b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce440fd800 0x7fce4406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 --2- 172.21.15.115:0/2759759673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce440fc530 0x7fce44071570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 >> 172.21.15.115:0/2759759673 conn(0x7fce440f7d10 msgr2=0x7fce440f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 shutdown_connections 2024-09-13T23:07:29.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:29.468+0000 7fce4982a640 1 -- 172.21.15.115:0/2759759673 wait complete. 2024-09-13T23:07:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:29 smithi115 ceph-mon[27601]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:29 smithi115 ceph-mon[27601]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:29 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3568649278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:29 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:29 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/1440632846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: pgmap v41: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2759759673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:07:30.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:07:30.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:07:30.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:30.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: Upgrade: Need to upgrade myself (mgr.smithi152.ntylos) 2024-09-13T23:07:30.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:30 smithi115 ceph-mon[27601]: Upgrade: Need to upgrade myself (mgr.smithi152.ntylos) 2024-09-13T23:07:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: pgmap v41: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2024-09-13T23:07:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2759759673' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:07:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: Upgrade: Need to upgrade myself (mgr.smithi152.ntylos) 2024-09-13T23:07:30.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:30 smithi152 ceph-mon[34465]: Upgrade: Need to upgrade myself (mgr.smithi152.ntylos) 2024-09-13T23:07:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: Upgrade: Updating mgr.smithi115.eqesbc 2024-09-13T23:07:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:07:32.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:07:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:07:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: Deploying daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T23:07:32.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:32 smithi152 ceph-mon[34465]: pgmap v42: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 404 op/s 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: Upgrade: Updating mgr.smithi115.eqesbc 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: Deploying daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T23:07:32.471 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:32 smithi115 ceph-mon[27601]: pgmap v42: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 404 op/s 2024-09-13T23:07:34.639 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:34 smithi115 ceph-mon[27601]: pgmap v43: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 745 KiB/s rd, 628 KiB/s wr, 169 op/s 2024-09-13T23:07:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:34 smithi152 ceph-mon[34465]: pgmap v43: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 745 KiB/s rd, 628 KiB/s wr, 169 op/s 2024-09-13T23:07:35.964 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:35 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:35.965 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:35 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:35.965 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:35 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:35.965 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:35 smithi115 ceph-mon[27601]: pgmap v44: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 747 KiB/s rd, 630 KiB/s wr, 172 op/s 2024-09-13T23:07:36.074 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:35 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:36.074 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:35 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:36.074 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:35 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:36.074 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:35 smithi152 ceph-mon[34465]: pgmap v44: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 747 KiB/s rd, 630 KiB/s wr, 172 op/s 2024-09-13T23:07:38.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:38 smithi115 ceph-mon[27601]: pgmap v45: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-13T23:07:38.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:38.777 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:38 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:38 smithi152 ceph-mon[34465]: pgmap v45: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-13T23:07:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:38 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: pgmap v46: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: Standby manager daemon smithi115.eqesbc restarted 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: Standby manager daemon smithi115.eqesbc started 2024-09-13T23:07:40.942 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/crt"}]: dispatch 2024-09-13T23:07:40.943 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:07:40.943 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/key"}]: dispatch 2024-09-13T23:07:40.943 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:07:40.943 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.943 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:40 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: pgmap v46: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: Standby manager daemon smithi115.eqesbc restarted 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: Standby manager daemon smithi115.eqesbc started 2024-09-13T23:07:40.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/crt"}]: dispatch 2024-09-13T23:07:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:07:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.eqesbc/key"}]: dispatch 2024-09-13T23:07:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:07:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:40.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:40 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:41.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:41 smithi152 ceph-mon[34465]: mgrmap e26: smithi152.ntylos(active, since 87s), standbys: smithi115.eqesbc 2024-09-13T23:07:41.976 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:41 smithi115 ceph-mon[27601]: mgrmap e26: smithi152.ntylos(active, since 87s), standbys: smithi115.eqesbc 2024-09-13T23:07:42.906 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:42 smithi152 ceph-mon[34465]: pgmap v47: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-13T23:07:43.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:42 smithi115 ceph-mon[27601]: pgmap v47: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-13T23:07:44.828 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:44.828 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:44.828 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:44.829 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: Activating manager daemon smithi115.eqesbc 2024-09-13T23:07:44.830 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T23:07:44.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd='[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]': finished 2024-09-13T23:07:44.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: mgrmap e27: smithi115.eqesbc(active, starting, since 0.00830852s) 2024-09-13T23:07:44.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:07:44.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:07:44.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:07:44.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:07:44.833 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:07:44.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: Manager daemon smithi115.eqesbc is now available 2024-09-13T23:07:44.835 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:44.836 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:44.836 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:07:44.836 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:44 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T23:07:45.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 172.21.15.152:0/2428119506' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: Activating manager daemon smithi115.eqesbc 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.24359 ' entity='mgr.smithi152.ntylos' cmd='[{"prefix": "mgr fail", "who": "smithi152.ntylos"}]': finished 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: mgrmap e27: smithi115.eqesbc(active, starting, since 0.00830852s) 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:07:45.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:07:45.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: Manager daemon smithi115.eqesbc is now available 2024-09-13T23:07:45.052 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:45.052 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:45.052 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:07:45.052 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:44 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: mgrmap e28: smithi115.eqesbc(active, since 1.01036s) 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: [13/Sep/2024:23:07:45] ENGINE Bus STARTING 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: [13/Sep/2024:23:07:45] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: [13/Sep/2024:23:07:45] ENGINE Error in HTTPServer.serve 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T23:07:46.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T23:07:46.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:07:46.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T23:07:46.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:07:46.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: [13/Sep/2024:23:07:45] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T23:07:46.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:45 smithi115 ceph-mon[27601]: [13/Sep/2024:23:07:45] ENGINE Bus STARTED 2024-09-13T23:07:46.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: mgrmap e28: smithi115.eqesbc(active, since 1.01036s) 2024-09-13T23:07:46.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: [13/Sep/2024:23:07:45] ENGINE Bus STARTING 2024-09-13T23:07:46.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: [13/Sep/2024:23:07:45] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T23:07:46.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: [13/Sep/2024:23:07:45] ENGINE Error in HTTPServer.serve 2024-09-13T23:07:46.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:07:46.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: [13/Sep/2024:23:07:45] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T23:07:46.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:45 smithi152 ceph-mon[34465]: [13/Sep/2024:23:07:45] ENGINE Bus STARTED 2024-09-13T23:07:46.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:46 smithi152 ceph-mon[34465]: pgmap v4: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:07:46.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:46 smithi152 ceph-mon[34465]: mgrmap e29: smithi115.eqesbc(active, since 2s) 2024-09-13T23:07:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:46 smithi115 ceph-mon[27601]: pgmap v4: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:07:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:46 smithi115 ceph-mon[27601]: mgrmap e29: smithi115.eqesbc(active, since 2s) 2024-09-13T23:07:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:48 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:48 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:48 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:48 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:48 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:48 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:48 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:48.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:48 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: pgmap v5: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: mgrmap e30: smithi115.eqesbc(active, since 4s) 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:07:49.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:07:49.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:49 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:07:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: pgmap v5: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:07:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: mgrmap e30: smithi115.eqesbc(active, since 4s) 2024-09-13T23:07:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:07:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:07:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:07:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:07:49.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:49 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/290265073' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:07:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:50 smithi115 ceph-mon[27601]: mgrmap e31: smithi115.eqesbc(active, since 5s), standbys: smithi152.ntylos 2024-09-13T23:07:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:50 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:50 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:50.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:50 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:50 smithi152 ceph-mon[34465]: mgrmap e31: smithi115.eqesbc(active, since 5s), standbys: smithi152.ntylos 2024-09-13T23:07:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:50 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:07:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:50 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:50 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:51 smithi152 ceph-mon[34465]: pgmap v6: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T23:07:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:51 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:51.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:51 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:51 smithi115 ceph-mon[27601]: pgmap v6: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T23:07:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:51 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:52.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:51 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:53.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:53 smithi115 ceph-mon[27601]: pgmap v7: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T23:07:53.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:53 smithi152 ceph-mon[34465]: pgmap v7: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T23:07:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: pgmap v8: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T23:07:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:54 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: pgmap v8: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T23:07:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:55.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:54 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:07:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:55 smithi152 ceph-mon[34465]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:07:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:55 smithi152 ceph-mon[34465]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T23:07:56.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:55 smithi115 ceph-mon[27601]: Reconfiguring prometheus.smithi115 (dependencies changed)... 2024-09-13T23:07:56.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:55 smithi115 ceph-mon[27601]: Reconfiguring daemon prometheus.smithi115 on smithi115 2024-09-13T23:07:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:56 smithi152 ceph-mon[34465]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:07:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:56 smithi115 ceph-mon[27601]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:07:59.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:58 smithi115 ceph-mon[27601]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T23:07:59.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:58 smithi152 ceph-mon[34465]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T23:07:59.557 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.554+0000 7fcd6c551640 1 -- 172.21.15.115:0/2820363555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 msgr2=0x7fcd640fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.554+0000 7fcd6c551640 1 --2- 172.21.15.115:0/2820363555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd640fc960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcd600048d0 tx=0x7fcd60009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- 172.21.15.115:0/2820363555 shutdown_connections 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 --2- 172.21.15.115:0/2820363555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 0x7fcd640fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 --2- 172.21.15.115:0/2820363555 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd640fc960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- 172.21.15.115:0/2820363555 >> 172.21.15.115:0/2820363555 conn(0x7fcd640f7d30 msgr2=0x7fcd640fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- 172.21.15.115:0/2820363555 shutdown_connections 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- 172.21.15.115:0/2820363555 wait complete. 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 Processor -- start 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- start start 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 0x7fcd6410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6410dc10 con 0x7fcd640fc550 2024-09-13T23:07:59.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.555+0000 7fcd6c551640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6410e430 con 0x7fcd640fd820 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58590/0 (socket says 172.21.15.115:58590) 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 -- 172.21.15.115:0/1511411929 learned_addr learned my addr 172.21.15.115:0/1511411929 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd69aec640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 0x7fcd6410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 -- 172.21.15.115:0/1511411929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 msgr2=0x7fcd6410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 0x7fcd6410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 -- 172.21.15.115:0/1511411929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60005040 con 0x7fcd640fc550 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6a2ed640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd600043d0 tx=0x7fcd60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd60038070 con 0x7fcd640fc550 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6410e660 con 0x7fcd640fc550 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd6002ae90 con 0x7fcd640fc550 2024-09-13T23:07:59.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.556+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd6003e670 con 0x7fcd640fc550 2024-09-13T23:07:59.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.557+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6410ec00 con 0x7fcd640fc550 2024-09-13T23:07:59.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.558+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd640fb9b0 con 0x7fcd640fc550 2024-09-13T23:07:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.558+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fcd60030020 con 0x7fcd640fc550 2024-09-13T23:07:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.559+0000 7fcd5affd640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 0x7fcd50070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.559+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fcd600adb40 con 0x7fcd640fc550 2024-09-13T23:07:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.559+0000 7fcd69aec640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 0x7fcd50070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.560+0000 7fcd69aec640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 0x7fcd50070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd6410ce30 tx=0x7fcd5400b040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.563+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fcd60077420 con 0x7fcd640fc550 2024-09-13T23:07:59.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.783+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 --> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd6410eee0 con 0x7fcd5006df60 2024-09-13T23:07:59.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.785+0000 7fcd5affd640 1 -- 172.21.15.115:0/1511411929 <== mgr.14716 v2:172.21.15.115:6800/4125949334 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fcd6410eee0 con 0x7fcd5006df60 2024-09-13T23:07:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.786+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 msgr2=0x7fcd50070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.786+0000 7fcd6c551640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 0x7fcd50070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd6410ce30 tx=0x7fcd5400b040 comp rx=0 tx=0).stop 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.786+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 msgr2=0x7fcd6410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.786+0000 7fcd6c551640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcd600043d0 tx=0x7fcd60009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 shutdown_connections 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fcd5006df60 0x7fcd50070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd640fd820 0x7fcd6410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 --2- 172.21.15.115:0/1511411929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd640fc550 0x7fcd6410d080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 >> 172.21.15.115:0/1511411929 conn(0x7fcd640f7d30 msgr2=0x7fcd640f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:59.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 shutdown_connections 2024-09-13T23:07:59.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.787+0000 7fcd6c551640 1 -- 172.21.15.115:0/1511411929 wait complete. 2024-09-13T23:07:59.796 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:07:59.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.866+0000 7fead9e34640 1 -- 172.21.15.115:0/1602833494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 msgr2=0x7fead40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.866+0000 7fead9e34640 1 --2- 172.21.15.115:0/1602833494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead40fb840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feac40048d0 tx=0x7feac4009da0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 -- 172.21.15.115:0/1602833494 shutdown_connections 2024-09-13T23:07:59.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 --2- 172.21.15.115:0/1602833494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 0x7fead40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.868 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 --2- 172.21.15.115:0/1602833494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead40fb840 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 -- 172.21.15.115:0/1602833494 >> 172.21.15.115:0/1602833494 conn(0x7fead40f6c10 msgr2=0x7fead40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:59.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 -- 172.21.15.115:0/1602833494 shutdown_connections 2024-09-13T23:07:59.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 -- 172.21.15.115:0/1602833494 wait complete. 2024-09-13T23:07:59.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 Processor -- start 2024-09-13T23:07:59.869 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.867+0000 7fead9e34640 1 -- start start 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 0x7fead410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead410dc10 con 0x7fead40fb430 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead410e430 con 0x7fead40fc700 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58594/0 (socket says 172.21.15.115:58594) 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 -- 172.21.15.115:0/2368261369 learned_addr learned my addr 172.21.15.115:0/2368261369 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7feacaffd640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 0x7fead410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 -- 172.21.15.115:0/2368261369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 msgr2=0x7fead410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 0x7fead410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 -- 172.21.15.115:0/2368261369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4005040 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead37fe640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feac40043d0 tx=0x7feac4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac4038070 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feac402ae90 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead410e660 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac403e670 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.868+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead410ec00 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.870+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40fa890 con 0x7fead40fb430 2024-09-13T23:07:59.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.870+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7feac4030020 con 0x7fead40fb430 2024-09-13T23:07:59.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.870+0000 7fead0ff9640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 0x7feac0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:59.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.870+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7feac40adbd0 con 0x7fead40fb430 2024-09-13T23:07:59.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.870+0000 7feacaffd640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 0x7feac0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:59.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.871+0000 7feacaffd640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 0x7feac0070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feabc007fd0 tx=0x7feabc009e90 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:59.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:07:59.875+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7feac4077470 con 0x7fead40fb430 2024-09-13T23:08:00.040 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:07:59 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:00.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.063+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 --> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fead410ee20 con 0x7feac006df60 2024-09-13T23:08:00.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.064+0000 7fead0ff9640 1 -- 172.21.15.115:0/2368261369 <== mgr.14716 v2:172.21.15.115:6800/4125949334 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fead410ee20 con 0x7feac006df60 2024-09-13T23:08:00.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 msgr2=0x7feac0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 0x7feac0070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feabc007fd0 tx=0x7feabc009e90 comp rx=0 tx=0).stop 2024-09-13T23:08:00.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 msgr2=0x7fead410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feac40043d0 tx=0x7feac4009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 shutdown_connections 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7feac006df60 0x7feac0070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fead40fc700 0x7fead410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 --2- 172.21.15.115:0/2368261369 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead40fb430 0x7fead410d080 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.066+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 >> 172.21.15.115:0/2368261369 conn(0x7fead40f6c10 msgr2=0x7fead4065640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.067+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 shutdown_connections 2024-09-13T23:08:00.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.067+0000 7fead9e34640 1 -- 172.21.15.115:0/2368261369 wait complete. 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 -- 172.21.15.115:0/1722452627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 msgr2=0x7f9df00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 --2- 172.21.15.115:0/1722452627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00ff140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9de00048d0 tx=0x7f9de0009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 -- 172.21.15.115:0/1722452627 shutdown_connections 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 --2- 172.21.15.115:0/1722452627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 0x7f9df0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 --2- 172.21.15.115:0/1722452627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00ff140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.145+0000 7f9df6528640 1 -- 172.21.15.115:0/1722452627 >> 172.21.15.115:0/1722452627 conn(0x7f9df00f6c10 msgr2=0x7f9df00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 -- 172.21.15.115:0/1722452627 shutdown_connections 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 -- 172.21.15.115:0/1722452627 wait complete. 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 Processor -- start 2024-09-13T23:08:00.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 -- start start 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 0x7f9df00fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00fb580 con 0x7f9df0065c40 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9df6528640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00fb6c0 con 0x7f9df00ff680 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.146+0000 7f9deffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58610/0 (socket says 172.21.15.115:58610) 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 -- 172.21.15.115:0/1982557811 learned_addr learned my addr 172.21.15.115:0/1982557811 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9def7fe640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 0x7f9df00fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 -- 172.21.15.115:0/1982557811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 msgr2=0x7f9df00fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 0x7f9df00fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 -- 172.21.15.115:0/1982557811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0005040 con 0x7f9df0065c40 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9deffff640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9de00048a0 tx=0x7f9de0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de0038070 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9de002abd0 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df00fb940 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de0033640 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.147+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0115160 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.148+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df004b720 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.149+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f9de0030020 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.149+0000 7f9decff9640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 0x7f9dd8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.149+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f9de00adc70 con 0x7f9df0065c40 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.149+0000 7f9def7fe640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 0x7f9dd8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.150+0000 7f9def7fe640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 0x7f9dd8070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9de40041d0 tx=0x7f9de4009040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.154+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9de0077520 con 0x7f9df0065c40 2024-09-13T23:08:00.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:07:59 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:00.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.353+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 --> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9df00fbad0 con 0x7f9dd806df60 2024-09-13T23:08:00.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.363+0000 7f9decff9640 1 -- 172.21.15.115:0/1982557811 <== mgr.14716 v2:172.21.15.115:6800/4125949334 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9df00fbad0 con 0x7f9dd806df60 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (54s) 10s ago 9m 25.6M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (9m) 10s ago 9m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (8m) 12s ago 8m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (44s) 10s ago 9m 79.7M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (4m) 10s ago 4m 124M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (4m) 10s ago 4m 72.3M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (4m) 12s ago 4m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (3m) 12s ago 3m 68.2M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (26s) 10s ago 10m 475M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283 running (2m) 12s ago 8m 122M - 19.1.1-324-gecab7be5 0652ff2b5d78 718f6398c5ee 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (10m) 10s ago 10m 54.5M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 fb7b988713a9 2024-09-13T23:08:00.364 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (8m) 12s ago 8m 43.8M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (78s) 10s ago 9m 16.5M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (31s) 12s ago 8m 8488k - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (7m) 10s ago 7m 209M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (7m) 10s ago 7m 230M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (6m) 10s ago 6m 190M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (6m) 12s ago 6m 273M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (5m) 12s ago 5m 234M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (5m) 12s ago 5m 229M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:08:00.365 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 starting - - - - 2024-09-13T23:08:00.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 msgr2=0x7f9dd8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 0x7f9dd8070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9de40041d0 tx=0x7f9de4009040 comp rx=0 tx=0).stop 2024-09-13T23:08:00.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 msgr2=0x7f9df00fcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9de00048a0 tx=0x7f9de0009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 shutdown_connections 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dd806df60 0x7f9dd8070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9df00ff680 0x7f9df00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 --2- 172.21.15.115:0/1982557811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9df0065c40 0x7f9df00fcb00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.365+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 >> 172.21.15.115:0/1982557811 conn(0x7f9df00f6c10 msgr2=0x7f9df00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.366+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 shutdown_connections 2024-09-13T23:08:00.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.366+0000 7f9df6528640 1 -- 172.21.15.115:0/1982557811 wait complete. 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2044553572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fd820 msgr2=0x7fbe340fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2044553572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fd820 0x7fbe340fdc90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbe280048d0 tx=0x7fbe28009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2044553572 shutdown_connections 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2044553572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fd820 0x7fbe340fdc90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2044553572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fc550 0x7fbe340fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2044553572 >> 172.21.15.115:0/2044553572 conn(0x7fbe340f7d30 msgr2=0x7fbe340fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.454 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2044553572 shutdown_connections 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.451+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2044553572 wait complete. 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 Processor -- start 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 -- start start 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fd820 0x7fbe3410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3410dc40 con 0x7fbe340fc550 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe3a55b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3410e460 con 0x7fbe340fd820 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.452+0000 7fbe33fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58634/0 (socket says 172.21.15.115:58634) 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 -- 172.21.15.115:0/2634594821 learned_addr learned my addr 172.21.15.115:0/2634594821 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe337fe640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fd820 0x7fbe3410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 -- 172.21.15.115:0/2634594821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fd820 msgr2=0x7fbe3410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fd820 0x7fbe3410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 -- 172.21.15.115:0/2634594821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28005040 con 0x7fbe340fc550 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe33fff640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400eb70 tx=0x7fbe2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24007c30 con 0x7fbe340fc550 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3410e690 con 0x7fbe340fc550 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbe2400f040 con 0x7fbe340fc550 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe2400ca60 con 0x7fbe340fc550 2024-09-13T23:08:00.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.453+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3410ec30 con 0x7fbe340fc550 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.454+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe340fb9b0 con 0x7fbe340fc550 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.455+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7fbe2400cbc0 con 0x7fbe340fc550 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.455+0000 7fbe30ff9640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 0x7fbe1c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.455+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fbe2408d6a0 con 0x7fbe340fc550 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.455+0000 7fbe337fe640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 0x7fbe1c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.456+0000 7fbe337fe640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 0x7fbe1c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007ac0 tx=0x7fbe28035040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.459+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbe24056e70 con 0x7fbe340fc550 2024-09-13T23:08:00.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.689+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe34104f80 con 0x7fbe340fc550 2024-09-13T23:08:00.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.689+0000 7fbe30ff9640 1 -- 172.21.15.115:0/2634594821 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fbe34104f80 con 0x7fbe340fc550 2024-09-13T23:08:00.690 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:08:00.690 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:08:00.690 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 12, 2024-09-13T23:08:00.691 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.691+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 msgr2=0x7fbe1c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.691+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 0x7fbe1c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007ac0 tx=0x7fbe28035040 comp rx=0 tx=0).stop 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.691+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 msgr2=0x7fbe3410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.691+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400eb70 tx=0x7fbe2400b040 comp rx=0 tx=0).stop 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 shutdown_connections 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7fbe1c06df60 0x7fbe1c070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe340fd820 0x7fbe3410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 --2- 172.21.15.115:0/2634594821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe340fc550 0x7fbe3410d0b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 >> 172.21.15.115:0/2634594821 conn(0x7fbe340f7d30 msgr2=0x7fbe340f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 shutdown_connections 2024-09-13T23:08:00.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.692+0000 7fbe3a55b640 1 -- 172.21.15.115:0/2634594821 wait complete. 2024-09-13T23:08:00.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- 172.21.15.115:0/4087363276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 msgr2=0x7f0f0c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 --2- 172.21.15.115:0/4087363276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c0ff160 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0f000048d0 tx=0x7f0f00009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- 172.21.15.115:0/4087363276 shutdown_connections 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 --2- 172.21.15.115:0/4087363276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 0x7f0f0c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 --2- 172.21.15.115:0/4087363276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c0ff160 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- 172.21.15.115:0/4087363276 >> 172.21.15.115:0/4087363276 conn(0x7f0f0c0f6c10 msgr2=0x7f0f0c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- 172.21.15.115:0/4087363276 shutdown_connections 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- 172.21.15.115:0/4087363276 wait complete. 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 Processor -- start 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.769+0000 7f0f13a55640 1 -- start start 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f13a55640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f13a55640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 0x7f0f0c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f13a55640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10dc20 con 0x7f0f0c065c20 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f13a55640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10e440 con 0x7f0f0c0ff6a0 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58652/0 (socket says 172.21.15.115:58652) 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 -- 172.21.15.115:0/2148431491 learned_addr learned my addr 172.21.15.115:0/2148431491 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f10ff0640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 0x7f0f0c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 -- 172.21.15.115:0/2148431491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 msgr2=0x7f0f0c10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 0x7f0f0c10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 -- 172.21.15.115:0/2148431491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f00005040 con 0x7f0f0c065c20 2024-09-13T23:08:00.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f117f1640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f000043d0 tx=0x7f0f00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f00038070 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c10e670 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f0002ae90 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.770+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0003e670 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.771+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c10ec10 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.771+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c0fa890 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.772+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f0f00030020 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.773+0000 7f0efdffb640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 0x7f0ef8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.773+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0f000adb00 con 0x7f0f0c065c20 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.773+0000 7f0f10ff0640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 0x7f0ef8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.773+0000 7f0f10ff0640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 0x7f0ef8070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c10ce40 tx=0x7f0f0800b040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.777+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0f000773e0 con 0x7f0f0c065c20 2024-09-13T23:08:00.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.974+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f0c104f50 con 0x7f0f0c065c20 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.975+0000 7f0efdffb640 1 -- 172.21.15.115:0/2148431491 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f0f0007aaa0 con 0x7f0f0c065c20 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:08:00.976 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:08:00.977 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:00.978 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:00.979 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:08:00.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 msgr2=0x7f0ef8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 0x7f0ef8070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c10ce40 tx=0x7f0f0800b040 comp rx=0 tx=0).stop 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 msgr2=0x7f0f0c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f000043d0 tx=0x7f0f00009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 shutdown_connections 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f0ef806df60 0x7f0ef8070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f0c0ff6a0 0x7f0f0c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 --2- 172.21.15.115:0/2148431491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f0c065c20 0x7f0f0c10d090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 >> 172.21.15.115:0/2148431491 conn(0x7f0f0c0f6c10 msgr2=0x7f0f0c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 shutdown_connections 2024-09-13T23:08:00.980 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:00.977+0000 7f0f13a55640 1 -- 172.21.15.115:0/2148431491 wait complete. 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 -- 172.21.15.115:0/3082249252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fd810 msgr2=0x7f9dc40fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 --2- 172.21.15.115:0/3082249252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fd810 0x7f9dc40fdc80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9db80048d0 tx=0x7f9db8009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 -- 172.21.15.115:0/3082249252 shutdown_connections 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 --2- 172.21.15.115:0/3082249252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fd810 0x7f9dc40fdc80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 --2- 172.21.15.115:0/3082249252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fc540 0x7f9dc40fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 -- 172.21.15.115:0/3082249252 >> 172.21.15.115:0/3082249252 conn(0x7f9dc40f7d00 msgr2=0x7f9dc40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 -- 172.21.15.115:0/3082249252 shutdown_connections 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.055+0000 7f9dca901640 1 -- 172.21.15.115:0/3082249252 wait complete. 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 Processor -- start 2024-09-13T23:08:01.057 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 -- start start 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fd810 0x7f9dc410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc410dc40 con 0x7f9dc40fc540 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dca901640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc410e410 con 0x7f9dc40fd810 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dc3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dc3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58666/0 (socket says 172.21.15.115:58666) 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.056+0000 7f9dc3fff640 1 -- 172.21.15.115:0/3407641958 learned_addr learned my addr 172.21.15.115:0/3407641958 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc37fe640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fd810 0x7f9dc410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc3fff640 1 -- 172.21.15.115:0/3407641958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fd810 msgr2=0x7f9dc410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.059 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc3fff640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fd810 0x7f9dc410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc3fff640 1 -- 172.21.15.115:0/3407641958 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8005040 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc3fff640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9db4002a50 tx=0x7f9db4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db4007c30 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc410e6a0 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9db400f040 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9db400da10 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.057+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc410ec40 con 0x7f9dc40fc540 2024-09-13T23:08:01.060 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.058+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc40fb9a0 con 0x7f9dc40fc540 2024-09-13T23:08:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.059+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f9db400dca0 con 0x7f9dc40fc540 2024-09-13T23:08:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.059+0000 7f9dc0ff9640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 0x7f9dac070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.059+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f9db408d250 con 0x7f9dc40fc540 2024-09-13T23:08:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.059+0000 7f9dc37fe640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 0x7f9dac070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.061 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.060+0000 7f9dc37fe640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 0x7f9dac070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc410ce60 tx=0x7f9db8035040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:01.064 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.063+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9db4056a20 con 0x7f9dc40fc540 2024-09-13T23:08:01.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.245+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 --> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dc410efc0 con 0x7f9dac06df60 2024-09-13T23:08:01.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.247+0000 7f9dc0ff9640 1 -- 172.21.15.115:0/3407641958 <== mgr.14716 v2:172.21.15.115:6800/4125949334 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9dc410efc0 con 0x7f9dac06df60 2024-09-13T23:08:01.247 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:08:01.247 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "2/21 daemons upgraded", 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:08:01.248 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 msgr2=0x7f9dac070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 0x7f9dac070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9dc410ce60 tx=0x7f9db8035040 comp rx=0 tx=0).stop 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 msgr2=0x7f9dc410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9db4002a50 tx=0x7f9db4004600 comp rx=0 tx=0).stop 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 shutdown_connections 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f9dac06df60 0x7f9dac070410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dc40fd810 0x7f9dc410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 --2- 172.21.15.115:0/3407641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dc40fc540 0x7f9dc410d0b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 >> 172.21.15.115:0/3407641958 conn(0x7f9dc40f7d00 msgr2=0x7f9dc40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 shutdown_connections 2024-09-13T23:08:01.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.249+0000 7f9dca901640 1 -- 172.21.15.115:0/3407641958 wait complete. 2024-09-13T23:08:01.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.327+0000 7f8e9423a640 1 -- 172.21.15.115:0/3923577628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c0ff720 msgr2=0x7f8e8c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.327+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3923577628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c101b00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e800048d0 tx=0x7f8e80009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- 172.21.15.115:0/3923577628 shutdown_connections 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3923577628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c101b00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3923577628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c066690 0x7f8e8c0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- 172.21.15.115:0/3923577628 >> 172.21.15.115:0/3923577628 conn(0x7f8e8c0f6c10 msgr2=0x7f8e8c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- 172.21.15.115:0/3923577628 shutdown_connections 2024-09-13T23:08:01.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- 172.21.15.115:0/3923577628 wait complete. 2024-09-13T23:08:01.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 Processor -- start 2024-09-13T23:08:01.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- start start 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c10feb0 con 0x7f8e8c066690 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.328+0000 7f8e9423a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1106d0 con 0x7f8e8c0ff720 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58676/0 (socket says 172.21.15.115:58676) 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 -- 172.21.15.115:0/3066787889 learned_addr learned my addr 172.21.15.115:0/3066787889 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e917d5640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 -- 172.21.15.115:0/3066787889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c0ff720 msgr2=0x7f8e8c10f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c10f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 -- 172.21.15.115:0/3066787889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e80005040 con 0x7f8e8c066690 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e91fd6640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e84002840 tx=0x7f8e84004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:01.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e84007c30 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e8400f040 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c110960 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8400d990 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.329+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c110ed0 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.330+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c105790 con 0x7f8e8c066690 2024-09-13T23:08:01.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.331+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 31) v1 ==== 92377+0+0 (secure 0 0 0) 0x7f8e84009600 con 0x7f8e8c066690 2024-09-13T23:08:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.331+0000 7f8e8a7fc640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 0x7f8e74070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.331+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8e8408d7f0 con 0x7f8e8c066690 2024-09-13T23:08:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.331+0000 7f8e917d5640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 0x7f8e74070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:01.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.332+0000 7f8e917d5640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 0x7f8e74070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000c00 tx=0x7f8e80035040 comp rx=0 tx=0).ready entity=mgr.14716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:01.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.335+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8e84056f90 con 0x7f8e8c066690 2024-09-13T23:08:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T23:08:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2634594821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:01 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/2148431491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:08:01.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.564+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8e8c0fa8b0 con 0x7f8e8c066690 2024-09-13T23:08:01.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.564+0000 7f8e8a7fc640 1 -- 172.21.15.115:0/3066787889 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8e8405a650 con 0x7f8e8c066690 2024-09-13T23:08:01.565 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 msgr2=0x7f8e74070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 0x7f8e74070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000c00 tx=0x7f8e80035040 comp rx=0 tx=0).stop 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 msgr2=0x7f8e8c10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e84002840 tx=0x7f8e84004570 comp rx=0 tx=0).stop 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 shutdown_connections 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:6800/4125949334,v1:172.21.15.115:6801/4125949334] conn(0x7f8e7406df60 0x7f8e74070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c0ff720 0x7f8e8c10f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 --2- 172.21.15.115:0/3066787889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e8c066690 0x7f8e8c10f320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 >> 172.21.15.115:0/3066787889 conn(0x7f8e8c0f6c10 msgr2=0x7f8e8c0fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 shutdown_connections 2024-09-13T23:08:01.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:01.566+0000 7f8e9423a640 1 -- 172.21.15.115:0/3066787889 wait complete. 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:08:01.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T23:08:01.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:01.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2634594821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:01.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:01 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2148431491' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:08:02.543 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:02 smithi152 ceph-mon[34465]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:02.543 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:02 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/3066787889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:08:02.543 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:02 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:02.544 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:02 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:02.544 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:02 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:02 smithi115 ceph-mon[27601]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:02 smithi115 ceph-mon[27601]: from='client.? 172.21.15.115:0/3066787889' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:08:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:02 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:02 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:02.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:02 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:03.444 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:03 smithi152 ceph-mon[34465]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:03.444 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:03 smithi152 ceph-mon[34465]: Upgrade: Updating mgr.smithi152.ntylos 2024-09-13T23:08:03.444 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:03 smithi152 ceph-mon[34465]: Deploying daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:08:03.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:03 smithi115 ceph-mon[27601]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:03.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:03 smithi115 ceph-mon[27601]: Upgrade: Updating mgr.smithi152.ntylos 2024-09-13T23:08:03.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:03 smithi115 ceph-mon[27601]: Deploying daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:08:05.666 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:05 smithi152 ceph-mon[34465]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:05.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:05 smithi115 ceph-mon[27601]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:06.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:06 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:06 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:06 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:06.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:06 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:06 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:06 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:06 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:06 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:06 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:06.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:06 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:07.750 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:07 smithi152 ceph-mon[34465]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:07.791 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:07 smithi115 ceph-mon[27601]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:09.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:09 smithi152 ceph-mon[34465]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:09.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:09 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:09 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:09 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.334 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:09 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:09 smithi115 ceph-mon[27601]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:09.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:09 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:09 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:09 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:09.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:09 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:11.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:11 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:08:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:08:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:08:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:08:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:08:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/3778805050' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:08:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:11.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:11 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: mgrmap e32: smithi115.eqesbc(active, since 27s), standbys: smithi152.ntylos 2024-09-13T23:08:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.eqesbc"}]: dispatch 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.eqesbc"}]': finished 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.ntylos"}]: dispatch 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.ntylos"}]': finished 2024-09-13T23:08:12.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:12 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:08:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: mgrmap e32: smithi115.eqesbc(active, since 27s), standbys: smithi152.ntylos 2024-09-13T23:08:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:12.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.eqesbc"}]: dispatch 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.eqesbc"}]': finished 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.ntylos"}]: dispatch 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.ntylos"}]': finished 2024-09-13T23:08:12.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:12 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:08:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:13 smithi115 ceph-mon[27601]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:13 smithi115 ceph-mon[27601]: Upgrade: Setting container_image for all mgr 2024-09-13T23:08:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:13 smithi152 ceph-mon[34465]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:08:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:13 smithi152 ceph-mon[34465]: Upgrade: Setting container_image for all mgr 2024-09-13T23:08:15.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: Upgrade: Updating mon.smithi115 2024-09-13T23:08:15.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:15.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:15.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:15.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:15.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: Deploying daemon mon.smithi115 on smithi115 2024-09-13T23:08:15.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:15.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:14 smithi115 ceph-mon[27601]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: Upgrade: Updating mon.smithi115 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:15.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: Deploying daemon mon.smithi115 on smithi115 2024-09-13T23:08:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:15.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:14 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:15.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:15 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:08:16.112 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:15 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[27597]: 2024-09-13T23:08:15.813+0000 7f5ae74e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:08:16.112 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:15 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[27597]: 2024-09-13T23:08:15.813+0000 7f5ae74e5640 -1 mon.smithi115@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T23:08:16.112 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:15 smithi115 podman[91170]: 2024-09-13 23:08:15.845679011 +0000 UTC m=+0.141432066 container died fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T23:08:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 podman[91170]: 2024-09-13 23:08:16.306087398 +0000 UTC m=+0.601840459 container cleanup fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=quincy-eb16b97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T23:08:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 bash[91170]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T23:08:16.939 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 podman[91182]: 2024-09-13 23:08:16.601730982 +0000 UTC m=+0.748170893 container remove fb7b988713a999e107104e60b198950eaf6a592e7c0ee20762cda88aae0c37cc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T23:08:16.939 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service: Deactivated successfully. 2024-09-13T23:08:16.939 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 systemd[1]: Stopped Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:08:16.939 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service: Consumed 10.140s CPU time. 2024-09-13T23:08:17.285 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:16 smithi115 systemd[1]: Starting Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:08:17.286 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 podman[91321]: 2024-09-13 23:08:17.050067966 +0000 UTC m=+0.015898127 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:08:17.286 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 podman[91321]: 2024-09-13 23:08:17.175435607 +0000 UTC m=+0.141265767 container create 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 podman[91321]: 2024-09-13 23:08:17.453536546 +0000 UTC m=+0.419366706 container init 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 podman[91321]: 2024-09-13 23:08:17.457006774 +0000 UTC m=+0.422836934 container start 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: pidfile_write: ignore empty --pid-file 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: load: jerasure load: lrc 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: RocksDB version: 7.9.2 2024-09-13T23:08:17.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Git sha 0 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: DB SUMMARY 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: DB Session ID: 0EU8SK3N7WII0GDLQW6P 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: CURRENT file: CURRENT 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: MANIFEST file: MANIFEST-000015 size: 972 Bytes 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 1, files: 000030.sst 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000028.log size: 2467888 ; 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.error_if_exists: 0 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.create_if_missing: 0 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.paranoid_checks: 1 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T23:08:17.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.env: 0x560e47d14940 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.info_log: 0x560e4a0858c0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.statistics: (nil) 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.use_fsync: 0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_log_file_size: 0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T23:08:17.802 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_fallocate: 1 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.use_direct_reads: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.db_log_dir: 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.wal_dir: 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T23:08:17.803 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.write_buffer_manager: 0x560e4a094dc0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.unordered_write: 0 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T23:08:17.804 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T23:08:17.805 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T23:08:17.805 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T23:08:17.805 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.row_cache: None 2024-09-13T23:08:17.805 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.wal_filter: None 2024-09-13T23:08:17.806 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T23:08:17.806 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T23:08:17.806 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.two_write_queues: 0 2024-09-13T23:08:17.806 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.wal_compression: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.atomic_flush: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.log_readahead_size: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T23:08:17.807 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_background_jobs: 2 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_background_compactions: -1 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_subcompactions: 1 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T23:08:17.808 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_open_files: -1 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_background_flushes: -1 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Compression algorithms supported: 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kZSTD supported: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kXpressCompression supported: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kBZip2Compression supported: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kLZ4Compression supported: 1 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kZlibCompression supported: 1 2024-09-13T23:08:17.809 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: kSnappyCompression supported: 1 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000015 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.merge_operator: 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_filter: None 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560e4a085520) 2024-09-13T23:08:17.810 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 4 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x560e4a0791f0 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-09-13T23:08:17.811 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: bloomfilter 2024-09-13T23:08:17.812 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 5 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_auto_readahead_size: 262144 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: prepopulate_block_cache: 0 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: initial_auto_readahead_size: 8192 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression: NoCompression 2024-09-13T23:08:17.813 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.num_levels: 7 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T23:08:17.814 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T23:08:17.815 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T23:08:17.816 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T23:08:17.817 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.inplace_update_support: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.bloom_locality: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.max_successive_merges: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T23:08:17.818 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.ttl: 2592000 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enable_blob_files: false 2024-09-13T23:08:17.819 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.min_blob_size: 0 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10272, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-13T23:08:17.820 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 041f505d-1090-4421-b160-cfa4b0960af1 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268897483606, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268897490428, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2247959, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10274, "largest_seqno": 11123, "table_properties": {"data_size": 2243095, "index_size": 2795, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1029, "raw_key_size": 9305, "raw_average_key_size": 23, "raw_value_size": 2234359, "raw_average_value_size": 5642, "num_data_blocks": 129, "num_entries": 396, "num_filter_entries": 396, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726268897, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "041f505d-1090-4421-b160-cfa4b0960af1", "db_session_id": "0EU8SK3N7WII0GDLQW6P", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268897490562, "job": 1, "event": "recovery_finished"} 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560e4a0a6e00 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: DB pointer 0x560e4a1a2000 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-09-13T23:08:17.821 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 1/0 2.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L6 1/0 5.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 7.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T23:08:17.822 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 623.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 623.0 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T23:08:17.823 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 225.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 225.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache BinnedLRUCache@0x560e4a0791f0#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: starting mon.smithi115 rank 0 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???) e2 preinit fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).mds e21 new map 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).mds e21 print_map 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e21 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:08:17.824 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: 1 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Filesystem 'cephfs' (1) 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: fs_name cephfs 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: epoch 21 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: tableserver 0 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: root 0 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_timeout 60 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_autoclose 300 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_file_size 1099511627776 2024-09-13T23:08:17.825 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_xattr_size 65536 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: required_client_features {} 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure 0 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure_osd_epoch 45 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_mds 2 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: in 0,1 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: up {0=14464,1=24257} 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: failed 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: damaged 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: stopped 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_pools [3] 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_pool 2 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: inline_data disabled 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: balancer 2024-09-13T23:08:17.826 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: bal_rank_mask -1 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: standby_count_wanted 1 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: qdb_cluster leader: 0 members: 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 ceph-mon[91340]: mon.smithi115@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 bash[91321]: 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 2024-09-13T23:08:17.827 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:17 smithi115 systemd[1]: Started Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:08:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: pgmap v20: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: mon.smithi115 calling monitor election 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: monmap epoch 2 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: last_changed 2024-09-13T22:59:32.394095+0000 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: created 2024-09-13T22:57:05.084385+0000 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: min_mon_release 17 (quincy) 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: election_strategy: 1 2024-09-13T23:08:19.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: 0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: mgrmap e32: smithi115.eqesbc(active, since 35s), standbys: smithi152.ntylos 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: overall HEALTH_OK 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: from='mgr.14716 ' entity='' 2024-09-13T23:08:19.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:19 smithi152 ceph-mon[34465]: mgrmap e33: smithi115.eqesbc(active, since 35s), standbys: smithi152.ntylos 2024-09-13T23:08:19.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:19.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: from='mgr.14716 172.21.15.115:0/1250669001' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: pgmap v20: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: mon.smithi115 calling monitor election 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: monmap epoch 2 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: last_changed 2024-09-13T22:59:32.394095+0000 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: created 2024-09-13T22:57:05.084385+0000 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: min_mon_release 17 (quincy) 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: election_strategy: 1 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: 0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-13T23:08:19.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:08:19.482 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T23:08:19.482 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: mgrmap e32: smithi115.eqesbc(active, since 35s), standbys: smithi152.ntylos 2024-09-13T23:08:19.482 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: overall HEALTH_OK 2024-09-13T23:08:19.482 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: from='mgr.14716 ' entity='' 2024-09-13T23:08:19.482 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:19 smithi115 ceph-mon[91340]: mgrmap e33: smithi115.eqesbc(active, since 35s), standbys: smithi152.ntylos 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:08:24.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:23 smithi152 ceph-mon[34465]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: Standby manager daemon smithi152.ntylos restarted 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: Standby manager daemon smithi152.ntylos started 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/crt"}]: dispatch 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.ntylos/key"}]: dispatch 2024-09-13T23:08:24.236 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:23 smithi115 ceph-mon[91340]: from='mgr.? 172.21.15.152:0/1287164886' entity='mgr.smithi152.ntylos' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: mgrmap e34: smithi115.eqesbc(active, since 40s), standbys: smithi152.ntylos 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: Active manager daemon smithi115.eqesbc restarted 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: Activating manager daemon smithi115.eqesbc 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: mgrmap e35: smithi115.eqesbc(active, starting, since 0.0077991s), standbys: smithi152.ntylos 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:25.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:08:25.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: Manager daemon smithi115.eqesbc is now available 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:08:25.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:24 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: mgrmap e34: smithi115.eqesbc(active, since 40s), standbys: smithi152.ntylos 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: Active manager daemon smithi115.eqesbc restarted 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: Activating manager daemon smithi115.eqesbc 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: mgrmap e35: smithi115.eqesbc(active, starting, since 0.0077991s), standbys: smithi152.ntylos 2024-09-13T23:08:25.273 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.eqesbc", "id": "smithi115.eqesbc"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr metadata", "who": "smithi152.ntylos", "id": "smithi152.ntylos"}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:08:25.274 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: Manager daemon smithi115.eqesbc is now available 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:08:25.275 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.eqesbc/trash_purge_schedule"}]: dispatch 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:26 smithi115 ceph-mon[91340]: mgrmap e36: smithi115.eqesbc(active, since 1.00966s), standbys: smithi152.ntylos 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:26 smithi115 ceph-mon[91340]: [13/Sep/2024:23:08:25] ENGINE Bus STARTING 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:26 smithi115 ceph-mon[91340]: [13/Sep/2024:23:08:25] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:26 smithi115 ceph-mon[91340]: [13/Sep/2024:23:08:25] ENGINE Error in HTTPServer.serve 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Traceback (most recent call last): 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:08:26.169 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._run(expiration_interval) 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: s = self.context.wrap_socket( 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: return self.sslsocket_class._create( 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self.do_handshake() 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: self._sslobj.do_handshake() 2024-09-13T23:08:26.170 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:26 smithi152 ceph-mon[34465]: mgrmap e36: smithi115.eqesbc(active, since 1.00966s), standbys: smithi152.ntylos 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:26 smithi152 ceph-mon[34465]: [13/Sep/2024:23:08:25] ENGINE Bus STARTING 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:26 smithi152 ceph-mon[34465]: [13/Sep/2024:23:08:25] ENGINE Serving on https://172.21.15.115:7150 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:26 smithi152 ceph-mon[34465]: [13/Sep/2024:23:08:25] ENGINE Error in HTTPServer.serve 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Traceback (most recent call last): 2024-09-13T23:08:26.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._run(expiration_interval) 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: s = self.context.wrap_socket( 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: return self.sslsocket_class._create( 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:08:26.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self.do_handshake() 2024-09-13T23:08:26.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:08:26.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: self._sslobj.do_handshake() 2024-09-13T23:08:26.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:08:27.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:27 smithi115 ceph-mon[91340]: [13/Sep/2024:23:08:25] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T23:08:27.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:27 smithi115 ceph-mon[91340]: [13/Sep/2024:23:08:25] ENGINE Bus STARTED 2024-09-13T23:08:27.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:27 smithi115 ceph-mon[91340]: pgmap v4: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:08:27.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:27 smithi115 ceph-mon[91340]: mgrmap e37: smithi115.eqesbc(active, since 2s), standbys: smithi152.ntylos 2024-09-13T23:08:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:27 smithi152 ceph-mon[34465]: [13/Sep/2024:23:08:25] ENGINE Serving on http://172.21.15.115:8765 2024-09-13T23:08:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:27 smithi152 ceph-mon[34465]: [13/Sep/2024:23:08:25] ENGINE Bus STARTED 2024-09-13T23:08:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:27 smithi152 ceph-mon[34465]: pgmap v4: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:08:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:27 smithi152 ceph-mon[34465]: mgrmap e37: smithi115.eqesbc(active, since 2s), standbys: smithi152.ntylos 2024-09-13T23:08:28.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:28 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:28 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:28 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:28 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:28 smithi152 ceph-mon[34465]: pgmap v5: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:08:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:28 smithi115 ceph-mon[91340]: pgmap v5: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T23:08:30.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:29 smithi152 ceph-mon[34465]: mgrmap e38: smithi115.eqesbc(active, since 4s), standbys: smithi152.ntylos 2024-09-13T23:08:30.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:29 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:30.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:29 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:30.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:29 smithi115 ceph-mon[91340]: mgrmap e38: smithi115.eqesbc(active, since 4s), standbys: smithi152.ntylos 2024-09-13T23:08:30.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:30.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: pgmap v6: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-13T23:08:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:31 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: pgmap v6: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 27 op/s 2024-09-13T23:08:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:31.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:31.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 -- 172.21.15.115:0/492743043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 msgr2=0x7fed240fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 --2- 172.21.15.115:0/492743043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed240fdf80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed200048d0 tx=0x7fed20009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 -- 172.21.15.115:0/492743043 shutdown_connections 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 --2- 172.21.15.115:0/492743043 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 0x7fed240fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 --2- 172.21.15.115:0/492743043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed240fdf80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.649+0000 7fed2bccf640 1 -- 172.21.15.115:0/492743043 >> 172.21.15.115:0/492743043 conn(0x7fed240f6390 msgr2=0x7fed240f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.650+0000 7fed2bccf640 1 -- 172.21.15.115:0/492743043 shutdown_connections 2024-09-13T23:08:31.655 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.650+0000 7fed2bccf640 1 -- 172.21.15.115:0/492743043 wait complete. 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.650+0000 7fed2bccf640 1 Processor -- start 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.650+0000 7fed2bccf640 1 -- start start 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed2bccf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed2bccf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 0x7fed2410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed2bccf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2410dc20 con 0x7fed240fdb70 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed2bccf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2410e440 con 0x7fed240fe4c0 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37574/0 (socket says 172.21.15.115:37574) 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 -- 172.21.15.115:0/20982624 learned_addr learned my addr 172.21.15.115:0/20982624 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed2926a640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 0x7fed2410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 -- 172.21.15.115:0/20982624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 msgr2=0x7fed2410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.656 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 0x7fed2410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 -- 172.21.15.115:0/20982624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20005040 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.651+0000 7fed29a6b640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed200048a0 tx=0x7fed20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.652+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20038070 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.652+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed20004290 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.652+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20033660 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.652+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2410e670 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.652+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2410ec10 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.653+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed240fa010 con 0x7fed240fdb70 2024-09-13T23:08:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.653+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fed20030020 con 0x7fed240fdb70 2024-09-13T23:08:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.654+0000 7fed1a7fc640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 0x7fed10070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.654+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fed200ae370 con 0x7fed240fdb70 2024-09-13T23:08:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.654+0000 7fed2926a640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 0x7fed10070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.654+0000 7fed2926a640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 0x7fed10070b10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed2410ce40 tx=0x7fed1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.659+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed20077480 con 0x7fed240fdb70 2024-09-13T23:08:31.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.860+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed2410ef30 con 0x7fed1006e660 2024-09-13T23:08:31.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.861+0000 7fed1a7fc640 1 -- 172.21.15.115:0/20982624 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fed2410ef30 con 0x7fed1006e660 2024-09-13T23:08:31.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 msgr2=0x7fed10070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 0x7fed10070b10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fed2410ce40 tx=0x7fed1400b040 comp rx=0 tx=0).stop 2024-09-13T23:08:31.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 msgr2=0x7fed2410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed200048a0 tx=0x7fed20009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 shutdown_connections 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fed1006e660 0x7fed10070b10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed240fe4c0 0x7fed2410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 --2- 172.21.15.115:0/20982624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed240fdb70 0x7fed2410d090 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.863+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 >> 172.21.15.115:0/20982624 conn(0x7fed240f6390 msgr2=0x7fed240f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.864+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 shutdown_connections 2024-09-13T23:08:31.866 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.864+0000 7fed2bccf640 1 -- 172.21.15.115:0/20982624 wait complete. 2024-09-13T23:08:31.874 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:08:31.949 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 -- 172.21.15.115:0/1464539945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 msgr2=0x7f70580fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 --2- 172.21.15.115:0/1464539945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580fb840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70540048d0 tx=0x7f7054009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 -- 172.21.15.115:0/1464539945 shutdown_connections 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 --2- 172.21.15.115:0/1464539945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 0x7f70580fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 --2- 172.21.15.115:0/1464539945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580fb840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 -- 172.21.15.115:0/1464539945 >> 172.21.15.115:0/1464539945 conn(0x7f70580f6c10 msgr2=0x7f70580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 -- 172.21.15.115:0/1464539945 shutdown_connections 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.947+0000 7f705fbf6640 1 -- 172.21.15.115:0/1464539945 wait complete. 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 Processor -- start 2024-09-13T23:08:31.950 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 -- start start 2024-09-13T23:08:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 0x7f70580fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580fdfd0 con 0x7f70580fb430 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705fbf6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580fe110 con 0x7f70580fc700 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705d992640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705d992640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37590/0 (socket says 172.21.15.115:37590) 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705d992640 1 -- 172.21.15.115:0/536329487 learned_addr learned my addr 172.21.15.115:0/536329487 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.948+0000 7f705d191640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 0x7f70580fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705d992640 1 -- 172.21.15.115:0/536329487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 msgr2=0x7f70580fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705d992640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 0x7f70580fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705d992640 1 -- 172.21.15.115:0/536329487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054005040 con 0x7f70580fb430 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705d992640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70540043d0 tx=0x7f7054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.952 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7054038070 con 0x7f70580fb430 2024-09-13T23:08:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f705402ae90 con 0x7f70580fb430 2024-09-13T23:08:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705403e670 con 0x7f70580fb430 2024-09-13T23:08:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70580fe390 con 0x7f70580fb430 2024-09-13T23:08:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.949+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70581150b0 con 0x7f70580fb430 2024-09-13T23:08:31.953 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.951+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70580fa890 con 0x7f70580fb430 2024-09-13T23:08:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.952+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f7054030020 con 0x7f70580fb430 2024-09-13T23:08:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.952+0000 7f704e7fc640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 0x7f7044070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:31.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.952+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f70540ae4e0 con 0x7f70580fb430 2024-09-13T23:08:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.952+0000 7f705d191640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 0x7f7044070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:31.955 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.953+0000 7f705d191640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 0x7f7044070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7048004eb0 tx=0x7f704800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:31.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:31.957+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7054077570 con 0x7f70580fb430 2024-09-13T23:08:32.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.153+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7058103f90 con 0x7f704406e660 2024-09-13T23:08:32.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.154+0000 7f704e7fc640 1 -- 172.21.15.115:0/536329487 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7058103f90 con 0x7f704406e660 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 msgr2=0x7f7044070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 0x7f7044070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7048004eb0 tx=0x7f704800b040 comp rx=0 tx=0).stop 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 msgr2=0x7f70580ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f70540043d0 tx=0x7f7054009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 shutdown_connections 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f704406e660 0x7f7044070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70580fc700 0x7f70580fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 --2- 172.21.15.115:0/536329487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70580fb430 0x7f70580ff550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 >> 172.21.15.115:0/536329487 conn(0x7f70580f6c10 msgr2=0x7f70580655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 shutdown_connections 2024-09-13T23:08:32.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.157+0000 7f705fbf6640 1 -- 172.21.15.115:0/536329487 wait complete. 2024-09-13T23:08:32.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:08:32.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:08:32.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:32.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 -- 172.21.15.115:0/3643620702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 msgr2=0x7f4c640fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/3643620702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c640fdc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c580048d0 tx=0x7f4c58009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 -- 172.21.15.115:0/3643620702 shutdown_connections 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/3643620702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c640fdc60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/3643620702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 0x7f4c640fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 -- 172.21.15.115:0/3643620702 >> 172.21.15.115:0/3643620702 conn(0x7f4c640f7ce0 msgr2=0x7f4c640fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 -- 172.21.15.115:0/3643620702 shutdown_connections 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.234+0000 7f4c6bf30640 1 -- 172.21.15.115:0/3643620702 wait complete. 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 Processor -- start 2024-09-13T23:08:32.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 -- start start 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 0x7f4c6410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6410dbf0 con 0x7f4c640fd7f0 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c6bf30640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6410e410 con 0x7f4c640fc520 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c694cb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c694cb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37612/0 (socket says 172.21.15.115:37612) 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c694cb640 1 -- 172.21.15.115:0/2629351461 learned_addr learned my addr 172.21.15.115:0/2629351461 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.235+0000 7f4c69ccc640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 0x7f4c6410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c694cb640 1 -- 172.21.15.115:0/2629351461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 msgr2=0x7f4c6410d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c694cb640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 0x7f4c6410d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c694cb640 1 -- 172.21.15.115:0/2629351461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58005040 con 0x7f4c640fd7f0 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c694cb640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4c580043d0 tx=0x7f4c58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c58038070 con 0x7f4c640fd7f0 2024-09-13T23:08:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c5802ae90 con 0x7f4c640fd7f0 2024-09-13T23:08:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6410e640 con 0x7f4c640fd7f0 2024-09-13T23:08:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c5803e670 con 0x7f4c640fd7f0 2024-09-13T23:08:32.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.236+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6410eb60 con 0x7f4c640fd7f0 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.237+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c640fb980 con 0x7f4c640fd7f0 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.238+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f4c58030020 con 0x7f4c640fd7f0 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.238+0000 7f4c627fc640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 0x7f4c4c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.238+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4c580ae4e0 con 0x7f4c640fd7f0 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.238+0000 7f4c69ccc640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 0x7f4c4c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.239+0000 7f4c69ccc640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 0x7f4c4c070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c540102e0 tx=0x7f4c54009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.242+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4c58077570 con 0x7f4c640fd7f0 2024-09-13T23:08:32.418 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.417+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c6410ee90 con 0x7f4c4c06e660 2024-09-13T23:08:32.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.426+0000 7f4c627fc640 1 -- 172.21.15.115:0/2629351461 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4c6410ee90 con 0x7f4c4c06e660 2024-09-13T23:08:32.427 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:08:32.427 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (87s) 2s ago 9m 25.6M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (10m) 2s ago 10m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (9m) 5s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (76s) 2s ago 9m 80.2M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (4m) 2s ago 4m 124M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (4m) 2s ago 4m 72.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (4m) 5s ago 4m 114M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (4m) 5s ago 4m 67.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (58s) 2s ago 11m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (27s) 5s ago 9m 437M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:08:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (15s) 2s ago 11m 27.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (9m) 5s ago 8m 50.4M 2048M 17.2.7-1629-geb16b97b ab51d1bebd12 d357a80d98d6 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (110s) 2s ago 10m 16.2M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (63s) 5s ago 9m 15.8M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (8m) 2s ago 8m 210M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (7m) 2s ago 7m 230M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (7m) 2s ago 7m 190M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (6m) 5s ago 6m 274M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (6m) 5s ago 6m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (6m) 5s ago 6m 230M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:08:32.429 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (32s) 2s ago 9m 46.4M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:08:32.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 msgr2=0x7f4c4c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 0x7f4c4c070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c540102e0 tx=0x7f4c54009040 comp rx=0 tx=0).stop 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 msgr2=0x7f4c6410d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4c580043d0 tx=0x7f4c58009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 shutdown_connections 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c4c06e660 0x7f4c4c070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c640fd7f0 0x7f4c6410d5a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 --2- 172.21.15.115:0/2629351461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c640fc520 0x7f4c6410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 >> 172.21.15.115:0/2629351461 conn(0x7f4c640f7ce0 msgr2=0x7f4c640f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 shutdown_connections 2024-09-13T23:08:32.431 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.428+0000 7f4c6bf30640 1 -- 172.21.15.115:0/2629351461 wait complete. 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:32.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:32.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:32.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:32 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:08:32.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 -- 172.21.15.115:0/3102254101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 msgr2=0x7faae00ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 --2- 172.21.15.115:0/3102254101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae00ff1e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faad00048d0 tx=0x7faad0009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 -- 172.21.15.115:0/3102254101 shutdown_connections 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 --2- 172.21.15.115:0/3102254101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 0x7faae0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 --2- 172.21.15.115:0/3102254101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae00ff1e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.504+0000 7faae7086640 1 -- 172.21.15.115:0/3102254101 >> 172.21.15.115:0/3102254101 conn(0x7faae00f6c10 msgr2=0x7faae00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 -- 172.21.15.115:0/3102254101 shutdown_connections 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 -- 172.21.15.115:0/3102254101 wait complete. 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 Processor -- start 2024-09-13T23:08:32.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 -- start start 2024-09-13T23:08:32.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 0x7faae010f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae0110750 con 0x7faae00666b0 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.505+0000 7faae7086640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae01108c0 con 0x7faae00ff720 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37640/0 (socket says 172.21.15.115:37640) 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 -- 172.21.15.115:0/2467102300 learned_addr learned my addr 172.21.15.115:0/2467102300 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faadffff640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 0x7faae010f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 -- 172.21.15.115:0/2467102300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 msgr2=0x7faae010f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 0x7faae010f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 -- 172.21.15.115:0/2467102300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0005040 con 0x7faae00666b0 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae4e22640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faad00048a0 tx=0x7faad0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad0038070 con 0x7faae00666b0 2024-09-13T23:08:32.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae0110b40 con 0x7faae00666b0 2024-09-13T23:08:32.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faad002ae90 con 0x7faae00666b0 2024-09-13T23:08:32.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faad002c8b0 con 0x7faae00666b0 2024-09-13T23:08:32.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.506+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae0111000 con 0x7faae00666b0 2024-09-13T23:08:32.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.508+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae0105810 con 0x7faae00666b0 2024-09-13T23:08:32.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.508+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7faad0030020 con 0x7faae00666b0 2024-09-13T23:08:32.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.508+0000 7faadd7fa640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 0x7faac8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.509+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faad00ae9e0 con 0x7faae00666b0 2024-09-13T23:08:32.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.509+0000 7faadffff640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 0x7faac8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.509+0000 7faadffff640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 0x7faac8070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faae010f1a0 tx=0x7faad4009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.515+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faad0078830 con 0x7faae00666b0 2024-09-13T23:08:32.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.747+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faae0105000 con 0x7faae00666b0 2024-09-13T23:08:32.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.748+0000 7faadd7fa640 1 -- 172.21.15.115:0/2467102300 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7faad007bef0 con 0x7faae00666b0 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:08:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:08:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:08:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 11, 2024-09-13T23:08:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T23:08:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:08:32.751 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 msgr2=0x7faac8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 0x7faac8070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faae010f1a0 tx=0x7faad4009120 comp rx=0 tx=0).stop 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 msgr2=0x7faae010f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faad00048a0 tx=0x7faad0009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 shutdown_connections 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7faac806e660 0x7faac8070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faae00ff720 0x7faae010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 --2- 172.21.15.115:0/2467102300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faae00666b0 0x7faae010f3f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 >> 172.21.15.115:0/2467102300 conn(0x7faae00f6c10 msgr2=0x7faae00fb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 shutdown_connections 2024-09-13T23:08:32.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.750+0000 7faae7086640 1 -- 172.21.15.115:0/2467102300 wait complete. 2024-09-13T23:08:32.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 -- 172.21.15.115:0/3592734931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fca30 msgr2=0x7f31480fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 --2- 172.21.15.115:0/3592734931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fca30 0x7f31480fce40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31380048d0 tx=0x7f3138009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 -- 172.21.15.115:0/3592734931 shutdown_connections 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 --2- 172.21.15.115:0/3592734931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fd380 0x7f31480fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 --2- 172.21.15.115:0/3592734931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fca30 0x7f31480fce40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.829+0000 7f314d71d640 1 -- 172.21.15.115:0/3592734931 >> 172.21.15.115:0/3592734931 conn(0x7f31480f63a0 msgr2=0x7f31480f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 -- 172.21.15.115:0/3592734931 shutdown_connections 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 -- 172.21.15.115:0/3592734931 wait complete. 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 Processor -- start 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 -- start start 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 0x7f3148111ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148112510 con 0x7f31480fd380 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.830+0000 7f314d71d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148112680 con 0x7f31480fca30 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f3146ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 0x7f3148111ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f3146ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.115:37912/0 (socket says 172.21.15.115:37912) 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f3146ffd640 1 -- 172.21.15.115:0/69453078 learned_addr learned my addr 172.21.15.115:0/69453078 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313e7fc640 1 -- 172.21.15.115:0/69453078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 msgr2=0x7f31480fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313e7fc640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313e7fc640 1 -- 172.21.15.115:0/69453078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138005040 con 0x7f31480fd380 2024-09-13T23:08:32.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f3146ffd640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313e7fc640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 0x7f3148111ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f313000b4b0 tx=0x7f3130009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f313000f6f0 con 0x7f31480fd380 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3148112960 con 0x7f31480fd380 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f313000fcf0 con 0x7f31480fd380 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3130011e30 con 0x7f31480fd380 2024-09-13T23:08:32.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.831+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3148112e80 con 0x7f31480fd380 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.832+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31480fa040 con 0x7f31480fd380 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.833+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3130011620 con 0x7f31480fd380 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.833+0000 7f313ffff640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 0x7f3134070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.834+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f313008e0f0 con 0x7f31480fd380 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.834+0000 7f3146ffd640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 0x7f3134070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:32.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.834+0000 7f3146ffd640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 0x7f3134070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3138007ac0 tx=0x7f3138035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:32.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:32.838+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3130057150 con 0x7f31480fd380 2024-09-13T23:08:33.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.048+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f314804b720 con 0x7f31480fd380 2024-09-13T23:08:33.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.048+0000 7f313ffff640 1 -- 172.21.15.115:0/69453078 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1972 (secure 0 0 0) 0x7f313005a810 con 0x7f31480fd380 2024-09-13T23:08:33.050 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:08:33.050 INFO:teuthology.orchestra.run.smithi115.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:08:33.051 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:08:33.052 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:33.053 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:33.054 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:08:33.054 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:08:33.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 msgr2=0x7f3134070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 0x7f3134070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3138007ac0 tx=0x7f3138035040 comp rx=0 tx=0).stop 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 msgr2=0x7f3148111ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 0x7f3148111ea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f313000b4b0 tx=0x7f3130009120 comp rx=0 tx=0).stop 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 shutdown_connections 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f313406e660 0x7f3134070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31480fd380 0x7f3148111ea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 --2- 172.21.15.115:0/69453078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f31480fca30 0x7f31480fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.050+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 >> 172.21.15.115:0/69453078 conn(0x7f31480f63a0 msgr2=0x7f31480f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.051+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 shutdown_connections 2024-09-13T23:08:33.055 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.051+0000 7f314d71d640 1 -- 172.21.15.115:0/69453078 wait complete. 2024-09-13T23:08:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 -- 172.21.15.115:0/407100417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 msgr2=0x7f12ec0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 --2- 172.21.15.115:0/407100417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec0fb860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0048d0 tx=0x7f12dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 -- 172.21.15.115:0/407100417 shutdown_connections 2024-09-13T23:08:33.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 --2- 172.21.15.115:0/407100417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 0x7f12ec0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 --2- 172.21.15.115:0/407100417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec0fb860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 -- 172.21.15.115:0/407100417 >> 172.21.15.115:0/407100417 conn(0x7f12ec0f6c10 msgr2=0x7f12ec0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 -- 172.21.15.115:0/407100417 shutdown_connections 2024-09-13T23:08:33.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.130+0000 7f12f2e82640 1 -- 172.21.15.115:0/407100417 wait complete. 2024-09-13T23:08:33.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 Processor -- start 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 -- start start 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 0x7f12ec111df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec1123d0 con 0x7f12ec0fb450 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.131+0000 7f12f2e82640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec112540 con 0x7f12ec0fc720 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37662/0 (socket says 172.21.15.115:37662) 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 -- 172.21.15.115:0/2093776750 learned_addr learned my addr 172.21.15.115:0/2093776750 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12ebfff640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 0x7f12ec111df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 -- 172.21.15.115:0/2093776750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 msgr2=0x7f12ec111df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 0x7f12ec111df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 -- 172.21.15.115:0/2093776750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc005040 con 0x7f12ec0fb450 2024-09-13T23:08:33.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f0c1e640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0048a0 tx=0x7f12dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12dc038070 con 0x7f12ec0fb450 2024-09-13T23:08:33.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12dc004290 con 0x7f12ec0fb450 2024-09-13T23:08:33.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec1127c0 con 0x7f12ec0fb450 2024-09-13T23:08:33.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12dc033660 con 0x7f12ec0fb450 2024-09-13T23:08:33.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.132+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec112d60 con 0x7f12ec0fb450 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.134+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0fa8b0 con 0x7f12ec0fb450 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.134+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f12dc030020 con 0x7f12ec0fb450 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.134+0000 7f12e97fa640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 0x7f12d4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.135+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f12dc0ae420 con 0x7f12ec0fb450 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.135+0000 7f12ebfff640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 0x7f12d4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.135+0000 7f12ebfff640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 0x7f12d4070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0663d0 tx=0x7f12e000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.139+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f12dc0774b0 con 0x7f12ec0fb450 2024-09-13T23:08:33.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.326+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12ec100b30 con 0x7f12d406e660 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.327+0000 7f12e97fa640 1 -- 172.21.15.115:0/2093776750 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f12ec100b30 con 0x7f12d406e660 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:08:33.329 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "3/21 daemons upgraded", 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:08:33.330 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 msgr2=0x7f12d4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 0x7f12d4070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0663d0 tx=0x7f12e000b040 comp rx=0 tx=0).stop 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 msgr2=0x7f12ec066620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0048a0 tx=0x7f12dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 shutdown_connections 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f12d406e660 0x7f12d4070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12ec0fc720 0x7f12ec111df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 --2- 172.21.15.115:0/2093776750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12ec0fb450 0x7f12ec066620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 >> 172.21.15.115:0/2093776750 conn(0x7f12ec0f6c10 msgr2=0x7f12ec0f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 shutdown_connections 2024-09-13T23:08:33.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.330+0000 7f12f2e82640 1 -- 172.21.15.115:0/2093776750 wait complete. 2024-09-13T23:08:33.408 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 -- 172.21.15.115:0/2559284778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 msgr2=0x7f075c0fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 --2- 172.21.15.115:0/2559284778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c0fdfb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f074c0048d0 tx=0x7f074c009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 -- 172.21.15.115:0/2559284778 shutdown_connections 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 --2- 172.21.15.115:0/2559284778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c0fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 --2- 172.21.15.115:0/2559284778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c0fdfb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 -- 172.21.15.115:0/2559284778 >> 172.21.15.115:0/2559284778 conn(0x7f075c0f63a0 msgr2=0x7f075c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 -- 172.21.15.115:0/2559284778 shutdown_connections 2024-09-13T23:08:33.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.406+0000 7f0761fd8640 1 -- 172.21.15.115:0/2559284778 wait complete. 2024-09-13T23:08:33.409 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:08:33.409 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: pgmap v7: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2467102300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:33.410 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:33 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/69453078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 Processor -- start 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 -- start start 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c10e4e0 con 0x7f075c0fdba0 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.407+0000 7f0761fd8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c10e650 con 0x7f075c0fe4f0 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37670/0 (socket says 172.21.15.115:37670) 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 -- 172.21.15.115:0/4244303575 learned_addr learned my addr 172.21.15.115:0/4244303575 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075affd640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.413 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 -- 172.21.15.115:0/4244303575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 msgr2=0x7f075c10d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c10d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 -- 172.21.15.115:0/4244303575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c005040 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075affd640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f075b7fe640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f074c003080 tx=0x7f074c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c038070 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f074c02abd0 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f074c03e670 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c10e8d0 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.408+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c10eda0 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.410+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c105820 con 0x7f075c0fdba0 2024-09-13T23:08:33.414 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.410+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f074c030020 con 0x7f075c0fdba0 2024-09-13T23:08:33.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:08:33.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:08:33.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:08:33.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:08:33.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: Updating smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: pgmap v7: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/2467102300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:08:33.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:33 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/69453078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:08:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.411+0000 7f0743fff640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 0x7f0744070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.411+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f074c0ae6c0 con 0x7f075c0fdba0 2024-09-13T23:08:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.411+0000 7f075affd640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 0x7f0744070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.411+0000 7f075affd640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 0x7f0744070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f075c10cee0 tx=0x7f0750008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.417 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.415+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f074c0776a0 con 0x7f075c0fdba0 2024-09-13T23:08:33.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.648+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f075c04b720 con 0x7f075c0fdba0 2024-09-13T23:08:33.650 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.648+0000 7f0743fff640 1 -- 172.21.15.115:0/4244303575 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f074c07ad60 con 0x7f075c0fdba0 2024-09-13T23:08:33.650 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 msgr2=0x7f0744070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 0x7f0744070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f075c10cee0 tx=0x7f0750008040 comp rx=0 tx=0).stop 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 msgr2=0x7f075c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f074c003080 tx=0x7f074c009da0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 shutdown_connections 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f074406e660 0x7f0744070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f075c0fe4f0 0x7f075c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 --2- 172.21.15.115:0/4244303575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f075c0fdba0 0x7f075c10d130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 >> 172.21.15.115:0/4244303575 conn(0x7f075c0f63a0 msgr2=0x7f075c0f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 shutdown_connections 2024-09-13T23:08:33.653 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:08:33.650+0000 7f0761fd8640 1 -- 172.21.15.115:0/4244303575 wait complete. 2024-09-13T23:08:34.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:34.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:34.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:34.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:34.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:34.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:34 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4244303575' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:34 smithi152 ceph-mon[34465]: from='client.? 172.21.15.115:0/4244303575' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:08:35.161 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:08:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-mon[34465]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-mon[34465]: Upgrade: Updating mon.smithi152 2024-09-13T23:08:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-mon[34465]: Deploying daemon mon.smithi152 on smithi152 2024-09-13T23:08:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-mon[34465]: pgmap v8: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T23:08:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152[34456]: 2024-09-13T23:08:35.294+0000 7f622e36d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:08:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152[34456]: 2024-09-13T23:08:35.294+0000 7f622e36d640 -1 mon.smithi152@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T23:08:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:35 smithi115 ceph-mon[91340]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:08:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:35 smithi115 ceph-mon[91340]: Upgrade: Updating mon.smithi152 2024-09-13T23:08:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:35 smithi115 ceph-mon[91340]: Deploying daemon mon.smithi152 on smithi152 2024-09-13T23:08:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:35 smithi115 ceph-mon[91340]: pgmap v8: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T23:08:35.855 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 podman[80003]: 2024-09-13 23:08:35.520140092 +0000 UTC m=+0.328649560 container died d357a80d98d6fa25512359985255b699cf025a7d2a2f3d06de6eb35b0c82a07e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-13T23:08:36.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 podman[80003]: 2024-09-13 23:08:35.970610988 +0000 UTC m=+0.779120455 container cleanup d357a80d98d6fa25512359985255b699cf025a7d2a2f3d06de6eb35b0c82a07e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=quincy-eb16b97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-13T23:08:36.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:35 smithi152 bash[80003]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152 2024-09-13T23:08:36.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 podman[80015]: 2024-09-13 23:08:36.231335372 +0000 UTC m=+0.707222451 container remove d357a80d98d6fa25512359985255b699cf025a7d2a2f3d06de6eb35b0c82a07e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T23:08:36.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service: Deactivated successfully. 2024-09-13T23:08:36.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:08:36.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service: Consumed 5.717s CPU time. 2024-09-13T23:08:36.920 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:08:36.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 podman[80145]: 2024-09-13 23:08:36.710024815 +0000 UTC m=+0.015870746 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:08:36.921 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:36 smithi152 podman[80145]: 2024-09-13 23:08:36.824429166 +0000 UTC m=+0.130275090 container create 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T23:08:37.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 podman[80145]: 2024-09-13 23:08:37.045001829 +0000 UTC m=+0.350847759 container init 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 podman[80145]: 2024-09-13 23:08:37.048341282 +0000 UTC m=+0.354187207 container start 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: pidfile_write: ignore empty --pid-file 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: load: jerasure load: lrc 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: RocksDB version: 7.9.2 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Git sha 0 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: DB SUMMARY 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: DB Session ID: 4G4KD1C2U597HRFJD057 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: CURRENT file: CURRENT 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T23:08:37.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: MANIFEST file: MANIFEST-000009 size: 896 Bytes 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000024.sst 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000022.log size: 6531193 ; 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.error_if_exists: 0 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.create_if_missing: 0 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.paranoid_checks: 1 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.env: 0x56138248e940 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.info_log: 0x5613847fb8c0 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.statistics: (nil) 2024-09-13T23:08:37.220 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.use_fsync: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_log_file_size: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_fallocate: 1 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.use_direct_reads: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.db_log_dir: 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.wal_dir: 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T23:08:37.221 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.write_buffer_manager: 0x56138480adc0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T23:08:37.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.unordered_write: 0 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.row_cache: None 2024-09-13T23:08:37.223 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.wal_filter: None 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.two_write_queues: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.wal_compression: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.atomic_flush: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.log_readahead_size: 0 2024-09-13T23:08:37.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_background_jobs: 2 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_background_compactions: -1 2024-09-13T23:08:37.226 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_subcompactions: 1 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T23:08:37.227 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_open_files: -1 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_background_flushes: -1 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Compression algorithms supported: 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kZSTD supported: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kXpressCompression supported: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kBZip2Compression supported: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T23:08:37.228 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kLZ4Compression supported: 1 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kZlibCompression supported: 1 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: kSnappyCompression supported: 1 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.merge_operator: 2024-09-13T23:08:37.229 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_filter: None 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5613847fb520) 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2024-09-13T23:08:37.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 4 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x5613847ef1f0 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2024-09-13T23:08:37.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: bloomfilter 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 5 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2024-09-13T23:08:37.232 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_auto_readahead_size: 262144 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: prepopulate_block_cache: 0 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: initial_auto_readahead_size: 8192 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression: NoCompression 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.num_levels: 7 2024-09-13T23:08:37.233 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T23:08:37.234 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T23:08:37.235 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T23:08:37.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T23:08:37.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.inplace_update_support: 0 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.bloom_locality: 0 2024-09-13T23:08:37.238 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.max_successive_merges: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.ttl: 2592000 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enable_blob_files: false 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.min_blob_size: 0 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T23:08:37.239 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10378, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 219fda60-3e25-4b00-a628-735e062a18ac 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268917074657, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268917090324, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3935711, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10384, "largest_seqno": 11783, "table_properties": {"data_size": 3928912, "index_size": 4218, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14079, "raw_average_key_size": 23, "raw_value_size": 3915890, "raw_average_value_size": 6537, "num_data_blocks": 192, "num_entries": 599, "num_filter_entries": 599, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726268917, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "219fda60-3e25-4b00-a628-735e062a18ac", "db_session_id": "4G4KD1C2U597HRFJD057", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268917090450, "job": 1, "event": "recovery_finished"} 2024-09-13T23:08:37.240 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56138481ce00 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: DB pointer 0x561384918000 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:08:37.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:08:37.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 3.75 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 520.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L6 1/0 5.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 8.89 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 520.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 520.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 520.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:08:37.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 187.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 187.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache BinnedLRUCache@0x5613847ef1f0#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T23:08:37.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: starting mon.smithi152 rank 1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???) e2 preinit fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).mds e21 new map 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).mds e21 print_map 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e21 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: 1 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Filesystem 'cephfs' (1) 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: fs_name cephfs 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: epoch 21 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:08:37.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: tableserver 0 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: root 0 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_timeout 60 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_autoclose 300 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_file_size 1099511627776 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_xattr_size 65536 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: required_client_features {} 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure 0 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure_osd_epoch 45 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_mds 2 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: in 0,1 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: up {0=14464,1=24257} 2024-09-13T23:08:37.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: failed 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: damaged 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: stopped 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_pools [3] 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_pool 2 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: inline_data disabled 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: balancer 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: bal_rank_mask -1 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: standby_count_wanted 1 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: qdb_cluster leader: 0 members: 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:08:37.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 ceph-mon[80164]: mon.smithi152@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 bash[80145]: 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 2024-09-13T23:08:37.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:37 smithi152 systemd[1]: Started Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:08:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: overall HEALTH_OK 2024-09-13T23:08:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: mon.smithi152 calling monitor election 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: mon.smithi115 calling monitor election 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: monmap epoch 3 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: last_changed 2024-09-13T23:08:37.522230+0000 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: created 2024-09-13T22:57:05.084385+0000 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: min_mon_release 19 (squid) 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: election_strategy: 1 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: 0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-13T23:08:38.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: mgrmap e38: smithi115.eqesbc(active, since 13s), standbys: smithi152.ntylos 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: overall HEALTH_OK 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:38.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:38 smithi152 ceph-mon[80164]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:08:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: overall HEALTH_OK 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: mon.smithi152 calling monitor election 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: mon.smithi115 calling monitor election 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: mon.smithi115 is new leader, mons smithi115,smithi152 in quorum (ranks 0,1) 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: monmap epoch 3 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: fsid 62d5ccce-7223-11ef-bceb-c7b262605968 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: last_changed 2024-09-13T23:08:37.522230+0000 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: created 2024-09-13T22:57:05.084385+0000 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: min_mon_release 19 (squid) 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: election_strategy: 1 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: 0: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-09-13T23:08:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: 1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.smithi152 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: mgrmap e38: smithi115.eqesbc(active, since 13s), standbys: smithi152.ntylos 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: overall HEALTH_OK 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:38.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:38 smithi115 ceph-mon[91340]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:08:39.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:39.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:41.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:41 smithi152 ceph-mon[80164]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:08:41.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:41 smithi115 ceph-mon[91340]: pgmap v11: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:08:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:43.466 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:43 smithi152 ceph-mon[80164]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:43.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:43 smithi115 ceph-mon[91340]: pgmap v12: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:44.936 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:44.936 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:44.936 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:44.936 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: Reconfiguring mon.smithi115 (monmap changed)... 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T23:08:44.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:44 smithi115 ceph-mon[91340]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:45.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: Reconfiguring mon.smithi115 (monmap changed)... 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: Reconfiguring daemon mon.smithi115 on smithi115 2024-09-13T23:08:45.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:44 smithi152 ceph-mon[80164]: pgmap v13: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: Reconfiguring mgr.smithi115.eqesbc (monmap changed)... 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: Reconfiguring daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T23:08:46.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:46 smithi115 ceph-mon[91340]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: Reconfiguring mgr.smithi115.eqesbc (monmap changed)... 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.eqesbc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: Reconfiguring daemon mgr.smithi115.eqesbc on smithi115 2024-09-13T23:08:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:46 smithi152 ceph-mon[80164]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T23:08:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:08:48.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:48.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:47 smithi115 ceph-mon[91340]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: Reconfiguring crash.smithi115 (monmap changed)... 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:48.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:47 smithi152 ceph-mon[80164]: Reconfiguring daemon crash.smithi115 on smithi115 2024-09-13T23:08:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:49.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T23:08:49.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:08:49.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:49.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:49 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.0 on smithi115 2024-09-13T23:08:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T23:08:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:08:49.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:49.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:49 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.0 on smithi115 2024-09-13T23:08:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T23:08:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:08:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.1 on smithi115 2024-09-13T23:08:50.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:50 smithi152 ceph-mon[80164]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:51.048 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:51.048 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T23:08:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:08:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.1 on smithi115 2024-09-13T23:08:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:50 smithi115 ceph-mon[91340]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:52.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:52.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:52.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T23:08:52.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:08:52.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:52.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.2 on smithi115 2024-09-13T23:08:52.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:52 smithi152 ceph-mon[80164]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:52.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:52.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:52.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T23:08:52.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:08:52.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:52.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.2 on smithi115 2024-09-13T23:08:52.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:52 smithi115 ceph-mon[91340]: pgmap v17: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:54.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:54.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: Reconfiguring mds.cephfs.smithi115.ywbcks (monmap changed)... 2024-09-13T23:08:54.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:08:54.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:54.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:53 smithi115 ceph-mon[91340]: Reconfiguring daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:08:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: Reconfiguring mds.cephfs.smithi115.ywbcks (monmap changed)... 2024-09-13T23:08:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:08:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:54.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:53 smithi152 ceph-mon[80164]: Reconfiguring daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:08:55.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:55.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:55.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:55.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:55.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:08:55.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: pgmap v18: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:08:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: Reconfiguring mds.cephfs.smithi115.vlvabd (monmap changed)... 2024-09-13T23:08:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: Reconfiguring daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:08:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:08:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:56.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: Reconfiguring mds.cephfs.smithi115.vlvabd (monmap changed)... 2024-09-13T23:08:56.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: Reconfiguring daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:08:56.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:56.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:56.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:08:56.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:57.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:56 smithi115 ceph-mon[91340]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-13T23:08:57.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:56 smithi115 ceph-mon[91340]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-13T23:08:57.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:56 smithi115 ceph-mon[91340]: pgmap v19: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:57.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:56 smithi152 ceph-mon[80164]: Reconfiguring crash.smithi152 (monmap changed)... 2024-09-13T23:08:57.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:56 smithi152 ceph-mon[80164]: Reconfiguring daemon crash.smithi152 on smithi152 2024-09-13T23:08:57.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:56 smithi152 ceph-mon[80164]: pgmap v19: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:08:58.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:58.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:58.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: Reconfiguring mgr.smithi152.ntylos (monmap changed)... 2024-09-13T23:08:58.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:58.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:58.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:58.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:58 smithi152 ceph-mon[80164]: Reconfiguring daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:08:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: Reconfiguring mgr.smithi152.ntylos (monmap changed)... 2024-09-13T23:08:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.ntylos", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:08:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:08:58.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:58.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:58 smithi115 ceph-mon[91340]: Reconfiguring daemon mgr.smithi152.ntylos on smithi152 2024-09-13T23:08:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: pgmap v20: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:59.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:08:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: pgmap v20: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:08:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:08:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:08:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:08:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:08:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:09:00.424 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:00 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: Reconfiguring mon.smithi152 (monmap changed)... 2024-09-13T23:09:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: Reconfiguring daemon mon.smithi152 on smithi152 2024-09-13T23:09:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:09:00.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:00 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:01 smithi152 ceph-mon[80164]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T23:09:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:01 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.3 on smithi152 2024-09-13T23:09:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:01 smithi152 ceph-mon[80164]: pgmap v21: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:01 smithi115 ceph-mon[91340]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T23:09:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:01 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.3 on smithi152 2024-09-13T23:09:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:01 smithi115 ceph-mon[91340]: pgmap v21: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:02.689 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.4 on smithi152 2024-09-13T23:09:02.690 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:02 smithi152 ceph-mon[80164]: pgmap v22: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:02.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.4 on smithi152 2024-09-13T23:09:02.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:02 smithi115 ceph-mon[91340]: pgmap v22: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:03.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- 172.21.15.115:0/2883313106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe40ff720 msgr2=0x7fcfe4101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:03.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/2883313106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe40ff720 0x7fcfe4101b00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80048d0 tx=0x7fcfd8009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- 172.21.15.115:0/2883313106 shutdown_connections 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/2883313106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe40ff720 0x7fcfe4101b00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/2883313106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe4066690 0x7fcfe40ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- 172.21.15.115:0/2883313106 >> 172.21.15.115:0/2883313106 conn(0x7fcfe40f6c10 msgr2=0x7fcfe40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- 172.21.15.115:0/2883313106 shutdown_connections 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- 172.21.15.115:0/2883313106 wait complete. 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 Processor -- start 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.743+0000 7fcfe9f17640 1 -- start start 2024-09-13T23:09:03.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe9f17640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe9f17640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe40ff720 0x7fcfe410d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe9f17640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410dcf0 con 0x7fcfe4066690 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe9f17640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410e510 con 0x7fcfe40ff720 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33328/0 (socket says 172.21.15.115:33328) 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 -- 172.21.15.115:0/4253042364 learned_addr learned my addr 172.21.15.115:0/4253042364 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe2ffd640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe40ff720 0x7fcfe410d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:03.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 -- 172.21.15.115:0/4253042364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe40ff720 msgr2=0x7fcfe410d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe40ff720 0x7fcfe410d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 -- 172.21.15.115:0/4253042364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8005040 con 0x7fcfe4066690 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfe37fe640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c810 tx=0x7fcfd4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.744+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd400a7d0 con 0x7fcfe4066690 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.745+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfd400add0 con 0x7fcfe4066690 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.745+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410e7a0 con 0x7fcfe4066690 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.745+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd40113a0 con 0x7fcfe4066690 2024-09-13T23:09:03.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.745+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410ed10 con 0x7fcfe4066690 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.746+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe4105770 con 0x7fcfe4066690 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.746+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fcfd4012400 con 0x7fcfe4066690 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.747+0000 7fcfcbfff640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 0x7fcfcc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.747+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcfd408e3b0 con 0x7fcfe4066690 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.747+0000 7fcfe2ffd640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 0x7fcfcc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:03.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.747+0000 7fcfe2ffd640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 0x7fcfcc070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8000c00 tx=0x7fcfd8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:03.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.752+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcfd4057410 con 0x7fcfe4066690 2024-09-13T23:09:03.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.939+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe410f060 con 0x7fcfcc06e660 2024-09-13T23:09:03.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.941+0000 7fcfcbfff640 1 -- 172.21.15.115:0/4253042364 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcfe410f060 con 0x7fcfcc06e660 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 msgr2=0x7fcfcc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 0x7fcfcc070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8000c00 tx=0x7fcfd8035040 comp rx=0 tx=0).stop 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 msgr2=0x7fcfe410d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c810 tx=0x7fcfd4004430 comp rx=0 tx=0).stop 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 shutdown_connections 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fcfcc06e660 0x7fcfcc070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcfe40ff720 0x7fcfe410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 --2- 172.21.15.115:0/4253042364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcfe4066690 0x7fcfe410d160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:03.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 >> 172.21.15.115:0/4253042364 conn(0x7fcfe40f6c10 msgr2=0x7fcfe40f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:03.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 shutdown_connections 2024-09-13T23:09:03.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:03.943+0000 7fcfe9f17640 1 -- 172.21.15.115:0/4253042364 wait complete. 2024-09-13T23:09:03.952 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:09:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- 172.21.15.115:0/431820535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 msgr2=0x7f6d480fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/431820535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d480fc980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009cf0 tx=0x7f6d40004cb0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- 172.21.15.115:0/431820535 shutdown_connections 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/431820535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d480fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/431820535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d480fc980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- 172.21.15.115:0/431820535 >> 172.21.15.115:0/431820535 conn(0x7f6d480f7d30 msgr2=0x7f6d480fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- 172.21.15.115:0/431820535 shutdown_connections 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- 172.21.15.115:0/431820535 wait complete. 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 Processor -- start 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.023+0000 7f6d4ced1640 1 -- start start 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d4810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4810dc00 con 0x7f6d480fc570 2024-09-13T23:09:04.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4810e420 con 0x7f6d480fd840 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33344/0 (socket says 172.21.15.115:33344) 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 -- 172.21.15.115:0/678958223 learned_addr learned my addr 172.21.15.115:0/678958223 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d45d9b640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d4810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 -- 172.21.15.115:0/678958223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 msgr2=0x7f6d4810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d4810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 -- 172.21.15.115:0/678958223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d400098b0 con 0x7f6d480fc570 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d45d9b640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d4810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4659c640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6d400046f0 tx=0x7f6d40004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d40009430 con 0x7f6d480fc570 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d40004330 con 0x7f6d480fc570 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4810e650 con 0x7f6d480fc570 2024-09-13T23:09:04.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d40003790 con 0x7f6d480fc570 2024-09-13T23:09:04.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.024+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4810eb90 con 0x7f6d480fc570 2024-09-13T23:09:04.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.025+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d480fb9d0 con 0x7f6d480fc570 2024-09-13T23:09:04.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.026+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f6d4002f030 con 0x7f6d480fc570 2024-09-13T23:09:04.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.026+0000 7f6d3effd640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 0x7f6d34070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.027+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6d400af6b0 con 0x7f6d480fc570 2024-09-13T23:09:04.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.027+0000 7f6d45d9b640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 0x7f6d34070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.027+0000 7f6d45d9b640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 0x7f6d34070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d4810ce20 tx=0x7f6d3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.031+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6d40078580 con 0x7f6d480fc570 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:04.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:03 smithi115 ceph-mon[91340]: Reconfiguring daemon osd.5 on smithi152 2024-09-13T23:09:04.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T23:09:04.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:09:04.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:04.139 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:03 smithi152 ceph-mon[80164]: Reconfiguring daemon osd.5 on smithi152 2024-09-13T23:09:04.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.214+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d4810eec0 con 0x7f6d3406e660 2024-09-13T23:09:04.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.215+0000 7f6d3effd640 1 -- 172.21.15.115:0/678958223 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6d4810eec0 con 0x7f6d3406e660 2024-09-13T23:09:04.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 msgr2=0x7f6d34070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 0x7f6d34070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d4810ce20 tx=0x7f6d3000b040 comp rx=0 tx=0).stop 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 msgr2=0x7f6d4810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6d400046f0 tx=0x7f6d40004cb0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 shutdown_connections 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f6d3406e660 0x7f6d34070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d480fd840 0x7f6d4810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.217+0000 7f6d4ced1640 1 --2- 172.21.15.115:0/678958223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d480fc570 0x7f6d4810d070 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.218+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 >> 172.21.15.115:0/678958223 conn(0x7f6d480f7d30 msgr2=0x7f6d480f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.218+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 shutdown_connections 2024-09-13T23:09:04.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.218+0000 7f6d4ced1640 1 -- 172.21.15.115:0/678958223 wait complete. 2024-09-13T23:09:04.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.297+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/1234971202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f80ff680 msgr2=0x7ff9f8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.297+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/1234971202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f80ff680 0x7ff9f8101a60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0048d0 tx=0x7ff9ec009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/1234971202 shutdown_connections 2024-09-13T23:09:04.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/1234971202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f80ff680 0x7ff9f8101a60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.300 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/1234971202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f8065c40 0x7ff9f80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/1234971202 >> 172.21.15.115:0/1234971202 conn(0x7ff9f80f6c10 msgr2=0x7ff9f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/1234971202 shutdown_connections 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/1234971202 wait complete. 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 Processor -- start 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- start start 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f80ff680 0x7ff9f810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810dc00 con 0x7ff9f8065c40 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.298+0000 7ff9fe9c9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f810e420 con 0x7ff9f80ff680 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33360/0 (socket says 172.21.15.115:33360) 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 -- 172.21.15.115:0/4292410808 learned_addr learned my addr 172.21.15.115:0/4292410808 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:04.301 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f77fe640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f80ff680 0x7ff9f810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 -- 172.21.15.115:0/4292410808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f80ff680 msgr2=0x7ff9f810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f80ff680 0x7ff9f810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 -- 172.21.15.115:0/4292410808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec005040 con 0x7ff9f8065c40 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f7fff640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eb70 tx=0x7ff9e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e8007c30 con 0x7ff9f8065c40 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9e800f040 con 0x7ff9f8065c40 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f810e6b0 con 0x7ff9f8065c40 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9e800caa0 con 0x7ff9f8065c40 2024-09-13T23:09:04.302 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.299+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f810ec50 con 0x7ff9f8065c40 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.300+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80fa890 con 0x7ff9f8065c40 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.301+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7ff9e8009110 con 0x7ff9f8065c40 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.301+0000 7ff9f4ff9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 0x7ff9e0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.301+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff9e808e6c0 con 0x7ff9f8065c40 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.301+0000 7ff9f77fe640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 0x7ff9e0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.303 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.302+0000 7ff9f77fe640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 0x7ff9e0070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec007ac0 tx=0x7ff9ec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.305+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9e8057590 con 0x7ff9f8065c40 2024-09-13T23:09:04.484 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.483+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9f810f060 con 0x7ff9e006e660 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.492+0000 7ff9f4ff9640 1 -- 172.21.15.115:0/4292410808 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff9f810f060 con 0x7ff9e006e660 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (119s) 34s ago 10m 25.6M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (10m) 34s ago 10m 6899k - 17.2.7-1629-geb16b97b ab51d1bebd12 4012e5efce90 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (9m) 24s ago 9m 6895k - 17.2.7-1629-geb16b97b ab51d1bebd12 db743ef14f61 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (108s) 34s ago 10m 80.2M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (5m) 34s ago 5m 124M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:09:04.493 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (5m) 34s ago 5m 72.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (5m) 24s ago 5m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (5m) 24s ago 5m 67.7M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (90s) 34s ago 11m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (59s) 24s ago 9m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (47s) 34s ago 11m 27.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (27s) 24s ago 9m 26.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 34s ago 10m 16.2M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (95s) 24s ago 9m 16.4M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (8m) 34s ago 8m 210M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (8m) 34s ago 8m 230M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (7m) 34s ago 7m 190M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (7m) 24s ago 7m 275M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (7m) 24s ago 7m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:09:04.494 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (6m) 24s ago 6m 230M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:09:04.495 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (64s) 34s ago 10m 46.4M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:09:04.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 msgr2=0x7ff9e0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 0x7ff9e0070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec007ac0 tx=0x7ff9ec035040 comp rx=0 tx=0).stop 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 msgr2=0x7ff9f810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800eb70 tx=0x7ff9e800b040 comp rx=0 tx=0).stop 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 shutdown_connections 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff9e006e660 0x7ff9e0070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9f80ff680 0x7ff9f810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 --2- 172.21.15.115:0/4292410808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f8065c40 0x7ff9f810d070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 >> 172.21.15.115:0/4292410808 conn(0x7ff9f80f6c10 msgr2=0x7ff9f80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 shutdown_connections 2024-09-13T23:09:04.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.494+0000 7ff9fe9c9640 1 -- 172.21.15.115:0/4292410808 wait complete. 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 -- 172.21.15.115:0/171362385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 msgr2=0x7f257c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 --2- 172.21.15.115:0/171362385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c0fdc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25640048d0 tx=0x7f2564009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 -- 172.21.15.115:0/171362385 shutdown_connections 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 --2- 172.21.15.115:0/171362385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c0fdc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 --2- 172.21.15.115:0/171362385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 0x7f257c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 -- 172.21.15.115:0/171362385 >> 172.21.15.115:0/171362385 conn(0x7f257c0f7d30 msgr2=0x7f257c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 -- 172.21.15.115:0/171362385 shutdown_connections 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.572+0000 7f258127b640 1 -- 172.21.15.115:0/171362385 wait complete. 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 Processor -- start 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 -- start start 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 0x7f257c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c10dc40 con 0x7f257c0fd820 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f258127b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c10e460 con 0x7f257c0fc550 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33368/0 (socket says 172.21.15.115:33368) 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 -- 172.21.15.115:0/4282231053 learned_addr learned my addr 172.21.15.115:0/4282231053 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 -- 172.21.15.115:0/4282231053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 msgr2=0x7f257c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f257affd640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 0x7f257c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.575 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 0x7f257c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.573+0000 7f2573fff640 1 -- 172.21.15.115:0/4282231053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564005040 con 0x7f257c0fd820 2024-09-13T23:09:04.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f2573fff640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25640043d0 tx=0x7f2564009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2564038070 con 0x7f257c0fd820 2024-09-13T23:09:04.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c10e690 con 0x7f257c0fd820 2024-09-13T23:09:04.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f256402ae90 con 0x7f257c0fd820 2024-09-13T23:09:04.577 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256403e670 con 0x7f257c0fd820 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.574+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c10ec30 con 0x7f257c0fd820 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.575+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c0fb9b0 con 0x7f257c0fd820 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.575+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f2564030020 con 0x7f257c0fd820 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.576+0000 7f25737fe640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 0x7f2568070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.576+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f25640ae550 con 0x7f257c0fd820 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.576+0000 7f257affd640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 0x7f2568070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.578 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.576+0000 7f257affd640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 0x7f2568070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f256c004ce0 tx=0x7f256c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.580 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.580+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2564077530 con 0x7f257c0fd820 2024-09-13T23:09:04.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.811+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f257c104f80 con 0x7f257c0fd820 2024-09-13T23:09:04.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.811+0000 7f25737fe640 1 -- 172.21.15.115:0/4282231053 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f256407abf0 con 0x7f257c0fd820 2024-09-13T23:09:04.812 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:09:04.812 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:09:04.812 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 10, 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:09:04.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:09:04.814 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:09:04.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 msgr2=0x7f2568070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 0x7f2568070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f256c004ce0 tx=0x7f256c00b040 comp rx=0 tx=0).stop 2024-09-13T23:09:04.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 msgr2=0x7f257c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25640043d0 tx=0x7f2564009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 shutdown_connections 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f256806e660 0x7f2568070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f257c0fd820 0x7f257c10d5f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 --2- 172.21.15.115:0/4282231053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f257c0fc550 0x7f257c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.813+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 >> 172.21.15.115:0/4282231053 conn(0x7f257c0f7d30 msgr2=0x7f257c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.814+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 shutdown_connections 2024-09-13T23:09:04.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.814+0000 7f258127b640 1 -- 172.21.15.115:0/4282231053 wait complete. 2024-09-13T23:09:04.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 -- 172.21.15.115:0/3780502400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 msgr2=0x7f2930101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 --2- 172.21.15.115:0/3780502400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f2930101a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29240048d0 tx=0x7f2924009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 -- 172.21.15.115:0/3780502400 shutdown_connections 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 --2- 172.21.15.115:0/3780502400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f2930101a80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 --2- 172.21.15.115:0/3780502400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 0x7f29300ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 -- 172.21.15.115:0/3780502400 >> 172.21.15.115:0/3780502400 conn(0x7f29300f6c10 msgr2=0x7f29300f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 -- 172.21.15.115:0/3780502400 shutdown_connections 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.891+0000 7f2935d74640 1 -- 172.21.15.115:0/3780502400 wait complete. 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 Processor -- start 2024-09-13T23:09:04.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 -- start start 2024-09-13T23:09:04.894 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 0x7f29300fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300fb5f0 con 0x7f29300ff6a0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f2935d74640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300fb730 con 0x7f2930066730 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f292effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f292effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33386/0 (socket says 172.21.15.115:33386) 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f292effd640 1 -- 172.21.15.115:0/1453881985 learned_addr learned my addr 172.21.15.115:0/1453881985 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.892+0000 7f292f7fe640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 0x7f29300fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f292effd640 1 -- 172.21.15.115:0/1453881985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 msgr2=0x7f29300fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f292effd640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 0x7f29300fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f292effd640 1 -- 172.21.15.115:0/1453881985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924005040 con 0x7f29300ff6a0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f292effd640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29240043d0 tx=0x7f2924009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2924038070 con 0x7f29300ff6a0 2024-09-13T23:09:04.895 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f292402ae90 con 0x7f29300ff6a0 2024-09-13T23:09:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29300fb9b0 con 0x7f29300ff6a0 2024-09-13T23:09:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f292403e670 con 0x7f29300ff6a0 2024-09-13T23:09:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.893+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29301150d0 con 0x7f29300ff6a0 2024-09-13T23:09:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.894+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29300fa8b0 con 0x7f29300ff6a0 2024-09-13T23:09:04.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.894+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f2924030020 con 0x7f29300ff6a0 2024-09-13T23:09:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.895+0000 7f2917fff640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 0x7f2918070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.895+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f29240ae4e0 con 0x7f29300ff6a0 2024-09-13T23:09:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.895+0000 7f292f7fe640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 0x7f2918070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:04.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.895+0000 7f292f7fe640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 0x7f2918070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29300fc920 tx=0x7f292000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:04.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:04.899+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2924077570 con 0x7f29300ff6a0 2024-09-13T23:09:04.916 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:04.917 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: pgmap v23: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:04.917 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.917 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:04.917 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:09:04.917 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:04 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: pgmap v23: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:09:05.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:04 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.102+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f293004b720 con 0x7f29300ff6a0 2024-09-13T23:09:05.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.102+0000 7f2917fff640 1 -- 172.21.15.115:0/1453881985 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1972 (secure 0 0 0) 0x7f292407ac30 con 0x7f29300ff6a0 2024-09-13T23:09:05.103 INFO:teuthology.orchestra.run.smithi115.stdout:e21 2024-09-13T23:09:05.103 INFO:teuthology.orchestra.run.smithi115.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 21 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:06:21.400942+0000 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:09:05.104 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:09:05.105 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:05.106 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 msgr2=0x7f2918070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 0x7f2918070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29300fc920 tx=0x7f292000b040 comp rx=0 tx=0).stop 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 msgr2=0x7f29300fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29240043d0 tx=0x7f2924009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 shutdown_connections 2024-09-13T23:09:05.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f291806e660 0x7f2918070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29300ff6a0 0x7f29300fb060 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 --2- 172.21.15.115:0/1453881985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2930066730 0x7f29300fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 >> 172.21.15.115:0/1453881985 conn(0x7f29300f6c10 msgr2=0x7f29300f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:05.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 shutdown_connections 2024-09-13T23:09:05.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.105+0000 7f2935d74640 1 -- 172.21.15.115:0/1453881985 wait complete. 2024-09-13T23:09:05.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 -- 172.21.15.115:0/280308958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fdbc0 msgr2=0x7f38480fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 --2- 172.21.15.115:0/280308958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fdbc0 0x7f38480fdfd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f38380048d0 tx=0x7f3838009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 -- 172.21.15.115:0/280308958 shutdown_connections 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 --2- 172.21.15.115:0/280308958 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fe510 0x7f38480fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 --2- 172.21.15.115:0/280308958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fdbc0 0x7f38480fdfd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 -- 172.21.15.115:0/280308958 >> 172.21.15.115:0/280308958 conn(0x7f38480f63c0 msgr2=0x7f38480f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 -- 172.21.15.115:0/280308958 shutdown_connections 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.185+0000 7f384d11f640 1 -- 172.21.15.115:0/280308958 wait complete. 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 Processor -- start 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 -- start start 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fdbc0 0x7f384810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384810dc90 con 0x7f38480fe510 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384d11f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384810e4b0 con 0x7f38480fdbc0 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33400/0 (socket says 172.21.15.115:33400) 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 -- 172.21.15.115:0/4273733210 learned_addr learned my addr 172.21.15.115:0/4273733210 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f3846d9d640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fdbc0 0x7f384810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 -- 172.21.15.115:0/4273733210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fdbc0 msgr2=0x7f384810d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fdbc0 0x7f384810d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 -- 172.21.15.115:0/4273733210 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838005040 con 0x7f38480fe510 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.186+0000 7f384659c640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f383c002870 tx=0x7f383c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.187+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c007c30 con 0x7f38480fe510 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.187+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384810e740 con 0x7f38480fe510 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.187+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f383c00f040 con 0x7f38480fe510 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.187+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c00da70 con 0x7f38480fe510 2024-09-13T23:09:05.189 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.187+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384810ece0 con 0x7f38480fe510 2024-09-13T23:09:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.188+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38480fa060 con 0x7f38480fe510 2024-09-13T23:09:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.188+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f383c00dbd0 con 0x7f38480fe510 2024-09-13T23:09:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.188+0000 7f382f7fe640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 0x7f3830070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.189+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f383c08db30 con 0x7f38480fe510 2024-09-13T23:09:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.189+0000 7f3846d9d640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 0x7f3830070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.189+0000 7f3846d9d640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 0x7f3830070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3838007ac0 tx=0x7f3838035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:05.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.193+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f383c056ab0 con 0x7f38480fe510 2024-09-13T23:09:05.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.373+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f384810f010 con 0x7f383006e660 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.374+0000 7f382f7fe640 1 -- 172.21.15.115:0/4273733210 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f384810f010 con 0x7f383006e660 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:09:05.377 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "4/21 daemons upgraded", 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 msgr2=0x7f3830070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 0x7f3830070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3838007ac0 tx=0x7f3838035040 comp rx=0 tx=0).stop 2024-09-13T23:09:05.378 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 msgr2=0x7f384810d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f383c002870 tx=0x7f383c004600 comp rx=0 tx=0).stop 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 shutdown_connections 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f383006e660 0x7f3830070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38480fe510 0x7f384810d640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 --2- 172.21.15.115:0/4273733210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38480fdbc0 0x7f384810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 >> 172.21.15.115:0/4273733210 conn(0x7f38480f63c0 msgr2=0x7f38480f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 shutdown_connections 2024-09-13T23:09:05.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.377+0000 7f384d11f640 1 -- 172.21.15.115:0/4273733210 wait complete. 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- 172.21.15.115:0/2757942350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 msgr2=0x7f0d100fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 --2- 172.21.15.115:0/2757942350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d100fb860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80048d0 tx=0x7f0cf8009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- 172.21.15.115:0/2757942350 shutdown_connections 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 --2- 172.21.15.115:0/2757942350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d100fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 --2- 172.21.15.115:0/2757942350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d100fb860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- 172.21.15.115:0/2757942350 >> 172.21.15.115:0/2757942350 conn(0x7f0d100f6c10 msgr2=0x7f0d100f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:05.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- 172.21.15.115:0/2757942350 shutdown_connections 2024-09-13T23:09:05.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- 172.21.15.115:0/2757942350 wait complete. 2024-09-13T23:09:05.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 Processor -- start 2024-09-13T23:09:05.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.455+0000 7f0d16de2640 1 -- start start 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d16de2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d16de2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d1010c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d16de2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1010cb30 con 0x7f0d100fb450 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d16de2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1010d350 con 0x7f0d100fc720 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33420/0 (socket says 172.21.15.115:33420) 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 -- 172.21.15.115:0/3479904806 learned_addr learned my addr 172.21.15.115:0/3479904806 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d0ffff640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d1010c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 -- 172.21.15.115:0/3479904806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 msgr2=0x7f0d1010c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d1010c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 -- 172.21.15.115:0/3479904806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8005040 con 0x7f0d100fb450 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d0ffff640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d1010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d14b7e640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8003080 tx=0x7f0cf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.456+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf8038070 con 0x7f0d100fb450 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.457+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cf802abd0 con 0x7f0d100fb450 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.457+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1010d580 con 0x7f0d100fb450 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.457+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf803e670 con 0x7f0d100fb450 2024-09-13T23:09:05.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.457+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1010db20 con 0x7f0d100fb450 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.458+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d100fa8b0 con 0x7f0d100fb450 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.458+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f0cf8030020 con 0x7f0d100fb450 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.459+0000 7f0d0d7fa640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 0x7f0cfc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.459+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0cf80ae610 con 0x7f0d100fb450 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.459+0000 7f0d0ffff640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 0x7f0cfc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:05.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.459+0000 7f0d0ffff640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 0x7f0cfc070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d1010bd50 tx=0x7f0d00009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:05.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.463+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0cf8077670 con 0x7f0d100fb450 2024-09-13T23:09:05.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.695+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0d1004b720 con 0x7f0d100fb450 2024-09-13T23:09:05.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.696+0000 7f0d0d7fa640 1 -- 172.21.15.115:0/3479904806 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0cf807ad30 con 0x7f0d100fb450 2024-09-13T23:09:05.697 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 msgr2=0x7f0cfc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 0x7f0cfc070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0d1010bd50 tx=0x7f0d00009040 comp rx=0 tx=0).stop 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 msgr2=0x7f0d1010bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8003080 tx=0x7f0cf8009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 shutdown_connections 2024-09-13T23:09:05.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cfc06e660 0x7f0cfc070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d100fc720 0x7f0d1010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 --2- 172.21.15.115:0/3479904806 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d100fb450 0x7f0d1010bfa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 >> 172.21.15.115:0/3479904806 conn(0x7f0d100f6c10 msgr2=0x7f0d100f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 shutdown_connections 2024-09-13T23:09:05.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:05.698+0000 7f0d16de2640 1 -- 172.21.15.115:0/3479904806 wait complete. 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: Reconfiguring mds.cephfs.smithi152.cmykpw (monmap changed)... 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: Reconfiguring daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4282231053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:05.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1453881985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:09:05.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:05.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:05.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:09:05.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:05.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:05 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3479904806' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:09:06.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: Reconfiguring mds.cephfs.smithi152.cmykpw (monmap changed)... 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: Reconfiguring daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4282231053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1453881985' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:06.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:05 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3479904806' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:09:06.962 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:06 smithi152 ceph-mon[80164]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:06.962 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:06 smithi152 ceph-mon[80164]: Reconfiguring mds.cephfs.smithi152.pntaqr (monmap changed)... 2024-09-13T23:09:06.963 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:06 smithi152 ceph-mon[80164]: Reconfiguring daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:09:06.963 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:06 smithi152 ceph-mon[80164]: pgmap v24: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:06 smithi115 ceph-mon[91340]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:06 smithi115 ceph-mon[91340]: Reconfiguring mds.cephfs.smithi152.pntaqr (monmap changed)... 2024-09-13T23:09:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:06 smithi115 ceph-mon[91340]: Reconfiguring daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:09:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:06 smithi115 ceph-mon[91340]: pgmap v24: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:08.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:08.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:08.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all mon 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-09-13T23:09:08.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-09-13T23:09:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all mon 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2024-09-13T23:09:08.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2024-09-13T23:09:09.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:09 smithi115 ceph-mon[91340]: pgmap v25: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:09.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:09.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:09:09.154 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:09 smithi152 ceph-mon[80164]: pgmap v25: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:09:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:10.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:10 smithi115 ceph-mon[91340]: Upgrade: Updating crash.smithi115 (1/2) 2024-09-13T23:09:10.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:10 smithi115 ceph-mon[91340]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T23:09:10.189 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:10 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:10 smithi152 ceph-mon[80164]: Upgrade: Updating crash.smithi115 (1/2) 2024-09-13T23:09:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:10 smithi152 ceph-mon[80164]: Deploying daemon crash.smithi115 on smithi115 2024-09-13T23:09:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:10 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:11.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:11 smithi115 ceph-mon[91340]: pgmap v26: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:11 smithi152 ceph-mon[80164]: pgmap v26: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:13.336 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:13 smithi152 ceph-mon[80164]: pgmap v27: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:13.336 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:13.337 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:13.337 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:13 smithi115 ceph-mon[91340]: pgmap v27: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:13.337 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:13.337 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:14.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: Upgrade: Updating crash.smithi152 (2/2) 2024-09-13T23:09:14.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:14.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:09:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: Deploying daemon crash.smithi152 on smithi152 2024-09-13T23:09:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:14 smithi115 ceph-mon[91340]: pgmap v28: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: Upgrade: Updating crash.smithi152 (2/2) 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: Deploying daemon crash.smithi152 on smithi152 2024-09-13T23:09:14.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:14 smithi152 ceph-mon[80164]: pgmap v28: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:16.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:16 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:09:16.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:16 smithi152 ceph-mon[80164]: pgmap v29: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:16.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:16 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:09:16.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:16 smithi115 ceph-mon[91340]: pgmap v29: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:17.873 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:17.873 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:17.873 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:17.873 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:17.874 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:18.053 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:18.053 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:18.053 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:18.053 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:18.053 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:18.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:18 smithi115 ceph-mon[91340]: pgmap v30: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:18.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:18 smithi152 ceph-mon[80164]: pgmap v30: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:21.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:20 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:20 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:20 smithi115 ceph-mon[91340]: pgmap v31: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:21.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:20 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:20 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.111 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:20 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.111 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:20 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.111 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:20 smithi152 ceph-mon[80164]: pgmap v31: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:21.112 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:20 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:21.112 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:20 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:22 smithi152 ceph-mon[80164]: pgmap v32: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:22.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:22 smithi115 ceph-mon[91340]: pgmap v32: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:22.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:22.994 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:24 smithi152 ceph-mon[80164]: pgmap v33: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:24.749 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:24.749 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:24.749 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:24 smithi115 ceph-mon[91340]: pgmap v33: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:24.749 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all crash 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: Upgrade: osd.0 is safe to restart 2024-09-13T23:09:26.801 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:26 smithi115 ceph-mon[91340]: pgmap v34: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all crash 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2024-09-13T23:09:26.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:09:26.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:09:26.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: Upgrade: osd.0 is safe to restart 2024-09-13T23:09:26.970 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:26 smithi152 ceph-mon[80164]: pgmap v34: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: Upgrade: Updating osd.0 2024-09-13T23:09:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:09:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: Deploying daemon osd.0 on smithi115 2024-09-13T23:09:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:28 smithi115 ceph-mon[91340]: pgmap v35: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:28.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: Upgrade: Updating osd.0 2024-09-13T23:09:28.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:28.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:09:28.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:28.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: Deploying daemon osd.0 on smithi115 2024-09-13T23:09:28.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:28 smithi152 ceph-mon[80164]: pgmap v35: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:09:30.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:30 smithi115 systemd[1]: Stopping Ceph osd.0 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:09:31.049 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:30 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[46353]: 2024-09-13T23:09:30.709+0000 7fe968cf5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:09:31.050 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:30 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[46353]: 2024-09-13T23:09:30.709+0000 7fe968cf5640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-13T23:09:31.050 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:30 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[46353]: 2024-09-13T23:09:30.709+0000 7fe968cf5640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:09:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:31 smithi152 ceph-mon[80164]: pgmap v36: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:31 smithi152 ceph-mon[80164]: osd.0 marked itself down and dead 2024-09-13T23:09:31.515 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:31 smithi115 ceph-mon[91340]: pgmap v36: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:09:31.515 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:31 smithi115 ceph-mon[91340]: osd.0 marked itself down and dead 2024-09-13T23:09:31.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:31 smithi115 podman[98990]: 2024-09-13 23:09:31.515148086 +0000 UTC m=+0.914069339 container died b2c0f666b35486cb6bc0531067ddac9f403f5755739fe471498b54dd0205ca44 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T23:09:32.096 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[98990]: 2024-09-13 23:09:32.034955189 +0000 UTC m=+1.433876441 container cleanup b2c0f666b35486cb6bc0531067ddac9f403f5755739fe471498b54dd0205ca44 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:09:32.097 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 bash[98990]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0 2024-09-13T23:09:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:32 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:09:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:32 smithi152 ceph-mon[80164]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T23:09:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:32 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:09:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:32 smithi115 ceph-mon[91340]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T23:09:32.550 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[99008]: 2024-09-13 23:09:32.244945609 +0000 UTC m=+0.727039004 container remove b2c0f666b35486cb6bc0531067ddac9f403f5755739fe471498b54dd0205ca44 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T23:09:32.940 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[99093]: 2024-09-13 23:09:32.554940734 +0000 UTC m=+0.015947400 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:09:32.940 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[99093]: 2024-09-13 23:09:32.696041234 +0000 UTC m=+0.157047884 container create feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T23:09:32.941 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[99093]: 2024-09-13 23:09:32.9402495 +0000 UTC m=+0.401256150 container init feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:09:33.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:33 smithi115 ceph-mon[91340]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:09:33.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:33 smithi115 ceph-mon[91340]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T23:09:33.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:32 smithi115 podman[99093]: 2024-09-13 23:09:32.943802019 +0000 UTC m=+0.404808677 container start feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T23:09:33.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 podman[99093]: 2024-09-13 23:09:33.023398415 +0000 UTC m=+0.484405068 container attach feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T23:09:33.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 podman[99093]: 2024-09-13 23:09:33.138598052 +0000 UTC m=+0.599604709 container died feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T23:09:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:33 smithi152 ceph-mon[80164]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:09:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:33 smithi152 ceph-mon[80164]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T23:09:34.252 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 podman[99116]: 2024-09-13 23:09:33.80266063 +0000 UTC m=+0.653707190 container remove feaeb21b4ae151f7f3e6386bd2c14e2b16e1634375278360e2d06b9d9822f9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T23:09:34.252 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T23:09:34.252 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 systemd[1]: Stopped Ceph osd.0 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:09:34.252 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:33 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.0.service: Consumed 50.710s CPU time. 2024-09-13T23:09:34.252 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 systemd[1]: Starting Ceph osd.0 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:09:34.523 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 podman[99214]: 2024-09-13 23:09:34.154384547 +0000 UTC m=+0.016121554 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:09:34.523 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 podman[99214]: 2024-09-13 23:09:34.291565065 +0000 UTC m=+0.153302104 container create a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be) 2024-09-13T23:09:34.523 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 podman[99214]: 2024-09-13 23:09:34.523178296 +0000 UTC m=+0.384915299 container init a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T23:09:34.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 podman[99214]: 2024-09-13 23:09:34.526552255 +0000 UTC m=+0.388289258 container start a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be) 2024-09-13T23:09:34.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 podman[99214]: 2024-09-13 23:09:34.623373974 +0000 UTC m=+0.485110984 container attach a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:09:34.799 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:09:34.800 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 bash[99214]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:09:34.800 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:09:34.800 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:34 smithi115 bash[99214]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:09:35.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-mon[91340]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:35 smithi152 ceph-mon[80164]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:35.683 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:09:35.683 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:09:35.683 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:09:35.683 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 -- 172.21.15.115:0/2702389691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b84071570 msgr2=0x7f3b8406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 --2- 172.21.15.115:0/2702389691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b84071570 0x7f3b8406faa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009c50 tx=0x7f3b74004d10 comp rx=0 tx=0).stop 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 -- 172.21.15.115:0/2702389691 shutdown_connections 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 --2- 172.21.15.115:0/2702389691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8406ffe0 0x7f3b84070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 --2- 172.21.15.115:0/2702389691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b84071570 0x7f3b8406faa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.783+0000 7f3b89238640 1 -- 172.21.15.115:0/2702389691 >> 172.21.15.115:0/2702389691 conn(0x7f3b840f7ce0 msgr2=0x7f3b840fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:35.787 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.784+0000 7f3b89238640 1 -- 172.21.15.115:0/2702389691 shutdown_connections 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.784+0000 7f3b89238640 1 -- 172.21.15.115:0/2702389691 wait complete. 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.784+0000 7f3b89238640 1 Processor -- start 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.784+0000 7f3b89238640 1 -- start start 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b84071570 0x7f3b8410f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8410fe40 con 0x7f3b8406ffe0 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84110660 con 0x7f3b84071570 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42188/0 (socket says 172.21.15.115:42188) 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 -- 172.21.15.115:0/1879808469 learned_addr learned my addr 172.21.15.115:0/1879808469 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b8259c640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b84071570 0x7f3b8410f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:35.788 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 -- 172.21.15.115:0/1879808469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b84071570 msgr2=0x7f3b8410f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b84071570 0x7f3b8410f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 -- 172.21.15.115:0/1879808469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740098b0 con 0x7f3b8406ffe0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b82d9d640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000f80 tx=0x7f3b74004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b74009710 con 0x7f3b8406ffe0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84110890 con 0x7f3b8406ffe0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b74032b10 con 0x7f3b8406ffe0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7403dba0 con 0x7f3b8406ffe0 2024-09-13T23:09:35.789 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.785+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84110e30 con 0x7f3b8406ffe0 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.787+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b840fb980 con 0x7f3b8406ffe0 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.787+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f3b7402f030 con 0x7f3b8406ffe0 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.787+0000 7f3b6b7fe640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 0x7f3b6c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.788+0000 7f3b8259c640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 0x7f3b6c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.788+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3b740af590 con 0x7f3b8406ffe0 2024-09-13T23:09:35.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.788+0000 7f3b8259c640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 0x7f3b6c070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007fd0 tx=0x7f3b78009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:35.793 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.792+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3b74078460 con 0x7f3b8406ffe0 2024-09-13T23:09:35.983 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.982+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b84111110 con 0x7f3b6c06e660 2024-09-13T23:09:35.983 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:09:35.983 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:09:35.983 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate[99230]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 bash[99214]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T23:09:35.984 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:35 smithi115 podman[99214]: 2024-09-13 23:09:35.712208356 +0000 UTC m=+1.573945354 container died a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T23:09:35.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.983+0000 7f3b6b7fe640 1 -- 172.21.15.115:0/1879808469 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3b84111110 con 0x7f3b6c06e660 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 msgr2=0x7f3b6c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 0x7f3b6c070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007fd0 tx=0x7f3b78009e90 comp rx=0 tx=0).stop 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 msgr2=0x7f3b8410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000f80 tx=0x7f3b74004d10 comp rx=0 tx=0).stop 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 shutdown_connections 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3b6c06e660 0x7f3b6c070b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b84071570 0x7f3b8410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 --2- 172.21.15.115:0/1879808469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8406ffe0 0x7f3b8410f2b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:35.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 >> 172.21.15.115:0/1879808469 conn(0x7f3b840f7ce0 msgr2=0x7f3b840f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:35.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 shutdown_connections 2024-09-13T23:09:35.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:35.985+0000 7f3b89238640 1 -- 172.21.15.115:0/1879808469 wait complete. 2024-09-13T23:09:35.994 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:09:36.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 -- 172.21.15.115:0/296526198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 msgr2=0x7f8af80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/296526198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af80fcb70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ae00048d0 tx=0x7f8ae0009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 -- 172.21.15.115:0/296526198 shutdown_connections 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/296526198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af80fcb70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/296526198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 0x7f8af80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 -- 172.21.15.115:0/296526198 >> 172.21.15.115:0/296526198 conn(0x7f8af80f6c10 msgr2=0x7f8af80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 -- 172.21.15.115:0/296526198 shutdown_connections 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.066+0000 7f8afd5dc640 1 -- 172.21.15.115:0/296526198 wait complete. 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 Processor -- start 2024-09-13T23:09:36.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 -- start start 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 0x7f8af810fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8065cf0 con 0x7f8af80fc700 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8afd5dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8065e60 con 0x7f8af80fb430 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49018/0 (socket says 172.21.15.115:49018) 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 -- 172.21.15.115:0/4011172133 learned_addr learned my addr 172.21.15.115:0/4011172133 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8af6ffd640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 0x7f8af810fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 -- 172.21.15.115:0/4011172133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 msgr2=0x7f8af810fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 0x7f8af810fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 -- 172.21.15.115:0/4011172133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0005040 con 0x7f8af80fc700 2024-09-13T23:09:36.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.067+0000 7f8aeffff640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0003080 tx=0x7f8ae0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.068+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae0038070 con 0x7f8af80fc700 2024-09-13T23:09:36.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.068+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ae002abd0 con 0x7f8af80fc700 2024-09-13T23:09:36.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.068+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af8112950 con 0x7f8af80fc700 2024-09-13T23:09:36.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.068+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae003e670 con 0x7f8af80fc700 2024-09-13T23:09:36.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.068+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af8112e70 con 0x7f8af80fc700 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.069+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80fa890 con 0x7f8af80fc700 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.069+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8ae0030020 con 0x7f8af80fc700 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.070+0000 7f8aef7fe640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 0x7f8ae4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.070+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8ae00ae600 con 0x7f8af80fc700 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.070+0000 7f8af6ffd640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 0x7f8ae4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.070+0000 7f8af6ffd640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 0x7f8ae4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8006fd0 tx=0x7f8ae8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.074+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ae0077660 con 0x7f8af80fc700 2024-09-13T23:09:36.266 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:36 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T23:09:36.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.265+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8af8100b00 con 0x7f8ae406e660 2024-09-13T23:09:36.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.266+0000 7f8aef7fe640 1 -- 172.21.15.115:0/4011172133 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8af8100b00 con 0x7f8ae406e660 2024-09-13T23:09:36.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 msgr2=0x7f8ae4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 0x7f8ae4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8006fd0 tx=0x7f8ae8008040 comp rx=0 tx=0).stop 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 msgr2=0x7f8af8112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0003080 tx=0x7f8ae0009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 shutdown_connections 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8ae406e660 0x7f8ae4070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8af80fc700 0x7f8af8112350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 --2- 172.21.15.115:0/4011172133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af80fb430 0x7f8af810fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.268+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 >> 172.21.15.115:0/4011172133 conn(0x7f8af80f6c10 msgr2=0x7f8af80f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.269+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 shutdown_connections 2024-09-13T23:09:36.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.269+0000 7f8afd5dc640 1 -- 172.21.15.115:0/4011172133 wait complete. 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 -- 172.21.15.115:0/3739758006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fc700 msgr2=0x7fe1440fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 --2- 172.21.15.115:0/3739758006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fc700 0x7fe1440fcb70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1380048d0 tx=0x7fe138009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 -- 172.21.15.115:0/3739758006 shutdown_connections 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 --2- 172.21.15.115:0/3739758006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fc700 0x7fe1440fcb70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 --2- 172.21.15.115:0/3739758006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fb430 0x7fe1440fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.347+0000 7fe14a535640 1 -- 172.21.15.115:0/3739758006 >> 172.21.15.115:0/3739758006 conn(0x7fe1440f6c10 msgr2=0x7fe1440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 -- 172.21.15.115:0/3739758006 shutdown_connections 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 -- 172.21.15.115:0/3739758006 wait complete. 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 Processor -- start 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 -- start start 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 0x7fe144112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144065cf0 con 0x7fe1440fb430 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe14a535640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144065e60 con 0x7fe1440fc700 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe143fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe143fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49026/0 (socket says 172.21.15.115:49026) 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.348+0000 7fe143fff640 1 -- 172.21.15.115:0/2121329755 learned_addr learned my addr 172.21.15.115:0/2121329755 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:36.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe1437fe640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 0x7fe144112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe143fff640 1 -- 172.21.15.115:0/2121329755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 msgr2=0x7fe144112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe143fff640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 0x7fe144112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe143fff640 1 -- 172.21.15.115:0/2121329755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138005040 con 0x7fe1440fb430 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe1437fe640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 0x7fe144112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe143fff640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b790 tx=0x7fe1340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13400c700 con 0x7fe1440fb430 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe13400cd00 con 0x7fe1440fb430 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe134015e70 con 0x7fe1440fb430 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144112950 con 0x7fe1440fb430 2024-09-13T23:09:36.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.349+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144112e70 con 0x7fe1440fb430 2024-09-13T23:09:36.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.350+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1440fa890 con 0x7fe1440fb430 2024-09-13T23:09:36.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.351+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fe134012070 con 0x7fe1440fb430 2024-09-13T23:09:36.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.351+0000 7fe140ff9640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 0x7fe12c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.351+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe13408dec0 con 0x7fe1440fb430 2024-09-13T23:09:36.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.351+0000 7fe1437fe640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 0x7fe12c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.352+0000 7fe1437fe640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 0x7fe12c070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe138004540 tx=0x7fe138035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.356+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe134056ea0 con 0x7fe1440fb430 2024-09-13T23:09:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:36 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T23:09:36.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 podman[99367]: 2024-09-13 23:09:36.453759545 +0000 UTC m=+0.735528386 container remove a0c00928fd242d4ff4b70abf8b50affef3631ed765461d840246d7e875e1db40 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T23:09:36.579 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.578+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe144100b00 con 0x7fe12c06e660 2024-09-13T23:09:36.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.592+0000 7fe140ff9640 1 -- 172.21.15.115:0/2121329755 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe144100b00 con 0x7fe12c06e660 2024-09-13T23:09:36.593 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:09:36.593 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (2m) 14s ago 10m 25.6M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (24s) 14s ago 11m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (20s) 16s ago 10m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (2m) 14s ago 10m 81.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (5m) 14s ago 5m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (5m) 14s ago 5m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (5m) 16s ago 5m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (5m) 16s ago 5m 67.4M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (2m) 14s ago 12m 492M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (91s) 16s ago 10m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (79s) 14s ago 12m 41.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (59s) 16s ago 10m 37.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 14s ago 11m 16.7M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:09:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 16s ago 10m 16.4M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (9m) 14s ago 9m 211M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 b2c0f666b354 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (8m) 14s ago 8m 232M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (8m) 14s ago 8m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (8m) 16s ago 7m 275M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (7m) 16s ago 7m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (7m) 16s ago 7m 231M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:09:36.595 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (96s) 14s ago 10m 48.0M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 msgr2=0x7fe12c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 0x7fe12c070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe138004540 tx=0x7fe138035040 comp rx=0 tx=0).stop 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 msgr2=0x7fe14410fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe13400b790 tx=0x7fe1340091d0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 shutdown_connections 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe12c06e660 0x7fe12c070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1440fc700 0x7fe144112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 --2- 172.21.15.115:0/2121329755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1440fb430 0x7fe14410fe00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.596 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 >> 172.21.15.115:0/2121329755 conn(0x7fe1440f6c10 msgr2=0x7fe1440f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 shutdown_connections 2024-09-13T23:09:36.597 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.595+0000 7fe14a535640 1 -- 172.21.15.115:0/2121329755 wait complete. 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.673+0000 7f8d57703640 1 -- 172.21.15.115:0/69830438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 msgr2=0x7f8d500fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.673+0000 7f8d57703640 1 --2- 172.21.15.115:0/69830438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d500fcb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d440048d0 tx=0x7f8d44009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- 172.21.15.115:0/69830438 shutdown_connections 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 --2- 172.21.15.115:0/69830438 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d500fcb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 --2- 172.21.15.115:0/69830438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 0x7f8d500fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- 172.21.15.115:0/69830438 >> 172.21.15.115:0/69830438 conn(0x7f8d500f6c10 msgr2=0x7f8d500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- 172.21.15.115:0/69830438 shutdown_connections 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- 172.21.15.115:0/69830438 wait complete. 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 Processor -- start 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- start start 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 0x7f8d5010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50065d10 con 0x7f8d500fc700 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d57703640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50065e80 con 0x7f8d500fb430 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d54c9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d54c9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49036/0 (socket says 172.21.15.115:49036) 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.674+0000 7f8d54c9e640 1 -- 172.21.15.115:0/199285726 learned_addr learned my addr 172.21.15.115:0/199285726 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d5549f640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 0x7f8d5010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d54c9e640 1 -- 172.21.15.115:0/199285726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 msgr2=0x7f8d5010fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d54c9e640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 0x7f8d5010fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d54c9e640 1 -- 172.21.15.115:0/199285726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44005040 con 0x7f8d500fc700 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d54c9e640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d44003080 tx=0x7f8d44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d44038070 con 0x7f8d500fc700 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d4402abd0 con 0x7f8d500fc700 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50112930 con 0x7f8d500fc700 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4403e670 con 0x7f8d500fc700 2024-09-13T23:09:36.678 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.675+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d50112e00 con 0x7f8d500fc700 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.676+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500fa890 con 0x7f8d500fc700 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.677+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f8d44030020 con 0x7f8d500fc700 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.677+0000 7f8d4dffb640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 0x7f8d38070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.678+0000 7f8d5549f640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 0x7f8d38070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.678+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8d440ae640 con 0x7f8d500fc700 2024-09-13T23:09:36.679 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.678+0000 7f8d5549f640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 0x7f8d38070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d50065970 tx=0x7f8d48009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:36.682 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.682+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8d440776d0 con 0x7f8d500fc700 2024-09-13T23:09:36.844 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 podman[99489]: 2024-09-13 23:09:36.594947741 +0000 UTC m=+0.020355566 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:09:36.844 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 podman[99489]: 2024-09-13 23:09:36.738925165 +0000 UTC m=+0.164332986 container create ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T23:09:36.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.936+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d5004b720 con 0x7f8d500fc700 2024-09-13T23:09:36.937 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.937+0000 7f8d4dffb640 1 -- 172.21.15.115:0/199285726 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+744 (secure 0 0 0) 0x7f8d4407ad90 con 0x7f8d500fc700 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 5 2024-09-13T23:09:36.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 9, 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:09:36.939 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 msgr2=0x7f8d38070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 0x7f8d38070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d50065970 tx=0x7f8d48009120 comp rx=0 tx=0).stop 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 msgr2=0x7f8d50112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d44003080 tx=0x7f8d44009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 shutdown_connections 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8d3806e660 0x7f8d38070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d500fc700 0x7f8d50112330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 --2- 172.21.15.115:0/199285726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8d500fb430 0x7f8d5010fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:36.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 >> 172.21.15.115:0/199285726 conn(0x7f8d500f6c10 msgr2=0x7f8d500f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:36.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 shutdown_connections 2024-09-13T23:09:36.941 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:36.939+0000 7f8d57703640 1 -- 172.21.15.115:0/199285726 wait complete. 2024-09-13T23:09:37.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 -- 172.21.15.115:0/2806894812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e54065ba0 msgr2=0x7f5e540ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2806894812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e54065ba0 0x7f5e540ff1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5e440048d0 tx=0x7f5e44009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 -- 172.21.15.115:0/2806894812 shutdown_connections 2024-09-13T23:09:37.023 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2806894812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e540ff720 0x7f5e54101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2806894812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e54065ba0 0x7f5e540ff1e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 -- 172.21.15.115:0/2806894812 >> 172.21.15.115:0/2806894812 conn(0x7f5e540f6c10 msgr2=0x7f5e540f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 -- 172.21.15.115:0/2806894812 shutdown_connections 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.021+0000 7f5e5a817640 1 -- 172.21.15.115:0/2806894812 wait complete. 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 Processor -- start 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 -- start start 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54065ba0 0x7f5e540fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540fb620 con 0x7f5e540ff720 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e5a817640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540fb760 con 0x7f5e54065ba0 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49058/0 (socket says 172.21.15.115:49058) 2024-09-13T23:09:37.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 -- 172.21.15.115:0/2656542008 learned_addr learned my addr 172.21.15.115:0/2656542008 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e53fff640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54065ba0 0x7f5e540fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 -- 172.21.15.115:0/2656542008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54065ba0 msgr2=0x7f5e540fcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54065ba0 0x7f5e540fcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.022+0000 7f5e537fe640 1 -- 172.21.15.115:0/2656542008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44005040 con 0x7f5e540ff720 2024-09-13T23:09:37.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e537fe640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800c760 tx=0x7f5e480043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4800a710 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e540fba40 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e4800ad10 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e480113a0 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.023+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54115190 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.024+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e540fa890 con 0x7f5e540ff720 2024-09-13T23:09:37.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.024+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7f5e4800a870 con 0x7f5e540ff720 2024-09-13T23:09:37.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.025+0000 7f5e50ff9640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 0x7f5e3c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.025+0000 7f5e53fff640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 0x7f5e3c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.025+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e4808e370 con 0x7f5e540ff720 2024-09-13T23:09:37.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.026+0000 7f5e53fff640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 0x7f5e3c070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e540fc950 tx=0x7f5e44035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.029+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e480573d0 con 0x7f5e540ff720 2024-09-13T23:09:37.160 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 podman[99489]: 2024-09-13 23:09:36.96583091 +0000 UTC m=+0.391238728 container init ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T23:09:37.161 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 podman[99489]: 2024-09-13 23:09:36.969374463 +0000 UTC m=+0.394782294 container start ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T23:09:37.161 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:36 smithi115 ceph-osd[99533]: -- 172.21.15.115:0/1448757881 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b4c9fc1e0 con 0x560b4c992000 2024-09-13T23:09:37.161 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:37 smithi115 bash[99489]: ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 2024-09-13T23:09:37.161 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:37 smithi115 systemd[1]: Started Ceph osd.0 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:09:37.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.245+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e54104f80 con 0x7f5e540ff720 2024-09-13T23:09:37.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.246+0000 7f5e50ff9640 1 -- 172.21.15.115:0/2656542008 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1970 (secure 0 0 0) 0x7f5e4805aa90 con 0x7f5e540ff720 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:e22 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:15:375366+0000 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:09:37.247 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 22 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:15.375359+0000 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:09:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:09:37.249 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 14464,24257 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:37.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 22 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.248+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 msgr2=0x7f5e3c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.248+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 0x7f5e3c070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e540fc950 tx=0x7f5e44035040 comp rx=0 tx=0).stop 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.248+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 msgr2=0x7f5e540fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.248+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800c760 tx=0x7f5e480043c0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 shutdown_connections 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f5e3c06e660 0x7f5e3c070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e540ff720 0x7f5e540fb0e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 --2- 172.21.15.115:0/2656542008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e54065ba0 0x7f5e540fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 >> 172.21.15.115:0/2656542008 conn(0x7f5e540f6c10 msgr2=0x7f5e540f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 shutdown_connections 2024-09-13T23:09:37.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.249+0000 7f5e5a817640 1 -- 172.21.15.115:0/2656542008 wait complete. 2024-09-13T23:09:37.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- 172.21.15.115:0/3347574696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 msgr2=0x7fe8d4101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/3347574696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d4101ae0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009c50 tx=0x7fe8c8004d10 comp rx=0 tx=0).stop 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- 172.21.15.115:0/3347574696 shutdown_connections 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/3347574696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d4101ae0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/3347574696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 0x7fe8d40ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- 172.21.15.115:0/3347574696 >> 172.21.15.115:0/3347574696 conn(0x7fe8d40f6c10 msgr2=0x7fe8d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- 172.21.15.115:0/3347574696 shutdown_connections 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- 172.21.15.115:0/3347574696 wait complete. 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 Processor -- start 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 -- start start 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 0x7fe8d410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.331+0000 7fe8d8b01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d8b01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d410dcb0 con 0x7fe8d40ff700 2024-09-13T23:09:37.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d8b01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d410e480 con 0x7fe8d4065bc0 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49086/0 (socket says 172.21.15.115:49086) 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 -- 172.21.15.115:0/2548992624 learned_addr learned my addr 172.21.15.115:0/2548992624 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d259c640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 0x7fe8d410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 -- 172.21.15.115:0/2548992624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 msgr2=0x7fe8d410d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 0x7fe8d410d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 -- 172.21.15.115:0/2548992624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80098b0 con 0x7fe8d40ff700 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d1d9b640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8000f80 tx=0x7fe8c8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c8009710 con 0x7fe8d40ff700 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe8c8032b10 con 0x7fe8d40ff700 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c803dba0 con 0x7fe8d40ff700 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d410e6b0 con 0x7fe8d40ff700 2024-09-13T23:09:37.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.332+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d410ec50 con 0x7fe8d40ff700 2024-09-13T23:09:37.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.333+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d40fa890 con 0x7fe8d40ff700 2024-09-13T23:09:37.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.334+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fe8c802f030 con 0x7fe8d40ff700 2024-09-13T23:09:37.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.335+0000 7fe8c2ffd640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 0x7fe8bc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.335+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe8c80af570 con 0x7fe8d40ff700 2024-09-13T23:09:37.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.335+0000 7fe8d259c640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 0x7fe8bc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.335+0000 7fe8d259c640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 0x7fe8bc070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009fd0 tx=0x7fe8cc009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.339+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe8c8078440 con 0x7fe8d40ff700 2024-09-13T23:09:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/199285726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/199285726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:37.581 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.580+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d410efa0 con 0x7fe8bc06e660 2024-09-13T23:09:37.582 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.581+0000 7fe8c2ffd640 1 -- 172.21.15.115:0/2548992624 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe8d410efa0 con 0x7fe8bc06e660 2024-09-13T23:09:37.582 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:09:37.582 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "6/21 daemons upgraded", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:09:37.583 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 msgr2=0x7fe8bc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 0x7fe8bc070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009fd0 tx=0x7fe8cc009e50 comp rx=0 tx=0).stop 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 msgr2=0x7fe8d410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8000f80 tx=0x7fe8c8004d10 comp rx=0 tx=0).stop 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 shutdown_connections 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe8bc06e660 0x7fe8bc070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8d40ff700 0x7fe8d410d660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 --2- 172.21.15.115:0/2548992624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8d4065bc0 0x7fe8d410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 >> 172.21.15.115:0/2548992624 conn(0x7fe8d40f6c10 msgr2=0x7fe8d40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 shutdown_connections 2024-09-13T23:09:37.585 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.584+0000 7fe8d8b01640 1 -- 172.21.15.115:0/2548992624 wait complete. 2024-09-13T23:09:37.665 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 -- 172.21.15.115:0/875772508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fe4f0 msgr2=0x7fdbc00fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 --2- 172.21.15.115:0/875772508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc00fa650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40048d0 tx=0x7fdbb4009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 -- 172.21.15.115:0/875772508 shutdown_connections 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 --2- 172.21.15.115:0/875772508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc00fa650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 --2- 172.21.15.115:0/875772508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fdba0 0x7fdbc00fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 -- 172.21.15.115:0/875772508 >> 172.21.15.115:0/875772508 conn(0x7fdbc00f63a0 msgr2=0x7fdbc00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 -- 172.21.15.115:0/875772508 shutdown_connections 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.663+0000 7fdbc6923640 1 -- 172.21.15.115:0/875772508 wait complete. 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 Processor -- start 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 -- start start 2024-09-13T23:09:37.666 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc010dc30 con 0x7fdbc00fdba0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbc6923640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc010e450 con 0x7fdbc00fe4f0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:49098/0 (socket says 172.21.15.115:49098) 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 -- 172.21.15.115:0/1643327023 learned_addr learned my addr 172.21.15.115:0/1643327023 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbf7fe640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 -- 172.21.15.115:0/1643327023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fe4f0 msgr2=0x7fdbc010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc010d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.664+0000 7fdbbffff640 1 -- 172.21.15.115:0/1643327023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4005040 con 0x7fdbc00fdba0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbbffff640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0002a50 tx=0x7fdbb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb0007c30 con 0x7fdbc00fdba0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbb000f040 con 0x7fdbc00fdba0 2024-09-13T23:09:37.667 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc010e6e0 con 0x7fdbc00fdba0 2024-09-13T23:09:37.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb000da90 con 0x7fdbc00fdba0 2024-09-13T23:09:37.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.665+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc010ec80 con 0x7fdbc00fdba0 2024-09-13T23:09:37.668 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.666+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc00fa040 con 0x7fdbc00fdba0 2024-09-13T23:09:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.666+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 38) v1 ==== 92655+0+0 (secure 0 0 0) 0x7fdbb000dc30 con 0x7fdbc00fdba0 2024-09-13T23:09:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.667+0000 7fdbbcff9640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 0x7fdba8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.667+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdbb008dc40 con 0x7fdbc00fdba0 2024-09-13T23:09:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.667+0000 7fdbbf7fe640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 0x7fdba8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:37.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.667+0000 7fdbbf7fe640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 0x7fdba8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:37.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.671+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbb0093020 con 0x7fdbc00fdba0 2024-09-13T23:09:37.911 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.910+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdbc004b720 con 0x7fdbc00fdba0 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.910+0000 7fdbbcff9640 1 -- 172.21.15.115:0/1643327023 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1383 (secure 0 0 0) 0x7fdbb0056b90 con 0x7fdbc00fdba0 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: osd.0 (root=default,host=smithi115) is down 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-13T23:09:37.912 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-13T23:09:37.913 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-13T23:09:37.914 INFO:teuthology.orchestra.run.smithi115.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T23:09:37.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 msgr2=0x7fdba8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.914 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 0x7fdba8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb4009da0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 msgr2=0x7fdbc010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0002a50 tx=0x7fdbb0004600 comp rx=0 tx=0).stop 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 shutdown_connections 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdba806e660 0x7fdba8070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbc00fe4f0 0x7fdbc010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 --2- 172.21.15.115:0/1643327023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdbc00fdba0 0x7fdbc010d0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 >> 172.21.15.115:0/1643327023 conn(0x7fdbc00f63a0 msgr2=0x7fdbc00f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 shutdown_connections 2024-09-13T23:09:37.915 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:09:37.914+0000 7fdbc6923640 1 -- 172.21.15.115:0/1643327023 wait complete. 2024-09-13T23:09:38.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:38 smithi152 ceph-mon[80164]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:38.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:38 smithi152 ceph-mon[80164]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:38.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:38 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2656542008' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:09:38.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:38 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1643327023' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:09:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:38 smithi115 ceph-mon[91340]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:38 smithi115 ceph-mon[91340]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:38 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2656542008' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:09:38.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:38 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1643327023' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:09:39.049 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:38 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:09:38.636+0000 7fe4b08ab640 -1 Falling back to public interface 2024-09-13T23:09:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:39 smithi152 ceph-mon[80164]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:39 smithi152 ceph-mon[80164]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 68/348 objects degraded (19.540%) 2024-09-13T23:09:39.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:39.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:39.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:39 smithi115 ceph-mon[91340]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:09:39.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:39 smithi115 ceph-mon[91340]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 68/348 objects degraded (19.540%) 2024-09-13T23:09:39.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:39.481 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:41.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:41 smithi115 ceph-mon[91340]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:41 smithi152 ceph-mon[80164]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:42 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:09:42.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:42 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby-replay 2024-09-13T23:09:43.458 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:43 smithi115 ceph-mon[91340]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:43.458 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:43 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.459 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:43 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.459 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:43 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.459 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:43 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:43 smithi152 ceph-mon[80164]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:43 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:43 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:43 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:43.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:43 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:44.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:44 smithi115 ceph-mon[91340]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:09:44.299 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:09:44.029+0000 7fe4b08ab640 -1 osd.0 48 log_to_monitors true 2024-09-13T23:09:44.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:44 smithi152 ceph-mon[80164]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:09:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:45 smithi115 ceph-mon[91340]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:45 smithi115 ceph-mon[91340]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:09:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:45 smithi115 ceph-mon[91340]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T23:09:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:45 smithi115 ceph-mon[91340]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:09:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:45 smithi115 ceph-mon[91340]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' 2024-09-13T23:09:45.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:09:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:09:44.998+0000 7fe4a463d640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:09:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:45 smithi152 ceph-mon[80164]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:45 smithi152 ceph-mon[80164]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:09:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:45 smithi152 ceph-mon[80164]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T23:09:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:45 smithi152 ceph-mon[80164]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:09:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:45 smithi152 ceph-mon[80164]: from='osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230]' entity='osd.0' 2024-09-13T23:09:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:46 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:09:46.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:46 smithi115 ceph-mon[91340]: osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230] boot 2024-09-13T23:09:46.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:46 smithi115 ceph-mon[91340]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T23:09:46.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:09:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:46 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:09:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:46 smithi152 ceph-mon[80164]: osd.0 [v2:172.21.15.115:6802/2408443230,v1:172.21.15.115:6803/2408443230] boot 2024-09-13T23:09:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:46 smithi152 ceph-mon[80164]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T23:09:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:09:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:09:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:47 smithi152 ceph-mon[80164]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T23:09:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:09:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:47 smithi115 ceph-mon[91340]: osdmap e53: 6 total, 6 up, 6 in 2024-09-13T23:09:48.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:48 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:09:48.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:48 smithi152 ceph-mon[80164]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T23:09:48.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:48 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:09:48.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:48 smithi115 ceph-mon[91340]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T23:09:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:49 smithi152 ceph-mon[80164]: pgmap v50: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:49 smithi115 ceph-mon[91340]: pgmap v50: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/348 objects degraded (19.540%) 2024-09-13T23:09:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:50 smithi152 ceph-mon[80164]: pgmap v51: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T23:09:50.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:50 smithi115 ceph-mon[91340]: pgmap v51: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-13T23:09:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:51 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded) 2024-09-13T23:09:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:51 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:09:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:51 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 68/348 objects degraded (19.540%), 20 pgs degraded) 2024-09-13T23:09:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:51 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:09:52.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:52 smithi152 ceph-mon[80164]: pgmap v52: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T23:09:52.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:52 smithi115 ceph-mon[91340]: pgmap v52: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-13T23:09:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:55 smithi152 ceph-mon[80164]: pgmap v53: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:55 smithi115 ceph-mon[91340]: pgmap v53: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:57 smithi152 ceph-mon[80164]: pgmap v54: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-13T23:09:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:57 smithi152 ceph-mon[80164]: mgrmap e39: smithi115.eqesbc(active, since 92s), standbys: smithi152.ntylos 2024-09-13T23:09:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:57 smithi115 ceph-mon[91340]: pgmap v54: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 614 B/s wr, 4 op/s 2024-09-13T23:09:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:57 smithi115 ceph-mon[91340]: mgrmap e39: smithi115.eqesbc(active, since 92s), standbys: smithi152.ntylos 2024-09-13T23:09:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:59 smithi152 ceph-mon[80164]: pgmap v55: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 556 B/s wr, 4 op/s 2024-09-13T23:09:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:09:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:09:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:59 smithi115 ceph-mon[91340]: pgmap v55: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 556 B/s wr, 4 op/s 2024-09-13T23:09:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:09:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:00.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:00 smithi152 ceph-mon[80164]: overall HEALTH_OK 2024-09-13T23:10:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:00 smithi115 ceph-mon[91340]: overall HEALTH_OK 2024-09-13T23:10:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:01 smithi152 ceph-mon[80164]: pgmap v56: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:10:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:01 smithi115 ceph-mon[91340]: pgmap v56: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:10:02.231 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:10:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: Upgrade: osd.1 is safe to restart 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: pgmap v57: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:10:03.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:03 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: Upgrade: osd.1 is safe to restart 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: pgmap v57: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:10:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:03 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:04.444 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:04 smithi115 ceph-mon[91340]: Upgrade: Updating osd.1 2024-09-13T23:10:04.444 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:04 smithi115 ceph-mon[91340]: Deploying daemon osd.1 on smithi115 2024-09-13T23:10:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:04 smithi152 ceph-mon[80164]: Upgrade: Updating osd.1 2024-09-13T23:10:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:04 smithi152 ceph-mon[80164]: Deploying daemon osd.1 on smithi115 2024-09-13T23:10:05.412 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:05 smithi115 ceph-mon[91340]: pgmap v58: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:10:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:05 smithi152 ceph-mon[80164]: pgmap v58: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T23:10:06.050 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:05 smithi115 systemd[1]: Stopping Ceph osd.1 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:10:06.050 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:06 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[54099]: 2024-09-13T23:10:06.041+0000 7f363cce5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:10:06.050 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:06 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[54099]: 2024-09-13T23:10:06.041+0000 7f363cce5640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-13T23:10:06.050 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:06 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[54099]: 2024-09-13T23:10:06.041+0000 7f363cce5640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:10:06.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:06 smithi152 ceph-mon[80164]: osd.1 marked itself down and dead 2024-09-13T23:10:06.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:06 smithi115 ceph-mon[91340]: osd.1 marked itself down and dead 2024-09-13T23:10:07.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:06 smithi115 podman[104765]: 2024-09-13 23:10:06.664211634 +0000 UTC m=+0.728102892 container died dfd0c08a0ab44ef75f1dbe3cda4f1aa920db3447d8e91ba9fdc3014127910a4f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T23:10:07.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:07 smithi115 ceph-mon[91340]: pgmap v59: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:10:07.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:07 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:10:07.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:07 smithi115 ceph-mon[91340]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T23:10:07.385 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104765]: 2024-09-13 23:10:07.175195594 +0000 UTC m=+1.239086849 container cleanup dfd0c08a0ab44ef75f1dbe3cda4f1aa920db3447d8e91ba9fdc3014127910a4f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-eb16b97, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T23:10:07.386 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 bash[104765]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1 2024-09-13T23:10:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:07 smithi152 ceph-mon[80164]: pgmap v59: 65 pgs: 65 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:10:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:07 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:10:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:07 smithi152 ceph-mon[80164]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T23:10:07.711 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104783]: 2024-09-13 23:10:07.384822894 +0000 UTC m=+0.717328049 container remove dfd0c08a0ab44ef75f1dbe3cda4f1aa920db3447d8e91ba9fdc3014127910a4f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T23:10:07.963 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104872]: 2024-09-13 23:10:07.613502532 +0000 UTC m=+0.015598968 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:07.964 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104872]: 2024-09-13 23:10:07.727579536 +0000 UTC m=+0.129675967 container create 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T23:10:07.964 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104872]: 2024-09-13 23:10:07.963667042 +0000 UTC m=+0.365763471 container init 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 -- 172.21.15.115:0/1790134839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fc700 msgr2=0x7f3c5c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/1790134839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c0fcb70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c480048d0 tx=0x7f3c48009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 -- 172.21.15.115:0/1790134839 shutdown_connections 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/1790134839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c0fcb70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/1790134839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 -- 172.21.15.115:0/1790134839 >> 172.21.15.115:0/1790134839 conn(0x7f3c5c0f6c10 msgr2=0x7f3c5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 -- 172.21.15.115:0/1790134839 shutdown_connections 2024-09-13T23:10:08.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 -- 172.21.15.115:0/1790134839 wait complete. 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:07.999+0000 7f3c62cd4640 1 Processor -- start 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c62cd4640 1 -- start start 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c62cd4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c62cd4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c62cd4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10dc10 con 0x7f3c5c0fb430 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c62cd4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c10e430 con 0x7f3c5c0fc700 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50172/0 (socket says 172.21.15.115:50172) 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 -- 172.21.15.115:0/85765479 learned_addr learned my addr 172.21.15.115:0/85765479 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c5bfff640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 -- 172.21.15.115:0/85765479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 msgr2=0x7f3c5c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c60a70640 1 -- 172.21.15.115:0/85765479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48005040 con 0x7f3c5c0fb430 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.000+0000 7f3c5bfff640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c60a70640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c790 tx=0x7f3c500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c5000a820 con 0x7f3c5c0fb430 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c5000ae20 con 0x7f3c5c0fb430 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c10e6c0 con 0x7f3c5c0fb430 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c500113a0 con 0x7f3c5c0fb430 2024-09-13T23:10:08.004 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.001+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c10ec60 con 0x7f3c5c0fb430 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.002+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c0fa890 con 0x7f3c5c0fb430 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.002+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3c5000a980 con 0x7f3c5c0fb430 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.003+0000 7f3c597fa640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 0x7f3c4c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.003+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3c5008e200 con 0x7f3c5c0fb430 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.003+0000 7f3c5bfff640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 0x7f3c4c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.004+0000 7f3c5bfff640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 0x7f3c4c0709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b020 tx=0x7f3c48009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.008 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.008+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3c50057430 con 0x7f3c5c0fb430 2024-09-13T23:10:08.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.198+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c5c104000 con 0x7f3c4c06e530 2024-09-13T23:10:08.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.200+0000 7f3c597fa640 1 -- 172.21.15.115:0/85765479 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3c4802ab20 con 0x7f3c4c06e530 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 msgr2=0x7f3c4c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 0x7f3c4c0709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b020 tx=0x7f3c48009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 msgr2=0x7f3c5c10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c790 tx=0x7f3c500043c0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 shutdown_connections 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3c4c06e530 0x7f3c4c0709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.203 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c5c0fc700 0x7f3c5c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 --2- 172.21.15.115:0/85765479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c5c0fb430 0x7f3c5c10d080 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 >> 172.21.15.115:0/85765479 conn(0x7f3c5c0f6c10 msgr2=0x7f3c5c065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 shutdown_connections 2024-09-13T23:10:08.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.202+0000 7f3c62cd4640 1 -- 172.21.15.115:0/85765479 wait complete. 2024-09-13T23:10:08.212 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:10:08.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 -- 172.21.15.115:0/866873930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 msgr2=0x7f2c380fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/866873930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fa6e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c280048d0 tx=0x7f2c28009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 -- 172.21.15.115:0/866873930 shutdown_connections 2024-09-13T23:10:08.284 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:08 smithi115 ceph-mon[91340]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T23:10:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/866873930 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 0x7f2c38101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/866873930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fa6e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 -- 172.21.15.115:0/866873930 >> 172.21.15.115:0/866873930 conn(0x7f2c380f5f20 msgr2=0x7f2c380f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 -- 172.21.15.115:0/866873930 shutdown_connections 2024-09-13T23:10:08.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.283+0000 7f2c3e85a640 1 -- 172.21.15.115:0/866873930 wait complete. 2024-09-13T23:10:08.285 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:07 smithi115 podman[104872]: 2024-09-13 23:10:07.96714954 +0000 UTC m=+0.369245972 container start 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T23:10:08.286 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 podman[104872]: 2024-09-13 23:10:08.063770604 +0000 UTC m=+0.465867057 container attach 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T23:10:08.286 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 podman[104872]: 2024-09-13 23:10:08.157688087 +0000 UTC m=+0.559784517 container died 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T23:10:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 Processor -- start 2024-09-13T23:10:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 -- start start 2024-09-13T23:10:08.287 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 0x7f2c380fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380fc320 con 0x7f2c380fa2d0 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c3e85a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380fc460 con 0x7f2c380fac20 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50198/0 (socket says 172.21.15.115:50198) 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 -- 172.21.15.115:0/971326733 learned_addr learned my addr 172.21.15.115:0/971326733 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c2ffff640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 0x7f2c380fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 -- 172.21.15.115:0/971326733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 msgr2=0x7f2c380fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 0x7f2c380fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.284+0000 7f2c37fff640 1 -- 172.21.15.115:0/971326733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28005040 con 0x7f2c380fa2d0 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c37fff640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c28000c00 tx=0x7f2c28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c28038070 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2c28032d30 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c380fc6e0 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c2803dba0 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.285+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38115110 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.286+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c380f9bc0 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.286+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2c28030020 con 0x7f2c380fa2d0 2024-09-13T23:10:08.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.287+0000 7f2c357fa640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 0x7f2c240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.287+0000 7f2c2ffff640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 0x7f2c240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.287+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2c280aebd0 con 0x7f2c380fa2d0 2024-09-13T23:10:08.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.288+0000 7f2c2ffff640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 0x7f2c240709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c200092d0 tx=0x7f2c20009e00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.292+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2c28077d00 con 0x7f2c380fa2d0 2024-09-13T23:10:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:08 smithi152 ceph-mon[80164]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T23:10:08.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.484+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c38101720 con 0x7f2c2406e530 2024-09-13T23:10:08.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.485+0000 7f2c357fa640 1 -- 172.21.15.115:0/971326733 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2c38101720 con 0x7f2c2406e530 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 msgr2=0x7f2c240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 0x7f2c240709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c200092d0 tx=0x7f2c20009e00 comp rx=0 tx=0).stop 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 msgr2=0x7f2c380fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c28000c00 tx=0x7f2c28009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 shutdown_connections 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c2406e530 0x7f2c240709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c380fac20 0x7f2c380fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 --2- 172.21.15.115:0/971326733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c380fa2d0 0x7f2c380fd8a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 >> 172.21.15.115:0/971326733 conn(0x7f2c380f5f20 msgr2=0x7f2c38100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 shutdown_connections 2024-09-13T23:10:08.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.487+0000 7f2c3e85a640 1 -- 172.21.15.115:0/971326733 wait complete. 2024-09-13T23:10:08.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.567+0000 7f803d57e640 1 -- 172.21.15.115:0/3723574086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fc700 msgr2=0x7f80380fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.567+0000 7f803d57e640 1 --2- 172.21.15.115:0/3723574086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fc700 0x7f80380fcb70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f80200048d0 tx=0x7f8020009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- 172.21.15.115:0/3723574086 shutdown_connections 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 --2- 172.21.15.115:0/3723574086 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fc700 0x7f80380fcb70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 --2- 172.21.15.115:0/3723574086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fb430 0x7f80380fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- 172.21.15.115:0/3723574086 >> 172.21.15.115:0/3723574086 conn(0x7f80380f6c10 msgr2=0x7f80380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- 172.21.15.115:0/3723574086 shutdown_connections 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- 172.21.15.115:0/3723574086 wait complete. 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 Processor -- start 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- start start 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fc700 0x7f803810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803810dc70 con 0x7f80380fb430 2024-09-13T23:10:08.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.568+0000 7f803d57e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803810e440 con 0x7f80380fc700 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50214/0 (socket says 172.21.15.115:50214) 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 -- 172.21.15.115:0/3130807228 learned_addr learned my addr 172.21.15.115:0/3130807228 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f80367fc640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fc700 0x7f803810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 -- 172.21.15.115:0/3130807228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fc700 msgr2=0x7f803810d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fc700 0x7f803810d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.572 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 -- 172.21.15.115:0/3130807228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020005040 con 0x7f80380fb430 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f8036ffd640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f802800db00 tx=0x7f8028004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8028017070 con 0x7f80380fb430 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f802800f040 con 0x7f80380fb430 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803810e6d0 con 0x7f80380fb430 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8028003940 con 0x7f80380fb430 2024-09-13T23:10:08.573 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.569+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803810ec70 con 0x7f80380fb430 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.570+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80380fa890 con 0x7f80380fb430 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.571+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8028003aa0 con 0x7f80380fb430 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.571+0000 7f802f7fe640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 0x7f80240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.572+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f802808e1f0 con 0x7f80380fb430 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.572+0000 7f80367fc640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 0x7f80240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.572+0000 7f80367fc640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 0x7f80240709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8020007ac0 tx=0x7f8020035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.576 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.576+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f802805ae90 con 0x7f80380fb430 2024-09-13T23:10:08.753 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.753+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8038104000 con 0x7f802406e530 2024-09-13T23:10:08.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.761+0000 7f802f7fe640 1 -- 172.21.15.115:0/3130807228 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f802002aad0 con 0x7f802406e530 2024-09-13T23:10:08.762 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:10:08.762 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 26s ago 11m 25.6M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:10:08.762 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (57s) 26s ago 11m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (52s) 48s ago 10m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (2m) 26s ago 11m 85.6M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (6m) 26s ago 6m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (6m) 26s ago 6m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (6m) 48s ago 6m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (6m) 48s ago 6m 67.4M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (2m) 26s ago 12m 494M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (2m) 48s ago 10m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (111s) 26s ago 13m 43.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (92s) 48s ago 10m 37.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (3m) 26s ago 11m 16.2M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 48s ago 10m 16.4M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (32s) 26s ago 9m 14.2M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:10:08.763 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (9m) 26s ago 9m 232M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 dfd0c08a0ab4 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (8m) 26s ago 8m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (8m) 48s ago 8m 275M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (8m) 48s ago 8m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (7m) 48s ago 7m 231M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (2m) 26s ago 11m 50.8M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:10:08.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 msgr2=0x7f80240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 0x7f80240709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8020007ac0 tx=0x7f8020035040 comp rx=0 tx=0).stop 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 msgr2=0x7f803810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f802800db00 tx=0x7f8028004e60 comp rx=0 tx=0).stop 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 shutdown_connections 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f802406e530 0x7f80240709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80380fc700 0x7f803810d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 --2- 172.21.15.115:0/3130807228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80380fb430 0x7f803810d0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.765 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.763+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 >> 172.21.15.115:0/3130807228 conn(0x7f80380f6c10 msgr2=0x7f80380655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.764+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 shutdown_connections 2024-09-13T23:10:08.766 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.764+0000 7f803d57e640 1 -- 172.21.15.115:0/3130807228 wait complete. 2024-09-13T23:10:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- 172.21.15.115:0/2166256591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 msgr2=0x7f493c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 --2- 172.21.15.115:0/2166256591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c0ff140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49340048d0 tx=0x7f4934009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- 172.21.15.115:0/2166256591 shutdown_connections 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 --2- 172.21.15.115:0/2166256591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 0x7f493c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 --2- 172.21.15.115:0/2166256591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c0ff140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- 172.21.15.115:0/2166256591 >> 172.21.15.115:0/2166256591 conn(0x7f493c0f6c10 msgr2=0x7f493c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- 172.21.15.115:0/2166256591 shutdown_connections 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- 172.21.15.115:0/2166256591 wait complete. 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 Processor -- start 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.842+0000 7f4942c9e640 1 -- start start 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4942c9e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4942c9e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 0x7f493c10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4942c9e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c10dca0 con 0x7f493c065c40 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4942c9e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c10e400 con 0x7f493c0ff680 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50236/0 (socket says 172.21.15.115:50236) 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 -- 172.21.15.115:0/3959135424 learned_addr learned my addr 172.21.15.115:0/3959135424 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f493bfff640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 0x7f493c10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 -- 172.21.15.115:0/3959135424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 msgr2=0x7f493c10d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 0x7f493c10d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 -- 172.21.15.115:0/3959135424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934005040 con 0x7f493c065c40 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4940a3a640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49340043d0 tx=0x7f4934009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4934038070 con 0x7f493c065c40 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f493402ae90 con 0x7f493c065c40 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493403e670 con 0x7f493c065c40 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.843+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c10e630 con 0x7f493c065c40 2024-09-13T23:10:08.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.844+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c10ebd0 con 0x7f493c065c40 2024-09-13T23:10:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.845+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c0fa890 con 0x7f493c065c40 2024-09-13T23:10:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.845+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4934030020 con 0x7f493c065c40 2024-09-13T23:10:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.846+0000 7f49397fa640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 0x7f49280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.846+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f49340ae390 con 0x7f493c065c40 2024-09-13T23:10:08.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.846+0000 7f493bfff640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 0x7f49280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:08.848 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.846+0000 7f493bfff640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 0x7f49280709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4924007fd0 tx=0x7f4924009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:08.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:08.850+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4934077480 con 0x7f493c065c40 2024-09-13T23:10:09.099 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 podman[104917]: 2024-09-13 23:10:08.83710934 +0000 UTC m=+0.673064549 container remove 5c51bf748a7ad95fdeeba95ce750178a30ac3884e23fe3a045da6099aabaa7a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T23:10:09.100 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T23:10:09.100 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 systemd[1]: Stopped Ceph osd.1 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:10:09.100 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:08 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.1.service: Consumed 58.970s CPU time. 2024-09-13T23:10:09.100 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 systemd[1]: Starting Ceph osd.1 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:10:09.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.110+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f493c10ee90 con 0x7f493c065c40 2024-09-13T23:10:09.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.111+0000 7f49397fa640 1 -- 172.21.15.115:0/3959135424 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f493407ab40 con 0x7f493c065c40 2024-09-13T23:10:09.112 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:10:09.112 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4, 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:09.113 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:10:09.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 8, 2024-09-13T23:10:09.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T23:10:09.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:10:09.114 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 msgr2=0x7f49280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 0x7f49280709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4924007fd0 tx=0x7f4924009e90 comp rx=0 tx=0).stop 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 msgr2=0x7f493c10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49340043d0 tx=0x7f4934009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 shutdown_connections 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f492806e530 0x7f49280709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f493c0ff680 0x7f493c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 --2- 172.21.15.115:0/3959135424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f493c065c40 0x7f493c10d110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.113+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 >> 172.21.15.115:0/3959135424 conn(0x7f493c0f6c10 msgr2=0x7f493c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.114+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 shutdown_connections 2024-09-13T23:10:09.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.114+0000 7f4942c9e640 1 -- 172.21.15.115:0/3959135424 wait complete. 2024-09-13T23:10:09.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 -- 172.21.15.115:0/3997301008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38340ff720 msgr2=0x7f3834101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 --2- 172.21.15.115:0/3997301008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38340ff720 0x7f3834101b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38280048d0 tx=0x7f3828009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 -- 172.21.15.115:0/3997301008 shutdown_connections 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 --2- 172.21.15.115:0/3997301008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38340ff720 0x7f3834101b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 --2- 172.21.15.115:0/3997301008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3834065ba0 0x7f38340ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.208+0000 7f3839c4f640 1 -- 172.21.15.115:0/3997301008 >> 172.21.15.115:0/3997301008 conn(0x7f38340f6c10 msgr2=0x7f38340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 -- 172.21.15.115:0/3997301008 shutdown_connections 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 -- 172.21.15.115:0/3997301008 wait complete. 2024-09-13T23:10:09.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 Processor -- start 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 -- start start 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38340ff720 0x7f383410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383410dc30 con 0x7f3834065ba0 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.209+0000 7f3839c4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383410e450 con 0x7f38340ff720 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50262/0 (socket says 172.21.15.115:50262) 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 -- 172.21.15.115:0/4232015838 learned_addr learned my addr 172.21.15.115:0/4232015838 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:09.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f3832ffd640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38340ff720 0x7f383410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 -- 172.21.15.115:0/4232015838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38340ff720 msgr2=0x7f383410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38340ff720 0x7f383410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 -- 172.21.15.115:0/4232015838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828005040 con 0x7f3834065ba0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f38337fe640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f382400c7e0 tx=0x7f38240043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382400a7a0 con 0x7f3834065ba0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383410e6e0 con 0x7f3834065ba0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f382400ada0 con 0x7f3834065ba0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38240113a0 con 0x7f3834065ba0 2024-09-13T23:10:09.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.210+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383410ec50 con 0x7f3834065ba0 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.212+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340fa890 con 0x7f3834065ba0 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.212+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f382400a900 con 0x7f3834065ba0 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.213+0000 7f381bfff640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 0x7f381c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.213+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f382408e220 con 0x7f3834065ba0 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.213+0000 7f3832ffd640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 0x7f381c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.213+0000 7f3832ffd640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 0x7f381c0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.217+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3824057390 con 0x7f3834065ba0 2024-09-13T23:10:09.421 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.420+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3834104f60 con 0x7f3834065ba0 2024-09-13T23:10:09.422 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-mon[91340]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:09.422 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-mon[91340]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:09.422 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:09.422 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:09.422 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3959135424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:09.422 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 podman[105086]: 2024-09-13 23:10:09.203507702 +0000 UTC m=+0.016428215 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:09.422 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 podman[105086]: 2024-09-13 23:10:09.345189615 +0000 UTC m=+0.158110116 container create eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True) 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.421+0000 7f381bfff640 1 -- 172.21.15.115:0/4232015838 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f382405aa50 con 0x7f3834065ba0 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:e23 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:41:170028+0000 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:09.423 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 23 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:40.461781+0000 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:10:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:10:09.425 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 24257,14464 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:09.426 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 msgr2=0x7f381c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 0x7f381c0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828035040 comp rx=0 tx=0).stop 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 msgr2=0x7f383410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f382400c7e0 tx=0x7f38240043c0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 shutdown_connections 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f381c06e530 0x7f381c0709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38340ff720 0x7f383410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 --2- 172.21.15.115:0/4232015838 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3834065ba0 0x7f383410d0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 >> 172.21.15.115:0/4232015838 conn(0x7f38340f6c10 msgr2=0x7f38340f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 shutdown_connections 2024-09-13T23:10:09.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.424+0000 7f3839c4f640 1 -- 172.21.15.115:0/4232015838 wait complete. 2024-09-13T23:10:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:09 smithi152 ceph-mon[80164]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:09 smithi152 ceph-mon[80164]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:09 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3959135424' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:09.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- 172.21.15.115:0/1258811366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 msgr2=0x7fc53c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 --2- 172.21.15.115:0/1258811366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c0ff1e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0048d0 tx=0x7fc52c009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- 172.21.15.115:0/1258811366 shutdown_connections 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 --2- 172.21.15.115:0/1258811366 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 0x7fc53c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 --2- 172.21.15.115:0/1258811366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c0ff1e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- 172.21.15.115:0/1258811366 >> 172.21.15.115:0/1258811366 conn(0x7fc53c0f6c10 msgr2=0x7fc53c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- 172.21.15.115:0/1258811366 shutdown_connections 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- 172.21.15.115:0/1258811366 wait complete. 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 Processor -- start 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.519+0000 7fc5429a7640 1 -- start start 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 0x7fc53c10d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c10dce0 con 0x7fc53c0666b0 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c10e4b0 con 0x7fc53c0ff720 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50282/0 (socket says 172.21.15.115:50282) 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 -- 172.21.15.115:0/596977372 learned_addr learned my addr 172.21.15.115:0/596977372 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53b7fe640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 0x7fc53c10d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 -- 172.21.15.115:0/596977372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 msgr2=0x7fc53c10d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 0x7fc53c10d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 -- 172.21.15.115:0/596977372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c005040 con 0x7fc53c0666b0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc53bfff640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0048a0 tx=0x7fc52c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c038070 con 0x7fc53c0666b0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc52c02abd0 con 0x7fc53c0666b0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c10e6e0 con 0x7fc53c0666b0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c033640 con 0x7fc53c0666b0 2024-09-13T23:10:09.523 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.520+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c10ec80 con 0x7fc53c0666b0 2024-09-13T23:10:09.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.521+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c0fa8b0 con 0x7fc53c0666b0 2024-09-13T23:10:09.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.522+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc52c030020 con 0x7fc53c0666b0 2024-09-13T23:10:09.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.522+0000 7fc538ff9640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 0x7fc5240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.523+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc52c0ae530 con 0x7fc53c0666b0 2024-09-13T23:10:09.524 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.523+0000 7fc53b7fe640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 0x7fc5240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.523+0000 7fc53b7fe640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 0x7fc5240709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc53c10cf00 tx=0x7fc530009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.527+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc52c077620 con 0x7fc53c0666b0 2024-09-13T23:10:09.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 podman[105086]: 2024-09-13 23:10:09.558366118 +0000 UTC m=+0.371286620 container init eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T23:10:09.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 podman[105086]: 2024-09-13 23:10:09.561726939 +0000 UTC m=+0.374647451 container start eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-13T23:10:09.694 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 podman[105086]: 2024-09-13 23:10:09.641463945 +0000 UTC m=+0.454384455 container attach eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:10:09.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.719+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc53c10ef10 con 0x7fc52406e530 2024-09-13T23:10:09.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.721+0000 7fc538ff9640 1 -- 172.21.15.115:0/596977372 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc53c10ef10 con 0x7fc52406e530 2024-09-13T23:10:09.721 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "7/21 daemons upgraded", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:10:09.722 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 msgr2=0x7fc5240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 0x7fc5240709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc53c10cf00 tx=0x7fc530009040 comp rx=0 tx=0).stop 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 msgr2=0x7fc53c10d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0048a0 tx=0x7fc52c009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 shutdown_connections 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc52406e530 0x7fc5240709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c0ff720 0x7fc53c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 --2- 172.21.15.115:0/596977372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc53c0666b0 0x7fc53c10d150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 >> 172.21.15.115:0/596977372 conn(0x7fc53c0f6c10 msgr2=0x7fc53c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 shutdown_connections 2024-09-13T23:10:09.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.723+0000 7fc5429a7640 1 -- 172.21.15.115:0/596977372 wait complete. 2024-09-13T23:10:09.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 -- 172.21.15.115:0/2837211256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 msgr2=0x7f96d0101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 --2- 172.21.15.115:0/2837211256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d0101b20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96c40048d0 tx=0x7f96c4009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 -- 172.21.15.115:0/2837211256 shutdown_connections 2024-09-13T23:10:09.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 --2- 172.21.15.115:0/2837211256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d0101b20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 --2- 172.21.15.115:0/2837211256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 0x7f96d00ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 -- 172.21.15.115:0/2837211256 >> 172.21.15.115:0/2837211256 conn(0x7f96d00f6c10 msgr2=0x7f96d00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 -- 172.21.15.115:0/2837211256 shutdown_connections 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.806+0000 7f96d4e19640 1 -- 172.21.15.115:0/2837211256 wait complete. 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 Processor -- start 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 -- start start 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 0x7f96d010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d010dc60 con 0x7f96d00ff740 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96d4e19640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d010e430 con 0x7f96d0065b80 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50296/0 (socket says 172.21.15.115:50296) 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 -- 172.21.15.115:0/1485249025 learned_addr learned my addr 172.21.15.115:0/1485249025 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:09.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96ce59c640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 0x7f96d010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 -- 172.21.15.115:0/1485249025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 msgr2=0x7f96d010d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:09.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 0x7f96d010d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:09.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.807+0000 7f96cdd9b640 1 -- 172.21.15.115:0/1485249025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4005040 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96cdd9b640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96c40043d0 tx=0x7f96c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c4038070 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f96c4009800 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d010e660 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c403e670 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.808+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d010ec00 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.809+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d00fa890 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.809+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f96c4030020 con 0x7f96d00ff740 2024-09-13T23:10:09.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.810+0000 7f96beffd640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 0x7f96b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:09.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.810+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f96c40ae2c0 con 0x7f96d00ff740 2024-09-13T23:10:09.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.810+0000 7f96ce59c640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 0x7f96b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:09.812 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.810+0000 7f96ce59c640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 0x7f96b80709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96d00658e0 tx=0x7f96c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:09.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:09.814+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96c40774e0 con 0x7f96d00ff740 2024-09-13T23:10:10.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:10.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 bash[105086]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:10.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:10.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:09 smithi115 bash[105086]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:10.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.048+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f96d010ef10 con 0x7f96d00ff740 2024-09-13T23:10:10.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.049+0000 7f96beffd640 1 -- 172.21.15.115:0/1485249025 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7f96c407aba0 con 0x7f96d00ff740 2024-09-13T23:10:10.050 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 osds down 2024-09-13T23:10:10.050 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:10:10.050 INFO:teuthology.orchestra.run.smithi115.stdout: osd.1 (root=default,host=smithi115) is down 2024-09-13T23:10:10.052 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 msgr2=0x7f96b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 0x7f96b80709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96d00658e0 tx=0x7f96c000b040 comp rx=0 tx=0).stop 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 msgr2=0x7f96d010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f96c40043d0 tx=0x7f96c4009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 shutdown_connections 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f96b806e530 0x7f96b80709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f96d00ff740 0x7f96d010d610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 --2- 172.21.15.115:0/1485249025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96d0065b80 0x7f96d010d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 >> 172.21.15.115:0/1485249025 conn(0x7f96d00f6c10 msgr2=0x7f96d00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 shutdown_connections 2024-09-13T23:10:10.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:10.052+0000 7f96d4e19640 1 -- 172.21.15.115:0/1485249025 wait complete. 2024-09-13T23:10:10.441 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-mon[91340]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.441 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-mon[91340]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.441 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4232015838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:10:10.441 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1485249025' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:10:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:10 smithi152 ceph-mon[80164]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:10 smithi152 ceph-mon[80164]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:10 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4232015838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:10:10.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:10 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1485249025' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:10:10.728 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:10:10.728 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:10:10.729 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:10:10.729 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T23:10:11.052 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:10:11.053 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:10:11.053 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate[105121]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T23:10:11.053 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 bash[105086]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T23:10:11.053 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:10 smithi115 podman[105086]: 2024-09-13 23:10:10.756509464 +0000 UTC m=+1.569429975 container died eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T23:10:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:11 smithi152 ceph-mon[80164]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:11 smithi152 ceph-mon[80164]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:11 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 54/348 objects degraded (15.517%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:11.487 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:11 smithi115 ceph-mon[91340]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:11.487 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:11 smithi115 ceph-mon[91340]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:11.487 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:11 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 54/348 objects degraded (15.517%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:11.799 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 podman[105299]: 2024-09-13 23:10:11.487321829 +0000 UTC m=+0.724368415 container remove eec0fc83ddf8415c2ea751ad7778697d39ec9e2039b9100be8a4b910b048edc9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:10:11.799 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 podman[105358]: 2024-09-13 23:10:11.60256645 +0000 UTC m=+0.015960452 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:11.800 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 podman[105358]: 2024-09-13 23:10:11.704771227 +0000 UTC m=+0.118165222 container create 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:10:12.299 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 podman[105358]: 2024-09-13 23:10:11.915791869 +0000 UTC m=+0.329185865 container init 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T23:10:12.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 podman[105358]: 2024-09-13 23:10:11.918919766 +0000 UTC m=+0.332313763 container start 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, ceph=True) 2024-09-13T23:10:12.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:11 smithi115 ceph-osd[105376]: -- 172.21.15.115:0/4217118936 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e50ee741e0 con 0x55e50e021c00 2024-09-13T23:10:12.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:12 smithi115 bash[105358]: 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 2024-09-13T23:10:12.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:12 smithi115 systemd[1]: Started Ceph osd.1 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:10:13.439 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:13 smithi115 ceph-mon[91340]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:13.439 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:13.439 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:13.439 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:13 smithi152 ceph-mon[80164]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:14.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:13 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:10:13.796+0000 7f3cf8344640 -1 Falling back to public interface 2024-09-13T23:10:15.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:15 smithi115 ceph-mon[91340]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:15 smithi152 ceph-mon[80164]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:17 smithi152 ceph-mon[80164]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:17 smithi115 ceph-mon[91340]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:18.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:18.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:19.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:19 smithi152 ceph-mon[80164]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:19.450 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:19 smithi115 ceph-mon[91340]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 54/348 objects degraded (15.517%) 2024-09-13T23:10:20.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:19 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:10:19.846+0000 7f3cf8344640 -1 osd.1 53 log_to_monitors true 2024-09-13T23:10:20.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:20 smithi152 ceph-mon[80164]: from='osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:10:20.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:20 smithi152 ceph-mon[80164]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:10:20.525 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:20 smithi115 ceph-mon[91340]: from='osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:10:20.525 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:20 smithi115 ceph-mon[91340]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:10:20.525 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:10:20 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:10:20.125+0000 7f3cf00de640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:10:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:21.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:21.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:10:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T23:10:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:21.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:10:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238] boot 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T23:10:22.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:22 smithi152 ceph-mon[80164]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T23:10:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:10:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: osd.1 [v2:172.21.15.115:6810/3966382238,v1:172.21.15.115:6811/3966382238] boot 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T23:10:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:22 smithi115 ceph-mon[91340]: osdmap e58: 6 total, 6 up, 6 in 2024-09-13T23:10:23.452 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:23 smithi115 ceph-mon[91340]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:23 smithi152 ceph-mon[80164]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:25 smithi152 ceph-mon[80164]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:25 smithi115 ceph-mon[91340]: pgmap v73: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 54/348 objects degraded (15.517%) 2024-09-13T23:10:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:26.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:26 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/348 objects degraded (15.517%), 16 pgs degraded) 2024-09-13T23:10:26.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:26 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:10:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:26 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/348 objects degraded (15.517%), 16 pgs degraded) 2024-09-13T23:10:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:26 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:10:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:27 smithi152 ceph-mon[80164]: pgmap v74: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:27 smithi115 ceph-mon[91340]: pgmap v74: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:29 smithi152 ceph-mon[80164]: pgmap v75: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 900 B/s rd, 1 op/s 2024-09-13T23:10:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:29 smithi115 ceph-mon[91340]: pgmap v75: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 900 B/s rd, 1 op/s 2024-09-13T23:10:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:31 smithi152 ceph-mon[80164]: pgmap v76: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T23:10:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:31 smithi115 ceph-mon[91340]: pgmap v76: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T23:10:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:33 smithi152 ceph-mon[80164]: pgmap v77: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:10:33.505 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:33 smithi115 ceph-mon[91340]: pgmap v77: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:10:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:35 smithi152 ceph-mon[80164]: pgmap v78: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T23:10:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:35 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:35 smithi115 ceph-mon[91340]: pgmap v78: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T23:10:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:35 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:37.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:37 smithi115 ceph-mon[91340]: pgmap v79: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T23:10:37.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:37.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:37 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:37.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:37 smithi115 ceph-mon[91340]: Upgrade: osd.2 is safe to restart 2024-09-13T23:10:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:37 smithi152 ceph-mon[80164]: pgmap v79: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T23:10:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:37 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:10:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:37 smithi152 ceph-mon[80164]: Upgrade: osd.2 is safe to restart 2024-09-13T23:10:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: Upgrade: Updating osd.2 2024-09-13T23:10:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:10:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:38.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: Deploying daemon osd.2 on smithi115 2024-09-13T23:10:38.800 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:38 smithi115 ceph-mon[91340]: pgmap v80: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: Upgrade: Updating osd.2 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: Deploying daemon osd.2 on smithi115 2024-09-13T23:10:38.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:38 smithi152 ceph-mon[80164]: pgmap v80: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:10:40.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 -- 172.21.15.115:0/1695685576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fd810 msgr2=0x7f20b00fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 --2- 172.21.15.115:0/1695685576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fd810 0x7f20b00fdc80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0048d0 tx=0x7f20ac009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 -- 172.21.15.115:0/1695685576 shutdown_connections 2024-09-13T23:10:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 --2- 172.21.15.115:0/1695685576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fd810 0x7f20b00fdc80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 --2- 172.21.15.115:0/1695685576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fc540 0x7f20b00fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.153+0000 7f20b8361640 1 -- 172.21.15.115:0/1695685576 >> 172.21.15.115:0/1695685576 conn(0x7f20b00f7d00 msgr2=0x7f20b00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.154+0000 7f20b8361640 1 -- 172.21.15.115:0/1695685576 shutdown_connections 2024-09-13T23:10:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.154+0000 7f20b8361640 1 -- 172.21.15.115:0/1695685576 wait complete. 2024-09-13T23:10:40.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.154+0000 7f20b8361640 1 Processor -- start 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b8361640 1 -- start start 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b8361640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b8361640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 0x7f20b010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b8361640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b010dc40 con 0x7f20b00fc540 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b8361640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b010e410 con 0x7f20b00fd810 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60592/0 (socket says 172.21.15.115:60592) 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 -- 172.21.15.115:0/1563657023 learned_addr learned my addr 172.21.15.115:0/1563657023 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b58fc640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 0x7f20b010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 -- 172.21.15.115:0/1563657023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 msgr2=0x7f20b010d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 0x7f20b010d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 -- 172.21.15.115:0/1563657023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac005040 con 0x7f20b00fc540 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b58fc640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 0x7f20b010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:10:40.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20b60fd640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c790 tx=0x7f20a00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.155+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a000a820 con 0x7f20b00fc540 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.156+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20a000ae20 con 0x7f20b00fc540 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.156+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b010e6a0 con 0x7f20b00fc540 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.156+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b010ec40 con 0x7f20b00fc540 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.156+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a00113a0 con 0x7f20b00fc540 2024-09-13T23:10:40.158 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.157+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00fb9a0 con 0x7f20b00fc540 2024-09-13T23:10:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.157+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f20a0012400 con 0x7f20b00fc540 2024-09-13T23:10:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.158+0000 7f20a6ffd640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 0x7f209c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.158+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f20a008e240 con 0x7f20b00fc540 2024-09-13T23:10:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.158+0000 7f20b58fc640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 0x7f209c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.158+0000 7f20b58fc640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 0x7f209c0709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00b020 tx=0x7f20ac009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.163 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.162+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f20a0057470 con 0x7f20b00fc540 2024-09-13T23:10:40.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:40 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:40.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:40 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:40.384 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.382+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20b010f0a0 con 0x7f209c06e530 2024-09-13T23:10:40.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.384+0000 7f20a6ffd640 1 -- 172.21.15.115:0/1563657023 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f20b010f0a0 con 0x7f209c06e530 2024-09-13T23:10:40.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 msgr2=0x7f209c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 0x7f209c0709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00b020 tx=0x7f20ac009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 msgr2=0x7f20b010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c790 tx=0x7f20a00043c0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 shutdown_connections 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f209c06e530 0x7f209c0709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b00fd810 0x7f20b010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 --2- 172.21.15.115:0/1563657023 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b00fc540 0x7f20b010d0b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 >> 172.21.15.115:0/1563657023 conn(0x7f20b00f7d00 msgr2=0x7f20b00f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 shutdown_connections 2024-09-13T23:10:40.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.386+0000 7f20b8361640 1 -- 172.21.15.115:0/1563657023 wait complete. 2024-09-13T23:10:40.396 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:10:40.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:40 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:40.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:40 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 -- 172.21.15.115:0/4217100040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d600ff6e0 msgr2=0x7f2d60101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 --2- 172.21.15.115:0/4217100040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d600ff6e0 0x7f2d60101ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d500048d0 tx=0x7f2d50009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 -- 172.21.15.115:0/4217100040 shutdown_connections 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 --2- 172.21.15.115:0/4217100040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d600ff6e0 0x7f2d60101ac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 --2- 172.21.15.115:0/4217100040 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d60065be0 0x7f2d600ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 -- 172.21.15.115:0/4217100040 >> 172.21.15.115:0/4217100040 conn(0x7f2d600f6c10 msgr2=0x7f2d600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 -- 172.21.15.115:0/4217100040 shutdown_connections 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.467+0000 7f2d67763640 1 -- 172.21.15.115:0/4217100040 wait complete. 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 Processor -- start 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 -- start start 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d600ff6e0 0x7f2d6010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6010dbe0 con 0x7f2d60065be0 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d67763640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6010e400 con 0x7f2d600ff6e0 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60608/0 (socket says 172.21.15.115:60608) 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 -- 172.21.15.115:0/255137546 learned_addr learned my addr 172.21.15.115:0/255137546 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d64cfe640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d600ff6e0 0x7f2d6010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 -- 172.21.15.115:0/255137546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d600ff6e0 msgr2=0x7f2d6010d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d600ff6e0 0x7f2d6010d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.468+0000 7f2d654ff640 1 -- 172.21.15.115:0/255137546 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50005040 con 0x7f2d60065be0 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d654ff640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c002840 tx=0x7f2d5c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5c007c30 con 0x7f2d60065be0 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d5c00f040 con 0x7f2d60065be0 2024-09-13T23:10:40.473 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6010e690 con 0x7f2d60065be0 2024-09-13T23:10:40.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5c009410 con 0x7f2d60065be0 2024-09-13T23:10:40.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.469+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6010ec30 con 0x7f2d60065be0 2024-09-13T23:10:40.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.470+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d600fa890 con 0x7f2d60065be0 2024-09-13T23:10:40.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.471+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2d5c0096d0 con 0x7f2d60065be0 2024-09-13T23:10:40.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.471+0000 7f2d55ffb640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 0x7f2d4c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.471+0000 7f2d64cfe640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 0x7f2d4c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.471+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2d5c08e150 con 0x7f2d60065be0 2024-09-13T23:10:40.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.472+0000 7f2d64cfe640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 0x7f2d4c0709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d6010ce00 tx=0x7f2d50009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.476+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d5c057240 con 0x7f2d60065be0 2024-09-13T23:10:40.685 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:40 smithi115 systemd[1]: Stopping Ceph osd.2 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:10:40.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.683+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d6010efc0 con 0x7f2d4c06e530 2024-09-13T23:10:40.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.685+0000 7f2d55ffb640 1 -- 172.21.15.115:0/255137546 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2d6010efc0 con 0x7f2d4c06e530 2024-09-13T23:10:40.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 msgr2=0x7f2d4c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 0x7f2d4c0709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d6010ce00 tx=0x7f2d50009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 msgr2=0x7f2d6010d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c002840 tx=0x7f2d5c004570 comp rx=0 tx=0).stop 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 shutdown_connections 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2d4c06e530 0x7f2d4c0709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d600ff6e0 0x7f2d6010d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 --2- 172.21.15.115:0/255137546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d60065be0 0x7f2d6010d050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 >> 172.21.15.115:0/255137546 conn(0x7f2d600f6c10 msgr2=0x7f2d600f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 shutdown_connections 2024-09-13T23:10:40.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.688+0000 7f2d67763640 1 -- 172.21.15.115:0/255137546 wait complete. 2024-09-13T23:10:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 -- 172.21.15.115:0/3277925926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fc720 msgr2=0x7f58dc0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 --2- 172.21.15.115:0/3277925926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fc720 0x7f58dc0fcb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f58c40048d0 tx=0x7f58c4009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 -- 172.21.15.115:0/3277925926 shutdown_connections 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 --2- 172.21.15.115:0/3277925926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fc720 0x7f58dc0fcb90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 --2- 172.21.15.115:0/3277925926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fb450 0x7f58dc0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 -- 172.21.15.115:0/3277925926 >> 172.21.15.115:0/3277925926 conn(0x7f58dc0f6c10 msgr2=0x7f58dc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 -- 172.21.15.115:0/3277925926 shutdown_connections 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.767+0000 7f58e1578640 1 -- 172.21.15.115:0/3277925926 wait complete. 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 Processor -- start 2024-09-13T23:10:40.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 -- start start 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 0x7f58dc10c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc10cb30 con 0x7f58dc0fb450 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58e1578640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc10d350 con 0x7f58dc0fc720 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60630/0 (socket says 172.21.15.115:60630) 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 -- 172.21.15.115:0/338111410 learned_addr learned my addr 172.21.15.115:0/338111410 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58d27fc640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 0x7f58dc10c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 -- 172.21.15.115:0/338111410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 msgr2=0x7f58dc10c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 0x7f58dc10c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58daffd640 1 -- 172.21.15.115:0/338111410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4005040 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.768+0000 7f58d27fc640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 0x7f58dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58daffd640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58cc002a50 tx=0x7f58cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58cc007c30 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc10d5e0 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58cc00f040 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58cc00da90 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.769+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc10db80 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.770+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc0fa8b0 con 0x7f58dc0fb450 2024-09-13T23:10:40.772 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.770+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f58cc00dd20 con 0x7f58dc0fb450 2024-09-13T23:10:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.771+0000 7f58d3fff640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 0x7f58c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.771+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f58cc08da70 con 0x7f58dc0fb450 2024-09-13T23:10:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.771+0000 7f58d27fc640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 0x7f58c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:40.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.771+0000 7f58d27fc640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 0x7f58c80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58c4007ac0 tx=0x7f58c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:40.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.775+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f58cc056b60 con 0x7f58dc0fb450 2024-09-13T23:10:40.954 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.953+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58dc10df50 con 0x7f58c806e530 2024-09-13T23:10:40.954 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:40 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[61794]: 2024-09-13T23:10:40.801+0000 7f610b162640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:10:40.954 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:40 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[61794]: 2024-09-13T23:10:40.801+0000 7f610b162640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-13T23:10:40.954 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:40 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[61794]: 2024-09-13T23:10:40.801+0000 7f610b162640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:10:40.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.962+0000 7f58d3fff640 1 -- 172.21.15.115:0/338111410 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f58dc10df50 con 0x7f58c806e530 2024-09-13T23:10:40.962 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:10:40.962 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (3m) 23s ago 12m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (89s) 23s ago 12m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (84s) 81s ago 11m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 23s ago 11m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (6m) 23s ago 6m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (6m) 23s ago 6m 72.5M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (6m) 81s ago 6m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (6m) 81s ago 6m 67.4M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (3m) 23s ago 13m 496M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (2m) 81s ago 11m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (2m) 23s ago 13m 45.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (2m) 81s ago 11m 37.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (3m) 23s ago 12m 16.7M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 81s ago 11m 16.4M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:10:40.963 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (64s) 23s ago 10m 97.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (29s) 23s ago 9m 11.9M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (9m) 23s ago 9m 191M 1557M 17.2.7-1629-geb16b97b ab51d1bebd12 9155a1406392 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (9m) 81s ago 9m 275M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (8m) 81s ago 8m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (8m) 81s ago 8m 231M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:10:40.964 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (2m) 23s ago 11m 54.4M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 msgr2=0x7f58c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 0x7f58c80709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58c4007ac0 tx=0x7f58c4035040 comp rx=0 tx=0).stop 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 msgr2=0x7f58dc10bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58cc002a50 tx=0x7f58cc004600 comp rx=0 tx=0).stop 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 shutdown_connections 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f58c806e530 0x7f58c80709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58dc0fc720 0x7f58dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 --2- 172.21.15.115:0/338111410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58dc0fb450 0x7f58dc10bfa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 >> 172.21.15.115:0/338111410 conn(0x7f58dc0f6c10 msgr2=0x7f58dc0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 shutdown_connections 2024-09-13T23:10:40.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:40.964+0000 7f58e1578640 1 -- 172.21.15.115:0/338111410 wait complete. 2024-09-13T23:10:41.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 -- 172.21.15.115:0/1266472561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5724066670 msgr2=0x7f57240ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 --2- 172.21.15.115:0/1266472561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5724066670 0x7f57240ff200 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f57140048d0 tx=0x7f5714009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 -- 172.21.15.115:0/1266472561 shutdown_connections 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 --2- 172.21.15.115:0/1266472561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57240ff740 0x7f5724101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 --2- 172.21.15.115:0/1266472561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5724066670 0x7f57240ff200 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.042+0000 7f5729443640 1 -- 172.21.15.115:0/1266472561 >> 172.21.15.115:0/1266472561 conn(0x7f57240f6c10 msgr2=0x7f57240f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 -- 172.21.15.115:0/1266472561 shutdown_connections 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 -- 172.21.15.115:0/1266472561 wait complete. 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 Processor -- start 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 -- start start 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724066670 0x7f572410f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572410ff60 con 0x7f57240ff740 2024-09-13T23:10:41.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f5729443640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724110730 con 0x7f5724066670 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f571bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f571bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60646/0 (socket says 172.21.15.115:60646) 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.043+0000 7f571bfff640 1 -- 172.21.15.115:0/4138414377 learned_addr learned my addr 172.21.15.115:0/4138414377 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f5722ffd640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724066670 0x7f572410f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571bfff640 1 -- 172.21.15.115:0/4138414377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724066670 msgr2=0x7f572410f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571bfff640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724066670 0x7f572410f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571bfff640 1 -- 172.21.15.115:0/4138414377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714005040 con 0x7f57240ff740 2024-09-13T23:10:41.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571bfff640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f570c002870 tx=0x7f570c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c007c30 con 0x7f57240ff740 2024-09-13T23:10:41.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57241109c0 con 0x7f57240ff740 2024-09-13T23:10:41.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f570c00f040 con 0x7f57240ff740 2024-09-13T23:10:41.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570c00da70 con 0x7f57240ff740 2024-09-13T23:10:41.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.044+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5724110f60 con 0x7f57240ff740 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.045+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240fa8b0 con 0x7f57240ff740 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.046+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f570c00dbd0 con 0x7f57240ff740 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.046+0000 7f571b7fe640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 0x7f57100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.046+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f570c08d890 con 0x7f57240ff740 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.046+0000 7f5722ffd640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 0x7f57100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.047+0000 7f5722ffd640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 0x7f57100709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.050+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f570c056a30 con 0x7f57240ff740 2024-09-13T23:10:41.289 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.288+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5724111220 con 0x7f57240ff740 2024-09-13T23:10:41.289 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:41 smithi115 ceph-mon[91340]: pgmap v81: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:10:41.289 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:41 smithi115 ceph-mon[91340]: osd.2 marked itself down and dead 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.289+0000 7f571b7fe640 1 -- 172.21.15.115:0/4138414377 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f570c05a0f0 con 0x7f57240ff740 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:41.290 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 3, 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 7, 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:10:41.291 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 msgr2=0x7f57100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 0x7f57100709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714035040 comp rx=0 tx=0).stop 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 msgr2=0x7f572410f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f570c002870 tx=0x7f570c004600 comp rx=0 tx=0).stop 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 shutdown_connections 2024-09-13T23:10:41.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f571006e530 0x7f57100709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57240ff740 0x7f572410f910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 --2- 172.21.15.115:0/4138414377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724066670 0x7f572410f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 >> 172.21.15.115:0/4138414377 conn(0x7f57240f6c10 msgr2=0x7f57240fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 shutdown_connections 2024-09-13T23:10:41.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.291+0000 7f5729443640 1 -- 172.21.15.115:0/4138414377 wait complete. 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 -- 172.21.15.115:0/3779862541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fb450 msgr2=0x7fa2900fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 --2- 172.21.15.115:0/3779862541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fb450 0x7fa2900fb860 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2800048d0 tx=0x7fa280009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 -- 172.21.15.115:0/3779862541 shutdown_connections 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 --2- 172.21.15.115:0/3779862541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fc720 0x7fa2900fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 --2- 172.21.15.115:0/3779862541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fb450 0x7fa2900fb860 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 -- 172.21.15.115:0/3779862541 >> 172.21.15.115:0/3779862541 conn(0x7fa2900f6c10 msgr2=0x7fa2900f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 -- 172.21.15.115:0/3779862541 shutdown_connections 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.370+0000 7fa296108640 1 -- 172.21.15.115:0/3779862541 wait complete. 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 Processor -- start 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 -- start start 2024-09-13T23:10:41.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 0x7fa29010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29010d430 con 0x7fa2900fc720 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa296108640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29010d5a0 con 0x7fa2900fb450 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60672/0 (socket says 172.21.15.115:60672) 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 -- 172.21.15.115:0/1217123907 learned_addr learned my addr 172.21.15.115:0/1217123907 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa28f7fe640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 0x7fa29010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 -- 172.21.15.115:0/1217123907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 msgr2=0x7fa29010c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 0x7fa29010c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa287fff640 1 -- 172.21.15.115:0/1217123907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280005040 con 0x7fa2900fc720 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.371+0000 7fa28f7fe640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 0x7fa29010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa287fff640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa27800daf0 tx=0x7fa27800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa27800edb0 con 0x7fa2900fc720 2024-09-13T23:10:41.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa278017910 con 0x7fa2900fc720 2024-09-13T23:10:41.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29010d820 con 0x7fa2900fc720 2024-09-13T23:10:41.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2780169f0 con 0x7fa2900fc720 2024-09-13T23:10:41.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.372+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29010dd40 con 0x7fa2900fc720 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.373+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2900fa8b0 con 0x7fa2900fc720 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.374+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa278014070 con 0x7fa2900fc720 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.374+0000 7fa28cff9640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 0x7fa27c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.374+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa278090500 con 0x7fa2900fc720 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.374+0000 7fa28f7fe640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 0x7fa27c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.375+0000 7fa28f7fe640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 0x7fa27c0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa280003080 tx=0x7fa280009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.379 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.378+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa278059670 con 0x7fa2900fc720 2024-09-13T23:10:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:41 smithi152 ceph-mon[80164]: pgmap v81: 65 pgs: 65 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:10:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:41 smithi152 ceph-mon[80164]: osd.2 marked itself down and dead 2024-09-13T23:10:41.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.583+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa29004b720 con 0x7fa2900fc720 2024-09-13T23:10:41.584 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.583+0000 7fa28cff9640 1 -- 172.21.15.115:0/1217123907 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7fa27805cd30 con 0x7fa2900fc720 2024-09-13T23:10:41.584 INFO:teuthology.orchestra.run.smithi115.stdout:e23 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:41:170028+0000 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 23 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:40.461781+0000 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:10:41.585 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:10:41.586 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 24257,14464 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:41.587 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 msgr2=0x7fa27c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 0x7fa27c0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa280003080 tx=0x7fa280009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 msgr2=0x7fa29010c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa27800daf0 tx=0x7fa27800b460 comp rx=0 tx=0).stop 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 shutdown_connections 2024-09-13T23:10:41.588 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa27c06e530 0x7fa27c0709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2900fc720 0x7fa29010c5c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 --2- 172.21.15.115:0/1217123907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2900fb450 0x7fa29010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 >> 172.21.15.115:0/1217123907 conn(0x7fa2900f6c10 msgr2=0x7fa2900f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 shutdown_connections 2024-09-13T23:10:41.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.587+0000 7fa296108640 1 -- 172.21.15.115:0/1217123907 wait complete. 2024-09-13T23:10:41.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- 172.21.15.115:0/3644442774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fc550 msgr2=0x7f837c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 --2- 172.21.15.115:0/3644442774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fc550 0x7f837c0fc960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f836c0048d0 tx=0x7f836c009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- 172.21.15.115:0/3644442774 shutdown_connections 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 --2- 172.21.15.115:0/3644442774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fd820 0x7f837c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 --2- 172.21.15.115:0/3644442774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fc550 0x7f837c0fc960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- 172.21.15.115:0/3644442774 >> 172.21.15.115:0/3644442774 conn(0x7f837c0f7d30 msgr2=0x7f837c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- 172.21.15.115:0/3644442774 shutdown_connections 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- 172.21.15.115:0/3644442774 wait complete. 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 Processor -- start 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.669+0000 7f8380b76640 1 -- start start 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8380b76640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fc550 0x7f837c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8380b76640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8380b76640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10dc10 con 0x7f837c0fd820 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8380b76640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10e430 con 0x7f837c0fc550 2024-09-13T23:10:41.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60692/0 (socket says 172.21.15.115:60692) 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 -- 172.21.15.115:0/291093197 learned_addr learned my addr 172.21.15.115:0/291093197 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f837a59c640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fc550 0x7f837c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 -- 172.21.15.115:0/291093197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fc550 msgr2=0x7f837c10d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fc550 0x7f837c10d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 -- 172.21.15.115:0/291093197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c005040 con 0x7f837c0fd820 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8379d9b640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370007c30 con 0x7f837c0fd820 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f837000f040 con 0x7f837c0fd820 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837000da10 con 0x7f837c0fd820 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.670+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c10e6c0 con 0x7f837c0fd820 2024-09-13T23:10:41.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.671+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c10ec10 con 0x7f837c0fd820 2024-09-13T23:10:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.672+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c0fb9b0 con 0x7f837c0fd820 2024-09-13T23:10:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.672+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f837000dc80 con 0x7f837c0fd820 2024-09-13T23:10:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.672+0000 7f836affd640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 0x7f83640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.673+0000 7f837a59c640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 0x7f83640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.673+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f837008d930 con 0x7f837c0fd820 2024-09-13T23:10:41.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.673+0000 7f837a59c640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 0x7f83640709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b020 tx=0x7f836c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.677+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8370056ad0 con 0x7f837c0fd820 2024-09-13T23:10:41.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.860+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f837c10ef90 con 0x7f836406e530 2024-09-13T23:10:41.861 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:41 smithi115 podman[110554]: 2024-09-13 23:10:41.584762424 +0000 UTC m=+0.915008839 container stop 9155a14063927de8d10c53b412afd05baa8ab6d51892ec07c4a4782b7709302f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=quincy-eb16b97, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:10:41.862 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:41 smithi115 podman[110554]: 2024-09-13 23:10:41.610793111 +0000 UTC m=+0.941039527 container died 9155a14063927de8d10c53b412afd05baa8ab6d51892ec07c4a4782b7709302f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=quincy-eb16b97, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T23:10:41.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.861+0000 7f836affd640 1 -- 172.21.15.115:0/291093197 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f837c10ef90 con 0x7f836406e530 2024-09-13T23:10:41.862 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:10:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:10:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:10:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "8/21 daemons upgraded", 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:10:41.863 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 msgr2=0x7f83640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 0x7f83640709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b020 tx=0x7f836c035040 comp rx=0 tx=0).stop 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 msgr2=0x7f837c10d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8370002a50 tx=0x7f8370004600 comp rx=0 tx=0).stop 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 shutdown_connections 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f836406e530 0x7f83640709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f837c0fd820 0x7f837c10d5c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 --2- 172.21.15.115:0/291093197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f837c0fc550 0x7f837c10d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 >> 172.21.15.115:0/291093197 conn(0x7f837c0f7d30 msgr2=0x7f837c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 shutdown_connections 2024-09-13T23:10:41.865 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.864+0000 7f8380b76640 1 -- 172.21.15.115:0/291093197 wait complete. 2024-09-13T23:10:41.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 -- 172.21.15.115:0/402071934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fc700 msgr2=0x7fe0000fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 --2- 172.21.15.115:0/402071934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fc700 0x7fe0000fcb70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff00048d0 tx=0x7fdff0009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 -- 172.21.15.115:0/402071934 shutdown_connections 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 --2- 172.21.15.115:0/402071934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fc700 0x7fe0000fcb70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 --2- 172.21.15.115:0/402071934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000fb430 0x7fe0000fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 -- 172.21.15.115:0/402071934 >> 172.21.15.115:0/402071934 conn(0x7fe0000f6c10 msgr2=0x7fe0000f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 -- 172.21.15.115:0/402071934 shutdown_connections 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.942+0000 7fe0087ac640 1 -- 172.21.15.115:0/402071934 wait complete. 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 Processor -- start 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 -- start start 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000fc700 0x7fe000112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000065cf0 con 0x7fe0000fb430 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe0087ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000065e60 con 0x7fe0000fc700 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:60712/0 (socket says 172.21.15.115:60712) 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 -- 172.21.15.115:0/3703205613 learned_addr learned my addr 172.21.15.115:0/3703205613 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 -- 172.21.15.115:0/3703205613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000fc700 msgr2=0x7fe000112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000fc700 0x7fe000112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.943+0000 7fe006548640 1 -- 172.21.15.115:0/3703205613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0005040 con 0x7fe0000fb430 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fe006548640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00bbb0 tx=0x7fdffc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdffc00c9c0 con 0x7fe0000fb430 2024-09-13T23:10:41.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdffc0092e0 con 0x7fe0000fb430 2024-09-13T23:10:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000112950 con 0x7fe0000fb430 2024-09-13T23:10:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdffc007640 con 0x7fe0000fb430 2024-09-13T23:10:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.944+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe000112e70 con 0x7fe0000fb430 2024-09-13T23:10:41.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.945+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000fa890 con 0x7fe0000fb430 2024-09-13T23:10:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.945+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdffc012070 con 0x7fe0000fb430 2024-09-13T23:10:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.946+0000 7fdff6ffd640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 0x7fdfec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:10:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.946+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdffc08e2e0 con 0x7fe0000fb430 2024-09-13T23:10:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.946+0000 7fe005d47640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 0x7fdfec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:10:41.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.946+0000 7fe005d47640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 0x7fdfec0709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdff002a530 tx=0x7fdff0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:10:41.951 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:41.950+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdffc0573d0 con 0x7fe0000fb430 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4138414377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1217123907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:10:42.194 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:42 smithi115 ceph-mon[91340]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T23:10:42.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.210+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe000103eb0 con 0x7fe0000fb430 2024-09-13T23:10:42.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.210+0000 7fdff6ffd640 1 -- 172.21.15.115:0/3703205613 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fdffc05aa90 con 0x7fe0000fb430 2024-09-13T23:10:42.211 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_WARN 1 osds down 2024-09-13T23:10:42.212 INFO:teuthology.orchestra.run.smithi115.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:10:42.212 INFO:teuthology.orchestra.run.smithi115.stdout: osd.2 (root=default,host=smithi115) is down 2024-09-13T23:10:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 msgr2=0x7fdfec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 0x7fdfec0709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdff002a530 tx=0x7fdff0009da0 comp rx=0 tx=0).stop 2024-09-13T23:10:42.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 msgr2=0x7fe00010fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00bbb0 tx=0x7fdffc009840 comp rx=0 tx=0).stop 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 shutdown_connections 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdfec06e530 0x7fdfec0709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000fc700 0x7fe000112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 --2- 172.21.15.115:0/3703205613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0000fb430 0x7fe00010fe00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 >> 172.21.15.115:0/3703205613 conn(0x7fe0000f6c10 msgr2=0x7fe0000f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 shutdown_connections 2024-09-13T23:10:42.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:10:42.213+0000 7fe0087ac640 1 -- 172.21.15.115:0/3703205613 wait complete. 2024-09-13T23:10:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:10:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T23:10:42.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4138414377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:42.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1217123907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:10:42.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:42 smithi152 ceph-mon[80164]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T23:10:42.549 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:42 smithi115 podman[110554]: 2024-09-13 23:10:42.194125877 +0000 UTC m=+1.524372294 container cleanup 9155a14063927de8d10c53b412afd05baa8ab6d51892ec07c4a4782b7709302f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-eb16b97, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T23:10:42.549 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:42 smithi115 bash[110554]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2 2024-09-13T23:10:42.549 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:42 smithi115 podman[110635]: 2024-09-13 23:10:42.40405111 +0000 UTC m=+0.813071824 container remove 9155a14063927de8d10c53b412afd05baa8ab6d51892ec07c4a4782b7709302f (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T23:10:43.074 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:42 smithi115 podman[110771]: 2024-09-13 23:10:42.702574351 +0000 UTC m=+0.015817808 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:43.074 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:42 smithi115 podman[110771]: 2024-09-13 23:10:42.838321923 +0000 UTC m=+0.151565378 container create 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.build-date=20240731) 2024-09-13T23:10:43.074 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 podman[110771]: 2024-09-13 23:10:43.074537349 +0000 UTC m=+0.387780808 container init 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T23:10:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:43 smithi152 ceph-mon[80164]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:43 smithi152 ceph-mon[80164]: pgmap v83: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:10:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:43 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3703205613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:10:43.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:43 smithi115 ceph-mon[91340]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:10:43.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:43 smithi115 ceph-mon[91340]: pgmap v83: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:10:43.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:43 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3703205613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:10:43.506 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 podman[110771]: 2024-09-13 23:10:43.079142799 +0000 UTC m=+0.392386258 container start 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:10:43.506 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 podman[110771]: 2024-09-13 23:10:43.18280732 +0000 UTC m=+0.496050785 container attach 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:10:43.506 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 podman[110771]: 2024-09-13 23:10:43.263794531 +0000 UTC m=+0.577037991 container died 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T23:10:44.242 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 podman[110795]: 2024-09-13 23:10:43.803170266 +0000 UTC m=+0.533630847 container remove 5f99010d21f9b3f2fdc7574bdcdbac55ac8ab5b9a84e908acec568284b5e8dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:10:44.242 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T23:10:44.242 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 systemd[1]: Stopped Ceph osd.2 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:10:44.242 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:43 smithi115 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.2.service: Consumed 46.964s CPU time. 2024-09-13T23:10:44.242 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 systemd[1]: Starting Ceph osd.2 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:10:44.540 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 podman[110896]: 2024-09-13 23:10:44.143891961 +0000 UTC m=+0.015789133 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:44.540 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 podman[110896]: 2024-09-13 23:10:44.27266145 +0000 UTC m=+0.144558605 container create b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T23:10:44.540 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 podman[110896]: 2024-09-13 23:10:44.540195755 +0000 UTC m=+0.412092916 container init b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:10:44.799 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 podman[110896]: 2024-09-13 23:10:44.543560776 +0000 UTC m=+0.415457932 container start b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:10:44.799 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 podman[110896]: 2024-09-13 23:10:44.648581915 +0000 UTC m=+0.520479085 container attach b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:10:44.800 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:44.800 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 bash[110896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:44.800 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:44.800 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:44 smithi115 bash[110896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:10:45.406 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-mon[91340]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:45 smithi152 ceph-mon[80164]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:45.690 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:10:45.690 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:10:45.690 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:10:45.690 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:10:46.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate[110911]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 bash[110896]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T23:10:46.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:45 smithi115 podman[110896]: 2024-09-13 23:10:45.718923049 +0000 UTC m=+1.590820206 container died b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T23:10:46.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:46 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 41/348 objects degraded (11.782%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:46 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 41/348 objects degraded (11.782%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:46.723 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 podman[111044]: 2024-09-13 23:10:46.369507545 +0000 UTC m=+0.640332633 container remove b09486ff09f23bdd9a2222a6d2ccb935290deef3c9f54dc1fc3dc9a41f4c7beb (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T23:10:46.723 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 podman[111107]: 2024-09-13 23:10:46.477602432 +0000 UTC m=+0.016046262 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:10:46.723 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 podman[111107]: 2024-09-13 23:10:46.603730587 +0000 UTC m=+0.142174459 container create b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T23:10:47.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 podman[111107]: 2024-09-13 23:10:46.822627402 +0000 UTC m=+0.361071232 container init b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T23:10:47.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 podman[111107]: 2024-09-13 23:10:46.825740338 +0000 UTC m=+0.364184173 container start b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be) 2024-09-13T23:10:47.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 ceph-osd[111126]: -- 172.21.15.115:0/1499062560 <== mon.0 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591b70dc1e0 con 0x5591b6289c00 2024-09-13T23:10:47.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 bash[111107]: b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf 2024-09-13T23:10:47.050 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:46 smithi115 systemd[1]: Started Ceph osd.2 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:10:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:47 smithi152 ceph-mon[80164]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:47 smithi115 ceph-mon[91340]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:48.658 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:48 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:10:48.442+0000 7fd185419640 -1 Falling back to public interface 2024-09-13T23:10:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:49 smithi152 ceph-mon[80164]: pgmap v87: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:49 smithi115 ceph-mon[91340]: pgmap v87: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:51.440 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:51 smithi115 ceph-mon[91340]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:51 smithi152 ceph-mon[80164]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:52 smithi115 ceph-mon[91340]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:52 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:52 smithi152 ceph-mon[80164]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:53.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:52 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:54.158 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:53 smithi115 ceph-mon[91340]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:10:54.159 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:53 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:10:53.805+0000 7fd185419640 -1 osd.2 58 log_to_monitors true 2024-09-13T23:10:54.159 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:10:53 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:10:53.875+0000 7fd17d1b3640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:10:54.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:53 smithi152 ceph-mon[80164]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:10:55.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:10:55.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T23:10:55.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:55.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:55.127 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:55.127 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:10:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T23:10:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: from='osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-13T23:10:55.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41/348 objects degraded (11.782%) 2024-09-13T23:10:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:55.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:10:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568] boot 2024-09-13T23:10:56.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.050 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:55 smithi115 ceph-mon[91340]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T23:10:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:10:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: osd.2 [v2:172.21.15.115:6818/2992096568,v1:172.21.15.115:6819/2992096568] boot 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:10:56.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:55 smithi152 ceph-mon[80164]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T23:10:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:10:57.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:10:57.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:10:57.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:56 smithi152 ceph-mon[80164]: pgmap v94: 65 pgs: 13 peering, 7 active+undersized, 7 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 22/348 objects degraded (6.322%) 2024-09-13T23:10:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:10:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:10:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:10:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:10:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:56 smithi115 ceph-mon[91340]: pgmap v94: 65 pgs: 13 peering, 7 active+undersized, 7 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 22/348 objects degraded (6.322%) 2024-09-13T23:10:58.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:57 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:58.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:57 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T23:10:59.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:10:58 smithi115 ceph-mon[91340]: pgmap v95: 65 pgs: 13 peering, 7 active+undersized, 7 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 22/348 objects degraded (6.322%) 2024-09-13T23:10:59.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:10:58 smithi152 ceph-mon[80164]: pgmap v95: 65 pgs: 13 peering, 7 active+undersized, 7 active+undersized+degraded, 38 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 22/348 objects degraded (6.322%) 2024-09-13T23:11:00.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:00 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded) 2024-09-13T23:11:00.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:00 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:11:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:00 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded) 2024-09-13T23:11:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:00 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:11:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:01 smithi152 ceph-mon[80164]: pgmap v96: 65 pgs: 3 peering, 62 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-13T23:11:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:01 smithi115 ceph-mon[91340]: pgmap v96: 65 pgs: 3 peering, 62 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-13T23:11:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:03 smithi152 ceph-mon[80164]: pgmap v97: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T23:11:03.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:03 smithi115 ceph-mon[91340]: pgmap v97: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T23:11:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:05 smithi152 ceph-mon[80164]: pgmap v98: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:11:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:05 smithi115 ceph-mon[91340]: pgmap v98: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:11:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:07 smithi152 ceph-mon[80164]: pgmap v99: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:11:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:07 smithi115 ceph-mon[91340]: pgmap v99: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:11:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:09 smithi152 ceph-mon[80164]: pgmap v100: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:09 smithi115 ceph-mon[91340]: pgmap v100: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:09.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:09.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:11 smithi152 ceph-mon[80164]: pgmap v101: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:11:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:11 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:11:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:11 smithi115 ceph-mon[91340]: pgmap v101: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:11:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:11 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:11:12.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 -- 172.21.15.115:0/447192153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fb450 msgr2=0x7fdf880fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 --2- 172.21.15.115:0/447192153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fb450 0x7fdf880fb860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf780048d0 tx=0x7fdf78009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 -- 172.21.15.115:0/447192153 shutdown_connections 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 --2- 172.21.15.115:0/447192153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fc720 0x7fdf880fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 --2- 172.21.15.115:0/447192153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fb450 0x7fdf880fb860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 -- 172.21.15.115:0/447192153 >> 172.21.15.115:0/447192153 conn(0x7fdf880f6c10 msgr2=0x7fdf880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 -- 172.21.15.115:0/447192153 shutdown_connections 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.303+0000 7fdf8db40640 1 -- 172.21.15.115:0/447192153 wait complete. 2024-09-13T23:11:12.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 Processor -- start 2024-09-13T23:11:12.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 -- start start 2024-09-13T23:11:12.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fb450 0x7fdf8810fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.307 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88066730 con 0x7fdf880fc720 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.304+0000 7fdf8db40640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880668a0 con 0x7fdf880fb450 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf877fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fb450 0x7fdf8810fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40246/0 (socket says 172.21.15.115:40246) 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 -- 172.21.15.115:0/584504437 learned_addr learned my addr 172.21.15.115:0/584504437 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 -- 172.21.15.115:0/584504437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fb450 msgr2=0x7fdf8810fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fb450 0x7fdf8810fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 -- 172.21.15.115:0/584504437 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78005040 con 0x7fdf880fc720 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf7effd640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c830 tx=0x7fdf70004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.308 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf7000a7d0 con 0x7fdf880fc720 2024-09-13T23:11:12.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf7000add0 con 0x7fdf880fc720 2024-09-13T23:11:12.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf700113a0 con 0x7fdf880fc720 2024-09-13T23:11:12.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.305+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf88112900 con 0x7fdf880fc720 2024-09-13T23:11:12.309 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.306+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88112e70 con 0x7fdf880fc720 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.307+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf880fa8b0 con 0x7fdf880fc720 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.307+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdf70012400 con 0x7fdf880fc720 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.307+0000 7fdf84ff9640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 0x7fdf740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.308+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdf7008e2a0 con 0x7fdf880fc720 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.308+0000 7fdf877fe640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 0x7fdf740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.310 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.308+0000 7fdf877fe640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 0x7fdf740709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf78000c00 tx=0x7fdf78035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.314 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.312+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdf70057410 con 0x7fdf880fc720 2024-09-13T23:11:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:12 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:11:12.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:12 smithi152 ceph-mon[80164]: Upgrade: osd.3 is safe to restart 2024-09-13T23:11:12.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.516+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf88100bd0 con 0x7fdf7406e530 2024-09-13T23:11:12.518 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:12 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:11:12.518 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:12 smithi115 ceph-mon[91340]: Upgrade: osd.3 is safe to restart 2024-09-13T23:11:12.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.517+0000 7fdf84ff9640 1 -- 172.21.15.115:0/584504437 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdf88100bd0 con 0x7fdf7406e530 2024-09-13T23:11:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 msgr2=0x7fdf740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 0x7fdf740709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf78000c00 tx=0x7fdf78035040 comp rx=0 tx=0).stop 2024-09-13T23:11:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 msgr2=0x7fdf88112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c830 tx=0x7fdf70004430 comp rx=0 tx=0).stop 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 shutdown_connections 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdf7406e530 0x7fdf740709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf880fc720 0x7fdf88112360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 --2- 172.21.15.115:0/584504437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf880fb450 0x7fdf8810fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 >> 172.21.15.115:0/584504437 conn(0x7fdf880f6c10 msgr2=0x7fdf880f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 shutdown_connections 2024-09-13T23:11:12.522 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.519+0000 7fdf8db40640 1 -- 172.21.15.115:0/584504437 wait complete. 2024-09-13T23:11:12.530 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:11:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 -- 172.21.15.115:0/1580401463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 msgr2=0x7fc4780fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/1580401463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4780fcb90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0048d0 tx=0x7fc46c009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 -- 172.21.15.115:0/1580401463 shutdown_connections 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/1580401463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4780fcb90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/1580401463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 0x7fc4780fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.598+0000 7fc47e2c1640 1 -- 172.21.15.115:0/1580401463 >> 172.21.15.115:0/1580401463 conn(0x7fc4780f6c10 msgr2=0x7fc4780f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 -- 172.21.15.115:0/1580401463 shutdown_connections 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 -- 172.21.15.115:0/1580401463 wait complete. 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 Processor -- start 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 -- start start 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 0x7fc47810fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478066840 con 0x7fc4780fc720 2024-09-13T23:11:12.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc47e2c1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780669b0 con 0x7fc4780fb450 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.599+0000 7fc4777fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40254/0 (socket says 172.21.15.115:40254) 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 -- 172.21.15.115:0/3918615851 learned_addr learned my addr 172.21.15.115:0/3918615851 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc477fff640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 0x7fc47810fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 -- 172.21.15.115:0/3918615851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 msgr2=0x7fc47810fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 0x7fc47810fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 -- 172.21.15.115:0/3918615851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c005040 con 0x7fc4780fc720 2024-09-13T23:11:12.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc4777fe640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc46c000c00 tx=0x7fc46c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc46c038070 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc478112990 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc46c02ae90 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc46c03d420 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.600+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc478112eb0 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.601+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4780fa8b0 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.602+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fc46c030020 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.602+0000 7fc474ff9640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 0x7fc4600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.602+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc46c0ae880 con 0x7fc4780fc720 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.602+0000 7fc477fff640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 0x7fc4600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.605 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.603+0000 7fc477fff640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 0x7fc4600709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc4780664a0 tx=0x7fc468009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.607+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc46c077970 con 0x7fc4780fc720 2024-09-13T23:11:12.790 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.788+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc478100bc0 con 0x7fc46006e530 2024-09-13T23:11:12.792 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.790+0000 7fc474ff9640 1 -- 172.21.15.115:0/3918615851 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc478100bc0 con 0x7fc46006e530 2024-09-13T23:11:12.794 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.792+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 msgr2=0x7fc4600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.792+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 0x7fc4600709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc4780664a0 tx=0x7fc468009120 comp rx=0 tx=0).stop 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.792+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 msgr2=0x7fc4781123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.792+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc46c000c00 tx=0x7fc46c009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 shutdown_connections 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fc46006e530 0x7fc4600709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4780fc720 0x7fc4781123f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 --2- 172.21.15.115:0/3918615851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc4780fb450 0x7fc47810fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 >> 172.21.15.115:0/3918615851 conn(0x7fc4780f6c10 msgr2=0x7fc4780f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 shutdown_connections 2024-09-13T23:11:12.795 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.793+0000 7fc47e2c1640 1 -- 172.21.15.115:0/3918615851 wait complete. 2024-09-13T23:11:12.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 -- 172.21.15.115:0/505028178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 msgr2=0x7f2f380fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 --2- 172.21.15.115:0/505028178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f380fcb70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f200048d0 tx=0x7f2f20009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 -- 172.21.15.115:0/505028178 shutdown_connections 2024-09-13T23:11:12.875 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 --2- 172.21.15.115:0/505028178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f380fcb70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 --2- 172.21.15.115:0/505028178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f380fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 -- 172.21.15.115:0/505028178 >> 172.21.15.115:0/505028178 conn(0x7f2f380f6c10 msgr2=0x7f2f380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 -- 172.21.15.115:0/505028178 shutdown_connections 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 -- 172.21.15.115:0/505028178 wait complete. 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.872+0000 7f2f3e072640 1 Processor -- start 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 -- start start 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f3810d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3810dbc0 con 0x7f2f380fc700 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3810e3e0 con 0x7f2f380fb430 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.876 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40266/0 (socket says 172.21.15.115:40266) 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 -- 172.21.15.115:0/3434271685 learned_addr learned my addr 172.21.15.115:0/3434271685 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f377fe640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f3810d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 -- 172.21.15.115:0/3434271685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 msgr2=0x7f2f3810d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f3810d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 -- 172.21.15.115:0/3434271685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20005040 con 0x7f2f380fc700 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f377fe640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f3810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f2ffff640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003080 tx=0x7f2f20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f20038070 con 0x7f2f380fc700 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f2002abd0 con 0x7f2f380fc700 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.873+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3810e610 con 0x7f2f380fc700 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.874+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f2003e670 con 0x7f2f380fc700 2024-09-13T23:11:12.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.874+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3810ebb0 con 0x7f2f380fc700 2024-09-13T23:11:12.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.875+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380fa890 con 0x7f2f380fc700 2024-09-13T23:11:12.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.875+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2f20030020 con 0x7f2f380fc700 2024-09-13T23:11:12.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.875+0000 7f2f34ff9640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 0x7f2f240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:12.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.875+0000 7f2f377fe640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 0x7f2f240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:12.878 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.876+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2f200ae550 con 0x7f2f380fc700 2024-09-13T23:11:12.879 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.876+0000 7f2f377fe640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 0x7f2f240709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f280041d0 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:12.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:12.880+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f20077640 con 0x7f2f380fc700 2024-09-13T23:11:13.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.052+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f38103fa0 con 0x7f2f2406e530 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.061+0000 7f2f34ff9640 1 -- 172.21.15.115:0/3434271685 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2f38103fa0 con 0x7f2f2406e530 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (4m) 21s ago 12m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (2m) 21s ago 12m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (116s) 113s ago 11m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (3m) 21s ago 12m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (7m) 21s ago 7m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (7m) 21s ago 7m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (7m) 113s ago 7m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:11:13.063 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (7m) 113s ago 7m 67.4M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (3m) 21s ago 13m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (3m) 113s ago 11m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (2m) 21s ago 14m 45.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (2m) 113s ago 11m 37.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 21s ago 12m 16.1M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 113s ago 11m 16.4M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (96s) 21s ago 10m 97.8M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (61s) 21s ago 10m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (26s) 21s ago 9m 11.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (9m) 113s ago 9m 275M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 47efc6818d5d 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (9m) 113s ago 9m 235M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:11:13.064 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (8m) 113s ago 8m 231M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:11:13.065 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 21s ago 12m 62.5M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:11:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 msgr2=0x7f2f240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 0x7f2f240709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2f280041d0 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2024-09-13T23:11:13.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 msgr2=0x7f2f3810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003080 tx=0x7f2f20009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 shutdown_connections 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2f2406e530 0x7f2f240709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f380fc700 0x7f2f3810d570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 --2- 172.21.15.115:0/3434271685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f380fb430 0x7f2f3810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 >> 172.21.15.115:0/3434271685 conn(0x7f2f380f6c10 msgr2=0x7f2f38065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 shutdown_connections 2024-09-13T23:11:13.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.063+0000 7f2f3e072640 1 -- 172.21.15.115:0/3434271685 wait complete. 2024-09-13T23:11:13.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 -- 172.21.15.115:0/1590104234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 msgr2=0x7f5770101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 --2- 172.21.15.115:0/1590104234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f5770101b20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5764009c50 tx=0x7f5764004d10 comp rx=0 tx=0).stop 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 -- 172.21.15.115:0/1590104234 shutdown_connections 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 --2- 172.21.15.115:0/1590104234 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f5770101b20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 --2- 172.21.15.115:0/1590104234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 0x7f57700ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 -- 172.21.15.115:0/1590104234 >> 172.21.15.115:0/1590104234 conn(0x7f57700f6c10 msgr2=0x7f57700f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 -- 172.21.15.115:0/1590104234 shutdown_connections 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.141+0000 7f5778457640 1 -- 172.21.15.115:0/1590104234 wait complete. 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 Processor -- start 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 -- start start 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 0x7f577010d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577010dd10 con 0x7f57700ff740 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f5778457640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577010e490 con 0x7f5770066690 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40282/0 (socket says 172.21.15.115:40282) 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 -- 172.21.15.115:0/3267663899 learned_addr learned my addr 172.21.15.115:0/3267663899 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57761f3640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 0x7f577010d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 -- 172.21.15.115:0/3267663899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 msgr2=0x7f577010d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 0x7f577010d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.142+0000 7f57759f2640 1 -- 172.21.15.115:0/3267663899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640098b0 con 0x7f57700ff740 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f57759f2640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f80 tx=0x7f5764004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5764009710 con 0x7f57700ff740 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5764032b10 con 0x7f57700ff740 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577010e6c0 con 0x7f57700ff740 2024-09-13T23:11:13.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f576403dba0 con 0x7f57700ff740 2024-09-13T23:11:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.143+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577010ec60 con 0x7f57700ff740 2024-09-13T23:11:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.144+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57700fa8b0 con 0x7f57700ff740 2024-09-13T23:11:13.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.144+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f576402f030 con 0x7f57700ff740 2024-09-13T23:11:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.145+0000 7f576effd640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 0x7f57580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.145+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f57640af1c0 con 0x7f57700ff740 2024-09-13T23:11:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.145+0000 7f57761f3640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 0x7f57580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.145+0000 7f57761f3640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 0x7f57580709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57700663f0 tx=0x7f576800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.149+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5764078330 con 0x7f57700ff740 2024-09-13T23:11:13.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:13 smithi152 ceph-mon[80164]: pgmap v102: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:13.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:13.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:11:13.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:13.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.380+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f577004b720 con 0x7f57700ff740 2024-09-13T23:11:13.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:13 smithi115 ceph-mon[91340]: pgmap v102: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:13.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:13.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:11:13.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:13.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.381+0000 7f576effd640 1 -- 172.21.15.115:0/3267663899 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f576407b9f0 con 0x7f57700ff740 2024-09-13T23:11:13.383 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:11:13.383 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:11:13.383 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:11:13.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 3, 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:11:13.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 7, 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 7 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 msgr2=0x7f57580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.385 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 0x7f57580709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57700663f0 tx=0x7f576800b040 comp rx=0 tx=0).stop 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 msgr2=0x7f577010d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f80 tx=0x7f5764004d10 comp rx=0 tx=0).stop 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 shutdown_connections 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f575806e530 0x7f57580709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57700ff740 0x7f577010d6c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 --2- 172.21.15.115:0/3267663899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5770066690 0x7f577010d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 >> 172.21.15.115:0/3267663899 conn(0x7f57700f6c10 msgr2=0x7f57700f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 shutdown_connections 2024-09-13T23:11:13.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.383+0000 7f5778457640 1 -- 172.21.15.115:0/3267663899 wait complete. 2024-09-13T23:11:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 -- 172.21.15.115:0/4138980444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 msgr2=0x7f81500fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 --2- 172.21.15.115:0/4138980444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f81500fdc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81440048d0 tx=0x7f8144009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 -- 172.21.15.115:0/4138980444 shutdown_connections 2024-09-13T23:11:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 --2- 172.21.15.115:0/4138980444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f81500fdc90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 --2- 172.21.15.115:0/4138980444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f81500fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 -- 172.21.15.115:0/4138980444 >> 172.21.15.115:0/4138980444 conn(0x7f81500f7d30 msgr2=0x7f81500fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 -- 172.21.15.115:0/4138980444 shutdown_connections 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.462+0000 7f815865e640 1 -- 172.21.15.115:0/4138980444 wait complete. 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 Processor -- start 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 -- start start 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f815010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815010dc40 con 0x7f81500fd820 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f815865e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815010e460 con 0x7f81500fc550 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40312/0 (socket says 172.21.15.115:40312) 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 -- 172.21.15.115:0/4134207522 learned_addr learned my addr 172.21.15.115:0/4134207522 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f81563fa640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f815010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 -- 172.21.15.115:0/4134207522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 msgr2=0x7f815010d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f815010d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f8155bf9640 1 -- 172.21.15.115:0/4134207522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144005040 con 0x7f81500fd820 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.463+0000 7f81563fa640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f815010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f8155bf9640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8144003080 tx=0x7f8144009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8144038070 con 0x7f81500fd820 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f814402abd0 con 0x7f81500fd820 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815010e690 con 0x7f81500fd820 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f814403e670 con 0x7f81500fd820 2024-09-13T23:11:13.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.464+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815010ec30 con 0x7f81500fd820 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.465+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81500fb9b0 con 0x7f81500fd820 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.465+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8144030020 con 0x7f81500fd820 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.466+0000 7f814effd640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 0x7f81380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.466+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f81440ae5a0 con 0x7f81500fd820 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.466+0000 7f81563fa640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 0x7f81380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.466+0000 7f81563fa640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 0x7f81380709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8140004550 tx=0x7f8140009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.472 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.470+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8144077690 con 0x7f81500fd820 2024-09-13T23:11:13.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.669+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f815010eed0 con 0x7f81500fd820 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.670+0000 7f814effd640 1 -- 172.21.15.115:0/4134207522 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f814407ad50 con 0x7f81500fd820 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:e23 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:41:170028+0000 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:13.672 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 23 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:40.461781+0000 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:11:13.673 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:11:13.674 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 24257,14464 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:13.675 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 msgr2=0x7f81380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 0x7f81380709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8140004550 tx=0x7f8140009040 comp rx=0 tx=0).stop 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 msgr2=0x7f815010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8144003080 tx=0x7f8144009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.676 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 shutdown_connections 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f813806e530 0x7f81380709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81500fd820 0x7f815010d5f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 --2- 172.21.15.115:0/4134207522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81500fc550 0x7f815010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 >> 172.21.15.115:0/4134207522 conn(0x7f81500f7d30 msgr2=0x7f81500f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 shutdown_connections 2024-09-13T23:11:13.677 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.673+0000 7f815865e640 1 -- 172.21.15.115:0/4134207522 wait complete. 2024-09-13T23:11:13.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.751+0000 7f4d799e2640 1 -- 172.21.15.115:0/243900892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fc720 msgr2=0x7f4d740fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.751+0000 7f4d799e2640 1 --2- 172.21.15.115:0/243900892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fc720 0x7f4d740fcb90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0048d0 tx=0x7f4d5c009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- 172.21.15.115:0/243900892 shutdown_connections 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 --2- 172.21.15.115:0/243900892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fc720 0x7f4d740fcb90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 --2- 172.21.15.115:0/243900892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fb450 0x7f4d740fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- 172.21.15.115:0/243900892 >> 172.21.15.115:0/243900892 conn(0x7f4d740f6c10 msgr2=0x7f4d740f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- 172.21.15.115:0/243900892 shutdown_connections 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- 172.21.15.115:0/243900892 wait complete. 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 Processor -- start 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- start start 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 0x7f4d7410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7410dc90 con 0x7f4d740fb450 2024-09-13T23:11:13.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.752+0000 7f4d799e2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7410e460 con 0x7f4d740fc720 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40326/0 (socket says 172.21.15.115:40326) 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 -- 172.21.15.115:0/703753341 learned_addr learned my addr 172.21.15.115:0/703753341 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d727fc640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 0x7f4d7410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 -- 172.21.15.115:0/703753341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 msgr2=0x7f4d7410d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 0x7f4d7410d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 -- 172.21.15.115:0/703753341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c005040 con 0x7f4d740fb450 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d727fc640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 0x7f4d7410d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d72ffd640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d64002a50 tx=0x7f4d64004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d64007c30 con 0x7f4d740fb450 2024-09-13T23:11:13.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d6400f040 con 0x7f4d740fb450 2024-09-13T23:11:13.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7410e6f0 con 0x7f4d740fb450 2024-09-13T23:11:13.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6400da90 con 0x7f4d740fb450 2024-09-13T23:11:13.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.753+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7410ec90 con 0x7f4d740fb450 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.754+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d740fa8b0 con 0x7f4d740fb450 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.755+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4d6400dc30 con 0x7f4d740fb450 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.755+0000 7f4d6b7fe640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 0x7f4d600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.755+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4d6408d990 con 0x7f4d740fb450 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.755+0000 7f4d727fc640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 0x7f4d600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:13.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.756+0000 7f4d727fc640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 0x7f4d600709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007ac0 tx=0x7f4d5c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:13.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.759+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4d64056b00 con 0x7f4d740fb450 2024-09-13T23:11:13.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.941+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d7410ef00 con 0x7f4d6006e530 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.942+0000 7f4d6b7fe640 1 -- 172.21.15.115:0/703753341 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4d7410ef00 con 0x7f4d6006e530 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:11:13.944 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "9/21 daemons upgraded", 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:11:13.945 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:11:13.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 msgr2=0x7f4d600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 0x7f4d600709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007ac0 tx=0x7f4d5c035040 comp rx=0 tx=0).stop 2024-09-13T23:11:13.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 msgr2=0x7f4d7410d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:13.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d64002a50 tx=0x7f4d64004600 comp rx=0 tx=0).stop 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 shutdown_connections 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4d6006e530 0x7f4d600709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d740fc720 0x7f4d7410d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 --2- 172.21.15.115:0/703753341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d740fb450 0x7f4d7410d100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 >> 172.21.15.115:0/703753341 conn(0x7f4d740f6c10 msgr2=0x7f4d74066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 shutdown_connections 2024-09-13T23:11:13.948 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:13.945+0000 7f4d799e2640 1 -- 172.21.15.115:0/703753341 wait complete. 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 -- 172.21.15.115:0/1383518995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fc720 msgr2=0x7f795c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 --2- 172.21.15.115:0/1383518995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fc720 0x7f795c0fcb90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79500048d0 tx=0x7f7950009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 -- 172.21.15.115:0/1383518995 shutdown_connections 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 --2- 172.21.15.115:0/1383518995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fc720 0x7f795c0fcb90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 --2- 172.21.15.115:0/1383518995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fb450 0x7f795c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 -- 172.21.15.115:0/1383518995 >> 172.21.15.115:0/1383518995 conn(0x7f795c0f6c10 msgr2=0x7f795c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 -- 172.21.15.115:0/1383518995 shutdown_connections 2024-09-13T23:11:14.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.023+0000 7f796179f640 1 -- 172.21.15.115:0/1383518995 wait complete. 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 Processor -- start 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 -- start start 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fc720 0x7f795c10d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10dc90 con 0x7f795c0fb450 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f796179f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10e460 con 0x7f795c0fc720 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40332/0 (socket says 172.21.15.115:40332) 2024-09-13T23:11:14.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 -- 172.21.15.115:0/2175338993 learned_addr learned my addr 172.21.15.115:0/2175338993 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795a7fc640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fc720 0x7f795c10d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 -- 172.21.15.115:0/2175338993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fc720 msgr2=0x7f795c10d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fc720 0x7f795c10d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 -- 172.21.15.115:0/2175338993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950005040 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.024+0000 7f795affd640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f794c002a50 tx=0x7f794c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.025+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c007c30 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.025+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f794c00f040 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.025+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c10e6f0 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.025+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f794c00da10 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.025+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c10ec90 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.026+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0fa8b0 con 0x7f795c0fb450 2024-09-13T23:11:14.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.026+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f794c00dc80 con 0x7f795c0fb450 2024-09-13T23:11:14.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.027+0000 7f79437fe640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:14.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.027+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f794c08d960 con 0x7f795c0fb450 2024-09-13T23:11:14.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.027+0000 7f795a7fc640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:14.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.027+0000 7f795a7fc640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 0x7f79440709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f795c10ceb0 tx=0x7f7950035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:14.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.031+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f794c056b00 con 0x7f795c0fb450 2024-09-13T23:11:14.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.263+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f795c04b720 con 0x7f795c0fb450 2024-09-13T23:11:14.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.264+0000 7f79437fe640 1 -- 172.21.15.115:0/2175338993 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f794c05a1c0 con 0x7f795c0fb450 2024-09-13T23:11:14.266 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 msgr2=0x7f79440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 0x7f79440709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f795c10ceb0 tx=0x7f7950035040 comp rx=0 tx=0).stop 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 msgr2=0x7f795c10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f794c002a50 tx=0x7f794c004600 comp rx=0 tx=0).stop 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 shutdown_connections 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f795c0fc720 0x7f795c10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 --2- 172.21.15.115:0/2175338993 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f795c0fb450 0x7f795c10d100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:14.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 >> 172.21.15.115:0/2175338993 conn(0x7f795c0f6c10 msgr2=0x7f795c066100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:14.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 shutdown_connections 2024-09-13T23:11:14.269 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:14.266+0000 7f796179f640 1 -- 172.21.15.115:0/2175338993 wait complete. 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: Upgrade: Updating osd.3 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: Deploying daemon osd.3 on smithi152 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3267663899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:14.419 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:14 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4134207522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: Upgrade: Updating osd.3 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: Deploying daemon osd.3 on smithi152 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3267663899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:14.454 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:14 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4134207522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:11:15.359 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:15 smithi152 systemd[1]: Stopping Ceph osd.3 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:11:15.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-mon[80164]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:15.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-mon[80164]: pgmap v103: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:15.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2175338993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:11:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:15 smithi115 ceph-mon[91340]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:15 smithi115 ceph-mon[91340]: pgmap v103: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:15 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2175338993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:11:15.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[39824]: 2024-09-13T23:11:15.357+0000 7ff682193640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:11:15.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[39824]: 2024-09-13T23:11:15.357+0000 7ff682193640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-13T23:11:15.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[39824]: 2024-09-13T23:11:15.357+0000 7ff682193640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:11:16.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:16 smithi152 ceph-mon[80164]: osd.3 marked itself down and dead 2024-09-13T23:11:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:16 smithi115 ceph-mon[91340]: osd.3 marked itself down and dead 2024-09-13T23:11:17.051 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:16 smithi152 podman[88909]: 2024-09-13 23:11:16.795940821 +0000 UTC m=+1.540543243 container died 47efc6818d5d19995bee93b1430d005028a123500f39988b85719778c076cd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T23:11:17.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:17 smithi152 ceph-mon[80164]: pgmap v104: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:11:17.442 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:17 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:11:17.442 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:17 smithi152 ceph-mon[80164]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T23:11:17.442 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:17 smithi152 podman[88909]: 2024-09-13 23:11:17.148670634 +0000 UTC m=+1.893273053 container cleanup 47efc6818d5d19995bee93b1430d005028a123500f39988b85719778c076cd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-eb16b97, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T23:11:17.442 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:17 smithi152 bash[88909]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3 2024-09-13T23:11:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:17 smithi115 ceph-mon[91340]: pgmap v104: 65 pgs: 65 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:11:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:17 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:11:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:17 smithi115 ceph-mon[91340]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T23:11:17.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:17 smithi152 podman[88924]: 2024-09-13 23:11:17.441665879 +0000 UTC m=+0.642444897 container remove 47efc6818d5d19995bee93b1430d005028a123500f39988b85719778c076cd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=quincy-eb16b97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:11:18.104 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:17 smithi152 podman[89011]: 2024-09-13 23:11:17.687858213 +0000 UTC m=+0.015635594 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:18.104 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:17 smithi152 podman[89011]: 2024-09-13 23:11:17.818212398 +0000 UTC m=+0.145989824 container create f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:11:18.104 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 podman[89011]: 2024-09-13 23:11:18.029031497 +0000 UTC m=+0.356808877 container init f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T23:11:18.104 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 podman[89011]: 2024-09-13 23:11:18.032362484 +0000 UTC m=+0.360139871 container start f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-13T23:11:18.104 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 podman[89011]: 2024-09-13 23:11:18.10387774 +0000 UTC m=+0.431655139 container attach f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:11:18.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:18 smithi152 ceph-mon[80164]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T23:11:18.468 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 podman[89011]: 2024-09-13 23:11:18.230553621 +0000 UTC m=+0.558331002 container died f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-13T23:11:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:18 smithi115 ceph-mon[91340]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T23:11:19.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 podman[89034]: 2024-09-13 23:11:18.824836518 +0000 UTC m=+0.584649256 container remove f461f645dc14aa1d828bf9957942dc551467e77a83c80424682898f182b09b9e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:11:19.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T23:11:19.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 systemd[1]: Stopped Ceph osd.3 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:11:19.219 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:18 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 7.748s CPU time. 2024-09-13T23:11:19.219 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 systemd[1]: Starting Ceph osd.3 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:11:19.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:19 smithi152 ceph-mon[80164]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:19.498 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 podman[89132]: 2024-09-13 23:11:19.251076121 +0000 UTC m=+0.108252737 container create 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:11:19.498 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 podman[89132]: 2024-09-13 23:11:19.158859977 +0000 UTC m=+0.016036594 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:19.498 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 podman[89132]: 2024-09-13 23:11:19.497907648 +0000 UTC m=+0.355084258 container init 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:11:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:19 smithi115 ceph-mon[91340]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 podman[89132]: 2024-09-13 23:11:19.501346029 +0000 UTC m=+0.358522638 container start 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 podman[89132]: 2024-09-13 23:11:19.572871125 +0000 UTC m=+0.430047749 container attach 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 bash[89132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:19.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:19 smithi152 bash[89132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:20.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:20 smithi115 ceph-mon[91340]: pgmap v108: 65 pgs: 15 active+undersized, 2 stale+active+clean, 14 active+undersized+degraded, 34 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:11:20.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-mon[80164]: pgmap v108: 65 pgs: 15 active+undersized, 2 stale+active+clean, 14 active+undersized+degraded, 34 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:11:20.646 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:11:20.646 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:11:20.647 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:11:20.647 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:11:20.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate[89147]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 bash[89132]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T23:11:20.969 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:20 smithi152 podman[89132]: 2024-09-13 23:11:20.674864297 +0000 UTC m=+1.532040904 container died 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T23:11:21.434 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:21 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 53/348 objects degraded (15.230%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:21.434 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 podman[89276]: 2024-09-13 23:11:21.230865018 +0000 UTC m=+0.549856208 container remove 85533c4d406743e210d03a5d9f179b287d87b203b9597b5e50df8a8c14d75b6f (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T23:11:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:21 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 53/348 objects degraded (15.230%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:21.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 podman[89334]: 2024-09-13 23:11:21.336958408 +0000 UTC m=+0.016081036 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:21.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 podman[89334]: 2024-09-13 23:11:21.440237684 +0000 UTC m=+0.119360304 container create fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T23:11:21.688 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 podman[89334]: 2024-09-13 23:11:21.68789575 +0000 UTC m=+0.367018369 container init fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T23:11:21.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 podman[89334]: 2024-09-13 23:11:21.691291284 +0000 UTC m=+0.370413904 container start fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T23:11:21.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 ceph-osd[89353]: -- 172.21.15.152:0/2901324587 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b57f38c1e0 con 0x55b57e539c00 2024-09-13T23:11:21.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 bash[89334]: fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e 2024-09-13T23:11:21.968 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:21 smithi152 systemd[1]: Started Ceph osd.3 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:11:23.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:23.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:23.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:23.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:22 smithi152 ceph-mon[80164]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:23.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:23.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:23.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:23.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:22 smithi115 ceph-mon[91340]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:23.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:11:23.584+0000 7f2496bc1640 -1 Falling back to public interface 2024-09-13T23:11:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:25 smithi152 ceph-mon[80164]: pgmap v110: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:25 smithi115 ceph-mon[91340]: pgmap v110: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:25.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:26.155 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:26.156 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:27 smithi152 ceph-mon[80164]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:27 smithi115 ceph-mon[91340]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:28.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:28 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 73/348 objects degraded (20.977%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:28 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 73/348 objects degraded (20.977%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: pgmap v112: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: pgmap v112: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:29.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:30.178 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:29 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:11:29.731+0000 7f2496bc1640 -1 osd.3 63 log_to_monitors true 2024-09-13T23:11:30.468 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:11:30 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:11:30.195+0000 7f248e95b640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:11:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:30 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:30.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:30 smithi152 ceph-mon[80164]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T23:11:30.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:30 smithi152 ceph-mon[80164]: from='osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:11:30.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:30 smithi152 ceph-mon[80164]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:11:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:30 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:30 smithi115 ceph-mon[91340]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T23:11:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:30 smithi115 ceph-mon[91340]: from='osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:11:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:30 smithi115 ceph-mon[91340]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:11:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:31 smithi152 ceph-mon[80164]: pgmap v113: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:31 smithi152 ceph-mon[80164]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:11:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:31 smithi152 ceph-mon[80164]: from='osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:11:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:31 smithi152 ceph-mon[80164]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T23:11:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:31 smithi152 ceph-mon[80164]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:11:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:31 smithi115 ceph-mon[91340]: pgmap v113: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/348 objects degraded (20.977%) 2024-09-13T23:11:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:31 smithi115 ceph-mon[91340]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:11:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:31 smithi115 ceph-mon[91340]: from='osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:11:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:31 smithi115 ceph-mon[91340]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T23:11:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:31 smithi115 ceph-mon[91340]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:11:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:32 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:11:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:32 smithi152 ceph-mon[80164]: osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520] boot 2024-09-13T23:11:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:32 smithi152 ceph-mon[80164]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T23:11:32.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:32 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:11:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:32 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:11:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:32 smithi115 ceph-mon[91340]: osd.3 [v2:172.21.15.152:6800/3421481520,v1:172.21.15.152:6801/3421481520] boot 2024-09-13T23:11:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:32 smithi115 ceph-mon[91340]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T23:11:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:32 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:11:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:33 smithi152 ceph-mon[80164]: pgmap v116: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 73/348 objects degraded (20.977%) 2024-09-13T23:11:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:33 smithi152 ceph-mon[80164]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T23:11:33.505 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:33 smithi115 ceph-mon[91340]: pgmap v116: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 73/348 objects degraded (20.977%) 2024-09-13T23:11:33.505 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:33 smithi115 ceph-mon[91340]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T23:11:34.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:34 smithi115 ceph-mon[91340]: pgmap v118: 65 pgs: 17 active+undersized, 18 active+undersized+degraded, 30 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/348 objects degraded (20.115%) 2024-09-13T23:11:34.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:34 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 70/348 objects degraded (20.115%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:34 smithi152 ceph-mon[80164]: pgmap v118: 65 pgs: 17 active+undersized, 18 active+undersized+degraded, 30 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 70/348 objects degraded (20.115%) 2024-09-13T23:11:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:34 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 70/348 objects degraded (20.115%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:36 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/348 objects degraded (20.115%), 18 pgs degraded) 2024-09-13T23:11:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:36 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:11:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:36 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/348 objects degraded (20.115%), 18 pgs degraded) 2024-09-13T23:11:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:36 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:11:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:37 smithi152 ceph-mon[80164]: pgmap v119: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:37 smithi115 ceph-mon[91340]: pgmap v119: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:39 smithi152 ceph-mon[80164]: pgmap v120: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 908 B/s rd, 1 op/s 2024-09-13T23:11:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:39 smithi115 ceph-mon[91340]: pgmap v120: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 908 B/s rd, 1 op/s 2024-09-13T23:11:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:41 smithi152 ceph-mon[80164]: pgmap v121: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:11:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:41 smithi115 ceph-mon[91340]: pgmap v121: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:11:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:43 smithi152 ceph-mon[80164]: pgmap v122: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:43.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:43 smithi115 ceph-mon[91340]: pgmap v122: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:44.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:44 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:44.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 -- 172.21.15.115:0/2096992093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fb450 msgr2=0x7fba340fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 --2- 172.21.15.115:0/2096992093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fb450 0x7fba340fb860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fba300048d0 tx=0x7fba30009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 -- 172.21.15.115:0/2096992093 shutdown_connections 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 --2- 172.21.15.115:0/2096992093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fc720 0x7fba340fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 --2- 172.21.15.115:0/2096992093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fb450 0x7fba340fb860 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 -- 172.21.15.115:0/2096992093 >> 172.21.15.115:0/2096992093 conn(0x7fba340f6c10 msgr2=0x7fba340f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 -- 172.21.15.115:0/2096992093 shutdown_connections 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.358+0000 7fba3ae01640 1 -- 172.21.15.115:0/2096992093 wait complete. 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 Processor -- start 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 -- start start 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fb450 0x7fba3410bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3410cb80 con 0x7fba340fc720 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba3ae01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3410d3a0 con 0x7fba340fb450 2024-09-13T23:11:44.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33068/0 (socket says 172.21.15.115:33068) 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba2bfff640 1 -- 172.21.15.115:0/864003595 learned_addr learned my addr 172.21.15.115:0/864003595 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.359+0000 7fba38b9d640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fb450 0x7fba3410bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba2bfff640 1 -- 172.21.15.115:0/864003595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fb450 msgr2=0x7fba3410bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba2bfff640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fb450 0x7fba3410bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba2bfff640 1 -- 172.21.15.115:0/864003595 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30005040 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba2bfff640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba2400eb70 tx=0x7fba2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba24007c30 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba2400f040 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2400ca60 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3410d5d0 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.360+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3410db70 con 0x7fba340fc720 2024-09-13T23:11:44.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.361+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba340fa8b0 con 0x7fba340fc720 2024-09-13T23:11:44.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.362+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fba2400cbc0 con 0x7fba340fc720 2024-09-13T23:11:44.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.362+0000 7fba297fa640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 0x7fba1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.362+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fba2408dd70 con 0x7fba340fc720 2024-09-13T23:11:44.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.362+0000 7fba38b9d640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 0x7fba1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.363+0000 7fba38b9d640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 0x7fba1c0709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba30000c00 tx=0x7fba30035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.367 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.367+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fba24056f10 con 0x7fba340fc720 2024-09-13T23:11:44.453 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:44.453 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:44 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:44.552 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.551+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba3410def0 con 0x7fba1c06e530 2024-09-13T23:11:44.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.552+0000 7fba297fa640 1 -- 172.21.15.115:0/864003595 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fba3410def0 con 0x7fba1c06e530 2024-09-13T23:11:44.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 msgr2=0x7fba1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 0x7fba1c0709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba30000c00 tx=0x7fba30035040 comp rx=0 tx=0).stop 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 msgr2=0x7fba3410c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba2400eb70 tx=0x7fba2400b040 comp rx=0 tx=0).stop 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 shutdown_connections 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fba1c06e530 0x7fba1c0709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fba340fc720 0x7fba3410c530 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 --2- 172.21.15.115:0/864003595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba340fb450 0x7fba3410bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.554+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 >> 172.21.15.115:0/864003595 conn(0x7fba340f6c10 msgr2=0x7fba340f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.555+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 shutdown_connections 2024-09-13T23:11:44.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.555+0000 7fba3ae01640 1 -- 172.21.15.115:0/864003595 wait complete. 2024-09-13T23:11:44.564 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.634+0000 7f34983cd640 1 -- 172.21.15.115:0/3107755245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 msgr2=0x7f34900fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.634+0000 7f34983cd640 1 --2- 172.21.15.115:0/3107755245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f34900fc930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3480009c50 tx=0x7f3480004d10 comp rx=0 tx=0).stop 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- 172.21.15.115:0/3107755245 shutdown_connections 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 --2- 172.21.15.115:0/3107755245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 0x7f34900fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 --2- 172.21.15.115:0/3107755245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f34900fc930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- 172.21.15.115:0/3107755245 >> 172.21.15.115:0/3107755245 conn(0x7f34900f7ce0 msgr2=0x7f34900fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:44.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- 172.21.15.115:0/3107755245 shutdown_connections 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- 172.21.15.115:0/3107755245 wait complete. 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 Processor -- start 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- start start 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 0x7f349010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349010dc10 con 0x7f34900fc520 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f34983cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349010e430 con 0x7f34900fd7f0 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f3496169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f3496169640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33074/0 (socket says 172.21.15.115:33074) 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f3496169640 1 -- 172.21.15.115:0/3581782591 learned_addr learned my addr 172.21.15.115:0/3581782591 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.635+0000 7f3495968640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 0x7f349010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.638 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f3496169640 1 -- 172.21.15.115:0/3581782591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 msgr2=0x7f349010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f3496169640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 0x7f349010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f3496169640 1 -- 172.21.15.115:0/3581782591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800098b0 con 0x7f34900fc520 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f3496169640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3480009c20 tx=0x7f3480004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3480009610 con 0x7f34900fc520 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349010e660 con 0x7f34900fc520 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3480032b10 con 0x7f34900fc520 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f348003da80 con 0x7f34900fc520 2024-09-13T23:11:44.639 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.636+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349010ec00 con 0x7f34900fc520 2024-09-13T23:11:44.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.637+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900fb980 con 0x7f34900fc520 2024-09-13T23:11:44.640 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.638+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f348002f030 con 0x7f34900fc520 2024-09-13T23:11:44.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.638+0000 7f348effd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 0x7f34780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.638+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f34800af780 con 0x7f34900fc520 2024-09-13T23:11:44.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.638+0000 7f3495968640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 0x7f34780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.641 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.638+0000 7f3495968640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 0x7f34780709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f349010ce30 tx=0x7f348400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.643 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.642+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3480078930 con 0x7f34900fc520 2024-09-13T23:11:44.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.844+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f349010eed0 con 0x7f347806e530 2024-09-13T23:11:44.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.846+0000 7f348effd640 1 -- 172.21.15.115:0/3581782591 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f349010eed0 con 0x7f347806e530 2024-09-13T23:11:44.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 msgr2=0x7f34780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 0x7f34780709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f349010ce30 tx=0x7f348400b040 comp rx=0 tx=0).stop 2024-09-13T23:11:44.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 msgr2=0x7f349010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3480009c20 tx=0x7f3480004d10 comp rx=0 tx=0).stop 2024-09-13T23:11:44.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 shutdown_connections 2024-09-13T23:11:44.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f347806e530 0x7f34780709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34900fd7f0 0x7f349010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.850 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 --2- 172.21.15.115:0/3581782591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34900fc520 0x7f349010d080 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 >> 172.21.15.115:0/3581782591 conn(0x7f34900f7ce0 msgr2=0x7f34900f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:44.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 shutdown_connections 2024-09-13T23:11:44.851 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.848+0000 7f34983cd640 1 -- 172.21.15.115:0/3581782591 wait complete. 2024-09-13T23:11:44.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 -- 172.21.15.115:0/4169491900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fb470 msgr2=0x7f2c1c0fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/4169491900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c0fb880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0048d0 tx=0x7f2c0c009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.929 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 -- 172.21.15.115:0/4169491900 shutdown_connections 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/4169491900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c0fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/4169491900 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c0fb880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 -- 172.21.15.115:0/4169491900 >> 172.21.15.115:0/4169491900 conn(0x7f2c1c0f6c10 msgr2=0x7f2c1c0f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 -- 172.21.15.115:0/4169491900 shutdown_connections 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.926+0000 7f2c21dfb640 1 -- 172.21.15.115:0/4169491900 wait complete. 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 Processor -- start 2024-09-13T23:11:44.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 -- start start 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c10fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c066730 con 0x7f2c1c0fc740 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c21dfb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0668a0 con 0x7f2c1c0fb470 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33100/0 (socket says 172.21.15.115:33100) 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 -- 172.21.15.115:0/429161736 learned_addr learned my addr 172.21.15.115:0/429161736 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:44.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1b7fe640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c10fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 -- 172.21.15.115:0/429161736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fb470 msgr2=0x7f2c1c10fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c10fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.927+0000 7f2c1affd640 1 -- 172.21.15.115:0/429161736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c005040 con 0x7f2c1c0fc740 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c1affd640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c10002a50 tx=0x7f2c10004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c10007c30 con 0x7f2c1c0fc740 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2c1000f040 con 0x7f2c1c0fc740 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c1128b0 con 0x7f2c1c0fc740 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1000dad0 con 0x7f2c1c0fc740 2024-09-13T23:11:44.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.928+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c112e20 con 0x7f2c1c0fc740 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.929+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c0fa8d0 con 0x7f2c1c0fc740 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.929+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2c1000dc30 con 0x7f2c1c0fc740 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.930+0000 7f2c03fff640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 0x7f2c040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.930+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2c1008df30 con 0x7f2c1c0fc740 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.930+0000 7f2c1b7fe640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 0x7f2c040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:44.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.930+0000 7f2c1b7fe640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 0x7f2c040709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:44.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:44.934+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2c100570a0 con 0x7f2c1c0fc740 2024-09-13T23:11:45.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.110+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c1c100980 con 0x7f2c0406e530 2024-09-13T23:11:45.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.119+0000 7f2c03fff640 1 -- 172.21.15.115:0/429161736 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2c1c100980 con 0x7f2c0406e530 2024-09-13T23:11:45.120 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:11:45.120 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (4m) 53s ago 13m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:11:45.120 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (2m) 53s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:11:45.120 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (2m) 20s ago 12m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (4m) 53s ago 12m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (7m) 53s ago 7m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (7m) 53s ago 7m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (7m) 20s ago 7m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (7m) 20s ago 7m 67.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (4m) 53s ago 14m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (3m) 20s ago 12m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (3m) 53s ago 14m 45.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (3m) 20s ago 12m 41.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 53s ago 13m 16.1M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 20s ago 12m 17.0M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (2m) 53s ago 11m 97.8M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:11:45.121 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (93s) 53s ago 10m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (58s) 53s ago 10m 11.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (23s) 20s ago 10m 12.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (9m) 20s ago 9m 238M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 0cc6f3695348 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (9m) 20s ago 9m 232M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (3m) 53s ago 12m 62.5M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:11:45.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 msgr2=0x7f2c040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 0x7f2c040709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c000c00 tx=0x7f2c0c035040 comp rx=0 tx=0).stop 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 msgr2=0x7f2c1c112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c10002a50 tx=0x7f2c10004600 comp rx=0 tx=0).stop 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 shutdown_connections 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2c0406e530 0x7f2c040709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c1c0fc740 0x7f2c1c112310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 --2- 172.21.15.115:0/429161736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2c1c0fb470 0x7f2c1c10fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 >> 172.21.15.115:0/429161736 conn(0x7f2c1c0f6c10 msgr2=0x7f2c1c0f8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 shutdown_connections 2024-09-13T23:11:45.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.121+0000 7f2c21dfb640 1 -- 172.21.15.115:0/429161736 wait complete. 2024-09-13T23:11:45.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 -- 172.21.15.115:0/399816746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4660065bc0 msgr2=0x7f46600ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 --2- 172.21.15.115:0/399816746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4660065bc0 0x7f46600ff1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f46500048d0 tx=0x7f4650009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 -- 172.21.15.115:0/399816746 shutdown_connections 2024-09-13T23:11:45.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 --2- 172.21.15.115:0/399816746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46600ff700 0x7f4660101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 --2- 172.21.15.115:0/399816746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4660065bc0 0x7f46600ff1c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 -- 172.21.15.115:0/399816746 >> 172.21.15.115:0/399816746 conn(0x7f46600f6c10 msgr2=0x7f46600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 -- 172.21.15.115:0/399816746 shutdown_connections 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.200+0000 7f46667bc640 1 -- 172.21.15.115:0/399816746 wait complete. 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 Processor -- start 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 -- start start 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4660065bc0 0x7f466010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466010dc90 con 0x7f46600ff700 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f46667bc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466010e460 con 0x7f4660065bc0 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f465f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f465f7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33118/0 (socket says 172.21.15.115:33118) 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f465f7fe640 1 -- 172.21.15.115:0/1292409897 learned_addr learned my addr 172.21.15.115:0/1292409897 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.201+0000 7f465ffff640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4660065bc0 0x7f466010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.206 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465f7fe640 1 -- 172.21.15.115:0/1292409897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4660065bc0 msgr2=0x7f466010d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465f7fe640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4660065bc0 0x7f466010d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465f7fe640 1 -- 172.21.15.115:0/1292409897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650005040 con 0x7f46600ff700 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465f7fe640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4654002870 tx=0x7f4654004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4654007c30 con 0x7f46600ff700 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f465400f040 con 0x7f46600ff700 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f465400da70 con 0x7f46600ff700 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466010e6f0 con 0x7f46600ff700 2024-09-13T23:11:45.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.202+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466010ec90 con 0x7f46600ff700 2024-09-13T23:11:45.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.203+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46600fa890 con 0x7f46600ff700 2024-09-13T23:11:45.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.203+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f465400dbd0 con 0x7f46600ff700 2024-09-13T23:11:45.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.204+0000 7f465cff9640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 0x7f46480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.204+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f465408d890 con 0x7f46600ff700 2024-09-13T23:11:45.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.204+0000 7f465ffff640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 0x7f46480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.204+0000 7f465ffff640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 0x7f46480709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4650000c00 tx=0x7f4650035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.208+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4654056a30 con 0x7f46600ff700 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: Upgrade: osd.4 is safe to restart 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: pgmap v123: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:11:45.429 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:45 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:45.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.440+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f466010ef50 con 0x7f46600ff700 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: Upgrade: osd.4 is safe to restart 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: pgmap v123: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:11:45.442 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:45 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:45.442 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.441+0000 7f465cff9640 1 -- 172.21.15.115:0/1292409897 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f465405a0f0 con 0x7f46600ff700 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:11:45.443 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 6, 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 8 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:11:45.444 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 msgr2=0x7f46480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 0x7f46480709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4650000c00 tx=0x7f4650035040 comp rx=0 tx=0).stop 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 msgr2=0x7f466010d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4654002870 tx=0x7f4654004600 comp rx=0 tx=0).stop 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 shutdown_connections 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f464806e530 0x7f46480709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.445 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46600ff700 0x7f466010d640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 --2- 172.21.15.115:0/1292409897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4660065bc0 0x7f466010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 >> 172.21.15.115:0/1292409897 conn(0x7f46600f6c10 msgr2=0x7f46600f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 shutdown_connections 2024-09-13T23:11:45.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.444+0000 7f46667bc640 1 -- 172.21.15.115:0/1292409897 wait complete. 2024-09-13T23:11:45.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 -- 172.21.15.115:0/3260378494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e00715d0 msgr2=0x7f44e006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/3260378494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e00715d0 0x7f44e006fb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0048d0 tx=0x7f44dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 -- 172.21.15.115:0/3260378494 shutdown_connections 2024-09-13T23:11:45.526 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/3260378494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e0070040 0x7f44e00704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/3260378494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e00715d0 0x7f44e006fb00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.523+0000 7f44e7b8a640 1 -- 172.21.15.115:0/3260378494 >> 172.21.15.115:0/3260378494 conn(0x7f44e00f7d30 msgr2=0x7f44e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 -- 172.21.15.115:0/3260378494 shutdown_connections 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 -- 172.21.15.115:0/3260378494 wait complete. 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 Processor -- start 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 -- start start 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e00715d0 0x7f44e0113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0114250 con 0x7f44e0070040 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e7b8a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0114a70 con 0x7f44e00715d0 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e5926640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.527 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e5926640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33138/0 (socket says 172.21.15.115:33138) 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.524+0000 7f44e5926640 1 -- 172.21.15.115:0/793201744 learned_addr learned my addr 172.21.15.115:0/793201744 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e5125640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e00715d0 0x7f44e0113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e5926640 1 -- 172.21.15.115:0/793201744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e00715d0 msgr2=0x7f44e0113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e5926640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e00715d0 0x7f44e0113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e5926640 1 -- 172.21.15.115:0/793201744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc005040 con 0x7f44e0070040 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e5926640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0043d0 tx=0x7f44dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44dc038070 con 0x7f44e0070040 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44dc009800 con 0x7f44e0070040 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e0114ca0 con 0x7f44e0070040 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44dc03e630 con 0x7f44e0070040 2024-09-13T23:11:45.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.525+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e0115240 con 0x7f44e0070040 2024-09-13T23:11:45.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.526+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00fb9b0 con 0x7f44e0070040 2024-09-13T23:11:45.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.527+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f44dc030020 con 0x7f44e0070040 2024-09-13T23:11:45.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.527+0000 7f44d67fc640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 0x7f44cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.527+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f44dc0ae3d0 con 0x7f44e0070040 2024-09-13T23:11:45.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.527+0000 7f44e5125640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 0x7f44cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.527+0000 7f44e5125640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 0x7f44cc0709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e0113470 tx=0x7f44d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.531+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44dc077540 con 0x7f44e0070040 2024-09-13T23:11:45.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.728+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f44e010b560 con 0x7f44e0070040 2024-09-13T23:11:45.729 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.728+0000 7f44d67fc640 1 -- 172.21.15.115:0/793201744 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f44dc07ac00 con 0x7f44e0070040 2024-09-13T23:11:45.729 INFO:teuthology.orchestra.run.smithi115.stdout:e23 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:41:170028+0000 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 23 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:40.461781+0000 2024-09-13T23:11:45.730 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:11:45.731 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 24257,14464 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:45.732 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:11:45.733 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 msgr2=0x7f44cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 0x7f44cc0709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e0113470 tx=0x7f44d000b040 comp rx=0 tx=0).stop 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 msgr2=0x7f44e01136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0043d0 tx=0x7f44dc009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 shutdown_connections 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44cc06e530 0x7f44cc0709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44e00715d0 0x7f44e0113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 --2- 172.21.15.115:0/793201744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44e0070040 0x7f44e01136c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 >> 172.21.15.115:0/793201744 conn(0x7f44e00f7d30 msgr2=0x7f44e00f9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 shutdown_connections 2024-09-13T23:11:45.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.731+0000 7f44e7b8a640 1 -- 172.21.15.115:0/793201744 wait complete. 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 -- 172.21.15.115:0/3481256052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 msgr2=0x7f28480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 --2- 172.21.15.115:0/3481256052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f28480fb860 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28380048d0 tx=0x7f2838009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 -- 172.21.15.115:0/3481256052 shutdown_connections 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 --2- 172.21.15.115:0/3481256052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 0x7f28480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 --2- 172.21.15.115:0/3481256052 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f28480fb860 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.810+0000 7f284ec64640 1 -- 172.21.15.115:0/3481256052 >> 172.21.15.115:0/3481256052 conn(0x7f28480f6c10 msgr2=0x7f28480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:45.813 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 -- 172.21.15.115:0/3481256052 shutdown_connections 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 -- 172.21.15.115:0/3481256052 wait complete. 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 Processor -- start 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 -- start start 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 0x7f284810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284810dc30 con 0x7f28480fb450 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ec64640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284810e450 con 0x7f28480fc720 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.811+0000 7f284ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33160/0 (socket says 172.21.15.115:33160) 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 -- 172.21.15.115:0/3704804842 learned_addr learned my addr 172.21.15.115:0/3704804842 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f2847fff640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 0x7f284810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 -- 172.21.15.115:0/3704804842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 msgr2=0x7f284810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 0x7f284810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 -- 172.21.15.115:0/3704804842 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2838005040 con 0x7f28480fb450 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ca00640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28380043d0 tx=0x7f2838009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2838038070 con 0x7f28480fb450 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f283802ae90 con 0x7f28480fb450 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284810e680 con 0x7f28480fb450 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283803e670 con 0x7f28480fb450 2024-09-13T23:11:45.815 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.812+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284810ec20 con 0x7f28480fb450 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.813+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28480fa8b0 con 0x7f28480fb450 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.814+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2838030020 con 0x7f28480fb450 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.814+0000 7f28457fa640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 0x7f28300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.814+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f28380ae330 con 0x7f28480fb450 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.814+0000 7f2847fff640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 0x7f28300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:45.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.815+0000 7f2847fff640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 0x7f28300709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f284810ce50 tx=0x7f283c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:45.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:45.819+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f28380774d0 con 0x7f28480fb450 2024-09-13T23:11:46.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.000+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f284810ee40 con 0x7f283006e530 2024-09-13T23:11:46.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.002+0000 7f28457fa640 1 -- 172.21.15.115:0/3704804842 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f284810ee40 con 0x7f283006e530 2024-09-13T23:11:46.002 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "10/21 daemons upgraded", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:11:46.003 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 msgr2=0x7f28300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 0x7f28300709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f284810ce50 tx=0x7f283c00b040 comp rx=0 tx=0).stop 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 msgr2=0x7f284810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28380043d0 tx=0x7f2838009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 shutdown_connections 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f283006e530 0x7f28300709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f28480fc720 0x7f284810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 --2- 172.21.15.115:0/3704804842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28480fb450 0x7f284810d0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 >> 172.21.15.115:0/3704804842 conn(0x7f28480f6c10 msgr2=0x7f28480660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 shutdown_connections 2024-09-13T23:11:46.005 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.004+0000 7f284ec64640 1 -- 172.21.15.115:0/3704804842 wait complete. 2024-09-13T23:11:46.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 -- 172.21.15.115:0/4102915798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 msgr2=0x7f98d80fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/4102915798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d80fb860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98c80048d0 tx=0x7f98c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 -- 172.21.15.115:0/4102915798 shutdown_connections 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/4102915798 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 0x7f98d80fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/4102915798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d80fb860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 -- 172.21.15.115:0/4102915798 >> 172.21.15.115:0/4102915798 conn(0x7f98d80f6c10 msgr2=0x7f98d80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 -- 172.21.15.115:0/4102915798 shutdown_connections 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.082+0000 7f98dc8c5640 1 -- 172.21.15.115:0/4102915798 wait complete. 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 Processor -- start 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 -- start start 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 0x7f98d810d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d810dd10 con 0x7f98d80fb450 2024-09-13T23:11:46.085 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98dc8c5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d810e490 con 0x7f98d80fc720 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40844/0 (socket says 172.21.15.115:40844) 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 -- 172.21.15.115:0/997421494 learned_addr learned my addr 172.21.15.115:0/997421494 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98cffff640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 0x7f98d810d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 -- 172.21.15.115:0/997421494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 msgr2=0x7f98d810d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 0x7f98d810d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 -- 172.21.15.115:0/997421494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8005040 con 0x7f98d80fb450 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.083+0000 7f98d659c640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.084+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c8038070 con 0x7f98d80fb450 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.084+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98c802ae90 con 0x7f98d80fb450 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.084+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d810e6c0 con 0x7f98d80fb450 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.084+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c803d440 con 0x7f98d80fb450 2024-09-13T23:11:46.086 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.084+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d810ec00 con 0x7f98d80fb450 2024-09-13T23:11:46.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.085+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80fa8b0 con 0x7f98d80fb450 2024-09-13T23:11:46.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.085+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f98c8030020 con 0x7f98d80fb450 2024-09-13T23:11:46.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.086+0000 7f98ceffd640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 0x7f98c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:11:46.087 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.086+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f98c80ae870 con 0x7f98d80fb450 2024-09-13T23:11:46.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.086+0000 7f98cffff640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 0x7f98c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:11:46.088 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.086+0000 7f98cffff640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 0x7f98c40709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98d810cf30 tx=0x7f98c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:11:46.090 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.090+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98c8077960 con 0x7f98d80fb450 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: Upgrade: Updating osd.4 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: Deploying daemon osd.4 on smithi152 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1292409897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:46.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:46 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/793201744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:11:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.326+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f98d804b720 con 0x7f98d80fb450 2024-09-13T23:11:46.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.326+0000 7f98ceffd640 1 -- 172.21.15.115:0/997421494 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f98c807b020 con 0x7f98d80fb450 2024-09-13T23:11:46.327 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:11:46.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 msgr2=0x7f98c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 0x7f98c40709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f98d810cf30 tx=0x7f98c0009040 comp rx=0 tx=0).stop 2024-09-13T23:11:46.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 msgr2=0x7f98d810d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:11:46.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.329 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 shutdown_connections 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c406e530 0x7f98c40709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98d80fc720 0x7f98d810d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 --2- 172.21.15.115:0/997421494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98d80fb450 0x7f98d810d180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 >> 172.21.15.115:0/997421494 conn(0x7f98d80f6c10 msgr2=0x7f98d8066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.328+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 shutdown_connections 2024-09-13T23:11:46.330 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:11:46.329+0000 7f98dc8c5640 1 -- 172.21.15.115:0/997421494 wait complete. 2024-09-13T23:11:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: Upgrade: Updating osd.4 2024-09-13T23:11:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: Deploying daemon osd.4 on smithi152 2024-09-13T23:11:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:46.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1292409897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:11:46.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:46 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/793201744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:11:47.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:47 smithi152 ceph-mon[80164]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:47.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:47 smithi152 ceph-mon[80164]: pgmap v124: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T23:11:47.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:47 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/997421494' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:11:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:47 smithi115 ceph-mon[91340]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:11:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:47 smithi115 ceph-mon[91340]: pgmap v124: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T23:11:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:47 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/997421494' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:11:48.020 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:47 smithi152 systemd[1]: Stopping Ceph osd.4 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:11:48.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:48 smithi152 ceph-mon[80164]: osd.4 marked itself down and dead 2024-09-13T23:11:48.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:48 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[46621]: 2024-09-13T23:11:48.029+0000 7f3661c8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:11:48.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:48 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[46621]: 2024-09-13T23:11:48.029+0000 7f3661c8b640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-13T23:11:48.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:48 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[46621]: 2024-09-13T23:11:48.029+0000 7f3661c8b640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:11:48.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:48 smithi115 ceph-mon[91340]: osd.4 marked itself down and dead 2024-09-13T23:11:48.965 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:48 smithi152 podman[93722]: 2024-09-13 23:11:48.68187172 +0000 UTC m=+0.766372685 container died 0cc6f369534867fbe49c39cf8dccd47b26a7d4af52f8fb3d36185b1a17abab09 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97) 2024-09-13T23:11:49.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:49 smithi152 ceph-mon[80164]: pgmap v125: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:49.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:49 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:11:49.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:49 smithi152 ceph-mon[80164]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T23:11:49.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93722]: 2024-09-13 23:11:49.072777559 +0000 UTC m=+1.157278529 container cleanup 0cc6f369534867fbe49c39cf8dccd47b26a7d4af52f8fb3d36185b1a17abab09 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=quincy-eb16b97, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T23:11:49.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 bash[93722]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4 2024-09-13T23:11:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:49 smithi115 ceph-mon[91340]: pgmap v125: 65 pgs: 65 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:11:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:49 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:11:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:49 smithi115 ceph-mon[91340]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T23:11:49.685 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93747]: 2024-09-13 23:11:49.349377955 +0000 UTC m=+0.662289436 container remove 0cc6f369534867fbe49c39cf8dccd47b26a7d4af52f8fb3d36185b1a17abab09 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T23:11:49.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93836]: 2024-09-13 23:11:49.587623318 +0000 UTC m=+0.016148137 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:49.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93836]: 2024-09-13 23:11:49.692073045 +0000 UTC m=+0.120597852 container create c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T23:11:49.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93836]: 2024-09-13 23:11:49.920188555 +0000 UTC m=+0.348713367 container init c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T23:11:49.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:49 smithi152 podman[93836]: 2024-09-13 23:11:49.923548433 +0000 UTC m=+0.352073242 container start c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:11:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:50 smithi152 ceph-mon[80164]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T23:11:50.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 podman[93836]: 2024-09-13 23:11:50.003701942 +0000 UTC m=+0.432226757 container attach c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T23:11:50.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 podman[93836]: 2024-09-13 23:11:50.121103785 +0000 UTC m=+0.549628597 container died c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:11:50.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:50 smithi115 ceph-mon[91340]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T23:11:50.958 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 podman[93859]: 2024-09-13 23:11:50.716459724 +0000 UTC m=+0.589374517 container remove c150450cc98e4acf8ee176d4b4197d1f810c6c539440881e3d4c73a832cc4874 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T23:11:50.958 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T23:11:50.958 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 systemd[1]: Stopped Ceph osd.4 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:11:50.958 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.4.service: Consumed 56.613s CPU time. 2024-09-13T23:11:51.218 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:50 smithi152 systemd[1]: Starting Ceph osd.4 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:11:51.218 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 podman[93957]: 2024-09-13 23:11:51.06768651 +0000 UTC m=+0.015368856 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:51.218 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 podman[93957]: 2024-09-13 23:11:51.167753127 +0000 UTC m=+0.115435462 container create 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T23:11:51.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:51 smithi152 ceph-mon[80164]: pgmap v128: 65 pgs: 3 active+undersized, 10 peering, 2 stale+active+clean, 2 active+undersized+degraded, 48 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 6/348 objects degraded (1.724%) 2024-09-13T23:11:51.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:51 smithi152 ceph-mon[80164]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T23:11:51.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:51 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 6/348 objects degraded (1.724%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:51.479 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 podman[93957]: 2024-09-13 23:11:51.396148837 +0000 UTC m=+0.343831172 container init 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T23:11:51.479 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 podman[93957]: 2024-09-13 23:11:51.399728131 +0000 UTC m=+0.347410473 container start 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T23:11:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:51 smithi115 ceph-mon[91340]: pgmap v128: 65 pgs: 3 active+undersized, 10 peering, 2 stale+active+clean, 2 active+undersized+degraded, 48 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 6/348 objects degraded (1.724%) 2024-09-13T23:11:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:51 smithi115 ceph-mon[91340]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T23:11:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:51 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 6/348 objects degraded (1.724%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:51.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 podman[93957]: 2024-09-13 23:11:51.478783248 +0000 UTC m=+0.426465582 container attach 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T23:11:51.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:51.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 bash[93957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:51.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:51.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:51 smithi152 bash[93957]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:11:52.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:52 smithi115 ceph-mon[91340]: pgmap v129: 65 pgs: 12 active+undersized, 10 peering, 12 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 45/348 objects degraded (12.931%) 2024-09-13T23:11:52.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-mon[80164]: pgmap v129: 65 pgs: 12 active+undersized, 10 peering, 12 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 45/348 objects degraded (12.931%) 2024-09-13T23:11:52.555 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:11:52.555 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:11:52.555 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:11:52.555 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:11:52.942 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:11:52.943 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate[93971]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T23:11:52.943 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 bash[93957]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T23:11:52.943 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:52 smithi152 podman[93957]: 2024-09-13 23:11:52.582396725 +0000 UTC m=+1.530079070 container died 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T23:11:53.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 podman[94112]: 2024-09-13 23:11:53.20801571 +0000 UTC m=+0.619339880 container remove 22e380dae738150e4090a5ffae775ed40652721b6e72511c8adca85cb855cecd (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T23:11:53.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 podman[94173]: 2024-09-13 23:11:53.322653837 +0000 UTC m=+0.016109077 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:11:53.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 podman[94173]: 2024-09-13 23:11:53.425926248 +0000 UTC m=+0.119381481 container create 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T23:11:53.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 podman[94173]: 2024-09-13 23:11:53.678589503 +0000 UTC m=+0.372044734 container init 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD) 2024-09-13T23:11:53.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 podman[94173]: 2024-09-13 23:11:53.68169703 +0000 UTC m=+0.375152267 container start 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:11:53.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 ceph-osd[94192]: -- 172.21.15.152:0/1235611924 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9478c61e0 con 0x55e94785c000 2024-09-13T23:11:53.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 bash[94173]: 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 2024-09-13T23:11:53.969 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:53 smithi152 systemd[1]: Started Ceph osd.4 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: pgmap v130: 65 pgs: 14 active+undersized, 8 peering, 12 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/348 objects degraded (12.931%) 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.162 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: pgmap v130: 65 pgs: 14 active+undersized, 8 peering, 12 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 45/348 objects degraded (12.931%) 2024-09-13T23:11:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:55.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:55.947 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:11:55 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:11:55.579+0000 7fd1debc5640 -1 Falling back to public interface 2024-09-13T23:11:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:56 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 59/348 objects degraded (16.954%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:56.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:56 smithi152 ceph-mon[80164]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T23:11:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:56 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 59/348 objects degraded (16.954%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:11:56.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:56 smithi115 ceph-mon[91340]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T23:11:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:57 smithi152 ceph-mon[80164]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:11:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:57 smithi115 ceph-mon[91340]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:11:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:11:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:11:59 smithi152 ceph-mon[80164]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:11:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:11:59 smithi115 ceph-mon[91340]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:01.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:01 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:01.968 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:12:01 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:12:01.648+0000 7fd1debc5640 -1 osd.4 68 log_to_monitors true 2024-09-13T23:12:02.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:12:02 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:12:02.215+0000 7fd1d695f640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:12:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:02 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:02 smithi152 ceph-mon[80164]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:12:02.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:02 smithi152 ceph-mon[80164]: from='osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:12:02.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:02 smithi152 ceph-mon[80164]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:12:02.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:02 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:02.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:02 smithi115 ceph-mon[91340]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:12:02.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:02 smithi115 ceph-mon[91340]: from='osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:12:02.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:02 smithi115 ceph-mon[91340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:12:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:03 smithi152 ceph-mon[80164]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:03 smithi152 ceph-mon[80164]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:12:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:03 smithi152 ceph-mon[80164]: from='osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:03 smithi152 ceph-mon[80164]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T23:12:03.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:03 smithi152 ceph-mon[80164]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:03.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:03 smithi115 ceph-mon[91340]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:03.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:03 smithi115 ceph-mon[91340]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:12:03.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:03 smithi115 ceph-mon[91340]: from='osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:03.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:03 smithi115 ceph-mon[91340]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T23:12:03.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:03 smithi115 ceph-mon[91340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:04 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:12:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:04 smithi152 ceph-mon[80164]: osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845] boot 2024-09-13T23:12:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:04 smithi152 ceph-mon[80164]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T23:12:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:04 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:12:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:04 smithi152 ceph-mon[80164]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T23:12:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:04 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:12:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:04 smithi115 ceph-mon[91340]: osd.4 [v2:172.21.15.152:6808/828910845,v1:172.21.15.152:6809/828910845] boot 2024-09-13T23:12:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:04 smithi115 ceph-mon[91340]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T23:12:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:04 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:12:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:04 smithi115 ceph-mon[91340]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T23:12:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:05 smithi152 ceph-mon[80164]: pgmap v137: 65 pgs: 1 peering, 17 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:05 smithi115 ceph-mon[91340]: pgmap v137: 65 pgs: 1 peering, 17 active+undersized, 16 active+undersized+degraded, 31 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 59/348 objects degraded (16.954%) 2024-09-13T23:12:06.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:06 smithi115 ceph-mon[91340]: pgmap v139: 65 pgs: 6 activating, 1 peering, 3 active+undersized, 3 active+undersized+degraded, 52 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 6/348 objects degraded (1.724%) 2024-09-13T23:12:06.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:06 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 6/348 objects degraded (1.724%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:06.721 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:06 smithi152 ceph-mon[80164]: pgmap v139: 65 pgs: 6 activating, 1 peering, 3 active+undersized, 3 active+undersized+degraded, 52 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 6/348 objects degraded (1.724%) 2024-09-13T23:12:06.721 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:06 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 6/348 objects degraded (1.724%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:08 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/348 objects degraded (1.724%), 3 pgs degraded) 2024-09-13T23:12:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:08 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:12:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:08 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/348 objects degraded (1.724%), 3 pgs degraded) 2024-09-13T23:12:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:08 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:12:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:09 smithi152 ceph-mon[80164]: pgmap v140: 65 pgs: 6 activating, 1 peering, 58 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:12:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:09 smithi115 ceph-mon[91340]: pgmap v140: 65 pgs: 6 activating, 1 peering, 58 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:12:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:11 smithi152 ceph-mon[80164]: pgmap v141: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T23:12:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:11 smithi115 ceph-mon[91340]: pgmap v141: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T23:12:13.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:13 smithi152 ceph-mon[80164]: pgmap v142: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-13T23:12:13.506 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:13 smithi115 ceph-mon[91340]: pgmap v142: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-13T23:12:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:15 smithi152 ceph-mon[80164]: pgmap v143: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T23:12:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:15 smithi115 ceph-mon[91340]: pgmap v143: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 -- 172.21.15.115:0/4023453014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 msgr2=0x7f12b0101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 --2- 172.21.15.115:0/4023453014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b0101b20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f12a40048d0 tx=0x7f12a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 -- 172.21.15.115:0/4023453014 shutdown_connections 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 --2- 172.21.15.115:0/4023453014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b0101b20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 --2- 172.21.15.115:0/4023453014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b00ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 -- 172.21.15.115:0/4023453014 >> 172.21.15.115:0/4023453014 conn(0x7f12b00f6c10 msgr2=0x7f12b00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 -- 172.21.15.115:0/4023453014 shutdown_connections 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.420+0000 7f12b85f8640 1 -- 172.21.15.115:0/4023453014 wait complete. 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 Processor -- start 2024-09-13T23:12:16.422 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 -- start start 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b010d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b010dc60 con 0x7f12b00ff740 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b85f8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b010e430 con 0x7f12b0065b80 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b5b93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b6394640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b010d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b5b93640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52796/0 (socket says 172.21.15.115:52796) 2024-09-13T23:12:16.423 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b5b93640 1 -- 172.21.15.115:0/3534688724 learned_addr learned my addr 172.21.15.115:0/3534688724 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:16.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b6394640 1 -- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 msgr2=0x7f12b010d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b6394640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b6394640 1 -- 172.21.15.115:0/3534688724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4005040 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.421+0000 7f12b5b93640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12b6394640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b010d0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12a000dad0 tx=0x7f12a0004db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a0017070 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12a000f040 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a00037d0 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b010e6c0 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.422+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b010ec60 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.423+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b00fa890 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.424+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f12a000b910 con 0x7f12b0065b80 2024-09-13T23:12:16.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.424+0000 7f12aeffd640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 0x7f12980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.424+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f12a008e0b0 con 0x7f12b0065b80 2024-09-13T23:12:16.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.424+0000 7f12b5b93640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 0x7f12980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.425+0000 7f12b5b93640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 0x7f12980709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007ac0 tx=0x7f12a4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.429+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f12a0057220 con 0x7f12b0065b80 2024-09-13T23:12:16.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:16 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:16 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:16.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.613+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b010f0a0 con 0x7f129806e530 2024-09-13T23:12:16.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.615+0000 7f12aeffd640 1 -- 172.21.15.115:0/3534688724 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f12b010f0a0 con 0x7f129806e530 2024-09-13T23:12:16.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 msgr2=0x7f12980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 0x7f12980709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007ac0 tx=0x7f12a4035040 comp rx=0 tx=0).stop 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 msgr2=0x7f12b010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b010d0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12a000dad0 tx=0x7f12a0004db0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 shutdown_connections 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f129806e530 0x7f12980709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12b00ff740 0x7f12b010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 --2- 172.21.15.115:0/3534688724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12b0065b80 0x7f12b010d0d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 >> 172.21.15.115:0/3534688724 conn(0x7f12b00f6c10 msgr2=0x7f12b00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 shutdown_connections 2024-09-13T23:12:16.618 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.617+0000 7f12b85f8640 1 -- 172.21.15.115:0/3534688724 wait complete. 2024-09-13T23:12:16.626 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:12:16.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 -- 172.21.15.115:0/3743771115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fdba0 msgr2=0x7f36e40fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/3743771115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fdba0 0x7f36e40fdfb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36d40048d0 tx=0x7f36d4009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 -- 172.21.15.115:0/3743771115 shutdown_connections 2024-09-13T23:12:16.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/3743771115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fe4f0 0x7f36e40fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/3743771115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fdba0 0x7f36e40fdfb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 -- 172.21.15.115:0/3743771115 >> 172.21.15.115:0/3743771115 conn(0x7f36e40f63a0 msgr2=0x7f36e40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 -- 172.21.15.115:0/3743771115 shutdown_connections 2024-09-13T23:12:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 -- 172.21.15.115:0/3743771115 wait complete. 2024-09-13T23:12:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.695+0000 7f36ea8ca640 1 Processor -- start 2024-09-13T23:12:16.697 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36ea8ca640 1 -- start start 2024-09-13T23:12:16.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36ea8ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fdba0 0x7f36e410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.698 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36ea8ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36ea8ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e410dc20 con 0x7f36e40fe4f0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36ea8ca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e410e440 con 0x7f36e40fdba0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fdba0 0x7f36e410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52818/0 (socket says 172.21.15.115:52818) 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 -- 172.21.15.115:0/2807228907 learned_addr learned my addr 172.21.15.115:0/2807228907 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 -- 172.21.15.115:0/2807228907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fdba0 msgr2=0x7f36e410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fdba0 0x7f36e410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 -- 172.21.15.115:0/2807228907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4005040 con 0x7f36e40fe4f0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.696+0000 7f36e37fe640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f36d8002870 tx=0x7f36d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.697+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d8007c30 con 0x7f36e40fe4f0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.697+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f36d800f040 con 0x7f36e40fe4f0 2024-09-13T23:12:16.699 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.697+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e410e670 con 0x7f36e40fe4f0 2024-09-13T23:12:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.697+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d800da70 con 0x7f36e40fe4f0 2024-09-13T23:12:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.697+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e410ec10 con 0x7f36e40fe4f0 2024-09-13T23:12:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.698+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e40fa040 con 0x7f36e40fe4f0 2024-09-13T23:12:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.698+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f36d800dbd0 con 0x7f36e40fe4f0 2024-09-13T23:12:16.700 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.699+0000 7f36e0ff9640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 0x7f36cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.699+0000 7f36e3fff640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 0x7f36cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.699+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f36d808d890 con 0x7f36e40fe4f0 2024-09-13T23:12:16.701 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.699+0000 7f36e3fff640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 0x7f36cc0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36d400b020 tx=0x7f36d4039040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.704 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.703+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f36d8056a30 con 0x7f36e40fe4f0 2024-09-13T23:12:16.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.887+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36e410ef40 con 0x7f36cc06e530 2024-09-13T23:12:16.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.889+0000 7f36e0ff9640 1 -- 172.21.15.115:0/2807228907 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f36e410ef40 con 0x7f36cc06e530 2024-09-13T23:12:16.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 msgr2=0x7f36cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 0x7f36cc0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36d400b020 tx=0x7f36d4039040 comp rx=0 tx=0).stop 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 msgr2=0x7f36e410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f36d8002870 tx=0x7f36d8004600 comp rx=0 tx=0).stop 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 shutdown_connections 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f36cc06e530 0x7f36cc0709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36e40fe4f0 0x7f36e410d5d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 --2- 172.21.15.115:0/2807228907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36e40fdba0 0x7f36e410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 >> 172.21.15.115:0/2807228907 conn(0x7f36e40f63a0 msgr2=0x7f36e40f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 shutdown_connections 2024-09-13T23:12:16.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.892+0000 7f36ea8ca640 1 -- 172.21.15.115:0/2807228907 wait complete. 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 -- 172.21.15.115:0/2936690185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 msgr2=0x7f85780fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 --2- 172.21.15.115:0/2936690185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f85780fcb90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85680048d0 tx=0x7f8568009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 -- 172.21.15.115:0/2936690185 shutdown_connections 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 --2- 172.21.15.115:0/2936690185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f85780fcb90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 --2- 172.21.15.115:0/2936690185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 0x7f85780fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 -- 172.21.15.115:0/2936690185 >> 172.21.15.115:0/2936690185 conn(0x7f85780f6c10 msgr2=0x7f85780f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:16.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 -- 172.21.15.115:0/2936690185 shutdown_connections 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.970+0000 7f857f83a640 1 -- 172.21.15.115:0/2936690185 wait complete. 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 Processor -- start 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 -- start start 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 0x7f857810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857810dc70 con 0x7f85780fc720 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857f83a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857810e490 con 0x7f85780fb450 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857cdd5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857cdd5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52832/0 (socket says 172.21.15.115:52832) 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857cdd5640 1 -- 172.21.15.115:0/2484854983 learned_addr learned my addr 172.21.15.115:0/2484854983 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.971+0000 7f857d5d6640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 0x7f857810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857cdd5640 1 -- 172.21.15.115:0/2484854983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 msgr2=0x7f857810d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857cdd5640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 0x7f857810d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:16.974 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857cdd5640 1 -- 172.21.15.115:0/2484854983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568005040 con 0x7f85780fc720 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857cdd5640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85680043d0 tx=0x7f8568009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8568038070 con 0x7f85780fc720 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857810e6c0 con 0x7f85780fc720 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f856802ae90 con 0x7f85780fc720 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856803e670 con 0x7f85780fc720 2024-09-13T23:12:16.975 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.972+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857810ec60 con 0x7f85780fc720 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.973+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780fa8b0 con 0x7f85780fc720 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.974+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8568030020 con 0x7f85780fc720 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.974+0000 7f856dffb640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 0x7f85640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.974+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f85680ae220 con 0x7f85780fc720 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.974+0000 7f857d5d6640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 0x7f85640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:16.976 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.975+0000 7f857d5d6640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 0x7f85640709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8574004ed0 tx=0x7f857400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:16.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:16.979+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8568077440 con 0x7f85780fc720 2024-09-13T23:12:17.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.155+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f857810ef90 con 0x7f856406e530 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.164+0000 7f856dffb640 1 -- 172.21.15.115:0/2484854983 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f857810ef90 con 0x7f856406e530 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 85s ago 13m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (3m) 85s ago 13m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (3m) 20s ago 12m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:12:17.165 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 85s ago 13m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (8m) 85s ago 8m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (8m) 85s ago 8m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (8m) 20s ago 8m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (8m) 20s ago 8m 67.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (4m) 85s ago 14m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (4m) 20s ago 12m 440M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (4m) 85s ago 15m 45.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (3m) 20s ago 12m 42.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 85s ago 13m 16.1M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 20s ago 12m 16.6M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:12:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (2m) 85s ago 11m 97.8M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 85s ago 11m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (90s) 85s ago 11m 11.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (55s) 20s ago 10m 102M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (23s) 20s ago 10m 11.6M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (9m) 20s ago 9m 233M 2581M 17.2.7-1629-geb16b97b ab51d1bebd12 186429e5f67d 2024-09-13T23:12:17.167 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (4m) 85s ago 13m 62.5M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.166+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 msgr2=0x7f85640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.166+0000 7f857f83a640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 0x7f85640709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8574004ed0 tx=0x7f857400b040 comp rx=0 tx=0).stop 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.166+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 msgr2=0x7f857810d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.166+0000 7f857f83a640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85680043d0 tx=0x7f8568009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.166+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 shutdown_connections 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f856406e530 0x7f85640709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85780fc720 0x7f857810d620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 --2- 172.21.15.115:0/2484854983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85780fb450 0x7f857810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 >> 172.21.15.115:0/2484854983 conn(0x7f85780f6c10 msgr2=0x7f85780f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 shutdown_connections 2024-09-13T23:12:17.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.167+0000 7f857f83a640 1 -- 172.21.15.115:0/2484854983 wait complete. 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 -- 172.21.15.115:0/4012261318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fd7f0 msgr2=0x7f14c80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 --2- 172.21.15.115:0/4012261318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fd7f0 0x7f14c80fdc60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0048d0 tx=0x7f14bc009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 -- 172.21.15.115:0/4012261318 shutdown_connections 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 --2- 172.21.15.115:0/4012261318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fd7f0 0x7f14c80fdc60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 --2- 172.21.15.115:0/4012261318 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fc520 0x7f14c80fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 -- 172.21.15.115:0/4012261318 >> 172.21.15.115:0/4012261318 conn(0x7f14c80f7ce0 msgr2=0x7f14c80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 -- 172.21.15.115:0/4012261318 shutdown_connections 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 -- 172.21.15.115:0/4012261318 wait complete. 2024-09-13T23:12:17.246 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.244+0000 7f14cea4f640 1 Processor -- start 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14cea4f640 1 -- start start 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14cea4f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14cea4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fd7f0 0x7f14c810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14cea4f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c810dbf0 con 0x7f14c80fc520 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14cea4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c810e410 con 0x7f14c80fd7f0 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52862/0 (socket says 172.21.15.115:52862) 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fd7f0 0x7f14c810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 -- 172.21.15.115:0/1875217279 learned_addr learned my addr 172.21.15.115:0/1875217279 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 -- 172.21.15.115:0/1875217279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fd7f0 msgr2=0x7f14c810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fd7f0 0x7f14c810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 -- 172.21.15.115:0/1875217279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc005040 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c7fff640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14b8002a80 tx=0x7f14b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.245+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b8007c30 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.246+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c810e6a0 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.246+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14b800f040 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.246+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14b800dab0 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.246+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c810eb00 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.247+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80fb980 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.247+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f14b800dc10 con 0x7f14c80fc520 2024-09-13T23:12:17.249 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.248+0000 7f14c4ff9640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 0x7f14b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.248+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f14b808d930 con 0x7f14c80fc520 2024-09-13T23:12:17.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.248+0000 7f14c77fe640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 0x7f14b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.248+0000 7f14c77fe640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 0x7f14b00709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14c810ce10 tx=0x7f14bc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.252+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f14b8056b50 con 0x7f14c80fc520 2024-09-13T23:12:17.415 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:17.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: Upgrade: osd.5 is safe to restart 2024-09-13T23:12:17.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: pgmap v144: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T23:12:17.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:17.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:12:17.416 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:17.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.484+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14c810eed0 con 0x7f14c80fc520 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: Upgrade: osd.5 is safe to restart 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: pgmap v144: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:12:17.485 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.484+0000 7f14c4ff9640 1 -- 172.21.15.115:0/1875217279 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f14b805a210 con 0x7f14c80fc520 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:12:17.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 1, 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 5, 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 9 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:12:17.487 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:12:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 msgr2=0x7f14b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 0x7f14b00709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14c810ce10 tx=0x7f14bc035040 comp rx=0 tx=0).stop 2024-09-13T23:12:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 msgr2=0x7f14c810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.488 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f14b8002a80 tx=0x7f14b8004600 comp rx=0 tx=0).stop 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 shutdown_connections 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f14b006e530 0x7f14b00709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c80fd7f0 0x7f14c810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 --2- 172.21.15.115:0/1875217279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14c80fc520 0x7f14c810d060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 >> 172.21.15.115:0/1875217279 conn(0x7f14c80f7ce0 msgr2=0x7f14c80f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 shutdown_connections 2024-09-13T23:12:17.489 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.487+0000 7f14cea4f640 1 -- 172.21.15.115:0/1875217279 wait complete. 2024-09-13T23:12:17.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 -- 172.21.15.115:0/3443501161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fc6b0 msgr2=0x7f67a80fcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 --2- 172.21.15.115:0/3443501161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fc6b0 0x7f67a80fcb20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f67900048d0 tx=0x7f6790009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 -- 172.21.15.115:0/3443501161 shutdown_connections 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 --2- 172.21.15.115:0/3443501161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fc6b0 0x7f67a80fcb20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 --2- 172.21.15.115:0/3443501161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fb3e0 0x7f67a80fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.565+0000 7f67ad12c640 1 -- 172.21.15.115:0/3443501161 >> 172.21.15.115:0/3443501161 conn(0x7f67a80f6b80 msgr2=0x7f67a80f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 -- 172.21.15.115:0/3443501161 shutdown_connections 2024-09-13T23:12:17.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 -- 172.21.15.115:0/3443501161 wait complete. 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 Processor -- start 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 -- start start 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fc6b0 0x7f67a8114680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a810dbe0 con 0x7f67a80fb3e0 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67ad12c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8065bd0 con 0x7f67a80fc6b0 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.566+0000 7f67a6d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52884/0 (socket says 172.21.15.115:52884) 2024-09-13T23:12:17.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 -- 172.21.15.115:0/459464216 learned_addr learned my addr 172.21.15.115:0/459464216 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a659c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fc6b0 0x7f67a8114680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 -- 172.21.15.115:0/459464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fc6b0 msgr2=0x7f67a8114680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fc6b0 0x7f67a8114680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 -- 172.21.15.115:0/459464216 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790005040 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67a6d9d640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f67a0002a50 tx=0x7f67a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a0007c30 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f67a000f040 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a8065eb0 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67a000dad0 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.567+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a8114f80 con 0x7f67a80fb3e0 2024-09-13T23:12:17.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.568+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a805ed70 con 0x7f67a80fb3e0 2024-09-13T23:12:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.569+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f67a000dc30 con 0x7f67a80fb3e0 2024-09-13T23:12:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.569+0000 7f679f7fe640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 0x7f67940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.569+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f67a008e010 con 0x7f67a80fb3e0 2024-09-13T23:12:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.569+0000 7f67a659c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 0x7f67940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.570+0000 7f67a659c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 0x7f67940709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f679000b020 tx=0x7f6790035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.574 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.574+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f67a0057100 con 0x7f67a80fb3e0 2024-09-13T23:12:17.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.772+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f67a8115330 con 0x7f67a80fb3e0 2024-09-13T23:12:17.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.772+0000 7f679f7fe640 1 -- 172.21.15.115:0/459464216 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f67a005a7c0 con 0x7f67a80fb3e0 2024-09-13T23:12:17.773 INFO:teuthology.orchestra.run.smithi115.stdout:e23 2024-09-13T23:12:17.773 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:09:41:170028+0000 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 23 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:09:40.461781+0000 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:12:17.774 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 45 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:12:17.775 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 24257,14464 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:14474} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3700826071,v1:172.21.15.115:6827/3700826071] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:24261} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/510740987,v1:172.21.15.152:6827/510740987] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:17.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:17.777 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:12:17.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 msgr2=0x7f67940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 0x7f67940709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f679000b020 tx=0x7f6790035040 comp rx=0 tx=0).stop 2024-09-13T23:12:17.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 msgr2=0x7f67a8112130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f67a0002a50 tx=0x7f67a0004600 comp rx=0 tx=0).stop 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 shutdown_connections 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f679406e530 0x7f67940709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67a80fc6b0 0x7f67a8114680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 --2- 172.21.15.115:0/459464216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67a80fb3e0 0x7f67a8112130 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 >> 172.21.15.115:0/459464216 conn(0x7f67a80f6b80 msgr2=0x7f67a80f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 shutdown_connections 2024-09-13T23:12:17.778 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.774+0000 7f67ad12c640 1 -- 172.21.15.115:0/459464216 wait complete. 2024-09-13T23:12:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 -- 172.21.15.115:0/1677839149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 msgr2=0x7fae640fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 --2- 172.21.15.115:0/1677839149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae640fa650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae540048d0 tx=0x7fae54009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 -- 172.21.15.115:0/1677839149 shutdown_connections 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 --2- 172.21.15.115:0/1677839149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae640fa650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 --2- 172.21.15.115:0/1677839149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 0x7fae640fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 -- 172.21.15.115:0/1677839149 >> 172.21.15.115:0/1677839149 conn(0x7fae640f63a0 msgr2=0x7fae640f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 -- 172.21.15.115:0/1677839149 shutdown_connections 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 -- 172.21.15.115:0/1677839149 wait complete. 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.854+0000 7fae69a4f640 1 Processor -- start 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae69a4f640 1 -- start start 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae69a4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 0x7fae6410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae69a4f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae69a4f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6410dc40 con 0x7fae640fe4f0 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae69a4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6410e460 con 0x7fae640fdba0 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52892/0 (socket says 172.21.15.115:52892) 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 -- 172.21.15.115:0/2787893172 learned_addr learned my addr 172.21.15.115:0/2787893172 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae62ffd640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 0x7fae6410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 -- 172.21.15.115:0/2787893172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 msgr2=0x7fae6410d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 0x7fae6410d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 -- 172.21.15.115:0/2787893172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54005040 con 0x7fae640fe4f0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.855+0000 7fae627fc640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae540043d0 tx=0x7fae54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.856+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae54038070 con 0x7fae640fe4f0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.856+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae5402ae90 con 0x7fae640fe4f0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.856+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6410e690 con 0x7fae640fe4f0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.856+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5403e670 con 0x7fae640fe4f0 2024-09-13T23:12:17.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.856+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6410ec30 con 0x7fae640fe4f0 2024-09-13T23:12:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.857+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae640fa040 con 0x7fae640fe4f0 2024-09-13T23:12:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.857+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fae54030020 con 0x7fae640fe4f0 2024-09-13T23:12:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.857+0000 7fae5b7fe640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 0x7fae500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.858+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fae540ae400 con 0x7fae640fe4f0 2024-09-13T23:12:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.858+0000 7fae62ffd640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 0x7fae500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:17.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.858+0000 7fae62ffd640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 0x7fae500709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007fd0 tx=0x7fae4c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:17.862+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae540774f0 con 0x7fae640fe4f0 2024-09-13T23:12:18.049 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.048+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae6410ef60 con 0x7fae5006e530 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.049+0000 7fae5b7fe640 1 -- 172.21.15.115:0/2787893172 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fae6410ef60 con 0x7fae5006e530 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:12:18.050 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "11/21 daemons upgraded", 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:12:18.051 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 msgr2=0x7fae500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 0x7fae500709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007fd0 tx=0x7fae4c009e90 comp rx=0 tx=0).stop 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 msgr2=0x7fae6410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae540043d0 tx=0x7fae54009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 shutdown_connections 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fae5006e530 0x7fae500709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae640fe4f0 0x7fae6410d5f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 --2- 172.21.15.115:0/2787893172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae640fdba0 0x7fae6410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 >> 172.21.15.115:0/2787893172 conn(0x7fae640f63a0 msgr2=0x7fae640f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:18.053 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 shutdown_connections 2024-09-13T23:12:18.054 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.052+0000 7fae69a4f640 1 -- 172.21.15.115:0/2787893172 wait complete. 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- 172.21.15.115:0/2686242391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fc520 msgr2=0x7f1ad00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 --2- 172.21.15.115:0/2686242391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fc520 0x7f1ad00fc930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00048d0 tx=0x7f1ac0009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- 172.21.15.115:0/2686242391 shutdown_connections 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 --2- 172.21.15.115:0/2686242391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 --2- 172.21.15.115:0/2686242391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fc520 0x7f1ad00fc930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- 172.21.15.115:0/2686242391 >> 172.21.15.115:0/2686242391 conn(0x7f1ad00f7ce0 msgr2=0x7f1ad00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- 172.21.15.115:0/2686242391 shutdown_connections 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- 172.21.15.115:0/2686242391 wait complete. 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 Processor -- start 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- start start 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fc520 0x7f1ad010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad010dc10 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ad639f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad010e430 con 0x7f1ad00fc520 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.131+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52908/0 (socket says 172.21.15.115:52908) 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 -- 172.21.15.115:0/3890981585 learned_addr learned my addr 172.21.15.115:0/3890981585 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:18.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1acffff640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fc520 0x7f1ad010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 -- 172.21.15.115:0/3890981585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fc520 msgr2=0x7f1ad010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fc520 0x7f1ad010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 -- 172.21.15.115:0/3890981585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0005040 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ac7fff640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8002a50 tx=0x7f1ab8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab8007c30 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ab800f040 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab800dad0 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad010e6c0 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.135 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.132+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad010ec60 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.133+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad00fb980 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.134+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1ab800dc30 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.134+0000 7f1acd7fa640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 0x7f1abc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:18.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.134+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1ab808df60 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.134+0000 7f1acffff640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 0x7f1abc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:18.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.135+0000 7f1acffff640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 0x7f1abc0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000b020 tx=0x7f1ac0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:18.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.139+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ab80c31b0 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: from='client.44233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: Upgrade: Updating osd.5 2024-09-13T23:12:18.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: Deploying daemon osd.5 on smithi152 2024-09-13T23:12:18.333 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.333 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1875217279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:18.333 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:18 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/459464216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:12:18.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.370+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1ad010ef70 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: from='client.44233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: Upgrade: Updating osd.5 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: Deploying daemon osd.5 on smithi152 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1875217279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:18.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:18 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/459464216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:12:18.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.371+0000 7f1acd7fa640 1 -- 172.21.15.115:0/3890981585 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1ab80570d0 con 0x7f1ad00fd7f0 2024-09-13T23:12:18.372 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 msgr2=0x7f1abc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 0x7f1abc0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000b020 tx=0x7f1ac0035040 comp rx=0 tx=0).stop 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 msgr2=0x7f1ad010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8002a50 tx=0x7f1ab8004600 comp rx=0 tx=0).stop 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 shutdown_connections 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1abc06e530 0x7f1abc0709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ad00fd7f0 0x7f1ad010d5c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 --2- 172.21.15.115:0/3890981585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ad00fc520 0x7f1ad010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 >> 172.21.15.115:0/3890981585 conn(0x7f1ad00f7ce0 msgr2=0x7f1ad00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 shutdown_connections 2024-09-13T23:12:18.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:18.373+0000 7f1ad639f640 1 -- 172.21.15.115:0/3890981585 wait complete. 2024-09-13T23:12:19.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:19 smithi152 ceph-mon[80164]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:19.292 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:19 smithi152 ceph-mon[80164]: pgmap v145: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:12:19.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:19 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3890981585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:12:19.293 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:19 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:19 smithi115 ceph-mon[91340]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:19 smithi115 ceph-mon[91340]: pgmap v145: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:12:19.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:19 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3890981585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:12:19.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:19 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:20.305 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:20 smithi152 systemd[1]: Stopping Ceph osd.5 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:12:20.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[53208]: 2024-09-13T23:12:20.303+0000 7fc048311640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:12:20.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[53208]: 2024-09-13T23:12:20.303+0000 7fc048311640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-13T23:12:20.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[53208]: 2024-09-13T23:12:20.303+0000 7fc048311640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:12:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:21 smithi152 ceph-mon[80164]: pgmap v146: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:12:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:21 smithi152 ceph-mon[80164]: osd.5 marked itself down and dead 2024-09-13T23:12:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:21 smithi115 ceph-mon[91340]: pgmap v146: 65 pgs: 65 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:12:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:21 smithi115 ceph-mon[91340]: osd.5 marked itself down and dead 2024-09-13T23:12:21.929 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:21 smithi152 podman[99016]: 2024-09-13 23:12:21.633122003 +0000 UTC m=+1.455747710 container died 186429e5f67d55f9a7426d50c9615b78cc7c780fc3c56f46daa757d097505683 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-eb16b97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T23:12:22.215 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99016]: 2024-09-13 23:12:22.003260373 +0000 UTC m=+1.825886068 container cleanup 186429e5f67d55f9a7426d50c9615b78cc7c780fc3c56f46daa757d097505683 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=quincy-eb16b97, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T23:12:22.215 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 bash[99016]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5 2024-09-13T23:12:22.215 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99034]: 2024-09-13 23:12:22.146414629 +0000 UTC m=+0.504170362 container remove 186429e5f67d55f9a7426d50c9615b78cc7c780fc3c56f46daa757d097505683 (image=quay.ceph.io/ceph-ci/ceph@sha256:a1fd6dadb08c4973ec538e917bdb1227697e119074c9629a2e7ba5e794a9b7b6, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=quincy-eb16b97, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:12:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:22 smithi152 ceph-mon[80164]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:12:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:22 smithi152 ceph-mon[80164]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T23:12:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:22 smithi152 ceph-mon[80164]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T23:12:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:22 smithi115 ceph-mon[91340]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:12:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:22 smithi115 ceph-mon[91340]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T23:12:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:22 smithi115 ceph-mon[91340]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T23:12:22.825 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99122]: 2024-09-13 23:12:22.572755002 +0000 UTC m=+0.106988651 container create 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T23:12:22.825 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99122]: 2024-09-13 23:12:22.481744156 +0000 UTC m=+0.015977821 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:12:22.825 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99122]: 2024-09-13 23:12:22.825410004 +0000 UTC m=+0.359643654 container init 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux ) 2024-09-13T23:12:23.216 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99122]: 2024-09-13 23:12:22.828680308 +0000 UTC m=+0.362913967 container start 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T23:12:23.217 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:22 smithi152 podman[99122]: 2024-09-13 23:12:22.908802235 +0000 UTC m=+0.443035890 container attach 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T23:12:23.217 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 podman[99122]: 2024-09-13 23:12:23.020812071 +0000 UTC m=+0.555045727 container died 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T23:12:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:23 smithi152 ceph-mon[80164]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:12:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:23 smithi152 ceph-mon[80164]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T23:12:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:23 smithi115 ceph-mon[91340]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T23:12:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:23 smithi115 ceph-mon[91340]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T23:12:23.968 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 podman[99146]: 2024-09-13 23:12:23.56281202 +0000 UTC m=+0.536164838 container remove 8c7f9fd96c5cb854ada28e61e5e64f8e37bddc447df64c020af2453d62e58ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T23:12:23.968 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T23:12:23.968 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 systemd[1]: Stopped Ceph osd.5 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:12:23.968 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.5.service: Consumed 58.481s CPU time. 2024-09-13T23:12:23.969 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 systemd[1]: Starting Ceph osd.5 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:12:24.267 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 podman[99244]: 2024-09-13 23:12:23.988920385 +0000 UTC m=+0.107108418 container create e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True) 2024-09-13T23:12:24.267 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:23 smithi152 podman[99244]: 2024-09-13 23:12:23.897423947 +0000 UTC m=+0.015611989 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:12:24.267 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 podman[99244]: 2024-09-13 23:12:24.266967795 +0000 UTC m=+0.385155831 container init e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T23:12:24.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 podman[99244]: 2024-09-13 23:12:24.270384251 +0000 UTC m=+0.388572287 container start e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:12:24.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 podman[99244]: 2024-09-13 23:12:24.350398503 +0000 UTC m=+0.468586544 container attach e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:12:24.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:12:24.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 bash[99244]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:12:24.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:12:24.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:24 smithi152 bash[99244]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:12:25.421 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-mon[80164]: pgmap v150: 65 pgs: 2 active+undersized, 7 peering, 6 stale+active+clean, 3 active+undersized+degraded, 47 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7/348 objects degraded (2.011%) 2024-09-13T23:12:25.421 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:25.421 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:25.422 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:12:25.422 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:12:25.422 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:12:25.422 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:12:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:25 smithi115 ceph-mon[91340]: pgmap v150: 65 pgs: 2 active+undersized, 7 peering, 6 stale+active+clean, 3 active+undersized+degraded, 47 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7/348 objects degraded (2.011%) 2024-09-13T23:12:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate[99259]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 bash[99244]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T23:12:25.719 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 podman[99244]: 2024-09-13 23:12:25.450003552 +0000 UTC m=+1.568191595 container died e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-13T23:12:26.086 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:25 smithi152 podman[99388]: 2024-09-13 23:12:25.962686206 +0000 UTC m=+0.506405841 container remove e40222df37e41a88cb1a76e9f28020289cb57b93b2413a937f2aeff702f6b062 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:12:26.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:26 smithi152 ceph-mon[80164]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T23:12:26.441 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:26 smithi152 ceph-mon[80164]: Health check failed: Degraded data redundancy: 7/348 objects degraded (2.011%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:26.442 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 podman[99450]: 2024-09-13 23:12:26.069762081 +0000 UTC m=+0.015854913 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:12:26.442 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 podman[99450]: 2024-09-13 23:12:26.197012832 +0000 UTC m=+0.143105656 container create 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T23:12:26.442 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 podman[99450]: 2024-09-13 23:12:26.441638976 +0000 UTC m=+0.387731797 container init 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T23:12:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:26 smithi115 ceph-mon[91340]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T23:12:26.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:26 smithi115 ceph-mon[91340]: Health check failed: Degraded data redundancy: 7/348 objects degraded (2.011%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:26.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 podman[99450]: 2024-09-13 23:12:26.444916587 +0000 UTC m=+0.391009420 container start 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T23:12:26.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 ceph-osd[99469]: -- 172.21.15.152:0/2196436389 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e620d201e0 con 0x55e61ff35c00 2024-09-13T23:12:26.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 bash[99450]: 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 2024-09-13T23:12:26.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:26 smithi152 systemd[1]: Started Ceph osd.5 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:12:27.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:27 smithi152 ceph-mon[80164]: pgmap v151: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/348 objects degraded (12.931%) 2024-09-13T23:12:27.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:27.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:27.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:27 smithi115 ceph-mon[91340]: pgmap v151: 65 pgs: 10 active+undersized, 7 peering, 11 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/348 objects degraded (12.931%) 2024-09-13T23:12:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:28.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:28 smithi152 ceph-mon[80164]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T23:12:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:28 smithi115 ceph-mon[91340]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T23:12:28.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:28 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:12:28.329+0000 7f89e0671640 -1 Falling back to public interface 2024-09-13T23:12:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:29 smithi152 ceph-mon[80164]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:29 smithi115 ceph-mon[91340]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:30 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:30 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:30 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:30 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:30 smithi115 ceph-mon[91340]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:30.608 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:30 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.608 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:30 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.608 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:30 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.609 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:30 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:30.609 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:30 smithi152 ceph-mon[80164]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 53/348 objects degraded (15.230%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:33.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:33.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 53/348 objects degraded (15.230%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:33.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:33 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:34.146 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:33 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:12:33.739+0000 7f89e0671640 -1 osd.5 73 log_to_monitors true 2024-09-13T23:12:34.468 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:12:34.311+0000 7f89d840b640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:12:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:34.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T23:12:34.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:12:34.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:34 smithi152 ceph-mon[80164]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:12:34.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:34.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T23:12:34.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:12:34.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:34 smithi115 ceph-mon[91340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:12:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all osd 2024-09-13T23:12:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T23:12:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T23:12:35.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:35.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:35 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T23:12:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all osd 2024-09-13T23:12:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T23:12:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/348 objects degraded (15.230%) 2024-09-13T23:12:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:35.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:35 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T23:12:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T23:12:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T23:12:36.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:36.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T23:12:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T23:12:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:36.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:36.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:36.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T23:12:37.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: Upgrade: Scaling down filesystem cephfs 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 53/348 objects degraded (15.230%) 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596] boot 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.152:6826/135789338,v1:172.21.15.152:6827/135789338] up:boot 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6826/1997927104,v1:172.21.15.115:6827/1997927104] up:boot 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: stopping daemon mds.cephfs.smithi152.cmykpw 2024-09-13T23:12:37.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:stopping} 2 up:standby 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:37 smithi152 ceph-mon[80164]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T23:12:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: Upgrade: Scaling down filesystem cephfs 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: pgmap v158: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 53/348 objects degraded (15.230%) 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: osd.5 [v2:172.21.15.152:6816/2366533596,v1:172.21.15.152:6817/2366533596] boot 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.152:6826/135789338,v1:172.21.15.152:6827/135789338] up:boot 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6826/1997927104,v1:172.21.15.115:6827/1997927104] up:boot 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: stopping daemon mds.cephfs.smithi152.cmykpw 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:active} 2 up:standby 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:12:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:stopping} 2 up:standby 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:37.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:37 smithi115 ceph-mon[91340]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T23:12:38.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:38 smithi152 ceph-mon[80164]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:38 smithi115 ceph-mon[91340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:39 smithi152 ceph-mon[80164]: pgmap v161: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 49/348 objects degraded (14.080%) 2024-09-13T23:12:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:39 smithi152 ceph-mon[80164]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:39 smithi115 ceph-mon[91340]: pgmap v161: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 49/348 objects degraded (14.080%) 2024-09-13T23:12:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:39 smithi115 ceph-mon[91340]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T23:12:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:39.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:41 smithi152 ceph-mon[80164]: pgmap v162: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/348 objects degraded (8.908%) 2024-09-13T23:12:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:41 smithi115 ceph-mon[91340]: pgmap v162: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 31/348 objects degraded (8.908%) 2024-09-13T23:12:42.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:42 smithi115 ceph-mon[91340]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/348 objects degraded (8.908%), 6 pgs degraded) 2024-09-13T23:12:42.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:42 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:12:42.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:42 smithi152 ceph-mon[80164]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/348 objects degraded (8.908%), 6 pgs degraded) 2024-09-13T23:12:42.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:42 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:12:43.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:43 smithi115 ceph-mon[91340]: pgmap v163: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:12:43.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:43 smithi152 ceph-mon[80164]: pgmap v163: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:12:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:45 smithi115 ceph-mon[91340]: pgmap v164: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:12:45.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:45 smithi152 ceph-mon[80164]: pgmap v164: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:12:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:46 smithi115 ceph-mon[91340]: pgmap v165: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T23:12:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:46 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:stopping} 2 up:standby 2024-09-13T23:12:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:46 smithi152 ceph-mon[80164]: pgmap v165: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-13T23:12:46.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:46 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.vlvabd=up:active,1=cephfs.smithi152.cmykpw=up:stopping} 2 up:standby 2024-09-13T23:12:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:47 smithi115 ceph-mon[91340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:47.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:47.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:47 smithi152 ceph-mon[80164]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.464+0000 7f72da0fe640 1 -- 172.21.15.115:0/3881587517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 msgr2=0x7f72d40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.464+0000 7f72da0fe640 1 --2- 172.21.15.115:0/3881587517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d40fdc90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72c80048d0 tx=0x7f72c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.464+0000 7f72da0fe640 1 -- 172.21.15.115:0/3881587517 shutdown_connections 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 --2- 172.21.15.115:0/3881587517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d40fdc90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 --2- 172.21.15.115:0/3881587517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 0x7f72d40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 -- 172.21.15.115:0/3881587517 >> 172.21.15.115:0/3881587517 conn(0x7f72d40f7d30 msgr2=0x7f72d40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 -- 172.21.15.115:0/3881587517 shutdown_connections 2024-09-13T23:12:48.466 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 -- 172.21.15.115:0/3881587517 wait complete. 2024-09-13T23:12:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 Processor -- start 2024-09-13T23:12:48.467 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.465+0000 7f72da0fe640 1 -- start start 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72da0fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 0x7f72d410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72da0fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72da0fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d410dc20 con 0x7f72d40fd820 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72da0fe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d410e440 con 0x7f72d40fc550 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41038/0 (socket says 172.21.15.115:41038) 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 -- 172.21.15.115:0/2933809355 learned_addr learned my addr 172.21.15.115:0/2933809355 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:48.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d37fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 0x7f72d410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 -- 172.21.15.115:0/2933809355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 msgr2=0x7f72d410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 0x7f72d410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 -- 172.21.15.115:0/2933809355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8005040 con 0x7f72d40fd820 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72d2ffd640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72c80043d0 tx=0x7f72c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.466+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c8038070 con 0x7f72d40fd820 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.467+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72c802ae90 con 0x7f72d40fd820 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.467+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d410e670 con 0x7f72d40fd820 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.467+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72c803e670 con 0x7f72d40fd820 2024-09-13T23:12:48.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.467+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d410ec10 con 0x7f72d40fd820 2024-09-13T23:12:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.468+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d40fb9b0 con 0x7f72d40fd820 2024-09-13T23:12:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.468+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f72c8030020 con 0x7f72d40fd820 2024-09-13T23:12:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.469+0000 7f72bbfff640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 0x7f72bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.469+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f72c80ae370 con 0x7f72d40fd820 2024-09-13T23:12:48.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.469+0000 7f72d37fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 0x7f72bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.471 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.469+0000 7f72d37fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 0x7f72bc0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72c4004eb0 tx=0x7f72c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:48.474 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.473+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f72c8077510 con 0x7f72d40fd820 2024-09-13T23:12:48.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:48 smithi115 ceph-mon[91340]: pgmap v166: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-13T23:12:48.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.657+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f72d410ef40 con 0x7f72bc06e530 2024-09-13T23:12:48.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.658+0000 7f72bbfff640 1 -- 172.21.15.115:0/2933809355 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f72d410ef40 con 0x7f72bc06e530 2024-09-13T23:12:48.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.660+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 msgr2=0x7f72bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.660+0000 7f72da0fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 0x7f72bc0709e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72c4004eb0 tx=0x7f72c400b040 comp rx=0 tx=0).stop 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 msgr2=0x7f72d410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72c80043d0 tx=0x7f72c8009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 shutdown_connections 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f72bc06e530 0x7f72bc0709e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72d40fd820 0x7f72d410d5d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 --2- 172.21.15.115:0/2933809355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d40fc550 0x7f72d410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 >> 172.21.15.115:0/2933809355 conn(0x7f72d40f7d30 msgr2=0x7f72d40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 shutdown_connections 2024-09-13T23:12:48.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.661+0000 7f72da0fe640 1 -- 172.21.15.115:0/2933809355 wait complete. 2024-09-13T23:12:48.670 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:12:48.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:48 smithi152 ceph-mon[80164]: pgmap v166: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-13T23:12:48.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 -- 172.21.15.115:0/3253800984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fb450 msgr2=0x7f84a00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 --2- 172.21.15.115:0/3253800984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fb450 0x7f84a00fb860 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84900048d0 tx=0x7f8490009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.741 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 -- 172.21.15.115:0/3253800984 shutdown_connections 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 --2- 172.21.15.115:0/3253800984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fc720 0x7f84a00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 --2- 172.21.15.115:0/3253800984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fb450 0x7f84a00fb860 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 -- 172.21.15.115:0/3253800984 >> 172.21.15.115:0/3253800984 conn(0x7f84a00f6c10 msgr2=0x7f84a00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 -- 172.21.15.115:0/3253800984 shutdown_connections 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 -- 172.21.15.115:0/3253800984 wait complete. 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.739+0000 7f84a4d70640 1 Processor -- start 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 -- start start 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fb450 0x7f84a01121e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a010dc90 con 0x7f84a00fc720 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0066720 con 0x7f84a00fb450 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.742 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41058/0 (socket says 172.21.15.115:41058) 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 -- 172.21.15.115:0/1303565928 learned_addr learned my addr 172.21.15.115:0/1303565928 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849e59c640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fb450 0x7f84a01121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 -- 172.21.15.115:0/1303565928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fb450 msgr2=0x7f84a01121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fb450 0x7f84a01121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 -- 172.21.15.115:0/1303565928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490005040 con 0x7f84a00fc720 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f849dd9b640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f849400c790 tx=0x7f84940043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849400a7a0 con 0x7f84a00fc720 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.740+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a0066a00 con 0x7f84a00fc720 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.741+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f849400ada0 con 0x7f84a00fc720 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.741+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a0115030 con 0x7f84a00fc720 2024-09-13T23:12:48.743 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.741+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84940113a0 con 0x7f84a00fc720 2024-09-13T23:12:48.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.741+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a00fa8b0 con 0x7f84a00fc720 2024-09-13T23:12:48.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.742+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f849400a900 con 0x7f84a00fc720 2024-09-13T23:12:48.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.742+0000 7f848effd640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 0x7f84880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:48.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.743+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f849408e150 con 0x7f84a00fc720 2024-09-13T23:12:48.745 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.743+0000 7f849e59c640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 0x7f84880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:48.746 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.743+0000 7f849e59c640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 0x7f84880709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c00 tx=0x7f8490035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:48.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.747+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8494057380 con 0x7f84a00fc720 2024-09-13T23:12:48.927 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.927+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a0100b80 con 0x7f848806e530 2024-09-13T23:12:48.928 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.928+0000 7f848effd640 1 -- 172.21.15.115:0/1303565928 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f84a0100b80 con 0x7f848806e530 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 msgr2=0x7f84880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 0x7f84880709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8490000c00 tx=0x7f8490035040 comp rx=0 tx=0).stop 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 msgr2=0x7f84a0114730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f849400c790 tx=0x7f84940043c0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 shutdown_connections 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f848806e530 0x7f84880709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a00fc720 0x7f84a0114730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 --2- 172.21.15.115:0/1303565928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84a00fb450 0x7f84a01121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 >> 172.21.15.115:0/1303565928 conn(0x7f84a00f6c10 msgr2=0x7f84a00f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:48.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 shutdown_connections 2024-09-13T23:12:48.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:48.931+0000 7f84a4d70640 1 -- 172.21.15.115:0/1303565928 wait complete. 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- 172.21.15.115:0/2850872428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fd7f0 msgr2=0x7f36940fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 --2- 172.21.15.115:0/2850872428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fd7f0 0x7f36940fdc60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f36880048d0 tx=0x7f3688009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- 172.21.15.115:0/2850872428 shutdown_connections 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 --2- 172.21.15.115:0/2850872428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fd7f0 0x7f36940fdc60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 --2- 172.21.15.115:0/2850872428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fc520 0x7f36940fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- 172.21.15.115:0/2850872428 >> 172.21.15.115:0/2850872428 conn(0x7f36940f7ce0 msgr2=0x7f36940fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.012 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- 172.21.15.115:0/2850872428 shutdown_connections 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- 172.21.15.115:0/2850872428 wait complete. 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 Processor -- start 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- start start 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fd7f0 0x7f369410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369410dc10 con 0x7f36940fc520 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.010+0000 7f369c45a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369410e430 con 0x7f36940fd7f0 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41074/0 (socket says 172.21.15.115:41074) 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 -- 172.21.15.115:0/2639387755 learned_addr learned my addr 172.21.15.115:0/2639387755 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f36999f5640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fd7f0 0x7f369410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.013 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 -- 172.21.15.115:0/2639387755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fd7f0 msgr2=0x7f369410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fd7f0 0x7f369410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 -- 172.21.15.115:0/2639387755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688005040 con 0x7f36940fc520 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369a1f6640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f368400db00 tx=0x7f3684004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3684017070 con 0x7f36940fc520 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f368400f040 con 0x7f36940fc520 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369410e6c0 con 0x7f36940fc520 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3684003960 con 0x7f36940fc520 2024-09-13T23:12:49.014 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.011+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369410ec60 con 0x7f36940fc520 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.012+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36940fb980 con 0x7f36940fc520 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.013+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3684003b50 con 0x7f36940fc520 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.013+0000 7f3692ffd640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 0x7f367c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.013+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f368408e180 con 0x7f36940fc520 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.013+0000 7f36999f5640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 0x7f367c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.015 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.014+0000 7f36999f5640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 0x7f367c0709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f369410ce30 tx=0x7f3688035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.018 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.018+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3684057270 con 0x7f36940fc520 2024-09-13T23:12:49.193 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.192+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f369410ef90 con 0x7f367c06e530 2024-09-13T23:12:49.201 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.201+0000 7f3692ffd640 1 -- 172.21.15.115:0/2639387755 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f369410ef90 con 0x7f367c06e530 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (5m) 117s ago 14m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (3m) 117s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (3m) 19s ago 13m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (5m) 117s ago 13m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (8m) 117s ago 8m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (8m) 117s ago 8m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (8m) 19s ago 8m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (8m) 19s ago 8m 67.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (5m) 117s ago 15m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (4m) 19s ago 13m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:12:49.202 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (4m) 117s ago 15m 45.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (4m) 19s ago 13m 43.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 117s ago 14m 16.1M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 19s ago 13m 16.5M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 117s ago 12m 97.8M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (2m) 117s ago 12m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 117s ago 11m 11.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (87s) 19s ago 11m 104M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (55s) 19s ago 10m 95.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (23s) 19s ago 10m 12.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:12:49.203 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (4m) 117s ago 13m 62.5M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 msgr2=0x7f367c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 0x7f367c0709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f369410ce30 tx=0x7f3688035040 comp rx=0 tx=0).stop 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 msgr2=0x7f369410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f368400db00 tx=0x7f3684004e60 comp rx=0 tx=0).stop 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 shutdown_connections 2024-09-13T23:12:49.204 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f367c06e530 0x7f367c0709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36940fd7f0 0x7f369410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 --2- 172.21.15.115:0/2639387755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36940fc520 0x7f369410d080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 >> 172.21.15.115:0/2639387755 conn(0x7f36940f7ce0 msgr2=0x7f36940f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 shutdown_connections 2024-09-13T23:12:49.205 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.203+0000 7f369c45a640 1 -- 172.21.15.115:0/2639387755 wait complete. 2024-09-13T23:12:49.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 -- 172.21.15.115:0/1560252714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 msgr2=0x7f58440fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.280 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 --2- 172.21.15.115:0/1560252714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f58440fb840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5834009c50 tx=0x7f5834004d10 comp rx=0 tx=0).stop 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 -- 172.21.15.115:0/1560252714 shutdown_connections 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 --2- 172.21.15.115:0/1560252714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f58440fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 --2- 172.21.15.115:0/1560252714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f58440fb840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 -- 172.21.15.115:0/1560252714 >> 172.21.15.115:0/1560252714 conn(0x7f58440f6c10 msgr2=0x7f58440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 -- 172.21.15.115:0/1560252714 shutdown_connections 2024-09-13T23:12:49.281 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.279+0000 7f58493e6640 1 -- 172.21.15.115:0/1560252714 wait complete. 2024-09-13T23:12:49.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 Processor -- start 2024-09-13T23:12:49.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 -- start start 2024-09-13T23:12:49.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.284 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f584410f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584410fe70 con 0x7f58440fb430 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f58493e6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844110690 con 0x7f58440fc700 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f5842ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41092/0 (socket says 172.21.15.115:41092) 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.280+0000 7f5842ffd640 1 -- 172.21.15.115:0/4106074020 learned_addr learned my addr 172.21.15.115:0/4106074020 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f58427fc640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f584410f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f5842ffd640 1 -- 172.21.15.115:0/4106074020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 msgr2=0x7f584410f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f5842ffd640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f584410f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f5842ffd640 1 -- 172.21.15.115:0/4106074020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340098b0 con 0x7f58440fb430 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f58427fc640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f584410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f5842ffd640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5834004a30 tx=0x7f5834004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.285 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5834009710 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5834032b10 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583403db10 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58441108c0 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.281+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5844110e60 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.282+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58440fa890 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.283+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f583402f030 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.283+0000 7f582b7fe640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 0x7f582c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.283+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f58340af7d0 con 0x7f58440fb430 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.283+0000 7f58427fc640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 0x7f582c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.286 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.284+0000 7f58427fc640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 0x7f582c0709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f584410f090 tx=0x7f583800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.288 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.287+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5834078940 con 0x7f58440fb430 2024-09-13T23:12:49.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.516+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5844103f70 con 0x7f58440fb430 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.517+0000 7f582b7fe640 1 -- 172.21.15.115:0/4106074020 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f583407c000 con 0x7f58440fb430 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:12:49.518 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 4, 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 10 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:12:49.519 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:12:49.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 msgr2=0x7f582c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 0x7f582c0709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f584410f090 tx=0x7f583800b040 comp rx=0 tx=0).stop 2024-09-13T23:12:49.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 msgr2=0x7f584410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5834004a30 tx=0x7f5834004d10 comp rx=0 tx=0).stop 2024-09-13T23:12:49.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 shutdown_connections 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f582c06e530 0x7f582c0709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58440fc700 0x7f584410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 --2- 172.21.15.115:0/4106074020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58440fb430 0x7f584410f2e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 >> 172.21.15.115:0/4106074020 conn(0x7f58440f6c10 msgr2=0x7f5844065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 shutdown_connections 2024-09-13T23:12:49.521 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.519+0000 7f58493e6640 1 -- 172.21.15.115:0/4106074020 wait complete. 2024-09-13T23:12:49.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- 172.21.15.115:0/3016655777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fc720 msgr2=0x7efd3c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 --2- 172.21.15.115:0/3016655777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fc720 0x7efd3c0fcb90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efd380048d0 tx=0x7efd38009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- 172.21.15.115:0/3016655777 shutdown_connections 2024-09-13T23:12:49.600 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 --2- 172.21.15.115:0/3016655777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fc720 0x7efd3c0fcb90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 --2- 172.21.15.115:0/3016655777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fb450 0x7efd3c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- 172.21.15.115:0/3016655777 >> 172.21.15.115:0/3016655777 conn(0x7efd3c0f6c10 msgr2=0x7efd3c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- 172.21.15.115:0/3016655777 shutdown_connections 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- 172.21.15.115:0/3016655777 wait complete. 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 Processor -- start 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.598+0000 7efd435b6640 1 -- start start 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd435b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd435b6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fc720 0x7efd3c10d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd435b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c10dc90 con 0x7efd3c0fb450 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd435b6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c10e4b0 con 0x7efd3c0fc720 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41106/0 (socket says 172.21.15.115:41106) 2024-09-13T23:12:49.601 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 -- 172.21.15.115:0/2715126797 learned_addr learned my addr 172.21.15.115:0/2715126797 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd40b51640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fc720 0x7efd3c10d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 -- 172.21.15.115:0/2715126797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fc720 msgr2=0x7efd3c10d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fc720 0x7efd3c10d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 -- 172.21.15.115:0/2715126797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38005040 con 0x7efd3c0fb450 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd41352640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c790 tx=0x7efd300043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3000a820 con 0x7efd3c0fb450 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efd3000ae20 con 0x7efd3c0fb450 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c10e740 con 0x7efd3c0fb450 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.599+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd300113a0 con 0x7efd3c0fb450 2024-09-13T23:12:49.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.600+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c10ece0 con 0x7efd3c0fb450 2024-09-13T23:12:49.603 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.601+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c0fa8b0 con 0x7efd3c0fb450 2024-09-13T23:12:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.601+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efd30012400 con 0x7efd3c0fb450 2024-09-13T23:12:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.601+0000 7efd2dffb640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 0x7efd280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.601+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efd3008e320 con 0x7efd3c0fb450 2024-09-13T23:12:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.602+0000 7efd40b51640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 0x7efd280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.604 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.602+0000 7efd40b51640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 0x7efd280709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd38007ac0 tx=0x7efd38035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.606 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.606+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efd30057490 con 0x7efd3c0fb450 2024-09-13T23:12:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.804+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd3c04b720 con 0x7efd3c0fb450 2024-09-13T23:12:49.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.805+0000 7efd2dffb640 1 -- 172.21.15.115:0/2715126797 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1951 (secure 0 0 0) 0x7efd3000a980 con 0x7efd3c0fb450 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:e27 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:12:46:225883+0000 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:12:49.806 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 27 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:12:45.465565+0000 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:12:49.807 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 0 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464,1=24257} 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:12:49.808 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 14464 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{1:24257} state up:stopping seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/1997927104,v1:172.21.15.115:6827/1997927104] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:49.809 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/135789338,v1:172.21.15.152:6827/135789338] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:12:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 27 2024-09-13T23:12:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 msgr2=0x7efd280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 0x7efd280709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd38007ac0 tx=0x7efd38035040 comp rx=0 tx=0).stop 2024-09-13T23:12:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 msgr2=0x7efd3c10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.810 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c790 tx=0x7efd300043c0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 shutdown_connections 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efd2806e530 0x7efd280709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd3c0fc720 0x7efd3c10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 --2- 172.21.15.115:0/2715126797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efd3c0fb450 0x7efd3c10d100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 >> 172.21.15.115:0/2715126797 conn(0x7efd3c0f6c10 msgr2=0x7efd3c066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 shutdown_connections 2024-09-13T23:12:49.811 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.808+0000 7efd435b6640 1 -- 172.21.15.115:0/2715126797 wait complete. 2024-09-13T23:12:49.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 -- 172.21.15.115:0/617233193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fd7f0 msgr2=0x7f51b80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 --2- 172.21.15.115:0/617233193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fd7f0 0x7f51b80fdc60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f51b40048d0 tx=0x7f51b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 -- 172.21.15.115:0/617233193 shutdown_connections 2024-09-13T23:12:49.890 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 --2- 172.21.15.115:0/617233193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fd7f0 0x7f51b80fdc60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 --2- 172.21.15.115:0/617233193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fc520 0x7f51b80fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.887+0000 7f51c009d640 1 -- 172.21.15.115:0/617233193 >> 172.21.15.115:0/617233193 conn(0x7f51b80f7ce0 msgr2=0x7f51b80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 -- 172.21.15.115:0/617233193 shutdown_connections 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 -- 172.21.15.115:0/617233193 wait complete. 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 Processor -- start 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 -- start start 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fd7f0 0x7f51b810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b810dc10 con 0x7f51b80fc520 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51c009d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b810e430 con 0x7f51b80fd7f0 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51bde39640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51bde39640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41116/0 (socket says 172.21.15.115:41116) 2024-09-13T23:12:49.891 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.888+0000 7f51bde39640 1 -- 172.21.15.115:0/761445270 learned_addr learned my addr 172.21.15.115:0/761445270 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51bd638640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fd7f0 0x7f51b810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51bde39640 1 -- 172.21.15.115:0/761445270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fd7f0 msgr2=0x7f51b810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51bde39640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fd7f0 0x7f51b810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51bde39640 1 -- 172.21.15.115:0/761445270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4005040 con 0x7f51b80fc520 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51bde39640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c790 tx=0x7f51a80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a800a820 con 0x7f51b80fc520 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b810e6c0 con 0x7f51b80fc520 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51a800ae20 con 0x7f51b80fc520 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a80113a0 con 0x7f51b80fc520 2024-09-13T23:12:49.892 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.889+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b810ec60 con 0x7f51b80fc520 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.890+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b80fb980 con 0x7f51b80fc520 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.891+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f51a8012400 con 0x7f51b80fc520 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.891+0000 7f51ae7fc640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 0x7f51a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.891+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f51a808e230 con 0x7f51b80fc520 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.891+0000 7f51bd638640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 0x7f51a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:49.893 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.892+0000 7f51bd638640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 0x7f51a40709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51b4007ac0 tx=0x7f51b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:49.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:49.895+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f51a8057460 con 0x7f51b80fc520 2024-09-13T23:12:50.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.078+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51b810f0a0 con 0x7f51a406e530 2024-09-13T23:12:50.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.079+0000 7f51ae7fc640 1 -- 172.21.15.115:0/761445270 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f51b810f0a0 con 0x7f51a406e530 2024-09-13T23:12:50.080 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:12:50.080 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:12:50.080 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:12:50.081 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 msgr2=0x7f51a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 0x7f51a40709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51b4007ac0 tx=0x7f51b4035040 comp rx=0 tx=0).stop 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 msgr2=0x7f51b810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c790 tx=0x7f51a80043c0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 shutdown_connections 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f51a406e530 0x7f51a40709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b80fd7f0 0x7f51b810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 --2- 172.21.15.115:0/761445270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51b80fc520 0x7f51b810d080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.083 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 >> 172.21.15.115:0/761445270 conn(0x7f51b80f7ce0 msgr2=0x7f51b80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:50.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 shutdown_connections 2024-09-13T23:12:50.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.082+0000 7f51c009d640 1 -- 172.21.15.115:0/761445270 wait complete. 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/1383749021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fd820 msgr2=0x7f3f740fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/1383749021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fd820 0x7f3f740fdc90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f680048d0 tx=0x7f3f68009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/1383749021 shutdown_connections 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/1383749021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fd820 0x7f3f740fdc90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/1383749021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f740fc550 0x7f3f740fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/1383749021 >> 172.21.15.115:0/1383749021 conn(0x7f3f740f7d30 msgr2=0x7f3f740fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/1383749021 shutdown_connections 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.164+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/1383749021 wait complete. 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 Processor -- start 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 -- start start 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:50.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f740fd820 0x7f3f7410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7410e420 con 0x7f3f740fc550 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f7a4ca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7410e590 con 0x7f3f740fd820 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41138/0 (socket says 172.21.15.115:41138) 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 -- 172.21.15.115:0/3254912977 learned_addr learned my addr 172.21.15.115:0/3254912977 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 -- 172.21.15.115:0/3254912977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f740fd820 msgr2=0x7f3f7410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f740fd820 0x7f3f7410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.165+0000 7f3f73fff640 1 -- 172.21.15.115:0/3254912977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68005040 con 0x7f3f740fc550 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f73fff640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b790 tx=0x7f3f640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f6400c700 con 0x7f3f740fc550 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f6400cd00 con 0x7f3f740fc550 2024-09-13T23:12:50.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7410e870 con 0x7f3f740fc550 2024-09-13T23:12:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f64015e70 con 0x7f3f740fc550 2024-09-13T23:12:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.166+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7410ed90 con 0x7f3f740fc550 2024-09-13T23:12:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.167+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f740fb9b0 con 0x7f3f740fc550 2024-09-13T23:12:50.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.167+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f3f64012070 con 0x7f3f740fc550 2024-09-13T23:12:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.168+0000 7f3f70ff9640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 0x7f3f5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:12:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.168+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3f6408dd80 con 0x7f3f740fc550 2024-09-13T23:12:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.168+0000 7f3f737fe640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 0x7f3f5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:12:50.170 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.168+0000 7f3f737fe640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 0x7f3f5c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f6802a530 tx=0x7f3f68009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:12:50.173 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.172+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3f64056e70 con 0x7f3f740fc550 2024-09-13T23:12:50.403 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.402+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3f7410efb0 con 0x7f3f740fc550 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4106074020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:50.404 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:50 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2715126797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:12:50.405 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.403+0000 7f3f70ff9640 1 -- 172.21.15.115:0/3254912977 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3f6405a530 con 0x7f3f740fc550 2024-09-13T23:12:50.406 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:12:50.406 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 msgr2=0x7f3f5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 0x7f3f5c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f6802a530 tx=0x7f3f68009da0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 msgr2=0x7f3f7410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b790 tx=0x7f3f640091d0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 shutdown_connections 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f3f5c06e530 0x7f3f5c0709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f740fd820 0x7f3f7410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 --2- 172.21.15.115:0/3254912977 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f740fc550 0x7f3f7410d0e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 >> 172.21.15.115:0/3254912977 conn(0x7f3f740f7d30 msgr2=0x7f3f740f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 shutdown_connections 2024-09-13T23:12:50.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:12:50.405+0000 7f3f7a4ca640 1 -- 172.21.15.115:0/3254912977 wait complete. 2024-09-13T23:12:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:50.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4106074020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:50 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2715126797' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:12:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:51 smithi152 ceph-mon[80164]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:51 smithi152 ceph-mon[80164]: pgmap v167: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-13T23:12:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:51 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3254912977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:12:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:51 smithi115 ceph-mon[91340]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:12:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:51 smithi115 ceph-mon[91340]: pgmap v167: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-13T23:12:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:51 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3254912977' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:12:53.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:53 smithi152 ceph-mon[80164]: pgmap v168: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T23:12:53.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:53 smithi115 ceph-mon[91340]: pgmap v168: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T23:12:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:55 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:55.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:55 smithi152 ceph-mon[80164]: pgmap v169: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T23:12:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:55.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:55 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:55.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:55 smithi115 ceph-mon[91340]: pgmap v169: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 0 op/s 2024-09-13T23:12:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: pgmap v170: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: pgmap v170: 65 pgs: 65 active+clean; 293 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.8 KiB/s wr, 1 op/s 2024-09-13T23:12:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:57.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:12:58.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:58 smithi152 ceph-mon[80164]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:58 smithi115 ceph-mon[91340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:12:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:12:59 smithi152 ceph-mon[80164]: pgmap v171: 65 pgs: 65 active+clean; 289 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 853 B/s wr, 0 op/s 2024-09-13T23:12:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:12:59 smithi115 ceph-mon[91340]: pgmap v171: 65 pgs: 65 active+clean; 289 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 853 B/s wr, 0 op/s 2024-09-13T23:13:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:01 smithi152 ceph-mon[80164]: pgmap v172: 65 pgs: 65 active+clean; 281 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-13T23:13:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:01 smithi115 ceph-mon[91340]: pgmap v172: 65 pgs: 65 active+clean; 281 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-13T23:13:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:03 smithi152 ceph-mon[80164]: pgmap v173: 65 pgs: 65 active+clean; 261 MiB data, 1021 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-13T23:13:03.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:03 smithi115 ceph-mon[91340]: pgmap v173: 65 pgs: 65 active+clean; 261 MiB data, 1021 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-13T23:13:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:05 smithi152 ceph-mon[80164]: pgmap v174: 65 pgs: 65 active+clean; 253 MiB data, 961 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:13:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:05 smithi115 ceph-mon[91340]: pgmap v174: 65 pgs: 65 active+clean; 253 MiB data, 961 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-13T23:13:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:07 smithi152 ceph-mon[80164]: pgmap v175: 65 pgs: 65 active+clean; 181 MiB data, 769 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-13T23:13:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:07.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:07 smithi115 ceph-mon[91340]: pgmap v175: 65 pgs: 65 active+clean; 181 MiB data, 769 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-13T23:13:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:07.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:08 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:08.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:08 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:09 smithi152 ceph-mon[80164]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:13:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:09 smithi152 ceph-mon[80164]: pgmap v176: 65 pgs: 65 active+clean; 181 MiB data, 769 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T23:13:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:09 smithi115 ceph-mon[91340]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T23:13:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:09 smithi115 ceph-mon[91340]: pgmap v176: 65 pgs: 65 active+clean; 181 MiB data, 769 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T23:13:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:11.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:11 smithi152 ceph-mon[80164]: pgmap v177: 65 pgs: 65 active+clean; 181 MiB data, 761 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-13T23:13:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:11 smithi115 ceph-mon[91340]: pgmap v177: 65 pgs: 65 active+clean; 181 MiB data, 761 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-13T23:13:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:13 smithi152 ceph-mon[80164]: pgmap v178: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:13:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:13 smithi115 ceph-mon[91340]: pgmap v178: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 5 op/s 2024-09-13T23:13:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:15 smithi152 ceph-mon[80164]: pgmap v179: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 2 op/s 2024-09-13T23:13:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:15 smithi115 ceph-mon[91340]: pgmap v179: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 426 B/s wr, 2 op/s 2024-09-13T23:13:16.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:16 smithi152 ceph-mon[80164]: daemon mds.cephfs.smithi152.cmykpw finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T23:13:16.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:16 smithi115 ceph-mon[91340]: daemon mds.cephfs.smithi152.cmykpw finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T23:13:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:17 smithi152 ceph-mon[80164]: pgmap v180: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 2 op/s 2024-09-13T23:13:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:17 smithi152 ceph-mon[80164]: mds.1 [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] down:stopped 2024-09-13T23:13:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:17 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:13:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:17 smithi115 ceph-mon[91340]: pgmap v180: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 597 B/s wr, 2 op/s 2024-09-13T23:13:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:17 smithi115 ceph-mon[91340]: mds.1 [v2:172.21.15.152:6824/992634188,v1:172.21.15.152:6825/992634188] down:stopped 2024-09-13T23:13:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:17 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:13:18.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.152:6824/311722183,v1:172.21.15.152:6825/311722183] up:boot 2024-09-13T23:13:18.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 3 up:standby 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:18 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.ywbcks"]}]: dispatch 2024-09-13T23:13:18.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.152:6824/311722183,v1:172.21.15.152:6825/311722183] up:boot 2024-09-13T23:13:18.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 3 up:standby 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:18.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:18 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.ywbcks"]}]: dispatch 2024-09-13T23:13:19.367 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:19 smithi115 ceph-mon[91340]: Upgrade: It appears safe to stop mds.cephfs.smithi115.ywbcks 2024-09-13T23:13:19.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:19 smithi115 ceph-mon[91340]: pgmap v181: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 0 op/s 2024-09-13T23:13:19.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:19 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:19.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:19 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:19.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:19 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:19 smithi152 ceph-mon[80164]: Upgrade: It appears safe to stop mds.cephfs.smithi115.ywbcks 2024-09-13T23:13:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:19 smithi152 ceph-mon[80164]: pgmap v181: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 0 op/s 2024-09-13T23:13:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:19 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:19 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.ywbcks", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:19 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:20.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:20 smithi115 ceph-mon[91340]: Upgrade: Updating mds.cephfs.smithi115.ywbcks 2024-09-13T23:13:20.426 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:20 smithi115 ceph-mon[91340]: Deploying daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:13:20.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:20 smithi152 ceph-mon[80164]: Upgrade: Updating mds.cephfs.smithi115.ywbcks 2024-09-13T23:13:20.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:20 smithi152 ceph-mon[80164]: Deploying daemon mds.cephfs.smithi115.ywbcks on smithi115 2024-09-13T23:13:20.494 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2416862630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fc700 msgr2=0x7fb8580fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2416862630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fc700 0x7fb8580fcb70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0048d0 tx=0x7fb84c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2416862630 shutdown_connections 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2416862630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fc700 0x7fb8580fcb70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2416862630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fb430 0x7fb8580fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2416862630 >> 172.21.15.115:0/2416862630 conn(0x7fb8580f6c10 msgr2=0x7fb8580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2416862630 shutdown_connections 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2416862630 wait complete. 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.492+0000 7fb85e2ff640 1 Processor -- start 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb85e2ff640 1 -- start start 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb85e2ff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.495 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb85e2ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fc700 0x7fb858114710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb85e2ff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85810dc70 con 0x7fb8580fb430 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb85e2ff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb858065bd0 con 0x7fb8580fc700 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34074/0 (socket says 172.21.15.115:34074) 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 -- 172.21.15.115:0/2046655273 learned_addr learned my addr 172.21.15.115:0/2046655273 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb8577fe640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fc700 0x7fb858114710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 -- 172.21.15.115:0/2046655273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fc700 msgr2=0x7fb858114710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fc700 0x7fb858114710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 -- 172.21.15.115:0/2046655273 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c005040 con 0x7fb8580fb430 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.493+0000 7fb857fff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c790 tx=0x7fb8480043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.494+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84800a820 con 0x7fb8580fb430 2024-09-13T23:13:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.494+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb858065eb0 con 0x7fb8580fb430 2024-09-13T23:13:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.494+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb84800ae20 con 0x7fb8580fb430 2024-09-13T23:13:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.494+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8480113a0 con 0x7fb8580fb430 2024-09-13T23:13:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.494+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb858115010 con 0x7fb8580fb430 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.495+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8580fa890 con 0x7fb8580fb430 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.495+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb848012400 con 0x7fb8580fb430 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.496+0000 7fb854ff9640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 0x7fb8400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.496+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb84808e240 con 0x7fb8580fb430 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.496+0000 7fb8577fe640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 0x7fb8400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.496+0000 7fb8577fe640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 0x7fb8400709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007ac0 tx=0x7fb84c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:20.501 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.500+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb848057470 con 0x7fb8580fb430 2024-09-13T23:13:20.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.712+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb858100b10 con 0x7fb84006e530 2024-09-13T23:13:20.714 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.713+0000 7fb854ff9640 1 -- 172.21.15.115:0/2046655273 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb858100b10 con 0x7fb84006e530 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 msgr2=0x7fb8400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 0x7fb8400709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84c007ac0 tx=0x7fb84c035040 comp rx=0 tx=0).stop 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 msgr2=0x7fb8581121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c790 tx=0x7fb8480043c0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 shutdown_connections 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb84006e530 0x7fb8400709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8580fc700 0x7fb858114710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 --2- 172.21.15.115:0/2046655273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580fb430 0x7fb8581121c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.715+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 >> 172.21.15.115:0/2046655273 conn(0x7fb8580f6c10 msgr2=0x7fb8580f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.716+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 shutdown_connections 2024-09-13T23:13:20.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.716+0000 7fb85e2ff640 1 -- 172.21.15.115:0/2046655273 wait complete. 2024-09-13T23:13:20.725 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:13:20.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.795+0000 7f2fe8162640 1 -- 172.21.15.115:0/3364786342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 msgr2=0x7f2fe00fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.795+0000 7f2fe8162640 1 --2- 172.21.15.115:0/3364786342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe00fc980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc004a10 tx=0x7f2fdc009d40 comp rx=0 tx=0).stop 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- 172.21.15.115:0/3364786342 shutdown_connections 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 --2- 172.21.15.115:0/3364786342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 0x7f2fe00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 --2- 172.21.15.115:0/3364786342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe00fc980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- 172.21.15.115:0/3364786342 >> 172.21.15.115:0/3364786342 conn(0x7f2fe00f7d30 msgr2=0x7f2fe00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- 172.21.15.115:0/3364786342 shutdown_connections 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- 172.21.15.115:0/3364786342 wait complete. 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 Processor -- start 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- start start 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 0x7f2fe006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe0070080 con 0x7f2fe00fc570 2024-09-13T23:13:20.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.796+0000 7f2fe8162640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00701c0 con 0x7f2fe00fd840 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34090/0 (socket says 172.21.15.115:34090) 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 -- 172.21.15.115:0/2141241774 learned_addr learned my addr 172.21.15.115:0/2141241774 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe56fd640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 0x7f2fe006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 -- 172.21.15.115:0/2141241774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 msgr2=0x7f2fe006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 0x7f2fe006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.799 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 -- 172.21.15.115:0/2141241774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0045d0 con 0x7f2fe00fc570 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe5efe640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02d040 tx=0x7f2fdc009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc038070 con 0x7f2fe00fc570 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2fdc02adf0 con 0x7f2fe00fc570 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe0070440 con 0x7f2fe00fc570 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc03c920 con 0x7f2fe00fc570 2024-09-13T23:13:20.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.797+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe0115120 con 0x7f2fe00fc570 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.798+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe00fb9d0 con 0x7f2fe00fc570 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.799+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2fdc030020 con 0x7f2fe00fc570 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.799+0000 7f2fd67fc640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 0x7f2fcc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.799+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2fdc0ae260 con 0x7f2fe00fc570 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.799+0000 7f2fe56fd640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 0x7f2fcc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:20.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.800+0000 7f2fe56fd640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 0x7f2fcc0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009b50 tx=0x7f2fd0009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:20.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.804+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2fdc0774c0 con 0x7f2fe00fc570 2024-09-13T23:13:20.987 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.986+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fe0101c00 con 0x7f2fcc06e530 2024-09-13T23:13:20.988 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.987+0000 7f2fd67fc640 1 -- 172.21.15.115:0/2141241774 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2fe0101c00 con 0x7f2fcc06e530 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 msgr2=0x7f2fcc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 0x7f2fcc0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009b50 tx=0x7f2fd0009120 comp rx=0 tx=0).stop 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 msgr2=0x7f2fe0071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc02d040 tx=0x7f2fdc009d40 comp rx=0 tx=0).stop 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 shutdown_connections 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2fcc06e530 0x7f2fcc0709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fd840 0x7f2fe006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 --2- 172.21.15.115:0/2141241774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fe00fc570 0x7f2fe0071570 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 >> 172.21.15.115:0/2141241774 conn(0x7f2fe00f7d30 msgr2=0x7f2fe00f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 shutdown_connections 2024-09-13T23:13:20.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:20.990+0000 7f2fe8162640 1 -- 172.21.15.115:0/2141241774 wait complete. 2024-09-13T23:13:21.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- 172.21.15.115:0/61187293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 msgr2=0x7f44dc0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 --2- 172.21.15.115:0/61187293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc0fcbb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009c50 tx=0x7f44d0004d10 comp rx=0 tx=0).stop 2024-09-13T23:13:21.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- 172.21.15.115:0/61187293 shutdown_connections 2024-09-13T23:13:21.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 --2- 172.21.15.115:0/61187293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc0fcbb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 --2- 172.21.15.115:0/61187293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc0fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- 172.21.15.115:0/61187293 >> 172.21.15.115:0/61187293 conn(0x7f44dc0f6c30 msgr2=0x7f44dc0f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- 172.21.15.115:0/61187293 shutdown_connections 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- 172.21.15.115:0/61187293 wait complete. 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 Processor -- start 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.068+0000 7f44e4306640 1 -- start start 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e4306640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc10f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e4306640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e4306640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc10fe90 con 0x7f44dc0fc740 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e4306640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc1106b0 con 0x7f44dc0fb470 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34104/0 (socket says 172.21.15.115:34104) 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 -- 172.21.15.115:0/1472000581 learned_addr learned my addr 172.21.15.115:0/1472000581 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e20a2640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc10f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 -- 172.21.15.115:0/1472000581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 msgr2=0x7f44dc10f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc10f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 -- 172.21.15.115:0/1472000581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00098b0 con 0x7f44dc0fc740 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e20a2640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e18a1640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f44d0003400 tx=0x7f44d0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d0032850 con 0x7f44dc0fc740 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc1108e0 con 0x7f44dc0fc740 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44d0009710 con 0x7f44dc0fc740 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.069+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d003db50 con 0x7f44dc0fc740 2024-09-13T23:13:21.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.070+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc110e80 con 0x7f44dc0fc740 2024-09-13T23:13:21.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.070+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44dc0fa8d0 con 0x7f44dc0fc740 2024-09-13T23:13:21.073 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.071+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f44d002f030 con 0x7f44dc0fc740 2024-09-13T23:13:21.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.071+0000 7f44daffd640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 0x7f44c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.071+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f44d00af930 con 0x7f44dc0fc740 2024-09-13T23:13:21.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.072+0000 7f44e20a2640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 0x7f44c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.072+0000 7f44e20a2640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 0x7f44c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44d4004c60 tx=0x7f44d4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.076+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44d0078a20 con 0x7f44dc0fc740 2024-09-13T23:13:21.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.253+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44dc103fe0 con 0x7f44c406e530 2024-09-13T23:13:21.254 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:21 smithi115 ceph-mon[91340]: pgmap v182: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 0 op/s 2024-09-13T23:13:21.262 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.262+0000 7f44daffd640 1 -- 172.21.15.115:0/1472000581 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f44dc103fe0 con 0x7f44c406e530 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 2m ago 14m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (4m) 2m ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (4m) 51s ago 14m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 2m ago 14m 83.9M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (9m) 2m ago 9m 123M - 17.2.7-1629-geb16b97b ab51d1bebd12 9320516a3423 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (9m) 2m ago 9m 72.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 bc4950ea9198 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (9m) 51s ago 9m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:13:21.263 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (9m) 51s ago 9m 67.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (5m) 2m ago 15m 498M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (5m) 51s ago 13m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (5m) 2m ago 16m 45.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (4m) 51s ago 13m 43.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 2m ago 14m 16.1M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 51s ago 13m 16.5M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (3m) 2m ago 13m 97.8M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (3m) 2m ago 12m 93.3M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (2m) 2m ago 12m 11.5M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (119s) 51s ago 11m 104M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (87s) 51s ago 11m 95.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (55s) 51s ago 10m 12.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:13:21.264 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 2m ago 14m 62.5M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:13:21.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 msgr2=0x7f44c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 0x7f44c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44d4004c60 tx=0x7f44d4009040 comp rx=0 tx=0).stop 2024-09-13T23:13:21.265 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 msgr2=0x7f44dc10f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f44d0003400 tx=0x7f44d0004d10 comp rx=0 tx=0).stop 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 shutdown_connections 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f44c406e530 0x7f44c40709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44dc0fc740 0x7f44dc10f840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 --2- 172.21.15.115:0/1472000581 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44dc0fb470 0x7f44dc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.264+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 >> 172.21.15.115:0/1472000581 conn(0x7f44dc0f6c30 msgr2=0x7f44dc066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.265+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 shutdown_connections 2024-09-13T23:13:21.266 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.265+0000 7f44e4306640 1 -- 172.21.15.115:0/1472000581 wait complete. 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- 172.21.15.115:0/3291755795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 msgr2=0x7f67880fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3291755795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f67880fdc90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f677c0048d0 tx=0x7f677c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- 172.21.15.115:0/3291755795 shutdown_connections 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3291755795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f67880fdc90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3291755795 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 0x7f67880fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- 172.21.15.115:0/3291755795 >> 172.21.15.115:0/3291755795 conn(0x7f67880f7d30 msgr2=0x7f67880fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- 172.21.15.115:0/3291755795 shutdown_connections 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- 172.21.15.115:0/3291755795 wait complete. 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 Processor -- start 2024-09-13T23:13:21.344 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.342+0000 7f678f4a0640 1 -- start start 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678f4a0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 0x7f678810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678f4a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678f4a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678810dc20 con 0x7f67880fd820 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678f4a0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678810e440 con 0x7f67880fc550 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34118/0 (socket says 172.21.15.115:34118) 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 -- 172.21.15.115:0/3724301252 learned_addr learned my addr 172.21.15.115:0/3724301252 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678d23c640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 0x7f678810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 -- 172.21.15.115:0/3724301252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 msgr2=0x7f678810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 0x7f678810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 -- 172.21.15.115:0/3724301252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c005040 con 0x7f67880fd820 2024-09-13T23:13:21.345 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678ca3b640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f677c0043d0 tx=0x7f677c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c038070 con 0x7f67880fd820 2024-09-13T23:13:21.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f677c02ae90 con 0x7f67880fd820 2024-09-13T23:13:21.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c03e670 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.343+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678810e670 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.344+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678810ec10 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.345+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67880fb9b0 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.345+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f677c030020 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.346+0000 7f6785ffb640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 0x7f67700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.346+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f677c0ae280 con 0x7f67880fd820 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.346+0000 7f678d23c640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 0x7f67700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.347 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.346+0000 7f678d23c640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 0x7f67700709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6780004eb0 tx=0x7f678000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.350+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f677c0774a0 con 0x7f67880fd820 2024-09-13T23:13:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:21 smithi152 ceph-mon[80164]: pgmap v182: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 341 B/s wr, 0 op/s 2024-09-13T23:13:21.586 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.586+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f678804b720 con 0x7f67880fd820 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.586+0000 7f6785ffb640 1 -- 172.21.15.115:0/3724301252 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f677c07ab60 con 0x7f67880fd820 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:21.587 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 3 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 3, 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 10 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:13:21.588 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 msgr2=0x7f67700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 0x7f67700709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6780004eb0 tx=0x7f678000b040 comp rx=0 tx=0).stop 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 msgr2=0x7f678810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f677c0043d0 tx=0x7f677c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 shutdown_connections 2024-09-13T23:13:21.589 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f677006e530 0x7f67700709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67880fd820 0x7f678810d5d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 --2- 172.21.15.115:0/3724301252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67880fc550 0x7f678810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.588+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 >> 172.21.15.115:0/3724301252 conn(0x7f67880f7d30 msgr2=0x7f67880f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.589+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 shutdown_connections 2024-09-13T23:13:21.590 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.589+0000 7f678f4a0640 1 -- 172.21.15.115:0/3724301252 wait complete. 2024-09-13T23:13:21.669 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.666+0000 7f01b0a67640 1 -- 172.21.15.115:0/1308035684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fc700 msgr2=0x7f01ac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.666+0000 7f01b0a67640 1 --2- 172.21.15.115:0/1308035684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fc700 0x7f01ac0fcb70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01a00048d0 tx=0x7f01a0009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- 172.21.15.115:0/1308035684 shutdown_connections 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 --2- 172.21.15.115:0/1308035684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fc700 0x7f01ac0fcb70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 --2- 172.21.15.115:0/1308035684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fb430 0x7f01ac0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- 172.21.15.115:0/1308035684 >> 172.21.15.115:0/1308035684 conn(0x7f01ac0f6c10 msgr2=0x7f01ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- 172.21.15.115:0/1308035684 shutdown_connections 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- 172.21.15.115:0/1308035684 wait complete. 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 Processor -- start 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- start start 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fc700 0x7f01ac10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.670 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac10cb10 con 0x7f01ac0fb430 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01b0a67640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac10d330 con 0x7f01ac0fc700 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01aa59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01aa59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34146/0 (socket says 172.21.15.115:34146) 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.667+0000 7f01aa59c640 1 -- 172.21.15.115:0/300136883 learned_addr learned my addr 172.21.15.115:0/300136883 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01a9d9b640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fc700 0x7f01ac10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01aa59c640 1 -- 172.21.15.115:0/300136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fc700 msgr2=0x7f01ac10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01aa59c640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fc700 0x7f01ac10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.671 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01aa59c640 1 -- 172.21.15.115:0/300136883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0005040 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01aa59c640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f019c00fce0 tx=0x7f019c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019c00de30 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f019c0090d0 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac10d560 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019c0126a0 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.668+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac10db00 con 0x7f01ac0fb430 2024-09-13T23:13:21.672 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.669+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac0fa890 con 0x7f01ac0fb430 2024-09-13T23:13:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.670+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f019c009240 con 0x7f01ac0fb430 2024-09-13T23:13:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.670+0000 7f019affd640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 0x7f01940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.673 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.670+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f019c0906a0 con 0x7f01ac0fb430 2024-09-13T23:13:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.670+0000 7f01a9d9b640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 0x7f01940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.674 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.670+0000 7f01a9d9b640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 0x7f01940709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01ac10bd30 tx=0x7f01a0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.675 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.674+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f019c059840 con 0x7f01ac0fb430 2024-09-13T23:13:21.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.876+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f01ac04b720 con 0x7f01ac0fb430 2024-09-13T23:13:21.877 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.876+0000 7f019affd640 1 -- 172.21.15.115:0/300136883 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1747 (secure 0 0 0) 0x7f019c05cf00 con 0x7f01ac0fb430 2024-09-13T23:13:21.877 INFO:teuthology.orchestra.run.smithi115.stdout:e30 2024-09-13T23:13:21.877 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:13:21:204879+0000 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 28 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:13:15.466949+0000 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:13:21.878 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 0 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=14464} 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 1 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:13:21.879 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 14464 members: 14464 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.115:6828/62115484,v1:172.21.15.115:6829/62115484] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/135789338,v1:172.21.15.152:6827/135789338] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:13:21.880 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{-1:44289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/311722183,v1:172.21.15.152:6825/311722183] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:13:21.881 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 30 2024-09-13T23:13:21.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 msgr2=0x7f01940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 0x7f01940709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01ac10bd30 tx=0x7f01a0035040 comp rx=0 tx=0).stop 2024-09-13T23:13:21.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 msgr2=0x7f01ac10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.881 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f019c00fce0 tx=0x7f019c004600 comp rx=0 tx=0).stop 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 shutdown_connections 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f019406e530 0x7f01940709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f01ac0fc700 0x7f01ac10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 --2- 172.21.15.115:0/300136883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01ac0fb430 0x7f01ac10bf80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.879+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 >> 172.21.15.115:0/300136883 conn(0x7f01ac0f6c10 msgr2=0x7f01ac0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.880+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 shutdown_connections 2024-09-13T23:13:21.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.880+0000 7f01b0a67640 1 -- 172.21.15.115:0/300136883 wait complete. 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 -- 172.21.15.115:0/3664899106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 msgr2=0x7fd12c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3664899106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c101a60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1200048d0 tx=0x7fd120009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 -- 172.21.15.115:0/3664899106 shutdown_connections 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3664899106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c101a60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3664899106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 0x7fd12c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.958+0000 7fd1336c3640 1 -- 172.21.15.115:0/3664899106 >> 172.21.15.115:0/3664899106 conn(0x7fd12c0f6c10 msgr2=0x7fd12c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 -- 172.21.15.115:0/3664899106 shutdown_connections 2024-09-13T23:13:21.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 -- 172.21.15.115:0/3664899106 wait complete. 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 Processor -- start 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 -- start start 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 0x7fd12c10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c10dc00 con 0x7fd12c0ff680 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd1336c3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c10e420 con 0x7fd12c065c40 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd130c5e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd130c5e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34168/0 (socket says 172.21.15.115:34168) 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.959+0000 7fd130c5e640 1 -- 172.21.15.115:0/3199236727 learned_addr learned my addr 172.21.15.115:0/3199236727 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd13145f640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 0x7fd12c10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd130c5e640 1 -- 172.21.15.115:0/3199236727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 msgr2=0x7fd12c10d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd130c5e640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 0x7fd12c10d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:21.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd130c5e640 1 -- 172.21.15.115:0/3199236727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120005040 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd130c5e640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1200043d0 tx=0x7fd120009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd120038070 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c10e650 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd12002ae90 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd12003e670 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.960+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c10ebf0 con 0x7fd12c0ff680 2024-09-13T23:13:21.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.961+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c0fa890 con 0x7fd12c0ff680 2024-09-13T23:13:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.962+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd120030020 con 0x7fd12c0ff680 2024-09-13T23:13:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.962+0000 7fd129ffb640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 0x7fd1140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.962+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1200ae3e0 con 0x7fd12c0ff680 2024-09-13T23:13:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.962+0000 7fd13145f640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 0x7fd1140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:21.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.963+0000 7fd13145f640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 0x7fd1140709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0659a0 tx=0x7fd11c004d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:21.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:21.967+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd1200774d0 con 0x7fd12c0ff680 2024-09-13T23:13:22.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.152+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd12c10ef40 con 0x7fd11406e530 2024-09-13T23:13:22.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.153+0000 7fd129ffb640 1 -- 172.21.15.115:0/3199236727 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd12c10ef40 con 0x7fd11406e530 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:13:22.154 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T23:13:22.155 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T23:13:22.155 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:13:22.155 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:13:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 msgr2=0x7fd1140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 0x7fd1140709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0659a0 tx=0x7fd11c004d00 comp rx=0 tx=0).stop 2024-09-13T23:13:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 msgr2=0x7fd12c10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd1200043d0 tx=0x7fd120009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 shutdown_connections 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd11406e530 0x7fd1140709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd12c0ff680 0x7fd12c10d5b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 --2- 172.21.15.115:0/3199236727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd12c065c40 0x7fd12c10d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.155+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 >> 172.21.15.115:0/3199236727 conn(0x7fd12c0f6c10 msgr2=0x7fd12c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.156+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 shutdown_connections 2024-09-13T23:13:22.157 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.156+0000 7fd1336c3640 1 -- 172.21.15.115:0/3199236727 wait complete. 2024-09-13T23:13:22.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 -- 172.21.15.115:0/742086987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fd820 msgr2=0x7ff0100fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 --2- 172.21.15.115:0/742086987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fd820 0x7ff0100fdc90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0048d0 tx=0x7ff00c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.236 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 -- 172.21.15.115:0/742086987 shutdown_connections 2024-09-13T23:13:22.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 --2- 172.21.15.115:0/742086987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fd820 0x7ff0100fdc90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 --2- 172.21.15.115:0/742086987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fc550 0x7ff0100fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 -- 172.21.15.115:0/742086987 >> 172.21.15.115:0/742086987 conn(0x7ff0100f7d30 msgr2=0x7ff0100fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:22.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 -- 172.21.15.115:0/742086987 shutdown_connections 2024-09-13T23:13:22.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.235+0000 7ff01785b640 1 -- 172.21.15.115:0/742086987 wait complete. 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 Processor -- start 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 -- start start 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fd820 0x7ff01010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01010dc00 con 0x7ff0100fc550 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff01785b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01010e420 con 0x7ff0100fd820 2024-09-13T23:13:22.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:34188/0 (socket says 172.21.15.115:34188) 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 -- 172.21.15.115:0/329147208 learned_addr learned my addr 172.21.15.115:0/329147208 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff014df6640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fd820 0x7ff01010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 -- 172.21.15.115:0/329147208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fd820 msgr2=0x7ff01010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fd820 0x7ff01010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.236+0000 7ff0155f7640 1 -- 172.21.15.115:0/329147208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c005040 con 0x7ff0100fc550 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff0155f7640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c830 tx=0x7ff000004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff00000a7d0 con 0x7ff0100fc550 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff00000add0 con 0x7ff0100fc550 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01010e6b0 con 0x7ff0100fc550 2024-09-13T23:13:22.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0000113a0 con 0x7ff0100fc550 2024-09-13T23:13:22.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.237+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01010ec50 con 0x7ff0100fc550 2024-09-13T23:13:22.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.238+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100fb9b0 con 0x7ff0100fc550 2024-09-13T23:13:22.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.238+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff000012400 con 0x7ff0100fc550 2024-09-13T23:13:22.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.239+0000 7ff005ffb640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:22.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.239+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff00008e330 con 0x7ff0100fc550 2024-09-13T23:13:22.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.239+0000 7ff014df6640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:22.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.239+0000 7ff014df6640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 0x7feffc0709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff00c004540 tx=0x7ff00c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:22.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.243+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff0000574a0 con 0x7ff0100fc550 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3724301252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:22.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:22 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/300136883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:13:22.476 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.475+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff01004b720 con 0x7ff0100fc550 2024-09-13T23:13:22.476 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:22.476 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:22.476 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T23:13:22.476 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:13:22.476 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:13:22.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3724301252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:22.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:22 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/300136883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:13:22.477 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.476+0000 7ff005ffb640 1 -- 172.21.15.115:0/329147208 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff00005ab60 con 0x7ff0100fc550 2024-09-13T23:13:22.477 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:13:22.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 msgr2=0x7feffc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 0x7feffc0709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff00c004540 tx=0x7ff00c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 msgr2=0x7ff01010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c830 tx=0x7ff000004430 comp rx=0 tx=0).stop 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 shutdown_connections 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.478+0000 7ff01785b640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.479+0000 7ff01785b640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0100fd820 0x7ff01010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.479+0000 7ff01785b640 1 --2- 172.21.15.115:0/329147208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0100fc550 0x7ff01010d070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.479+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 >> 172.21.15.115:0/329147208 conn(0x7ff0100f7d30 msgr2=0x7ff0100f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.479+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 shutdown_connections 2024-09-13T23:13:22.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:22.479+0000 7ff01785b640 1 -- 172.21.15.115:0/329147208 wait complete. 2024-09-13T23:13:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:23 smithi152 ceph-mon[80164]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:23 smithi152 ceph-mon[80164]: pgmap v184: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2024-09-13T23:13:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:23 smithi152 ceph-mon[80164]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:23 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/329147208' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:13:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:23 smithi115 ceph-mon[91340]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:23 smithi115 ceph-mon[91340]: pgmap v184: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2024-09-13T23:13:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:23 smithi115 ceph-mon[91340]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:23 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/329147208' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:13:24.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:25.543 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:25 smithi115 ceph-mon[91340]: pgmap v185: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2024-09-13T23:13:25.543 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:25.543 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:25.543 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:25 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:25 smithi152 ceph-mon[80164]: pgmap v185: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 204 B/s wr, 0 op/s 2024-09-13T23:13:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:25 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:26.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:26 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:boot 2024-09-13T23:13:26.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:26 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 3 up:standby 2024-09-13T23:13:26.313 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:26 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:13:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:26 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:boot 2024-09-13T23:13:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:26 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.vlvabd=up:active} 3 up:standby 2024-09-13T23:13:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:26 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:13:27.502 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:27 smithi115 ceph-mon[91340]: pgmap v186: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:27 smithi152 ceph-mon[80164]: pgmap v186: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:28 smithi115 ceph-mon[91340]: pgmap v187: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:28.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:28 smithi152 ceph-mon[80164]: pgmap v187: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:31.295 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.295 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.295 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:31 smithi115 ceph-mon[91340]: pgmap v188: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:31.296 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.296 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:31 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:31 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:31 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:31 smithi152 ceph-mon[80164]: pgmap v188: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:31 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:31.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:31 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:33 smithi152 ceph-mon[80164]: pgmap v189: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:33.489 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:33 smithi115 ceph-mon[91340]: pgmap v189: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:34.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: Detected new or changed devices on smithi115 2024-09-13T23:13:34.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:34.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:34.921 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.vlvabd"]}]: dispatch 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: Upgrade: It appears safe to stop mds.cephfs.smithi115.vlvabd 2024-09-13T23:13:34.922 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:34 smithi115 ceph-mon[91340]: pgmap v190: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:35.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: Detected new or changed devices on smithi115 2024-09-13T23:13:35.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:35.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.vlvabd"]}]: dispatch 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: Upgrade: It appears safe to stop mds.cephfs.smithi115.vlvabd 2024-09-13T23:13:35.219 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:34 smithi152 ceph-mon[80164]: pgmap v190: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: Upgrade: Updating mds.cephfs.smithi115.vlvabd 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: Deploying daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:13:36.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:36 smithi115 ceph-mon[91340]: pgmap v191: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:36.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: Upgrade: Updating mds.cephfs.smithi115.vlvabd 2024-09-13T23:13:36.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:36.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.vlvabd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:36.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:36.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: Deploying daemon mds.cephfs.smithi115.vlvabd on smithi115 2024-09-13T23:13:36.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:36 smithi152 ceph-mon[80164]: pgmap v191: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:13:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[91336]: 2024-09-13T23:13:37.199+0000 7ff98610d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:13:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:13:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:13:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T23:13:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: Standby daemon mds.cephfs.smithi115.ywbcks assigned to filesystem cephfs as rank 0 2024-09-13T23:13:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:13:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:13:37.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:37 smithi115 ceph-mon[91340]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:replay} 2 up:standby 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: Standby daemon mds.cephfs.smithi115.ywbcks assigned to filesystem cephfs as rank 0 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:13:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:37 smithi152 ceph-mon[80164]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:replay} 2 up:standby 2024-09-13T23:13:38.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:38 smithi115 ceph-mon[91340]: pgmap v193: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-09-13T23:13:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:38 smithi152 ceph-mon[80164]: pgmap v193: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-09-13T23:13:40.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:40 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:40.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:40 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:40.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:40 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:40.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:40 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:41 smithi152 ceph-mon[80164]: pgmap v194: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-13T23:13:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:41 smithi115 ceph-mon[91340]: pgmap v194: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-09-13T23:13:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:43 smithi152 ceph-mon[80164]: pgmap v195: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-13T23:13:43.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:43 smithi115 ceph-mon[91340]: pgmap v195: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-13T23:13:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:45 smithi152 ceph-mon[80164]: pgmap v196: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T23:13:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:45 smithi152 ceph-mon[80164]: reconnect by client.14496 v1:192.168.0.1:0/1701520229 after 0 2024-09-13T23:13:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:45 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:reconnect 2024-09-13T23:13:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:45 smithi152 ceph-mon[80164]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:reconnect} 2 up:standby 2024-09-13T23:13:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:45 smithi152 ceph-mon[80164]: reconnect by client.24289 v1:192.168.0.1:0/2880520886 after 0.00699987 2024-09-13T23:13:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:45 smithi115 ceph-mon[91340]: pgmap v196: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-13T23:13:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:45 smithi115 ceph-mon[91340]: reconnect by client.14496 v1:192.168.0.1:0/1701520229 after 0 2024-09-13T23:13:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:45 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:reconnect 2024-09-13T23:13:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:45 smithi115 ceph-mon[91340]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:reconnect} 2 up:standby 2024-09-13T23:13:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:45 smithi115 ceph-mon[91340]: reconnect by client.24289 v1:192.168.0.1:0/2880520886 after 0.00699987 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:rejoin 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:rejoin} 2 up:standby 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: daemon mds.cephfs.smithi115.ywbcks is now active in filesystem cephfs as rank 0 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:46.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:rejoin 2024-09-13T23:13:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: fsmap cephfs:1/1 {0=cephfs.smithi115.ywbcks=up:rejoin} 2 up:standby 2024-09-13T23:13:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: daemon mds.cephfs.smithi115.ywbcks is now active in filesystem cephfs as rank 0 2024-09-13T23:13:46.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:46.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:46.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: pgmap v197: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 204 B/s wr, 5 op/s 2024-09-13T23:13:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:13:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: Cluster is now healthy 2024-09-13T23:13:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] up:boot 2024-09-13T23:13:47.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:active 2024-09-13T23:13:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:13:47.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:47 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:13:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: pgmap v197: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 204 B/s wr, 5 op/s 2024-09-13T23:13:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:13:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: Cluster is now healthy 2024-09-13T23:13:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] up:boot 2024-09-13T23:13:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] up:active 2024-09-13T23:13:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:13:47.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:47 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:13:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:49 smithi152 ceph-mon[80164]: pgmap v198: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 187 B/s wr, 5 op/s 2024-09-13T23:13:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:49 smithi115 ceph-mon[91340]: pgmap v198: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 187 B/s wr, 5 op/s 2024-09-13T23:13:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:51 smithi152 ceph-mon[80164]: pgmap v199: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T23:13:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:51 smithi115 ceph-mon[91340]: pgmap v199: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 -- 172.21.15.115:0/741606811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fdbb0 msgr2=0x7fd7640fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 --2- 172.21.15.115:0/741606811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fdbb0 0x7fd7640fdfc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0048d0 tx=0x7fd75c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 -- 172.21.15.115:0/741606811 shutdown_connections 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 --2- 172.21.15.115:0/741606811 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fe500 0x7fd7640fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 --2- 172.21.15.115:0/741606811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fdbb0 0x7fd7640fdfc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 -- 172.21.15.115:0/741606811 >> 172.21.15.115:0/741606811 conn(0x7fd7640f63b0 msgr2=0x7fd7640f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 -- 172.21.15.115:0/741606811 shutdown_connections 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.561+0000 7fd7694f6640 1 -- 172.21.15.115:0/741606811 wait complete. 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 Processor -- start 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 -- start start 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fdbb0 0x7fd76410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76410dc30 con 0x7fd7640fe500 2024-09-13T23:13:52.566 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7694f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76410e450 con 0x7fd7640fdbb0 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41570/0 (socket says 172.21.15.115:41570) 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 -- 172.21.15.115:0/1742968365 learned_addr learned my addr 172.21.15.115:0/1742968365 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 -- 172.21.15.115:0/1742968365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fdbb0 msgr2=0x7fd76410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd762ffd640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fdbb0 0x7fd76410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fdbb0 0x7fd76410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 -- 172.21.15.115:0/1742968365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c005040 con 0x7fd7640fe500 2024-09-13T23:13:52.567 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.562+0000 7fd7627fc640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00cae0 tx=0x7fd74c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.563+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74c00a9d0 con 0x7fd7640fe500 2024-09-13T23:13:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.563+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd74c012440 con 0x7fd7640fe500 2024-09-13T23:13:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.563+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76410e6e0 con 0x7fd7640fe500 2024-09-13T23:13:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.563+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd74c0115e0 con 0x7fd7640fe500 2024-09-13T23:13:52.568 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.563+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76410ec80 con 0x7fd7640fe500 2024-09-13T23:13:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.564+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640fa050 con 0x7fd7640fe500 2024-09-13T23:13:52.569 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.564+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fd74c0125b0 con 0x7fd7640fe500 2024-09-13T23:13:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.565+0000 7fd75b7fe640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 0x7fd7500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.565+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd74c08e940 con 0x7fd7640fe500 2024-09-13T23:13:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.565+0000 7fd762ffd640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 0x7fd7500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.570 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.565+0000 7fd762ffd640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 0x7fd7500709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:52.571 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.570+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd74c057a50 con 0x7fd7640fe500 2024-09-13T23:13:52.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.757+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd76410f000 con 0x7fd75006e530 2024-09-13T23:13:52.759 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.758+0000 7fd75b7fe640 1 -- 172.21.15.115:0/1742968365 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd76410f000 con 0x7fd75006e530 2024-09-13T23:13:52.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 msgr2=0x7fd7500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 0x7fd7500709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd75c000c00 tx=0x7fd75c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.761 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 msgr2=0x7fd76410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00cae0 tx=0x7fd74c007eb0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 shutdown_connections 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fd75006e530 0x7fd7500709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7640fe500 0x7fd76410d5e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 --2- 172.21.15.115:0/1742968365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7640fdbb0 0x7fd76410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.760+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 >> 172.21.15.115:0/1742968365 conn(0x7fd7640f63b0 msgr2=0x7fd7640f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.761+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 shutdown_connections 2024-09-13T23:13:52.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.761+0000 7fd7694f6640 1 -- 172.21.15.115:0/1742968365 wait complete. 2024-09-13T23:13:52.770 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 -- 172.21.15.115:0/3761149150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 msgr2=0x7fe98c0fb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 --2- 172.21.15.115:0/3761149150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c0fb000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0048d0 tx=0x7fe97c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 -- 172.21.15.115:0/3761149150 shutdown_connections 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 --2- 172.21.15.115:0/3761149150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c0fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 --2- 172.21.15.115:0/3761149150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c0fb000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.840+0000 7fe99188d640 1 -- 172.21.15.115:0/3761149150 >> 172.21.15.115:0/3761149150 conn(0x7fe98c0f63b0 msgr2=0x7fe98c0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.841+0000 7fe99188d640 1 -- 172.21.15.115:0/3761149150 shutdown_connections 2024-09-13T23:13:52.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.841+0000 7fe99188d640 1 -- 172.21.15.115:0/3761149150 wait complete. 2024-09-13T23:13:52.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.841+0000 7fe99188d640 1 Processor -- start 2024-09-13T23:13:52.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.841+0000 7fe99188d640 1 -- start start 2024-09-13T23:13:52.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe99188d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe99188d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c10c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe99188d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c10d3d0 con 0x7fe98c0fabf0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe99188d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c10d540 con 0x7fe98c0fbec0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41594/0 (socket says 172.21.15.115:41594) 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 -- 172.21.15.115:0/2142473168 learned_addr learned my addr 172.21.15.115:0/2142473168 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98a7fc640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c10c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 -- 172.21.15.115:0/2142473168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 msgr2=0x7fe98c10c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c10c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 -- 172.21.15.115:0/2142473168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c005040 con 0x7fe98c0fabf0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98a7fc640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c10c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe98affd640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0048a0 tx=0x7fe97c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c03a070 con 0x7fe98c0fabf0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe97c03faa0 con 0x7fe98c0fabf0 2024-09-13T23:13:52.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c10d7c0 con 0x7fe98c0fabf0 2024-09-13T23:13:52.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.842+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe97c033a60 con 0x7fe98c0fabf0 2024-09-13T23:13:52.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.843+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c10dc80 con 0x7fe98c0fabf0 2024-09-13T23:13:52.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.844+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c103e80 con 0x7fe98c0fabf0 2024-09-13T23:13:52.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.844+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fe97c030020 con 0x7fe98c0fabf0 2024-09-13T23:13:52.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.845+0000 7fe9737fe640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 0x7fe9740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:52.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.845+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe97c0b0b50 con 0x7fe98c0fabf0 2024-09-13T23:13:52.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.845+0000 7fe98a7fc640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 0x7fe9740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:52.847 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.845+0000 7fe98a7fc640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 0x7fe9740709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe980006fd0 tx=0x7fe980008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:52.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:52.849+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe97c079c60 con 0x7fe98c0fabf0 2024-09-13T23:13:53.047 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.046+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe98c10def0 con 0x7fe97406e530 2024-09-13T23:13:53.048 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.047+0000 7fe9737fe640 1 -- 172.21.15.115:0/2142473168 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe98c10def0 con 0x7fe97406e530 2024-09-13T23:13:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 msgr2=0x7fe9740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 0x7fe9740709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe980006fd0 tx=0x7fe980008040 comp rx=0 tx=0).stop 2024-09-13T23:13:53.050 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 msgr2=0x7fe98c10c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0048a0 tx=0x7fe97c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 shutdown_connections 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fe97406e530 0x7fe9740709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c0fbec0 0x7fe98c10c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 --2- 172.21.15.115:0/2142473168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe98c0fabf0 0x7fe98c10c020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.049+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 >> 172.21.15.115:0/2142473168 conn(0x7fe98c0f63b0 msgr2=0x7fe98c0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.050+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 shutdown_connections 2024-09-13T23:13:53.051 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.050+0000 7fe99188d640 1 -- 172.21.15.115:0/2142473168 wait complete. 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.134+0000 7fa13d359640 1 -- 172.21.15.115:0/1274584668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fe510 msgr2=0x7fa1380fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.134+0000 7fa13d359640 1 --2- 172.21.15.115:0/1274584668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fe510 0x7fa1380fa670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0048d0 tx=0x7fa12c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 -- 172.21.15.115:0/1274584668 shutdown_connections 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 --2- 172.21.15.115:0/1274584668 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fe510 0x7fa1380fa670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 --2- 172.21.15.115:0/1274584668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fdbc0 0x7fa1380fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 -- 172.21.15.115:0/1274584668 >> 172.21.15.115:0/1274584668 conn(0x7fa1380f63c0 msgr2=0x7fa1380f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 -- 172.21.15.115:0/1274584668 shutdown_connections 2024-09-13T23:13:53.136 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 -- 172.21.15.115:0/1274584668 wait complete. 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.135+0000 7fa13d359640 1 Processor -- start 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa13d359640 1 -- start start 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa13d359640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa13d359640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fe510 0x7fa13810f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa13d359640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138110740 con 0x7fa1380fdbc0 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa13d359640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381108b0 con 0x7fa1380fe510 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41618/0 (socket says 172.21.15.115:41618) 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 -- 172.21.15.115:0/2342033881 learned_addr learned my addr 172.21.15.115:0/2342033881 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:53.138 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa1367fc640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fe510 0x7fa13810f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 -- 172.21.15.115:0/2342033881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fe510 msgr2=0x7fa13810f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fe510 0x7fa13810f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.136+0000 7fa136ffd640 1 -- 172.21.15.115:0/2342033881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c005040 con 0x7fa1380fdbc0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa136ffd640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b790 tx=0x7fa1280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa12800c700 con 0x7fa1380fdbc0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa12800cd00 con 0x7fa1380fdbc0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa128015e70 con 0x7fa1380fdbc0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa138110b90 con 0x7fa1380fdbc0 2024-09-13T23:13:53.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.137+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa138111000 con 0x7fa1380fdbc0 2024-09-13T23:13:53.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.138+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138105820 con 0x7fa1380fdbc0 2024-09-13T23:13:53.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.138+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fa128012070 con 0x7fa1380fdbc0 2024-09-13T23:13:53.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.139+0000 7fa11f7fe640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 0x7fa1200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.139+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa12808dce0 con 0x7fa1380fdbc0 2024-09-13T23:13:53.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.139+0000 7fa1367fc640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 0x7fa1200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.141 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.140+0000 7fa1367fc640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 0x7fa1200709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa13810f140 tx=0x7fa12c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.144+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa128056df0 con 0x7fa1380fdbc0 2024-09-13T23:13:53.337 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.336+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1381113a0 con 0x7fa12006e530 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.345+0000 7fa11f7fe640 1 -- 172.21.15.115:0/2342033881 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa1381113a0 con 0x7fa12006e530 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (6m) 0s ago 15m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (4m) 0s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (4m) 84s ago 14m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:13:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (6m) 0s ago 15m 84.0M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (8s) 0s ago 9m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 1036e851db03 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (28s) 0s ago 10m 141M - 19.1.1-324-gecab7be5 0652ff2b5d78 b3c2cd84ec81 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (9m) 84s ago 9m 113M - 17.2.7-1629-geb16b97b ab51d1bebd12 3e5b4d8ac342 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (9m) 84s ago 9m 67.6M - 17.2.7-1629-geb16b97b ab51d1bebd12 da80f04eeba8 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (6m) 0s ago 16m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (5m) 84s ago 14m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (5m) 0s ago 16m 50.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (5m) 84s ago 14m 43.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 0s ago 15m 16.3M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 84s ago 14m 16.5M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 0s ago 13m 109M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:13:53.347 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (3m) 0s ago 13m 105M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:13:53.348 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 0s ago 12m 89.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:13:53.348 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (2m) 84s ago 12m 104M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:13:53.348 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (2m) 84s ago 11m 95.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:13:53.348 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (87s) 84s ago 11m 12.1M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:13:53.348 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (5m) 0s ago 14m 64.6M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:13:53.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.348+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 msgr2=0x7fa1200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.348+0000 7fa13d359640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 0x7fa1200709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa13810f140 tx=0x7fa12c035040 comp rx=0 tx=0).stop 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.348+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 msgr2=0x7fa13810f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.348+0000 7fa13d359640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b790 tx=0x7fa1280091d0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 shutdown_connections 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fa12006e530 0x7fa1200709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1380fe510 0x7fa13810f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 --2- 172.21.15.115:0/2342033881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa1380fdbc0 0x7fa13810f390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 >> 172.21.15.115:0/2342033881 conn(0x7fa1380f63c0 msgr2=0x7fa1380f7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 shutdown_connections 2024-09-13T23:13:53.350 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.349+0000 7fa13d359640 1 -- 172.21.15.115:0/2342033881 wait complete. 2024-09-13T23:13:53.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:53 smithi115 ceph-mon[91340]: pgmap v200: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-13T23:13:53.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:53.420 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:53 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:53.436 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 -- 172.21.15.115:0/2922826889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 msgr2=0x7fb5940fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 --2- 172.21.15.115:0/2922826889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb5940fcb70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb5880048d0 tx=0x7fb588009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 -- 172.21.15.115:0/2922826889 shutdown_connections 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 --2- 172.21.15.115:0/2922826889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb5940fcb70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 --2- 172.21.15.115:0/2922826889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 0x7fb5940fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 -- 172.21.15.115:0/2922826889 >> 172.21.15.115:0/2922826889 conn(0x7fb5940f6c10 msgr2=0x7fb5940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 -- 172.21.15.115:0/2922826889 shutdown_connections 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.435+0000 7fb599d5a640 1 -- 172.21.15.115:0/2922826889 wait complete. 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 Processor -- start 2024-09-13T23:13:53.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 -- start start 2024-09-13T23:13:53.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 0x7fb59410ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59410b920 con 0x7fb5940fc700 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb599d5a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594111440 con 0x7fb5940fb430 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb592ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb592ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41630/0 (socket says 172.21.15.115:41630) 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.436+0000 7fb592ffd640 1 -- 172.21.15.115:0/4067150127 learned_addr learned my addr 172.21.15.115:0/4067150127 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb5937fe640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 0x7fb59410ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb592ffd640 1 -- 172.21.15.115:0/4067150127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 msgr2=0x7fb59410ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.439 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb592ffd640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 0x7fb59410ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb592ffd640 1 -- 172.21.15.115:0/4067150127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588005040 con 0x7fb5940fc700 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb592ffd640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb588003080 tx=0x7fb588009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb588038070 con 0x7fb5940fc700 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb58802abd0 con 0x7fb5940fc700 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb58803e670 con 0x7fb5940fc700 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5941116c0 con 0x7fb5940fc700 2024-09-13T23:13:53.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.437+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594111c60 con 0x7fb5940fc700 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.439+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940fa890 con 0x7fb5940fc700 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.439+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb588030020 con 0x7fb5940fc700 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.439+0000 7fb57bfff640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 0x7fb57c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.439+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb5880ae500 con 0x7fb5940fc700 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.439+0000 7fb5937fe640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 0x7fb57c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.440+0000 7fb5937fe640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 0x7fb57c0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb59410ab90 tx=0x7fb584009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.448+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb588077610 con 0x7fb5940fc700 2024-09-13T23:13:53.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:53 smithi152 ceph-mon[80164]: pgmap v200: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-13T23:13:53.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:53.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:53 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:53.732 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.731+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb594103e30 con 0x7fb5940fc700 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.732+0000 7fb57bfff640 1 -- 172.21.15.115:0/4067150127 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fb58807acd0 con 0x7fb5940fc700 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:53.733 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 17.2.7-1629-geb16b97b (eb16b97b08b1a378bbb6cbc2dadc21f07d8ac10b) quincy (stable)": 2, 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 12 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:13:53.734 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:13:53.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 msgr2=0x7fb57c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 0x7fb57c0709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb59410ab90 tx=0x7fb584009040 comp rx=0 tx=0).stop 2024-09-13T23:13:53.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 msgr2=0x7fb59410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb588003080 tx=0x7fb588009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 shutdown_connections 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb57c06e530 0x7fb57c0709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb5940fc700 0x7fb59410b320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 --2- 172.21.15.115:0/4067150127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5940fb430 0x7fb59410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.734+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 >> 172.21.15.115:0/4067150127 conn(0x7fb5940f6c10 msgr2=0x7fb594065530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.735+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 shutdown_connections 2024-09-13T23:13:53.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.735+0000 7fb599d5a640 1 -- 172.21.15.115:0/4067150127 wait complete. 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 -- 172.21.15.115:0/2928501278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 msgr2=0x7f536c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 --2- 172.21.15.115:0/2928501278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c0fdc90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f535c0048d0 tx=0x7f535c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 -- 172.21.15.115:0/2928501278 shutdown_connections 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 --2- 172.21.15.115:0/2928501278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c0fdc90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 --2- 172.21.15.115:0/2928501278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 0x7f536c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 -- 172.21.15.115:0/2928501278 >> 172.21.15.115:0/2928501278 conn(0x7f536c0f7d30 msgr2=0x7f536c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:53.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 -- 172.21.15.115:0/2928501278 shutdown_connections 2024-09-13T23:13:53.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.822+0000 7f53745da640 1 -- 172.21.15.115:0/2928501278 wait complete. 2024-09-13T23:13:53.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 Processor -- start 2024-09-13T23:13:53.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 -- start start 2024-09-13T23:13:53.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 0x7f536c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c10dc40 con 0x7f536c0fd820 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f53745da640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c10e460 con 0x7f536c0fc550 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f5371b75640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f5371b75640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41636/0 (socket says 172.21.15.115:41636) 2024-09-13T23:13:53.828 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f5371b75640 1 -- 172.21.15.115:0/3102986326 learned_addr learned my addr 172.21.15.115:0/3102986326 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.823+0000 7f5372376640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 0x7f536c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5371b75640 1 -- 172.21.15.115:0/3102986326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 msgr2=0x7f536c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5371b75640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 0x7f536c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5371b75640 1 -- 172.21.15.115:0/3102986326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c005040 con 0x7f536c0fd820 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5371b75640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f535c0043d0 tx=0x7f535c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c038070 con 0x7f536c0fd820 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c10e690 con 0x7f536c0fd820 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f535c02ae90 con 0x7f536c0fd820 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535c03e670 con 0x7f536c0fd820 2024-09-13T23:13:53.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.824+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c10ec30 con 0x7f536c0fd820 2024-09-13T23:13:53.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.826+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c0fb9b0 con 0x7f536c0fd820 2024-09-13T23:13:53.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.826+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f535c030020 con 0x7f536c0fd820 2024-09-13T23:13:53.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.826+0000 7f5362ffd640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 0x7f53580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:53.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.827+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f535c0ae390 con 0x7f536c0fd820 2024-09-13T23:13:53.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.827+0000 7f5372376640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 0x7f53580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:53.831 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.827+0000 7f5372376640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 0x7f53580709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5368004ed0 tx=0x7f536800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:53.832 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:53.831+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f535c0774d0 con 0x7f536c0fd820 2024-09-13T23:13:54.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.071+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f536c10ee80 con 0x7f536c0fd820 2024-09-13T23:13:54.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.071+0000 7f5362ffd640 1 -- 172.21.15.115:0/3102986326 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1976 (secure 0 0 0) 0x7f535c07ab90 con 0x7f536c0fd820 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:e36 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:13:46:168805+0000 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 36 2024-09-13T23:13:54.073 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:13:46.168803+0000 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:13:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 81 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34438} 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:13:54.075 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 1 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 34438 members: 34438 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:34438} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:54.077 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T23:13:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:13:54.077 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{-1:34442} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:13:54.077 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{-1:44267} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/135789338,v1:172.21.15.152:6827/135789338] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:13:54.077 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{-1:44289} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/311722183,v1:172.21.15.152:6825/311722183] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 36 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.073+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 msgr2=0x7f53580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.073+0000 7f53745da640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 0x7f53580709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5368004ed0 tx=0x7f536800b040 comp rx=0 tx=0).stop 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.073+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 msgr2=0x7f536c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.073+0000 7f53745da640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f535c0043d0 tx=0x7f535c009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 shutdown_connections 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f535806e530 0x7f53580709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f536c0fd820 0x7f536c10d5f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 --2- 172.21.15.115:0/3102986326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f536c0fc550 0x7f536c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 >> 172.21.15.115:0/3102986326 conn(0x7f536c0f7d30 msgr2=0x7f536c0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 shutdown_connections 2024-09-13T23:13:54.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.074+0000 7f53745da640 1 -- 172.21.15.115:0/3102986326 wait complete. 2024-09-13T23:13:54.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.165+0000 7f26bf304640 1 -- 172.21.15.115:0/231058975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b80ff720 msgr2=0x7f26b8101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.165+0000 7f26bf304640 1 --2- 172.21.15.115:0/231058975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b80ff720 0x7f26b8101b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26b40048d0 tx=0x7f26b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- 172.21.15.115:0/231058975 shutdown_connections 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 --2- 172.21.15.115:0/231058975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b80ff720 0x7f26b8101b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 --2- 172.21.15.115:0/231058975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b8065ba0 0x7f26b80ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- 172.21.15.115:0/231058975 >> 172.21.15.115:0/231058975 conn(0x7f26b80f6c10 msgr2=0x7f26b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- 172.21.15.115:0/231058975 shutdown_connections 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- 172.21.15.115:0/231058975 wait complete. 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 Processor -- start 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- start start 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.168 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 0x7f26b810d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b810e500 con 0x7f26b8065ba0 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bf304640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b810e670 con 0x7f26b80ff720 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.166+0000 7f26bd0a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41652/0 (socket says 172.21.15.115:41652) 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 -- 172.21.15.115:0/3066735380 learned_addr learned my addr 172.21.15.115:0/3066735380 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bc89f640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 0x7f26b810d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 -- 172.21.15.115:0/3066735380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 msgr2=0x7f26b810d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 0x7f26b810d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 -- 172.21.15.115:0/3066735380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4005040 con 0x7f26b8065ba0 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bc89f640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 0x7f26b810d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:13:54.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bd0a0640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26a800b580 tx=0x7f26a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a800f570 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b810e950 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26a800fb70 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a8010d40 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.167+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b810ee70 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.168+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b81057f0 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.169+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f26a800fce0 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.169+0000 7f26adffb640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 0x7f26a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.169+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f26a808dff0 con 0x7f26b8065ba0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.169+0000 7f26bc89f640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 0x7f26a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.170+0000 7f26bc89f640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 0x7f26a40709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26b810cf50 tx=0x7f26b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:54.174 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.174+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f26a80571a0 con 0x7f26b8065ba0 2024-09-13T23:13:54.370 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.369+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26b810f0e0 con 0x7f26a406e530 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/4067150127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3102986326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:13:54.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:54.371 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.370+0000 7f26adffb640 1 -- 172.21.15.115:0/3066735380 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f26b810f0e0 con 0x7f26a406e530 2024-09-13T23:13:54.371 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:13:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:13:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:13:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "mon" 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "14/21 daemons upgraded", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:13:54.372 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 msgr2=0x7f26a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 0x7f26a40709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26b810cf50 tx=0x7f26b4035040 comp rx=0 tx=0).stop 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 msgr2=0x7f26b810d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26a800b580 tx=0x7f26a80091a0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 shutdown_connections 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f26a406e530 0x7f26a40709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26b80ff720 0x7f26b810d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 --2- 172.21.15.115:0/3066735380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b8065ba0 0x7f26b810d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 >> 172.21.15.115:0/3066735380 conn(0x7f26b80f6c10 msgr2=0x7f26b80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:54.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 shutdown_connections 2024-09-13T23:13:54.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.373+0000 7f26bf304640 1 -- 172.21.15.115:0/3066735380 wait complete. 2024-09-13T23:13:54.456 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 -- 172.21.15.115:0/4237272233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0ff670 msgr2=0x7fbb9c101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 --2- 172.21.15.115:0/4237272233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c101a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb900048d0 tx=0x7fbb90009da0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 -- 172.21.15.115:0/4237272233 shutdown_connections 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 --2- 172.21.15.115:0/4237272233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c101a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 --2- 172.21.15.115:0/4237272233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c0ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 -- 172.21.15.115:0/4237272233 >> 172.21.15.115:0/4237272233 conn(0x7fbb9c0f6c00 msgr2=0x7fbb9c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 -- 172.21.15.115:0/4237272233 shutdown_connections 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.455+0000 7fbba26ff640 1 -- 172.21.15.115:0/4237272233 wait complete. 2024-09-13T23:13:54.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 Processor -- start 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 -- start start 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c10d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10dc90 con 0x7fbb9c0664d0 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbba26ff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c10e410 con 0x7fbb9c0ff670 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbb9bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbb9bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41668/0 (socket says 172.21.15.115:41668) 2024-09-13T23:13:54.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.456+0000 7fbb9bfff640 1 -- 172.21.15.115:0/2607963449 learned_addr learned my addr 172.21.15.115:0/2607963449 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb9b7fe640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c10d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb9bfff640 1 -- 172.21.15.115:0/2607963449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0ff670 msgr2=0x7fbb9c10d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb9bfff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c10d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb9bfff640 1 -- 172.21.15.115:0/2607963449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90005040 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb9bfff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c002840 tx=0x7fbb8c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8c007c30 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbb8c00f040 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8c00d990 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c10e6a0 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.457+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c10ebf0 con 0x7fbb9c0664d0 2024-09-13T23:13:54.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.458+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c105750 con 0x7fbb9c0664d0 2024-09-13T23:13:54.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.460+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbb8c009600 con 0x7fbb9c0664d0 2024-09-13T23:13:54.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.460+0000 7fbb98ff9640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 0x7fbb840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:13:54.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.460+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbb8c08deb0 con 0x7fbb9c0664d0 2024-09-13T23:13:54.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.460+0000 7fbb9b7fe640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 0x7fbb840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:13:54.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.461+0000 7fbb9b7fe640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 0x7fbb840709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c10ceb0 tx=0x7fbb90035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:13:54.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.463+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbb8c056fc0 con 0x7fbb9c0664d0 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/4067150127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3102986326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:54.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.705+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbb9c0fa880 con 0x7fbb9c0664d0 2024-09-13T23:13:54.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.706+0000 7fbb98ff9640 1 -- 172.21.15.115:0/2607963449 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbb8c05a680 con 0x7fbb9c0664d0 2024-09-13T23:13:54.707 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 msgr2=0x7fbb840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 0x7fbb840709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c10ceb0 tx=0x7fbb90035040 comp rx=0 tx=0).stop 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 msgr2=0x7fbb9c10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c002840 tx=0x7fbb8c004570 comp rx=0 tx=0).stop 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 shutdown_connections 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbb8406e530 0x7fbb840709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb9c0ff670 0x7fbb9c10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 --2- 172.21.15.115:0/2607963449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb9c0664d0 0x7fbb9c10d100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:13:54.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 >> 172.21.15.115:0/2607963449 conn(0x7fbb9c0f6c00 msgr2=0x7fbb9c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:13:54.710 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 shutdown_connections 2024-09-13T23:13:54.710 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:13:54.708+0000 7fbba26ff640 1 -- 172.21.15.115:0/2607963449 wait complete. 2024-09-13T23:13:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:55 smithi115 ceph-mon[91340]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:55 smithi115 ceph-mon[91340]: pgmap v201: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-13T23:13:55.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:55 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2607963449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:13:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:55 smithi152 ceph-mon[80164]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:55 smithi152 ceph-mon[80164]: pgmap v201: 65 pgs: 65 active+clean; 181 MiB data, 757 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-13T23:13:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:55 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2607963449' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:13:56.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:56 smithi115 ceph-mon[91340]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:56.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:56 smithi152 ceph-mon[80164]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: pgmap v202: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:57.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:57 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.cmykpw"]}]: dispatch 2024-09-13T23:13:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: pgmap v202: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-13T23:13:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:13:57.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:57 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.cmykpw"]}]: dispatch 2024-09-13T23:13:58.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:58 smithi152 ceph-mon[80164]: Upgrade: It appears safe to stop mds.cephfs.smithi152.cmykpw 2024-09-13T23:13:58.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:58 smithi115 ceph-mon[91340]: Upgrade: It appears safe to stop mds.cephfs.smithi152.cmykpw 2024-09-13T23:13:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:59 smithi152 ceph-mon[80164]: pgmap v203: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T23:13:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:13:59 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:59 smithi115 ceph-mon[91340]: pgmap v203: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-13T23:13:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:13:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.cmykpw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:13:59.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:13:59 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:00.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:00 smithi152 ceph-mon[80164]: Upgrade: Updating mds.cephfs.smithi152.cmykpw 2024-09-13T23:14:00.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:00 smithi152 ceph-mon[80164]: Deploying daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:14:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:00 smithi115 ceph-mon[91340]: Upgrade: Updating mds.cephfs.smithi152.cmykpw 2024-09-13T23:14:00.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:00 smithi115 ceph-mon[91340]: Deploying daemon mds.cephfs.smithi152.cmykpw on smithi152 2024-09-13T23:14:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:01 smithi152 ceph-mon[80164]: pgmap v204: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-13T23:14:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:01 smithi115 ceph-mon[91340]: pgmap v204: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-13T23:14:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:02 smithi152 ceph-mon[80164]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T23:14:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:02 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2 up:standby 2024-09-13T23:14:02.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:02 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:02.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:02 smithi115 ceph-mon[91340]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T23:14:02.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:02 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2 up:standby 2024-09-13T23:14:02.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:02 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:03 smithi152 ceph-mon[80164]: pgmap v206: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:03.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:03 smithi115 ceph-mon[91340]: pgmap v206: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:05.315 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:05 smithi152 ceph-mon[80164]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:05 smithi115 ceph-mon[91340]: pgmap v207: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: pgmap v208: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.152:6824/1935544166,v1:172.21.15.152:6825/1935544166] up:boot 2024-09-13T23:14:07.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:14:07.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:07 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:07.406 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:07.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:07.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:07.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: pgmap v208: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:07.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.152:6824/1935544166,v1:172.21.15.152:6825/1935544166] up:boot 2024-09-13T23:14:07.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:14:07.481 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:07 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:09 smithi152 ceph-mon[80164]: pgmap v209: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:09 smithi115 ceph-mon[91340]: pgmap v209: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:10.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:10 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:10.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:10 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:10.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:10 smithi115 ceph-mon[91340]: pgmap v210: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:10.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:10 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:10.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:10 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:10.679 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:10 smithi152 ceph-mon[80164]: pgmap v210: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.189 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:13.190 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.190 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.190 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.190 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.190 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:13 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.pntaqr"]}]: dispatch 2024-09-13T23:14:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: pgmap v211: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:13.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:13 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi152.pntaqr"]}]: dispatch 2024-09-13T23:14:14.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:14 smithi152 ceph-mon[80164]: Detected new or changed devices on smithi152 2024-09-13T23:14:14.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:14 smithi152 ceph-mon[80164]: Upgrade: It appears safe to stop mds.cephfs.smithi152.pntaqr 2024-09-13T23:14:14.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:14.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:14:14.432 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:14 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:14.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:14 smithi115 ceph-mon[91340]: Detected new or changed devices on smithi152 2024-09-13T23:14:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:14 smithi115 ceph-mon[91340]: Upgrade: It appears safe to stop mds.cephfs.smithi152.pntaqr 2024-09-13T23:14:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.pntaqr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:14:14.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:14 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:15 smithi152 ceph-mon[80164]: Upgrade: Updating mds.cephfs.smithi152.pntaqr 2024-09-13T23:14:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:15 smithi152 ceph-mon[80164]: Deploying daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:14:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:15 smithi152 ceph-mon[80164]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:15 smithi115 ceph-mon[91340]: Upgrade: Updating mds.cephfs.smithi152.pntaqr 2024-09-13T23:14:15.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:15 smithi115 ceph-mon[91340]: Deploying daemon mds.cephfs.smithi152.pntaqr on smithi152 2024-09-13T23:14:15.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:15 smithi115 ceph-mon[91340]: pgmap v212: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:17 smithi152 ceph-mon[80164]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:17 smithi152 ceph-mon[80164]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T23:14:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:17 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2 up:standby 2024-09-13T23:14:17.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:17 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:17 smithi115 ceph-mon[91340]: pgmap v213: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:17 smithi115 ceph-mon[91340]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T23:14:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:17 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 2 up:standby 2024-09-13T23:14:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:17 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:19 smithi152 ceph-mon[80164]: pgmap v215: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:19 smithi115 ceph-mon[91340]: pgmap v215: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:21 smithi152 ceph-mon[80164]: pgmap v216: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:21 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:21 smithi115 ceph-mon[91340]: pgmap v216: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:21 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:22.439 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:22 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.152:6826/2974383973,v1:172.21.15.152:6827/2974383973] up:boot 2024-09-13T23:14:22.439 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:22 smithi152 ceph-mon[80164]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:14:22.439 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:22 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:22 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.152:6826/2974383973,v1:172.21.15.152:6827/2974383973] up:boot 2024-09-13T23:14:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:22 smithi115 ceph-mon[91340]: fsmap cephfs:1 {0=cephfs.smithi115.ywbcks=up:active} 3 up:standby 2024-09-13T23:14:22.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:22 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:23.450 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:23 smithi115 ceph-mon[91340]: pgmap v217: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:23.466 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:23 smithi152 ceph-mon[80164]: pgmap v217: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:24.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:24.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:24.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:24.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 -- 172.21.15.115:0/3957982937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 msgr2=0x7f4b7c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:24.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 --2- 172.21.15.115:0/3957982937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c0fb840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009c50 tx=0x7f4b6c004d10 comp rx=0 tx=0).stop 2024-09-13T23:14:24.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 -- 172.21.15.115:0/3957982937 shutdown_connections 2024-09-13T23:14:24.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 --2- 172.21.15.115:0/3957982937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 0x7f4b7c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 --2- 172.21.15.115:0/3957982937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c0fb840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 -- 172.21.15.115:0/3957982937 >> 172.21.15.115:0/3957982937 conn(0x7f4b7c0f6c10 msgr2=0x7f4b7c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:24.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 -- 172.21.15.115:0/3957982937 shutdown_connections 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.799+0000 7f4b832bf640 1 -- 172.21.15.115:0/3957982937 wait complete. 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 Processor -- start 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 -- start start 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 0x7f4b7c1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:24.805 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c065cc0 con 0x7f4b7c0fb430 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b832bf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c065e30 con 0x7f4b7c0fc700 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58332/0 (socket says 172.21.15.115:58332) 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 -- 172.21.15.115:0/450014231 learned_addr learned my addr 172.21.15.115:0/450014231 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8085a640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 0x7f4b7c1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:24.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 -- 172.21.15.115:0/450014231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 msgr2=0x7f4b7c1122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 0x7f4b7c1122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.800+0000 7f4b8105b640 1 -- 172.21.15.115:0/450014231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0098b0 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b8105b640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c004a30 tx=0x7f4b6c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6c032850 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b6c009710 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c112850 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6c03dc20 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.801+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c112dc0 con 0x7f4b7c0fb430 2024-09-13T23:14:24.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.802+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0fa890 con 0x7f4b7c0fb430 2024-09-13T23:14:24.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.803+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4b6c02f030 con 0x7f4b7c0fb430 2024-09-13T23:14:24.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.803+0000 7f4b79ffb640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 0x7f4b640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:24.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.803+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4b6c0af770 con 0x7f4b7c0fb430 2024-09-13T23:14:24.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.804+0000 7f4b8085a640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 0x7f4b640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:24.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.804+0000 7f4b8085a640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 0x7f4b640709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4b700041d0 tx=0x7f4b70004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:24.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.808+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b6c078880 con 0x7f4b7c0fb430 2024-09-13T23:14:24.991 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.991+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b7c100b60 con 0x7f4b6406e530 2024-09-13T23:14:24.993 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.992+0000 7f4b79ffb640 1 -- 172.21.15.115:0/450014231 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4b7c100b60 con 0x7f4b6406e530 2024-09-13T23:14:24.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 msgr2=0x7f4b640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:24.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 0x7f4b640709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4b700041d0 tx=0x7f4b70004330 comp rx=0 tx=0).stop 2024-09-13T23:14:24.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 msgr2=0x7f4b7c10fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:24.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c004a30 tx=0x7f4b6c004d10 comp rx=0 tx=0).stop 2024-09-13T23:14:24.995 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 shutdown_connections 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b6406e530 0x7f4b640709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0fc700 0x7f4b7c1122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 --2- 172.21.15.115:0/450014231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b7c0fb430 0x7f4b7c10fd60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 >> 172.21.15.115:0/450014231 conn(0x7f4b7c0f6c10 msgr2=0x7f4b7c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 shutdown_connections 2024-09-13T23:14:24.996 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:24.994+0000 7f4b832bf640 1 -- 172.21.15.115:0/450014231 wait complete. 2024-09-13T23:14:25.004 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:14:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- 172.21.15.115:0/1979864694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fc550 msgr2=0x7f21200fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 --2- 172.21.15.115:0/1979864694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fc550 0x7f21200fc960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21100048d0 tx=0x7f2110009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.076 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- 172.21.15.115:0/1979864694 shutdown_connections 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 --2- 172.21.15.115:0/1979864694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fd820 0x7f21200fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 --2- 172.21.15.115:0/1979864694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fc550 0x7f21200fc960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- 172.21.15.115:0/1979864694 >> 172.21.15.115:0/1979864694 conn(0x7f21200f7d30 msgr2=0x7f21200fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- 172.21.15.115:0/1979864694 shutdown_connections 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- 172.21.15.115:0/1979864694 wait complete. 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 Processor -- start 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.075+0000 7f21254bb640 1 -- start start 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21254bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 0x7f212010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21254bb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21254bb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212010dc10 con 0x7f21200fd820 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21254bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212010e430 con 0x7f21200fc550 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58336/0 (socket says 172.21.15.115:58336) 2024-09-13T23:14:25.077 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 -- 172.21.15.115:0/866667108 learned_addr learned my addr 172.21.15.115:0/866667108 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211effd640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 0x7f212010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 -- 172.21.15.115:0/866667108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 msgr2=0x7f212010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 0x7f212010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 -- 172.21.15.115:0/866667108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110005040 con 0x7f21200fd820 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211effd640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 0x7f212010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f211e7fc640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2108002a50 tx=0x7f2108004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2108007c30 con 0x7f21200fd820 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f210800f040 con 0x7f21200fd820 2024-09-13T23:14:25.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210800da90 con 0x7f21200fd820 2024-09-13T23:14:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.076+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212010e6c0 con 0x7f21200fd820 2024-09-13T23:14:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.077+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212010ec60 con 0x7f21200fd820 2024-09-13T23:14:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.078+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21200fb9b0 con 0x7f21200fd820 2024-09-13T23:14:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.078+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f210800dd00 con 0x7f21200fd820 2024-09-13T23:14:25.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.079+0000 7f21177fe640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 0x7f210c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.079+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f210808daf0 con 0x7f21200fd820 2024-09-13T23:14:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.079+0000 7f211effd640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 0x7f210c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.079+0000 7f211effd640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 0x7f210c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211000b020 tx=0x7f2110009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.083+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2108056b80 con 0x7f21200fd820 2024-09-13T23:14:25.267 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.267+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f212010efb0 con 0x7f210c06e530 2024-09-13T23:14:25.268 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.268+0000 7f21177fe640 1 -- 172.21.15.115:0/866667108 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f212010efb0 con 0x7f210c06e530 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 msgr2=0x7f210c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 0x7f210c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f211000b020 tx=0x7f2110009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 msgr2=0x7f212010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2108002a50 tx=0x7f2108004600 comp rx=0 tx=0).stop 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 shutdown_connections 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f210c06e530 0x7f210c0709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21200fd820 0x7f212010d5c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 --2- 172.21.15.115:0/866667108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21200fc550 0x7f212010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 >> 172.21.15.115:0/866667108 conn(0x7f21200f7d30 msgr2=0x7f21200f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.271 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 shutdown_connections 2024-09-13T23:14:25.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.270+0000 7f21254bb640 1 -- 172.21.15.115:0/866667108 wait complete. 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.347+0000 7f0e35a16640 1 -- 172.21.15.115:0/3493566425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fd820 msgr2=0x7f0e300fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.347+0000 7f0e35a16640 1 --2- 172.21.15.115:0/3493566425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fd820 0x7f0e300fdc90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0e180048d0 tx=0x7f0e18009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 -- 172.21.15.115:0/3493566425 shutdown_connections 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 --2- 172.21.15.115:0/3493566425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fd820 0x7f0e300fdc90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 --2- 172.21.15.115:0/3493566425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fc550 0x7f0e300fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 -- 172.21.15.115:0/3493566425 >> 172.21.15.115:0/3493566425 conn(0x7f0e300f7d30 msgr2=0x7f0e300fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 -- 172.21.15.115:0/3493566425 shutdown_connections 2024-09-13T23:14:25.349 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 -- 172.21.15.115:0/3493566425 wait complete. 2024-09-13T23:14:25.350 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:25 smithi115 ceph-mon[91340]: pgmap v218: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.348+0000 7f0e35a16640 1 Processor -- start 2024-09-13T23:14:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e35a16640 1 -- start start 2024-09-13T23:14:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e35a16640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e35a16640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fd820 0x7f0e3010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.351 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e35a16640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3010e490 con 0x7f0e300fc550 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e35a16640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3010e600 con 0x7f0e300fd820 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58350/0 (socket says 172.21.15.115:58350) 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 -- 172.21.15.115:0/1799152248 learned_addr learned my addr 172.21.15.115:0/1799152248 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2e7fc640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fd820 0x7f0e3010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 -- 172.21.15.115:0/1799152248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fd820 msgr2=0x7f0e3010d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fd820 0x7f0e3010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 -- 172.21.15.115:0/1799152248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18005040 con 0x7f0e300fc550 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.349+0000 7f0e2effd640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800bbb0 tx=0x7f0e28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.350+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2800c9c0 con 0x7f0e300fc550 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.350+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e280092e0 con 0x7f0e300fc550 2024-09-13T23:14:25.352 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.350+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3010e8e0 con 0x7f0e300fc550 2024-09-13T23:14:25.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.350+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e28007640 con 0x7f0e300fc550 2024-09-13T23:14:25.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.350+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3010ee00 con 0x7f0e300fc550 2024-09-13T23:14:25.353 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.351+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e301057e0 con 0x7f0e300fc550 2024-09-13T23:14:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.351+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0e28012070 con 0x7f0e300fc550 2024-09-13T23:14:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.352+0000 7f0e277fe640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.352+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0e2808e3a0 con 0x7f0e300fc550 2024-09-13T23:14:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.352+0000 7f0e2e7fc640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.354 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.352+0000 7f0e2e7fc640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 0x7f0e1c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e18000c00 tx=0x7f0e18009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.356+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e28057430 con 0x7f0e300fc550 2024-09-13T23:14:25.456 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:25 smithi152 ceph-mon[80164]: pgmap v218: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:25.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.531+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e3010f070 con 0x7f0e1c06e530 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.539+0000 7f0e277fe640 1 -- 172.21.15.115:0/1799152248 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0e3010f070 con 0x7f0e1c06e530 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 32s ago 15m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (5m) 32s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (5m) 2s ago 15m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (7m) 32s ago 15m 84.0M - 9.4.7 954c08fa6188 180cd376b0e7 2024-09-13T23:14:25.540 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (40s) 32s ago 10m 14.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 1036e851db03 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (61s) 32s ago 10m 141M - 19.1.1-324-gecab7be5 0652ff2b5d78 b3c2cd84ec81 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (20s) 2s ago 10m 14.6M - 19.1.1-324-gecab7be5 0652ff2b5d78 0a8a451837f9 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (4s) 2s ago 10m 12.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 9f94a5e88ae3 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (6m) 32s ago 17m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (6m) 2s ago 14m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (6m) 32s ago 17m 50.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (5m) 2s ago 14m 42.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 32s ago 15m 16.3M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 2s ago 15m 16.8M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (4m) 32s ago 14m 109M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (4m) 32s ago 13m 105M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (3m) 32s ago 13m 89.0M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (3m) 2s ago 12m 117M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:14:25.541 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (2m) 2s ago 12m 101M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:14:25.542 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (119s) 2s ago 11m 94.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:14:25.542 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 32s ago 15m 64.6M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:14:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 msgr2=0x7f0e1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 0x7f0e1c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e18000c00 tx=0x7f0e18009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 msgr2=0x7f0e3010d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800bbb0 tx=0x7f0e28009840 comp rx=0 tx=0).stop 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 shutdown_connections 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e300fd820 0x7f0e3010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 --2- 172.21.15.115:0/1799152248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e300fc550 0x7f0e3010d0e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 >> 172.21.15.115:0/1799152248 conn(0x7f0e300f7d30 msgr2=0x7f0e300f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 shutdown_connections 2024-09-13T23:14:25.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.542+0000 7f0e35a16640 1 -- 172.21.15.115:0/1799152248 wait complete. 2024-09-13T23:14:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 -- 172.21.15.115:0/2888819731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fc530 msgr2=0x7f0ec80fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2888819731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fc530 0x7f0ec80fc940 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80048d0 tx=0x7f0eb8009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 -- 172.21.15.115:0/2888819731 shutdown_connections 2024-09-13T23:14:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2888819731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fd800 0x7f0ec80fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2888819731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fc530 0x7f0ec80fc940 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 -- 172.21.15.115:0/2888819731 >> 172.21.15.115:0/2888819731 conn(0x7f0ec80f7d10 msgr2=0x7f0ec80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 -- 172.21.15.115:0/2888819731 shutdown_connections 2024-09-13T23:14:25.621 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.619+0000 7f0ecd161640 1 -- 172.21.15.115:0/2888819731 wait complete. 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.620+0000 7f0ecd161640 1 Processor -- start 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.620+0000 7f0ecd161640 1 -- start start 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.620+0000 7f0ecd161640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fc530 0x7f0ec810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.620+0000 7f0ecd161640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ecd161640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec810dc20 con 0x7f0ec80fd800 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ecd161640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec810e440 con 0x7f0ec80fc530 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ec6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fc530 0x7f0ec810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58366/0 (socket says 172.21.15.115:58366) 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 -- 172.21.15.115:0/2730620783 learned_addr learned my addr 172.21.15.115:0/2730620783 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:25.623 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 -- 172.21.15.115:0/2730620783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fc530 msgr2=0x7f0ec810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fc530 0x7f0ec810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 -- 172.21.15.115:0/2730620783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8005040 con 0x7f0ec80fd800 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebe59c640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000eb70 tx=0x7f0eb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb0007c30 con 0x7f0ec80fd800 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0eb000f040 con 0x7f0ec80fd800 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb000ca60 con 0x7f0ec80fd800 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec810e670 con 0x7f0ec80fd800 2024-09-13T23:14:25.624 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.621+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec810eb00 con 0x7f0ec80fd800 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.623+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec80fb990 con 0x7f0ec80fd800 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.623+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0eb000cbc0 con 0x7f0ec80fd800 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.624+0000 7f0ebffff640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 0x7f0eb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.624+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0eb008dde0 con 0x7f0ec80fd800 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.624+0000 7f0ec6d9d640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 0x7f0eb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.625 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.624+0000 7f0ec6d9d640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 0x7f0eb40709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8004540 tx=0x7f0eb8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.628+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0eb0056f20 con 0x7f0ec80fd800 2024-09-13T23:14:25.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.857+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ec804b720 con 0x7f0ec80fd800 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.858+0000 7f0ebffff640 1 -- 172.21.15.115:0/2730620783 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f0eb005a5e0 con 0x7f0ec80fd800 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:14:25.859 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:14:25.860 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 msgr2=0x7f0eb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 0x7f0eb40709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8004540 tx=0x7f0eb8035040 comp rx=0 tx=0).stop 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 msgr2=0x7f0ec810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000eb70 tx=0x7f0eb000b040 comp rx=0 tx=0).stop 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 shutdown_connections 2024-09-13T23:14:25.861 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0eb406e530 0x7f0eb40709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ec80fd800 0x7f0ec810d5d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 --2- 172.21.15.115:0/2730620783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ec80fc530 0x7f0ec810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 >> 172.21.15.115:0/2730620783 conn(0x7f0ec80f7d10 msgr2=0x7f0ec80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 shutdown_connections 2024-09-13T23:14:25.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.860+0000 7f0ecd161640 1 -- 172.21.15.115:0/2730620783 wait complete. 2024-09-13T23:14:25.939 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 -- 172.21.15.115:0/1290291354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 msgr2=0x7ff5a80fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 --2- 172.21.15.115:0/1290291354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a80fdfb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0048d0 tx=0x7ff59c009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 -- 172.21.15.115:0/1290291354 shutdown_connections 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 --2- 172.21.15.115:0/1290291354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 0x7ff5a80fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 --2- 172.21.15.115:0/1290291354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a80fdfb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 -- 172.21.15.115:0/1290291354 >> 172.21.15.115:0/1290291354 conn(0x7ff5a80f63a0 msgr2=0x7ff5a80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 -- 172.21.15.115:0/1290291354 shutdown_connections 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.938+0000 7ff5af146640 1 -- 172.21.15.115:0/1290291354 wait complete. 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 Processor -- start 2024-09-13T23:14:25.940 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 -- start start 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 0x7ff5a810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a810dc60 con 0x7ff5a80fdba0 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5af146640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a810e430 con 0x7ff5a80fe4f0 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5acee2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5acee2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58388/0 (socket says 172.21.15.115:58388) 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5acee2640 1 -- 172.21.15.115:0/1617967937 learned_addr learned my addr 172.21.15.115:0/1617967937 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:25.942 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.939+0000 7ff5a7fff640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 0x7ff5a810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5acee2640 1 -- 172.21.15.115:0/1617967937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 msgr2=0x7ff5a810d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5acee2640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 0x7ff5a810d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5acee2640 1 -- 172.21.15.115:0/1617967937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c005040 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5acee2640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0043d0 tx=0x7ff59c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c038070 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a810e660 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff59c02ae90 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c03e670 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.940+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a810eb80 con 0x7ff5a80fdba0 2024-09-13T23:14:25.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.941+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80fa040 con 0x7ff5a80fdba0 2024-09-13T23:14:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.942+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff59c030020 con 0x7ff5a80fdba0 2024-09-13T23:14:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.942+0000 7ff5a57fa640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.942+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff59c0ae390 con 0x7ff5a80fdba0 2024-09-13T23:14:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.942+0000 7ff5a7fff640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:25.944 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.943+0000 7ff5a7fff640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 0x7ff5980709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810ce80 tx=0x7ff59400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:25.947 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:25.947+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff59c0774d0 con 0x7ff5a80fdba0 2024-09-13T23:14:26.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.153+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff5a810ee00 con 0x7ff5a80fdba0 2024-09-13T23:14:26.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.153+0000 7ff5a57fa640 1 -- 172.21.15.115:0/1617967937 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 40 v40) v1 ==== 76+0+1982 (secure 0 0 0) 0x7ff59c07ab90 con 0x7ff5a80fdba0 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:e40 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:14:21:177042+0000 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 36 2024-09-13T23:14:26.155 INFO:teuthology.orchestra.run.smithi115.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:13:46.168803+0000 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 81 2024-09-13T23:14:26.156 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 1 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:in 0 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34438} 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 1 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:14:26.157 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 34438 members: 34438 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:34438} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:Standby daemons: 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{-1:34442} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1935544166,v1:172.21.15.152:6825/1935544166] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:14:26.158 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2974383973,v1:172.21.15.152:6827/2974383973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 40 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.155+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 msgr2=0x7ff5980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.155+0000 7ff5af146640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 0x7ff5980709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810ce80 tx=0x7ff59400b040 comp rx=0 tx=0).stop 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.155+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 msgr2=0x7ff5a810d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.155+0000 7ff5af146640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0043d0 tx=0x7ff59c009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 shutdown_connections 2024-09-13T23:14:26.159 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5a80fe4f0 0x7ff5a810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 --2- 172.21.15.115:0/1617967937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5a80fdba0 0x7ff5a810d0d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 >> 172.21.15.115:0/1617967937 conn(0x7ff5a80f63a0 msgr2=0x7ff5a80f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:26.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 shutdown_connections 2024-09-13T23:14:26.160 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.156+0000 7ff5af146640 1 -- 172.21.15.115:0/1617967937 wait complete. 2024-09-13T23:14:26.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 -- 172.21.15.115:0/2480671573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fb470 msgr2=0x7f22f40fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 --2- 172.21.15.115:0/2480671573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fb470 0x7f22f40fb880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22e80048d0 tx=0x7f22e8009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.237 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 -- 172.21.15.115:0/2480671573 shutdown_connections 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 --2- 172.21.15.115:0/2480671573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fc740 0x7f22f40fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 --2- 172.21.15.115:0/2480671573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fb470 0x7f22f40fb880 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 -- 172.21.15.115:0/2480671573 >> 172.21.15.115:0/2480671573 conn(0x7f22f40f6c30 msgr2=0x7f22f40f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 -- 172.21.15.115:0/2480671573 shutdown_connections 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.236+0000 7f22fadd2640 1 -- 172.21.15.115:0/2480671573 wait complete. 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 Processor -- start 2024-09-13T23:14:26.238 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 -- start start 2024-09-13T23:14:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fb470 0x7f22f410fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4066750 con 0x7f22f40fc740 2024-09-13T23:14:26.239 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22fadd2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40668c0 con 0x7f22f40fb470 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35148/0 (socket says 172.21.15.115:35148) 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 -- 172.21.15.115:0/1954014540 learned_addr learned my addr 172.21.15.115:0/1954014540 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f8b6e640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fb470 0x7f22f410fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 -- 172.21.15.115:0/1954014540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fb470 msgr2=0x7f22f410fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fb470 0x7f22f410fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.237+0000 7f22f3fff640 1 -- 172.21.15.115:0/1954014540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8005040 con 0x7f22f40fc740 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22f3fff640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22e000eb70 tx=0x7f22e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e0007c30 con 0x7f22f40fc740 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22e000f040 con 0x7f22f40fc740 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f41128e0 con 0x7f22f40fc740 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22e000ca60 con 0x7f22f40fc740 2024-09-13T23:14:26.240 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.238+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f4112e50 con 0x7f22f40fc740 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.239+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40fa8d0 con 0x7f22f40fc740 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.239+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f22e000cbc0 con 0x7f22f40fc740 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.240+0000 7f22f17fa640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 0x7f22e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.240+0000 7f22f8b6e640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 0x7f22e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.240+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f22e008dd60 con 0x7f22f40fc740 2024-09-13T23:14:26.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.240+0000 7f22f8b6e640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 0x7f22e40709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22e8000c00 tx=0x7f22e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:26.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.244+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f22e0056f20 con 0x7f22f40fc740 2024-09-13T23:14:26.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.425+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f4100ba0 con 0x7f22e406e530 2024-09-13T23:14:26.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.427+0000 7f22f17fa640 1 -- 172.21.15.115:0/1954014540 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f22f4100ba0 con 0x7f22e406e530 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": true, 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [ 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "crash", 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "osd", 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "mon", 2024-09-13T23:14:26.428 INFO:teuthology.orchestra.run.smithi115.stdout: "mds", 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr" 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": "16/21 daemons upgraded", 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:14:26.429 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 msgr2=0x7f22e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 0x7f22e40709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22e8000c00 tx=0x7f22e8035040 comp rx=0 tx=0).stop 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 msgr2=0x7f22f41123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22e000eb70 tx=0x7f22e000b040 comp rx=0 tx=0).stop 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 shutdown_connections 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f22e406e530 0x7f22e40709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22f40fc740 0x7f22f41123a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 --2- 172.21.15.115:0/1954014540 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22f40fb470 0x7f22f410fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 >> 172.21.15.115:0/1954014540 conn(0x7f22f40f6c30 msgr2=0x7f22f40f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 shutdown_connections 2024-09-13T23:14:26.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.429+0000 7f22fadd2640 1 -- 172.21.15.115:0/1954014540 wait complete. 2024-09-13T23:14:26.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:26 smithi152 ceph-mon[80164]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:26.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:26 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2730620783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:26.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:26 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1617967937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:14:26.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.505+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1770838328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 msgr2=0x7ff1e80fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.505+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1770838328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e80fa650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80048d0 tx=0x7ff1d8009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1770838328 shutdown_connections 2024-09-13T23:14:26.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1770838328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e80fa650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1770838328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 0x7ff1e80fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1770838328 >> 172.21.15.115:0/1770838328 conn(0x7ff1e80f63a0 msgr2=0x7ff1e80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:26.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:26 smithi115 ceph-mon[91340]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:26.507 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:26 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2730620783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:26.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:26 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1617967937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:14:26.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1770838328 shutdown_connections 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1770838328 wait complete. 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 Processor -- start 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.506+0000 7ff1ed31a640 1 -- start start 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1ed31a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 0x7ff1e810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1ed31a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1ed31a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e810dc70 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1ed31a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e810e440 con 0x7ff1e80fdba0 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:35174/0 (socket says 172.21.15.115:35174) 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 -- 172.21.15.115:0/1777473741 learned_addr learned my addr 172.21.15.115:0/1777473741 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e6ffd640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 0x7ff1e810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 -- 172.21.15.115:0/1777473741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 msgr2=0x7ff1e810d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 0x7ff1e810d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 -- 172.21.15.115:0/1777473741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8005040 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1e67fc640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80048a0 tx=0x7ff1d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.507+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d8038070 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.508+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1d802abd0 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.508+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e810e670 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.508+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d8033640 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.508+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e810ec10 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.509+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e80fa040 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.509+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff1d8030020 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.510+0000 7ff1df7fe640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 0x7ff1d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.510+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff1d80ae410 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.510+0000 7ff1e6ffd640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 0x7ff1d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:26.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.510+0000 7ff1e6ffd640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 0x7ff1d40709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00041d0 tx=0x7ff1d0004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:26.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.515+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff1d80775d0 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.746+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff1e810eed0 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.746+0000 7ff1df7fe640 1 -- 172.21.15.115:0/1777473741 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff1d807ac90 con 0x7ff1e80fe4f0 2024-09-13T23:14:26.747 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 msgr2=0x7ff1d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 0x7ff1d40709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00041d0 tx=0x7ff1d0004330 comp rx=0 tx=0).stop 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 msgr2=0x7ff1e810d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80048a0 tx=0x7ff1d8009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 shutdown_connections 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff1d406e530 0x7ff1d40709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1e80fe4f0 0x7ff1e810d620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 --2- 172.21.15.115:0/1777473741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1e80fdba0 0x7ff1e810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:26.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 >> 172.21.15.115:0/1777473741 conn(0x7ff1e80f63a0 msgr2=0x7ff1e80f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:26.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 shutdown_connections 2024-09-13T23:14:26.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:26.748+0000 7ff1ed31a640 1 -- 172.21.15.115:0/1777473741 wait complete. 2024-09-13T23:14:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: pgmap v219: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1777473741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.vlvabd"}]': finished 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ywbcks"}]': finished 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.cmykpw"}]': finished 2024-09-13T23:14:27.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:27.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.pntaqr"}]': finished 2024-09-13T23:14:27.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:27 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T23:14:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: pgmap v219: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1777473741' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:14:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:27.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.vlvabd"}]: dispatch 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.vlvabd"}]': finished 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ywbcks"}]: dispatch 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.ywbcks"}]': finished 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.cmykpw"}]: dispatch 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.cmykpw"}]': finished 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.pntaqr"}]: dispatch 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi152.pntaqr"}]': finished 2024-09-13T23:14:27.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:27 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T23:14:28.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:28.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all mds 2024-09-13T23:14:28.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T23:14:28.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: daemon mds.cephfs.smithi115.vlvabd assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T23:14:28.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T23:14:28.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:starting} 2 up:standby 2024-09-13T23:14:28.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:28.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T23:14:28.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:28 smithi152 ceph-mon[80164]: daemon mds.cephfs.smithi115.vlvabd is now active in filesystem cephfs as rank 1 2024-09-13T23:14:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all mds 2024-09-13T23:14:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T23:14:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: daemon mds.cephfs.smithi115.vlvabd assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T23:14:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T23:14:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:starting} 2 up:standby 2024-09-13T23:14:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T23:14:28.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:28 smithi115 ceph-mon[91340]: daemon mds.cephfs.smithi115.vlvabd is now active in filesystem cephfs as rank 1 2024-09-13T23:14:29.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T23:14:29.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: pgmap v220: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:29.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T23:14:29.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: mds.? [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] up:active 2024-09-13T23:14:29.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:14:29.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:active} 2 up:standby-replay 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.301 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.302 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.303 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:29 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: pgmap v220: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: mds.? [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] up:active 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:active} 2 up:standby 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: fsmap cephfs:2 {0=cephfs.smithi115.ywbcks=up:active,1=cephfs.smithi115.vlvabd=up:active} 2 up:standby-replay 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:29.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:29 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all rgw 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all iscsi 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all nfs 2024-09-13T23:14:30.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:30 smithi152 ceph-mon[80164]: Upgrade: Setting container_image for all nvmeof 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all rgw 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all iscsi 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all nfs 2024-09-13T23:14:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:30 smithi115 ceph-mon[91340]: Upgrade: Setting container_image for all nvmeof 2024-09-13T23:14:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:31 smithi152 ceph-mon[80164]: Upgrade: Updating grafana.smithi115 2024-09-13T23:14:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:31 smithi152 ceph-mon[80164]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T23:14:31.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:31 smithi152 ceph-mon[80164]: pgmap v221: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:14:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:31 smithi115 ceph-mon[91340]: Upgrade: Updating grafana.smithi115 2024-09-13T23:14:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:31 smithi115 ceph-mon[91340]: Deploying daemon grafana.smithi115 on smithi115 2024-09-13T23:14:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:31 smithi115 ceph-mon[91340]: pgmap v221: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T23:14:33.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:33 smithi152 ceph-mon[80164]: pgmap v222: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:14:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:33 smithi115 ceph-mon[91340]: pgmap v222: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:14:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:35 smithi115 ceph-mon[91340]: pgmap v223: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:14:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:35 smithi152 ceph-mon[80164]: pgmap v223: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:14:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:37 smithi115 ceph-mon[91340]: pgmap v224: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T23:14:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:37 smithi152 ceph-mon[80164]: pgmap v224: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T23:14:39.224 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:39 smithi115 ceph-mon[91340]: pgmap v225: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T23:14:39.225 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:39.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:39 smithi152 ceph-mon[80164]: pgmap v225: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T23:14:39.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:41.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:41 smithi115 ceph-mon[91340]: pgmap v226: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T23:14:41.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:41.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:41.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:41 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:41.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:41 smithi152 ceph-mon[80164]: pgmap v226: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T23:14:41.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:41.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:41.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:41 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:43.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:43 smithi115 ceph-mon[91340]: pgmap v227: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:14:43.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:43 smithi152 ceph-mon[80164]: pgmap v227: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T23:14:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:45 smithi115 ceph-mon[91340]: pgmap v228: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4 op/s 2024-09-13T23:14:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:45 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:45 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:45.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:45 smithi152 ceph-mon[80164]: pgmap v228: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4 op/s 2024-09-13T23:14:45.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:45 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:45.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:45 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:46 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:47.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:46 smithi115 ceph-mon[91340]: pgmap v229: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 5 op/s 2024-09-13T23:14:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:46 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:47.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:46 smithi152 ceph-mon[80164]: pgmap v229: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 5 op/s 2024-09-13T23:14:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: pgmap v230: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:49.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:49.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: pgmap v230: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:49.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:49.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:49.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.470 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: Upgrade: Finalizing container_image settings 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T23:14:50.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T23:14:50.472 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:50.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:50.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:50.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:50.474 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.550 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.551 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: Upgrade: Finalizing container_image settings 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T23:14:50.553 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.554 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.555 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:14:50.556 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:14:50.557 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:51 smithi152 ceph-mon[80164]: Upgrade: Complete! 2024-09-13T23:14:51.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:51 smithi152 ceph-mon[80164]: pgmap v231: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:14:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:51 smithi115 ceph-mon[91340]: Upgrade: Complete! 2024-09-13T23:14:51.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:51 smithi115 ceph-mon[91340]: pgmap v231: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:14:53.469 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:53 smithi152 ceph-mon[80164]: pgmap v232: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:14:53.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:53 smithi115 ceph-mon[91340]: pgmap v232: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:14:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:54.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:14:54.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:14:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:55 smithi152 ceph-mon[80164]: pgmap v233: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:55 smithi115 ceph-mon[91340]: pgmap v233: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:56.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 -- 172.21.15.115:0/2476726012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fc550 msgr2=0x7f54880fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:56.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 --2- 172.21.15.115:0/2476726012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fc550 0x7f54880fc960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54700048d0 tx=0x7f5470009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:56.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 -- 172.21.15.115:0/2476726012 shutdown_connections 2024-09-13T23:14:56.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 --2- 172.21.15.115:0/2476726012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fd820 0x7f54880fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 --2- 172.21.15.115:0/2476726012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fc550 0x7f54880fc960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 -- 172.21.15.115:0/2476726012 >> 172.21.15.115:0/2476726012 conn(0x7f54880f7d30 msgr2=0x7f54880fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 -- 172.21.15.115:0/2476726012 shutdown_connections 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.839+0000 7f548c8e2640 1 -- 172.21.15.115:0/2476726012 wait complete. 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 Processor -- start 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 -- start start 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fc550 0x7f5488071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488070080 con 0x7f54880fd820 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548c8e2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880701c0 con 0x7f54880fc550 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f5485d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:56.843 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f5485d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57564/0 (socket says 172.21.15.115:57564) 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f5485d9b640 1 -- 172.21.15.115:0/398323822 learned_addr learned my addr 172.21.15.115:0/398323822 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.840+0000 7f548659c640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fc550 0x7f5488071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f5485d9b640 1 -- 172.21.15.115:0/398323822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fc550 msgr2=0x7f5488071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f5485d9b640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fc550 0x7f5488071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f5485d9b640 1 -- 172.21.15.115:0/398323822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470005040 con 0x7f54880fd820 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f5485d9b640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547800b790 tx=0x7f54780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f547800c700 con 0x7f54880fd820 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f547800cd00 con 0x7f54880fd820 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54880704a0 con 0x7f54880fd820 2024-09-13T23:14:56.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5478015e80 con 0x7f54880fd820 2024-09-13T23:14:56.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.841+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5488115180 con 0x7f54880fd820 2024-09-13T23:14:56.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.842+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54880fb9b0 con 0x7f54880fd820 2024-09-13T23:14:56.845 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.843+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5478012070 con 0x7f54880fd820 2024-09-13T23:14:56.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.844+0000 7f547effd640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 0x7f54740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:56.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.844+0000 7f548659c640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 0x7f54740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:56.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.844+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f547808dac0 con 0x7f54880fd820 2024-09-13T23:14:56.846 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.844+0000 7f548659c640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 0x7f54740709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:56.849 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:56.848+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5478056b50 con 0x7f54880fd820 2024-09-13T23:14:57.031 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.030+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5488101c80 con 0x7f547406e530 2024-09-13T23:14:57.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.032+0000 7f547effd640 1 -- 172.21.15.115:0/398323822 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f5488101c80 con 0x7f547406e530 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 msgr2=0x7f54740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 0x7f54740709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470035040 comp rx=0 tx=0).stop 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 msgr2=0x7f548806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547800b790 tx=0x7f54780091d0 comp rx=0 tx=0).stop 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 shutdown_connections 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f547406e530 0x7f54740709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:57.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54880fd820 0x7f548806fa60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:57.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 --2- 172.21.15.115:0/398323822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54880fc550 0x7f5488071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:57.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 >> 172.21.15.115:0/398323822 conn(0x7f54880f7d30 msgr2=0x7f54880f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:57.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 shutdown_connections 2024-09-13T23:14:57.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:57.034+0000 7f548c8e2640 1 -- 172.21.15.115:0/398323822 wait complete. 2024-09-13T23:14:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:57 smithi152 ceph-mon[80164]: pgmap v234: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:14:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:57 smithi115 ceph-mon[91340]: pgmap v234: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:14:57.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T23:14:57.900 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:14:58.298 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:58 smithi115 ceph-mon[91340]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:58.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:58 smithi152 ceph-mon[80164]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:14:59.361 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:14:59 smithi115 ceph-mon[91340]: pgmap v235: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:14:59 smithi152 ceph-mon[80164]: pgmap v235: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 -- 172.21.15.115:0/1294910368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 msgr2=0x7fab580fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 --2- 172.21.15.115:0/1294910368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab580fb040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fab480048d0 tx=0x7fab48009da0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 -- 172.21.15.115:0/1294910368 shutdown_connections 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 --2- 172.21.15.115:0/1294910368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab580fb040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 --2- 172.21.15.115:0/1294910368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 0x7fab58102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 -- 172.21.15.115:0/1294910368 >> 172.21.15.115:0/1294910368 conn(0x7fab58071ac0 msgr2=0x7fab58071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 -- 172.21.15.115:0/1294910368 shutdown_connections 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.524+0000 7fab5c8be640 1 -- 172.21.15.115:0/1294910368 wait complete. 2024-09-13T23:14:59.547 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 Processor -- start 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 -- start start 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 0x7fab581137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58113da0 con 0x7fab580fabd0 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5c8be640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5810d1e0 con 0x7fab58102680 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57582/0 (socket says 172.21.15.115:57582) 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.525+0000 7fab5659c640 1 -- 172.21.15.115:0/3252730139 learned_addr learned my addr 172.21.15.115:0/3252730139 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab55d9b640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 0x7fab581137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5659c640 1 -- 172.21.15.115:0/3252730139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 msgr2=0x7fab581137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5659c640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 0x7fab581137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5659c640 1 -- 172.21.15.115:0/3252730139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48005040 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5659c640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab40002a50 tx=0x7fab40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab40007c30 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab4000f040 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5810d4c0 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab4000da90 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.526+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5810da30 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.527+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab580725d0 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.528+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fab4000dc30 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.528+0000 7fab4effd640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 0x7fab440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.528+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fab4008da20 con 0x7fab580fabd0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.528+0000 7fab55d9b640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 0x7fab440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.529+0000 7fab55d9b640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 0x7fab440709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab580f8d90 tx=0x7fab48035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:14:59.549 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.532+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab40056b30 con 0x7fab580fabd0 2024-09-13T23:14:59.711 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.710+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab5804b720 con 0x7fab4406e530 2024-09-13T23:14:59.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.719+0000 7fab4effd640 1 -- 172.21.15.115:0/3252730139 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fab5804b720 con 0x7fab4406e530 2024-09-13T23:14:59.720 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:14:59.720 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (7m) 14s ago 16m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (5m) 14s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (5m) 36s ago 15m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (19s) 14s ago 16m 47.9M - 9.4.12 2bacad6d85d8 179348b2dcf1 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (74s) 14s ago 11m 18.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 1036e851db03 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (95s) 14s ago 11m 70.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 b3c2cd84ec81 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (54s) 36s ago 11m 14.6M - 19.1.1-324-gecab7be5 0652ff2b5d78 0a8a451837f9 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (39s) 36s ago 10m 12.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 9f94a5e88ae3 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (7m) 14s ago 17m 513M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (6m) 36s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (6m) 14s ago 17m 52.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (6m) 36s ago 15m 42.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (8m) 14s ago 16m 17.0M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:14:59.721 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (7m) 36s ago 15m 16.8M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (5m) 14s ago 14m 110M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (4m) 14s ago 14m 107M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (4m) 14s ago 13m 90.2M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (3m) 36s ago 13m 117M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (3m) 36s ago 12m 101M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (2m) 36s ago 12m 94.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:14:59.722 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (6m) 14s ago 15m 62.3M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 msgr2=0x7fab440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 0x7fab440709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab580f8d90 tx=0x7fab48035040 comp rx=0 tx=0).stop 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 msgr2=0x7fab58113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab40002a50 tx=0x7fab40004600 comp rx=0 tx=0).stop 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 shutdown_connections 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fab4406e530 0x7fab440709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab58102680 0x7fab581137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 --2- 172.21.15.115:0/3252730139 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab580fabd0 0x7fab58113260 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:14:59.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 >> 172.21.15.115:0/3252730139 conn(0x7fab58071ac0 msgr2=0x7fab58105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:14:59.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 shutdown_connections 2024-09-13T23:14:59.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:14:59.722+0000 7fab5c8be640 1 -- 172.21.15.115:0/3252730139 wait complete. 2024-09-13T23:15:00.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade status' 2024-09-13T23:15:00.647 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:15:01.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:01 smithi115 ceph-mon[91340]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:01.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:01 smithi115 ceph-mon[91340]: pgmap v236: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:01 smithi152 ceph-mon[80164]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:01 smithi152 ceph-mon[80164]: pgmap v236: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- 172.21.15.115:0/1429648707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a440fb480 msgr2=0x7f8a440fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/1429648707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a440fb480 0x7f8a440fb8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8a300048d0 tx=0x7f8a30009da0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- 172.21.15.115:0/1429648707 shutdown_connections 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/1429648707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a440fb480 0x7f8a440fb8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/1429648707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a441014c0 0x7f8a44101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- 172.21.15.115:0/1429648707 >> 172.21.15.115:0/1429648707 conn(0x7f8a440f7000 msgr2=0x7f8a440f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- 172.21.15.115:0/1429648707 shutdown_connections 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- 172.21.15.115:0/1429648707 wait complete. 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 Processor -- start 2024-09-13T23:15:02.304 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.282+0000 7f8a4afd4640 1 -- start start 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a4afd4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a440fb480 0x7f8a4410e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a4afd4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a4afd4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4410edc0 con 0x7f8a441014c0 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a4afd4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4410ef30 con 0x7f8a440fb480 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57608/0 (socket says 172.21.15.115:57608) 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 -- 172.21.15.115:0/263801906 learned_addr learned my addr 172.21.15.115:0/263801906 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a48d70640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a440fb480 0x7f8a4410e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 -- 172.21.15.115:0/263801906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a440fb480 msgr2=0x7f8a4410e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a440fb480 0x7f8a4410e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 -- 172.21.15.115:0/263801906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30005040 con 0x7f8a441014c0 2024-09-13T23:15:02.305 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a43fff640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8a30003080 tx=0x7f8a30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a30038070 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a44117260 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a3002ade0 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.283+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3002c880 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.284+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a44117670 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.284+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a440fcbc0 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.285+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8a30030020 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.285+0000 7f8a417fa640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 0x7f8a340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.286+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8a300ae280 con 0x7f8a441014c0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.286+0000 7f8a48d70640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 0x7f8a340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.286+0000 7f8a48d70640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 0x7f8a340709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a38006fd0 tx=0x7f8a38008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:02.306 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.290+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8a30077310 con 0x7f8a441014c0 2024-09-13T23:15:02.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.473+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a4404b720 con 0x7f8a3406e530 2024-09-13T23:15:02.475 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.475+0000 7f8a417fa640 1 -- 172.21.15.115:0/263801906 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8a4404b720 con 0x7f8a3406e530 2024-09-13T23:15:02.475 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "target_image": null, 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "in_progress": false, 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "which": "", 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "services_complete": [], 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "progress": null, 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "message": "", 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout: "is_paused": false 2024-09-13T23:15:02.476 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 msgr2=0x7f8a340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 0x7f8a340709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a38006fd0 tx=0x7f8a38008040 comp rx=0 tx=0).stop 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 msgr2=0x7f8a4410e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8a30003080 tx=0x7f8a30009da0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 shutdown_connections 2024-09-13T23:15:02.478 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3406e530 0x7f8a340709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a441014c0 0x7f8a4410e730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 --2- 172.21.15.115:0/263801906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a440fb480 0x7f8a4410e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:02.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 >> 172.21.15.115:0/263801906 conn(0x7f8a440f7000 msgr2=0x7f8a440f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:02.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 shutdown_connections 2024-09-13T23:15:02.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:02.477+0000 7f8a4afd4640 1 -- 172.21.15.115:0/263801906 wait complete. 2024-09-13T23:15:03.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph health detail' 2024-09-13T23:15:03.455 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:15:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:03 smithi152 ceph-mon[80164]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:03.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:03 smithi115 ceph-mon[91340]: pgmap v237: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:04 smithi152 ceph-mon[80164]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:04.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:04 smithi115 ceph-mon[91340]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- 172.21.15.115:0/3225994320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 msgr2=0x7f4c440fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 --2- 172.21.15.115:0/3225994320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c440fe830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009c50 tx=0x7f4c34004d10 comp rx=0 tx=0).stop 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- 172.21.15.115:0/3225994320 shutdown_connections 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 --2- 172.21.15.115:0/3225994320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 0x7f4c44065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 --2- 172.21.15.115:0/3225994320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c440fe830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- 172.21.15.115:0/3225994320 >> 172.21.15.115:0/3225994320 conn(0x7f4c440723b0 msgr2=0x7f4c440727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:05.153 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- 172.21.15.115:0/3225994320 shutdown_connections 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- 172.21.15.115:0/3225994320 wait complete. 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 Processor -- start 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.137+0000 7f4c4911f640 1 -- start start 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 0x7f4c441131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44113cf0 con 0x7f4c440fe460 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4410d130 con 0x7f4c44064fc0 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:57618/0 (socket says 172.21.15.115:57618) 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 -- 172.21.15.115:0/2687121775 learned_addr learned my addr 172.21.15.115:0/2687121775 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c42d9d640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 0x7f4c441131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 -- 172.21.15.115:0/2687121775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 msgr2=0x7f4c441131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:05.154 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 0x7f4c441131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 -- 172.21.15.115:0/2687121775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340098b0 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4259c640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c002a50 tx=0x7f4c2c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2c007c30 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c2c00f040 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4410d410 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2c00da90 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.138+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4410d9b0 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.139+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440fdcf0 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.140+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4c2c00dd00 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.140+0000 7f4c3b7fe640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 0x7f4c300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.140+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4c2c08dad0 con 0x7f4c440fe460 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.140+0000 7f4c42d9d640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 0x7f4c300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:05.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.141+0000 7f4c42d9d640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 0x7f4c300709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004a30 tx=0x7f4c34004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:05.156 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.145+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4c2c056b60 con 0x7f4c440fe460 2024-09-13T23:15:05.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.379+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4c4410e850 con 0x7f4c440fe460 2024-09-13T23:15:05.380 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.379+0000 7f4c3b7fe640 1 -- 172.21.15.115:0/2687121775 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4c2c05a220 con 0x7f4c440fe460 2024-09-13T23:15:05.380 INFO:teuthology.orchestra.run.smithi115.stdout:HEALTH_OK 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 msgr2=0x7f4c300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 0x7f4c300709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004a30 tx=0x7f4c34004d10 comp rx=0 tx=0).stop 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 msgr2=0x7f4c441136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c002a50 tx=0x7f4c2c004600 comp rx=0 tx=0).stop 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 shutdown_connections 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4c3006e530 0x7f4c300709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c440fe460 0x7f4c441136f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 --2- 172.21.15.115:0/2687121775 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c44064fc0 0x7f4c441131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 >> 172.21.15.115:0/2687121775 conn(0x7f4c440723b0 msgr2=0x7f4c44105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:05.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 shutdown_connections 2024-09-13T23:15:05.383 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:05.381+0000 7f4c4911f640 1 -- 172.21.15.115:0/2687121775 wait complete. 2024-09-13T23:15:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:05 smithi152 ceph-mon[80164]: pgmap v238: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:05 smithi115 ceph-mon[91340]: pgmap v238: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:05.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T23:15:06.200 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:15:06.464 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:06 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2687121775' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:15:06.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:06 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2687121775' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:15:07.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:07 smithi115 ceph-mon[91340]: pgmap v239: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:07 smithi152 ceph-mon[80164]: pgmap v239: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 -- 172.21.15.115:0/894570880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 msgr2=0x7f4b941029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/894570880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b941029f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b840048d0 tx=0x7f4b84009da0 comp rx=0 tx=0).stop 2024-09-13T23:15:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 -- 172.21.15.115:0/894570880 shutdown_connections 2024-09-13T23:15:07.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/894570880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fac80 0x7f4b940fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/894570880 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b941029f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 -- 172.21.15.115:0/894570880 >> 172.21.15.115:0/894570880 conn(0x7f4b94070ce0 msgr2=0x7f4b940710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 -- 172.21.15.115:0/894570880 shutdown_connections 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 -- 172.21.15.115:0/894570880 wait complete. 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.904+0000 7f4b9a42b640 1 Processor -- start 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 -- start start 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fac80 0x7f4b940fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940fc970 con 0x7f4b94102620 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940fcae0 con 0x7f4b940fac80 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37606/0 (socket says 172.21.15.115:37606) 2024-09-13T23:15:07.934 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 -- 172.21.15.115:0/2594689617 learned_addr learned my addr 172.21.15.115:0/2594689617 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 -- 172.21.15.115:0/2594689617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fac80 msgr2=0x7f4b940fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fac80 0x7f4b940fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 -- 172.21.15.115:0/2594689617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84005040 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b8bfff640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b790 tx=0x7f4b7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c00c700 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94119510 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b7c00cd00 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.905+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7c015e70 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.906+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94119950 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.907+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b940657b0 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.907+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f4b7c012070 con 0x7f4b94102620 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.908+0000 7f4b917fa640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 0x7f4b800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:15:07.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.908+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4b7c08dde0 con 0x7f4b94102620 2024-09-13T23:15:07.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.908+0000 7f4b93fff640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 0x7f4b800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:15:07.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.908+0000 7f4b93fff640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 0x7f4b800709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b840043d0 tx=0x7f4b84009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:15:07.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:07.912+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b7c056e70 con 0x7f4b94102620 2024-09-13T23:15:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.144+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b94109680 con 0x7f4b94102620 2024-09-13T23:15:08.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.145+0000 7f4b917fa640 1 -- 172.21.15.115:0/2594689617 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f4b7c05a530 con 0x7f4b94102620 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:15:08.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:15:08.147 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 msgr2=0x7f4b800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 0x7f4b800709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b840043d0 tx=0x7f4b84009da0 comp rx=0 tx=0).stop 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 msgr2=0x7f4b940fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b790 tx=0x7f4b7c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 shutdown_connections 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f4b8006e530 0x7f4b800709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b94102620 0x7f4b940fc3a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 --2- 172.21.15.115:0/2594689617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b940fac80 0x7f4b940fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 >> 172.21.15.115:0/2594689617 conn(0x7f4b94070ce0 msgr2=0x7f4b94105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 shutdown_connections 2024-09-13T23:15:08.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:15:08.147+0000 7f4b9a42b640 1 -- 172.21.15.115:0/2594689617 wait complete. 2024-09-13T23:15:08.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:08 smithi115 ceph-mon[91340]: pgmap v240: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:08.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:08 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2594689617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:15:08.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T23:15:08.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:08 smithi152 ceph-mon[80164]: pgmap v240: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:08.969 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:08 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2594689617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:15:09.091 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:15:09.799 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:09.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:10.680 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:10 smithi115 ceph-mon[91340]: pgmap v241: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:10.884 INFO:teuthology.orchestra.run.smithi115.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T23:15:10.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:10 smithi152 ceph-mon[80164]: pgmap v241: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:11.581 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'sleep 60' 2024-09-13T23:15:11.835 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:15:13.290 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:13 smithi115 ceph-mon[91340]: pgmap v242: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:13.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:13 smithi152 ceph-mon[80164]: pgmap v242: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:15.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:15 smithi152 ceph-mon[80164]: pgmap v243: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:15.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:15 smithi115 ceph-mon[91340]: pgmap v243: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:17.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:17 smithi152 ceph-mon[80164]: pgmap v244: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:17.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:17 smithi115 ceph-mon[91340]: pgmap v244: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:19.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:19 smithi152 ceph-mon[80164]: pgmap v245: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:19 smithi115 ceph-mon[91340]: pgmap v245: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:21.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:21 smithi152 ceph-mon[80164]: pgmap v246: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:21.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:21 smithi115 ceph-mon[91340]: pgmap v246: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:23.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:23 smithi152 ceph-mon[80164]: pgmap v247: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:23 smithi115 ceph-mon[91340]: pgmap v247: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:24.300 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:24.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:25.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:25 smithi152 ceph-mon[80164]: pgmap v248: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:25 smithi115 ceph-mon[91340]: pgmap v248: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:27.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:27 smithi152 ceph-mon[80164]: pgmap v249: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:27.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:27 smithi115 ceph-mon[91340]: pgmap v249: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:29 smithi115 ceph-mon[91340]: pgmap v250: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:29.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:29 smithi152 ceph-mon[80164]: pgmap v250: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:31 smithi115 ceph-mon[91340]: pgmap v251: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:31 smithi152 ceph-mon[80164]: pgmap v251: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:33.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:33 smithi115 ceph-mon[91340]: pgmap v252: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:33.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:33 smithi152 ceph-mon[80164]: pgmap v252: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:35 smithi115 ceph-mon[91340]: pgmap v253: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:35 smithi152 ceph-mon[80164]: pgmap v253: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:37 smithi115 ceph-mon[91340]: pgmap v254: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:37 smithi152 ceph-mon[80164]: pgmap v254: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:39 smithi115 ceph-mon[91340]: pgmap v255: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:39.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:39 smithi152 ceph-mon[80164]: pgmap v255: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:39.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:41 smithi115 ceph-mon[91340]: pgmap v256: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:41.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:41 smithi152 ceph-mon[80164]: pgmap v256: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:43.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:43 smithi115 ceph-mon[91340]: pgmap v257: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:43.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:43 smithi152 ceph-mon[80164]: pgmap v257: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:45.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:45 smithi115 ceph-mon[91340]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:45.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:45 smithi152 ceph-mon[80164]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:47.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:47 smithi115 ceph-mon[91340]: pgmap v259: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:47 smithi152 ceph-mon[80164]: pgmap v259: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:48.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:48 smithi152 ceph-mon[80164]: pgmap v260: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:49.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:48 smithi115 ceph-mon[91340]: pgmap v260: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:49.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:49 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:15:50.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:49 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:15:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:15:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:15:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:15:50.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:50 smithi152 ceph-mon[80164]: pgmap v261: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:15:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:15:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:15:51.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:50 smithi115 ceph-mon[91340]: pgmap v261: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:53.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:53 smithi152 ceph-mon[80164]: pgmap v262: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:53.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:53 smithi115 ceph-mon[91340]: pgmap v262: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:15:54.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:54.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:15:55.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:55 smithi152 ceph-mon[80164]: pgmap v263: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:55.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:55 smithi115 ceph-mon[91340]: pgmap v263: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:57.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:57 smithi152 ceph-mon[80164]: pgmap v264: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:57 smithi115 ceph-mon[91340]: pgmap v264: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:15:59.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:15:59 smithi152 ceph-mon[80164]: pgmap v265: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:15:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:15:59 smithi115 ceph-mon[91340]: pgmap v265: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:01.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:01 smithi152 ceph-mon[80164]: pgmap v266: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:01.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:01 smithi115 ceph-mon[91340]: pgmap v266: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:03.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:03 smithi152 ceph-mon[80164]: pgmap v267: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:03.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:03 smithi115 ceph-mon[91340]: pgmap v267: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:05 smithi152 ceph-mon[80164]: pgmap v268: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:05.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:05 smithi115 ceph-mon[91340]: pgmap v268: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:07 smithi152 ceph-mon[80164]: pgmap v269: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:07.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:07 smithi115 ceph-mon[91340]: pgmap v269: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:09 smithi115 ceph-mon[91340]: pgmap v270: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:09.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:09.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:09 smithi152 ceph-mon[80164]: pgmap v270: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:09.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:11.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:11 smithi115 ceph-mon[91340]: pgmap v271: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:11 smithi152 ceph-mon[80164]: pgmap v271: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:13.477 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:13 smithi115 ceph-mon[91340]: pgmap v272: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:13 smithi152 ceph-mon[80164]: pgmap v272: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:14.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T23:16:14.403 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:15.544 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:15 smithi115 ceph-mon[91340]: pgmap v273: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:15 smithi152 ceph-mon[80164]: pgmap v273: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:16.106 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 -- 172.21.15.115:0/1705493218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900fb490 msgr2=0x7f11900fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 --2- 172.21.15.115:0/1705493218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900fb490 0x7f11900fb900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f117c0048d0 tx=0x7f117c009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 -- 172.21.15.115:0/1705493218 shutdown_connections 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 --2- 172.21.15.115:0/1705493218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11900fb490 0x7f11900fb900 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 --2- 172.21.15.115:0/1705493218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11901014d0 0x7f11901018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 -- 172.21.15.115:0/1705493218 >> 172.21.15.115:0/1705493218 conn(0x7f11900f7010 msgr2=0x7f11900f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 -- 172.21.15.115:0/1705493218 shutdown_connections 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.083+0000 7f1196bac640 1 -- 172.21.15.115:0/1705493218 wait complete. 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 Processor -- start 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 -- start start 2024-09-13T23:16:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11900fb490 0x7f119010e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119010ecc0 con 0x7f11901014d0 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f1196bac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119010ee30 con 0x7f11900fb490 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f118ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f118ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40494/0 (socket says 172.21.15.115:40494) 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.084+0000 7f118ffff640 1 -- 172.21.15.115:0/2109788989 learned_addr learned my addr 172.21.15.115:0/2109788989 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f1194948640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11900fb490 0x7f119010e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118ffff640 1 -- 172.21.15.115:0/2109788989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11900fb490 msgr2=0x7f119010e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118ffff640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11900fb490 0x7f119010e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118ffff640 1 -- 172.21.15.115:0/2109788989 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c005040 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118ffff640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117c038070 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f117c02ade0 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11901171f0 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f117c02c7e0 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.085+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190117650 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.086+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900fcbd0 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.087+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f117c030020 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.087+0000 7f118d7fa640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 0x7f11800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.087+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f117c0ade50 con 0x7f11901014d0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.087+0000 7f1194948640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 0x7f11800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:16.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.088+0000 7f1194948640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 0x7f11800709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1184007fd0 tx=0x7f1184009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:16.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.091+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f117c076f90 con 0x7f11901014d0 2024-09-13T23:16:16.270 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.269+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 --> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f119004b720 con 0x7f118006e530 2024-09-13T23:16:16.279 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.278+0000 7f118d7fa640 1 -- 172.21.15.115:0/2109788989 <== mgr.34104 v2:172.21.15.115:6800/68209964 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f119004b720 con 0x7f118006e530 2024-09-13T23:16:16.279 INFO:teuthology.orchestra.run.smithi115.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:16:16.279 INFO:teuthology.orchestra.run.smithi115.stdout:alertmanager.smithi115 smithi115 *:9093,9094 running (9m) 91s ago 17m 24.2M - 0.25.0 c8568f914cd2 c077195c87f7 2024-09-13T23:16:16.279 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi115 smithi115 running (7m) 91s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 c4fa94c0a8f7 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:crash.smithi152 smithi152 running (6m) 113s ago 16m 6891k - 19.1.1-324-gecab7be5 0652ff2b5d78 d9ad4c1d04eb 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:grafana.smithi115 smithi115 *:3000 running (95s) 91s ago 17m 47.9M - 9.4.12 2bacad6d85d8 179348b2dcf1 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.vlvabd smithi115 running (2m) 91s ago 12m 18.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 1036e851db03 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi115.ywbcks smithi115 running (2m) 91s ago 12m 70.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 b3c2cd84ec81 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.cmykpw smithi152 running (2m) 113s ago 12m 14.6M - 19.1.1-324-gecab7be5 0652ff2b5d78 0a8a451837f9 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mds.cephfs.smithi152.pntaqr smithi152 running (115s) 113s ago 12m 12.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 9f94a5e88ae3 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi115.eqesbc smithi115 *:8443,9283,8765 running (8m) 91s ago 18m 513M - 19.1.1-324-gecab7be5 0652ff2b5d78 61f81ecff659 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mgr.smithi152.ntylos smithi152 *:8443,9283,8765 running (8m) 113s ago 16m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 16dad3703a08 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi115 smithi115 running (7m) 91s ago 19m 52.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 4fc39f079203 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:mon.smithi152 smithi152 running (7m) 113s ago 16m 42.8M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 0ce493fa832a 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi115 smithi115 *:9100 running (9m) 91s ago 17m 17.0M - 1.5.0 0da6a335fe13 d95e89d962d7 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:node-exporter.smithi152 smithi152 *:9100 running (8m) 113s ago 16m 16.8M - 1.5.0 0da6a335fe13 baf3b8677444 2024-09-13T23:16:16.280 INFO:teuthology.orchestra.run.smithi115.stdout:osd.0 smithi115 running (6m) 91s ago 15m 110M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 ad3f53534fd4 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:osd.1 smithi115 running (6m) 91s ago 15m 107M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 2df7474939a8 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:osd.2 smithi115 running (5m) 91s ago 15m 90.2M 1557M 19.1.1-324-gecab7be5 0652ff2b5d78 b1b42c607379 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:osd.3 smithi152 running (4m) 113s ago 14m 117M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 fb09c583afe7 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:osd.4 smithi152 running (4m) 113s ago 14m 101M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 3cc5f1e5cb08 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:osd.5 smithi152 running (3m) 113s ago 13m 94.5M 2581M 19.1.1-324-gecab7be5 0652ff2b5d78 5e3e7221a0b6 2024-09-13T23:16:16.281 INFO:teuthology.orchestra.run.smithi115.stdout:prometheus.smithi115 smithi115 *:9095 running (8m) 91s ago 17m 62.3M - 2.43.0 a07b618ecd1d 5f6f07c35a14 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 msgr2=0x7f11800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 0x7f11800709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1184007fd0 tx=0x7f1184009e90 comp rx=0 tx=0).stop 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 msgr2=0x7f119010e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 shutdown_connections 2024-09-13T23:16:16.282 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f118006e530 0x7f11800709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f11901014d0 0x7f119010e6c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 --2- 172.21.15.115:0/2109788989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11900fb490 0x7f119010e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:16.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.280+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 >> 172.21.15.115:0/2109788989 conn(0x7f11900f7010 msgr2=0x7f11900f8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:16.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.281+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 shutdown_connections 2024-09-13T23:16:16.283 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:16.281+0000 7f1196bac640 1 -- 172.21.15.115:0/2109788989 wait complete. 2024-09-13T23:16:16.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T23:16:17.178 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:17.527 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:17 smithi115 ceph-mon[91340]: pgmap v274: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:17.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:17 smithi152 ceph-mon[80164]: pgmap v274: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:18.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:18 smithi115 ceph-mon[91340]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:18 smithi152 ceph-mon[80164]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 -- 172.21.15.115:0/3877986246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 msgr2=0x7f98dc0fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 --2- 172.21.15.115:0/3877986246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc0fd940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004900 tx=0x7f98cc009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 -- 172.21.15.115:0/3877986246 shutdown_connections 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 --2- 172.21.15.115:0/3877986246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc1065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 --2- 172.21.15.115:0/3877986246 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc0fd940 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 -- 172.21.15.115:0/3877986246 >> 172.21.15.115:0/3877986246 conn(0x7f98dc0f7010 msgr2=0x7f98dc0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 -- 172.21.15.115:0/3877986246 shutdown_connections 2024-09-13T23:16:18.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.882+0000 7f98e0e25640 1 -- 172.21.15.115:0/3877986246 wait complete. 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 Processor -- start 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 -- start start 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc113d90 con 0x7f98dc0fd570 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98e0e25640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc10d1d0 con 0x7f98dc0fdf10 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98da59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40514/0 (socket says 172.21.15.115:40514) 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98da59c640 1 -- 172.21.15.115:0/1165348220 learned_addr learned my addr 172.21.15.115:0/1165348220 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98d9d9b640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98da59c640 1 -- 172.21.15.115:0/1165348220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 msgr2=0x7f98dc113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:18.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.883+0000 7f98da59c640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98da59c640 1 -- 172.21.15.115:0/1165348220 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc005040 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98d9d9b640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98da59c640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004960 tx=0x7f98cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc038070 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98cc008ed0 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc10d450 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98cc0095a0 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.884+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc10d910 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.885+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc066330 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.885+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f98cc030020 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.886+0000 7f98d2ffd640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 0x7f98c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.886+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f98cc0ae150 con 0x7f98dc0fd570 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.886+0000 7f98d9d9b640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 0x7f98c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:18.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.886+0000 7f98d9d9b640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 0x7f98c80709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98dc10eb10 tx=0x7f98c4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:18.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:18.890+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98cc0771e0 con 0x7f98dc0fd570 2024-09-13T23:16:19.129 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.128+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98dc04b720 con 0x7f98dc0fd570 2024-09-13T23:16:19.129 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.128+0000 7f98d2ffd640 1 -- 172.21.15.115:0/1165348220 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f98cc07a8a0 con 0x7f98dc0fd570 2024-09-13T23:16:19.130 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-13T23:16:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "mon": { 2024-09-13T23:16:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:16:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "mgr": { 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd": { 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:16:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "overall": { 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-13T23:16:19.132 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-13T23:16:19.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 msgr2=0x7f98c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:19.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 0x7f98c80709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f98dc10eb10 tx=0x7f98c4009040 comp rx=0 tx=0).stop 2024-09-13T23:16:19.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 msgr2=0x7f98dc113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:19.133 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98cc004960 tx=0x7f98cc009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 shutdown_connections 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f98c806e530 0x7f98c80709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98dc0fdf10 0x7f98dc113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 --2- 172.21.15.115:0/1165348220 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98dc0fd570 0x7f98dc113250 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 >> 172.21.15.115:0/1165348220 conn(0x7f98dc0f7010 msgr2=0x7f98dc0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 shutdown_connections 2024-09-13T23:16:19.134 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:19.131+0000 7f98e0e25640 1 -- 172.21.15.115:0/1165348220 wait complete. 2024-09-13T23:16:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:19 smithi115 ceph-mon[91340]: pgmap v275: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:19 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1165348220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:19 smithi152 ceph-mon[80164]: pgmap v275: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:19 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1165348220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:19.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T23:16:20.082 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:21.503 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:21 smithi115 ceph-mon[91340]: pgmap v276: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:21.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 -- 172.21.15.115:0/1132537890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c06fab0 msgr2=0x7f103c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 --2- 172.21.15.115:0/1132537890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c06fab0 0x7f103c06fe80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10380048d0 tx=0x7f1038009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 -- 172.21.15.115:0/1132537890 shutdown_connections 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 --2- 172.21.15.115:0/1132537890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f103c0703c0 0x7f103c108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 --2- 172.21.15.115:0/1132537890 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c06fab0 0x7f103c06fe80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 -- 172.21.15.115:0/1132537890 >> 172.21.15.115:0/1132537890 conn(0x7f103c0f80f0 msgr2=0x7f103c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 -- 172.21.15.115:0/1132537890 shutdown_connections 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.702+0000 7f104477d640 1 -- 172.21.15.115:0/1132537890 wait complete. 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 Processor -- start 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 -- start start 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f103c06fab0 0x7f103c1157a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:21.706 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c1163c0 con 0x7f103c0703c0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f104477d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c10f740 con 0x7f103c06fab0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40532/0 (socket says 172.21.15.115:40532) 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 -- 172.21.15.115:0/2157613619 learned_addr learned my addr 172.21.15.115:0/2157613619 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 -- 172.21.15.115:0/2157613619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f103c06fab0 msgr2=0x7f103c1157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f103c06fab0 0x7f103c1157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.703+0000 7f1041d18640 1 -- 172.21.15.115:0/2157613619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038005040 con 0x7f103c0703c0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f1041d18640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b790 tx=0x7f102c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102c00c700 con 0x7f103c0703c0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f102c00cd00 con 0x7f103c0703c0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c10f9d0 con 0x7f103c0703c0 2024-09-13T23:16:21.707 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f102c015e70 con 0x7f103c0703c0 2024-09-13T23:16:21.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.704+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c10fef0 con 0x7f103c0703c0 2024-09-13T23:16:21.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.705+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0711f0 con 0x7f103c0703c0 2024-09-13T23:16:21.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.705+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f102c012070 con 0x7f103c0703c0 2024-09-13T23:16:21.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.706+0000 7f1032ffd640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 0x7f10280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:21.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.706+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f102c08dce0 con 0x7f103c0703c0 2024-09-13T23:16:21.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.706+0000 7f1042519640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 0x7f10280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:21.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.706+0000 7f1042519640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 0x7f10280709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f103802a530 tx=0x7f1038009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:21.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.710+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f102c056df0 con 0x7f103c0703c0 2024-09-13T23:16:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:21 smithi152 ceph-mon[80164]: pgmap v276: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.941+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f103c04b720 con 0x7f103c0703c0 2024-09-13T23:16:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.941+0000 7f1032ffd640 1 -- 172.21.15.115:0/2157613619 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f102c05a4b0 con 0x7f103c0703c0 2024-09-13T23:16:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 msgr2=0x7f10280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 0x7f10280709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f103802a530 tx=0x7f1038009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 msgr2=0x7f103c115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:21.945 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b790 tx=0x7f102c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 shutdown_connections 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f102806e530 0x7f10280709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f103c0703c0 0x7f103c115ce0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 --2- 172.21.15.115:0/2157613619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f103c06fab0 0x7f103c1157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.943+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 >> 172.21.15.115:0/2157613619 conn(0x7f103c0f80f0 msgr2=0x7f103c0f9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.944+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 shutdown_connections 2024-09-13T23:16:21.946 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:21.944+0000 7f104477d640 1 -- 172.21.15.115:0/2157613619 wait complete. 2024-09-13T23:16:21.954 INFO:teuthology.orchestra.run.smithi115.stdout:true 2024-09-13T23:16:22.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:22 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2157613619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:22.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T23:16:22.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:22 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2157613619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:22.870 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:23.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:23 smithi115 ceph-mon[91340]: pgmap v277: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:23.619 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:23 smithi152 ceph-mon[80164]: pgmap v277: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:24.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- 172.21.15.115:0/2521477679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fdf00 msgr2=0x7fb8481065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 --2- 172.21.15.115:0/2521477679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fdf00 0x7fb8481065d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb830004900 tx=0x7fb830009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- 172.21.15.115:0/2521477679 shutdown_connections 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 --2- 172.21.15.115:0/2521477679 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fdf00 0x7fb8481065d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 --2- 172.21.15.115:0/2521477679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fd560 0x7fb8480fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- 172.21.15.115:0/2521477679 >> 172.21.15.115:0/2521477679 conn(0x7fb8480f7000 msgr2=0x7fb8480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- 172.21.15.115:0/2521477679 shutdown_connections 2024-09-13T23:16:24.591 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- 172.21.15.115:0/2521477679 wait complete. 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 Processor -- start 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- start start 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fdf00 0x7fb848113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848113ee0 con 0x7fb8480fd560 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb84e92a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84810d2d0 con 0x7fb8480fdf00 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.574+0000 7fb847fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40554/0 (socket says 172.21.15.115:40554) 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 -- 172.21.15.115:0/1105412140 learned_addr learned my addr 172.21.15.115:0/1105412140 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb83ffff640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fdf00 0x7fb848113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 -- 172.21.15.115:0/1105412140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fdf00 msgr2=0x7fb848113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:24.592 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fdf00 0x7fb848113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 -- 172.21.15.115:0/1105412140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830005040 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb847fff640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b790 tx=0x7fb8380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb83800c700 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb83800cd00 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb838015e80 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84810d5b0 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.575+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84810dad0 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.576+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480662b0 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.577+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb838012070 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.577+0000 7fb8457fa640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.577+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb83808dac0 con 0x7fb8480fd560 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.577+0000 7fb83ffff640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:24.593 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.578+0000 7fb83ffff640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb830009ac0 tx=0x7fb830035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:24.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.582+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb838056bd0 con 0x7fb8480fd560 2024-09-13T23:16:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:24.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.816+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8480fac40 con 0x7fb8480fd560 2024-09-13T23:16:24.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.816+0000 7fb8457fa640 1 -- 172.21.15.115:0/1105412140 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb83805a290 con 0x7fb8480fd560 2024-09-13T23:16:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 msgr2=0x7fb8340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb830009ac0 tx=0x7fb830035040 comp rx=0 tx=0).stop 2024-09-13T23:16:24.820 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 msgr2=0x7fb848113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b790 tx=0x7fb8380091d0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 shutdown_connections 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8480fdf00 0x7fb848113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 --2- 172.21.15.115:0/1105412140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8480fd560 0x7fb848113310 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 >> 172.21.15.115:0/1105412140 conn(0x7fb8480f7000 msgr2=0x7fb8480f8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 shutdown_connections 2024-09-13T23:16:24.821 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:24.818+0000 7fb84e92a640 1 -- 172.21.15.115:0/1105412140 wait complete. 2024-09-13T23:16:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T23:16:25.420 DEBUG:teuthology.parallel:result is None 2024-09-13T23:16:25.420 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:16:25.435 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:16:25.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T23:16:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:25 smithi115 ceph-mon[91340]: pgmap v278: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:25.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:25 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1105412140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:25.681 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:25.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:25 smithi152 ceph-mon[80164]: pgmap v278: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:25.720 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:25 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1105412140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:16:27.372 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/182192066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73700facf0 msgr2=0x7f73700fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 --2- 172.21.15.115:0/182192066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73700facf0 0x7f73700fb160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f73640048d0 tx=0x7f7364009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/182192066 shutdown_connections 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 --2- 172.21.15.115:0/182192066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73700facf0 0x7f73700fb160 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 --2- 172.21.15.115:0/182192066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7370102670 0x7f7370102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/182192066 >> 172.21.15.115:0/182192066 conn(0x7f7370070d50 msgr2=0x7f7370071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/182192066 shutdown_connections 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/182192066 wait complete. 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 Processor -- start 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- start start 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73700facf0 0x7f73700fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:27.373 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73700fc9e0 con 0x7f7370102670 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73700fcb50 con 0x7f73700facf0 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52810/0 (socket says 172.21.15.115:52810) 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 -- 172.21.15.115:0/2044114399 learned_addr learned my addr 172.21.15.115:0/2044114399 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73759a3640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73700facf0 0x7f73700fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 -- 172.21.15.115:0/2044114399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73700facf0 msgr2=0x7f73700fbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73700facf0 0x7f73700fbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 -- 172.21.15.115:0/2044114399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364005040 con 0x7f7370102670 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f73751a2640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7364003080 tx=0x7f7364009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7364038070 con 0x7f7370102670 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73640097e0 con 0x7f7370102670 2024-09-13T23:16:27.374 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370119590 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f736403d420 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.348+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7370119910 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.349+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73700657b0 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.350+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f7364030020 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.350+0000 7f736e7fc640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 0x7f73580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.350+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f73640ae780 con 0x7f7370102670 2024-09-13T23:16:27.375 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.350+0000 7f73759a3640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 0x7f73580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.351+0000 7f73759a3640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 0x7f73580709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73700652d0 tx=0x7f7360009620 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:27.376 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.354+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7364077810 con 0x7f7370102670 2024-09-13T23:16:27.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:27 smithi115 ceph-mon[91340]: pgmap v279: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.554+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f73701096d0 con 0x7f7370102670 2024-09-13T23:16:27.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.555+0000 7f736e7fc640 1 -- 172.21.15.115:0/2044114399 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+2010 (secure 0 0 0) 0x7f736407aed0 con 0x7f7370102670 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:e43 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:btime 2024-09-13T23:14:28:576067+0000 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:legacy client fscid: 1 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:fs_name cephfs 2024-09-13T23:16:27.557 INFO:teuthology.orchestra.run.smithi115.stdout:epoch 43 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:created 2024-09-13T23:03:48.502784+0000 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:modified 2024-09-13T23:14:28.576050+0000 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:tableserver 0 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:root 0 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:session_timeout 60 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:session_autoclose 300 2024-09-13T23:16:27.558 INFO:teuthology.orchestra.run.smithi115.stdout:max_file_size 1099511627776 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:max_xattr_size 65536 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:required_client_features {} 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure 0 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:last_failure_osd_epoch 81 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:max_mds 2 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:in 0,1 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:up {0=34438,1=34442} 2024-09-13T23:16:27.559 INFO:teuthology.orchestra.run.smithi115.stdout:failed 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:damaged 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:stopped 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:data_pools [3] 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:metadata_pool 2 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:inline_data disabled 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:balancer 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:bal_rank_mask -1 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:standby_count_wanted 1 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:qdb_cluster leader: 34438 members: 34442,34438 2024-09-13T23:16:27.560 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.ywbcks{0:34438} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.115:6826/2183849912,v1:172.21.15.115:6827/2183849912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:16:27.561 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.cmykpw{0:44327} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6824/1935544166,v1:172.21.15.152:6825/1935544166] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:16:27.561 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi115.vlvabd{1:34442} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.115:6828/3057534468,v1:172.21.15.115:6829/3057534468] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:16:27.561 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.cephfs.smithi152.pntaqr{1:44331} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.152:6826/2974383973,v1:172.21.15.152:6827/2974383973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:16:27.561 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:27.561 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 msgr2=0x7f73580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 0x7f73580709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73700652d0 tx=0x7f7360009620 comp rx=0 tx=0).stop 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 msgr2=0x7f73700fc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7364003080 tx=0x7f7364009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 shutdown_connections 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f735806e530 0x7f73580709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7370102670 0x7f73700fc410 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 --2- 172.21.15.115:0/2044114399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73700facf0 0x7f73700fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 >> 172.21.15.115:0/2044114399 conn(0x7f7370070d50 msgr2=0x7f73700f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 shutdown_connections 2024-09-13T23:16:27.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:27.557+0000 7f7377c07640 1 -- 172.21.15.115:0/2044114399 wait complete. 2024-09-13T23:16:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:27 smithi152 ceph-mon[80164]: pgmap v279: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:28.219 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T23:16:28.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T23:16:28.475 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:28.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:28 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2044114399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:16:28.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:28 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2044114399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:16:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:29 smithi115 ceph-mon[91340]: pgmap v280: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:29.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:29 smithi152 ceph-mon[80164]: pgmap v280: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:30.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- 172.21.15.115:0/3465576974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fd5a0 msgr2=0x7f42b40fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:30.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3465576974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fd5a0 0x7f42b40fd970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f42a80048d0 tx=0x7f42a8009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- 172.21.15.115:0/3465576974 shutdown_connections 2024-09-13T23:16:30.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3465576974 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fdf40 0x7f42b4106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3465576974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fd5a0 0x7f42b40fd970 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- 172.21.15.115:0/3465576974 >> 172.21.15.115:0/3465576974 conn(0x7f42b40f7060 msgr2=0x7f42b40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- 172.21.15.115:0/3465576974 shutdown_connections 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- 172.21.15.115:0/3465576974 wait complete. 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 Processor -- start 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.121+0000 7f42bafc0640 1 -- start start 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42bafc0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fd5a0 0x7f42b4113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42bafc0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42bafc0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b4113dd0 con 0x7f42b40fdf40 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42bafc0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b410d210 con 0x7f42b40fd5a0 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:30.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52828/0 (socket says 172.21.15.115:52828) 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 -- 172.21.15.115:0/3740317450 learned_addr learned my addr 172.21.15.115:0/3740317450 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b8d5c640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fd5a0 0x7f42b4113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 -- 172.21.15.115:0/3740317450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fd5a0 msgr2=0x7f42b4113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fd5a0 0x7f42b4113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 -- 172.21.15.115:0/3740317450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8005040 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.122+0000 7f42b3fff640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c790 tx=0x7f42a00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.123+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a000a820 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.123+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42a000ae20 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.123+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b410d4f0 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.123+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a00113a0 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.123+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b410da10 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.124+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b40662b0 con 0x7f42b40fdf40 2024-09-13T23:16:30.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.124+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f42a000a980 con 0x7f42b40fdf40 2024-09-13T23:16:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.124+0000 7f42b17fa640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 0x7f42a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.125+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f42a008e280 con 0x7f42b40fdf40 2024-09-13T23:16:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.125+0000 7f42b8d5c640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 0x7f42a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.125+0000 7f42b8d5c640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 0x7f42a40709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42a8007ac0 tx=0x7f42a8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:30.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.129+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f42a0057430 con 0x7f42b40fdf40 2024-09-13T23:16:30.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.332+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b41095a0 con 0x7f42b40fdf40 2024-09-13T23:16:30.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.332+0000 7f42b17fa640 1 -- 172.21.15.115:0/3740317450 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+5299 (secure 0 0 0) 0x7f42a005aaf0 con 0x7f42b40fdf40 2024-09-13T23:16:30.333 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:30.334 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":43,"btime":"2024-09-13T23:14:28:576067+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:14:28.576050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34438,"mds_1":34442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":1,"incarnation":41,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44327":{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44331":{"gid":44331,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6827/2974383973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2974383973},{"type":"v1","addr":"172.21.15.152:6827","nonce":2974383973}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34442,34438]},"id":1}]} 2024-09-13T23:16:30.334 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 43 2024-09-13T23:16:30.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.334+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 msgr2=0x7f42a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.334+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 0x7f42a40709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42a8007ac0 tx=0x7f42a8035040 comp rx=0 tx=0).stop 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.334+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 msgr2=0x7f42b41137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.334+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c790 tx=0x7f42a00043c0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 shutdown_connections 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f42a406e530 0x7f42a40709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f42b40fdf40 0x7f42b41137d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 --2- 172.21.15.115:0/3740317450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b40fd5a0 0x7f42b4113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 >> 172.21.15.115:0/3740317450 conn(0x7f42b40f7060 msgr2=0x7f42b40f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 shutdown_connections 2024-09-13T23:16:30.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:30.335+0000 7f42bafc0640 1 -- 172.21.15.115:0/3740317450 wait complete. 2024-09-13T23:16:30.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:30 smithi115 ceph-mon[91340]: pgmap v281: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:30.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:30 smithi152 ceph-mon[80164]: pgmap v281: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:30.998 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-13T23:16:30.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T23:16:31.244 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:31.517 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:31 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3740317450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:16:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:31 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3740317450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:16:32.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:32 smithi115 ceph-mon[91340]: pgmap v282: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:32.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:32 smithi152 ceph-mon[80164]: pgmap v282: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 -- 172.21.15.115:0/246795789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 msgr2=0x7fb1b80fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/246795789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b80fbbe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40048d0 tx=0x7fb1b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 -- 172.21.15.115:0/246795789 shutdown_connections 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/246795789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 0x7fb1b80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/246795789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b80fbbe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 -- 172.21.15.115:0/246795789 >> 172.21.15.115:0/246795789 conn(0x7fb1b80723b0 msgr2=0x7fb1b80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 -- 172.21.15.115:0/246795789 shutdown_connections 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.961+0000 7fb1bebb9640 1 -- 172.21.15.115:0/246795789 wait complete. 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 Processor -- start 2024-09-13T23:16:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 -- start start 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 0x7fb1b8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8113d50 con 0x7fb1b80fb810 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bebb9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b810d190 con 0x7fb1b80fcf80 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.962+0000 7fb1bc955640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52856/0 (socket says 172.21.15.115:52856) 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 -- 172.21.15.115:0/3953202255 learned_addr learned my addr 172.21.15.115:0/3953202255 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1affff640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 0x7fb1b8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 -- 172.21.15.115:0/3953202255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 msgr2=0x7fb1b8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 0x7fb1b8113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 -- 172.21.15.115:0/3953202255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4005040 con 0x7fb1b80fb810 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bc955640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1b4038070 con 0x7fb1b80fb810 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b810d410 con 0x7fb1b80fb810 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1b402ade0 con 0x7fb1b80fb810 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1b402c7e0 con 0x7fb1b80fb810 2024-09-13T23:16:32.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.963+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b810d950 con 0x7fb1b80fb810 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.965+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80fcbc0 con 0x7fb1b80fb810 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.965+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb1b4030020 con 0x7fb1b80fb810 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.966+0000 7fb1ad7fa640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 0x7fb1a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.966+0000 7fb1affff640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 0x7fb1a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.966+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb1b40adda0 con 0x7fb1b80fb810 2024-09-13T23:16:32.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.966+0000 7fb1affff640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 0x7fb1a00709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8007fd0 tx=0x7fb1a8009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:32.971 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:32.970+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1b4076f60 con 0x7fb1b80fb810 2024-09-13T23:16:33.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.168+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fb1b804b750 con 0x7fb1b80fb810 2024-09-13T23:16:33.169 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.168+0000 7fb1ad7fa640 1 -- 172.21.15.115:0/3953202255 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v43) v1 ==== 107+0+4931 (secure 0 0 0) 0x7fb1b407a620 con 0x7fb1b80fb810 2024-09-13T23:16:33.170 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:33.170 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":20,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:05:45.291299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/3700826071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3700826071},{"type":"v1","addr":"172.21.15.115:6827","nonce":3700826071}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24261":{"gid":24261,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6827/510740987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":510740987},{"type":"v1","addr":"172.21.15.152:6827","nonce":510740987}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:16:33.170 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 20 2024-09-13T23:16:33.171 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.170+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 msgr2=0x7fb1a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.170+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 0x7fb1a00709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8007fd0 tx=0x7fb1a8009e90 comp rx=0 tx=0).stop 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.170+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 msgr2=0x7fb1b8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.170+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b4009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 shutdown_connections 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb1a006e530 0x7fb1a00709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1b80fcf80 0x7fb1b8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 --2- 172.21.15.115:0/3953202255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1b80fb810 0x7fb1b8113210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 >> 172.21.15.115:0/3953202255 conn(0x7fb1b80723b0 msgr2=0x7fb1b80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 shutdown_connections 2024-09-13T23:16:33.172 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:33.171+0000 7fb1bebb9640 1 -- 172.21.15.115:0/3953202255 wait complete. 2024-09-13T23:16:33.548 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:33 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3953202255' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T23:16:33.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:33 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3953202255' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T23:16:33.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T23:16:34.067 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:34.450 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:34 smithi115 ceph-mon[91340]: pgmap v283: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:34.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:34 smithi152 ceph-mon[80164]: pgmap v283: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:35.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 -- 172.21.15.115:0/3578728749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 msgr2=0x7fddd8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:35.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 --2- 172.21.15.115:0/3578728749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8102900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fddc80048d0 tx=0x7fddc8009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 -- 172.21.15.115:0/3578728749 shutdown_connections 2024-09-13T23:16:35.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 --2- 172.21.15.115:0/3578728749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 --2- 172.21.15.115:0/3578728749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8102900 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 -- 172.21.15.115:0/3578728749 >> 172.21.15.115:0/3578728749 conn(0x7fddd80f80f0 msgr2=0x7fddd80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 -- 172.21.15.115:0/3578728749 shutdown_connections 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.549+0000 7fddde694640 1 -- 172.21.15.115:0/3578728749 wait complete. 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 Processor -- start 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 -- start start 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8113d50 con 0x7fddd8102530 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddde694640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd810d190 con 0x7fddd8102ed0 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddd7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddd7fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52874/0 (socket says 172.21.15.115:52874) 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddd7fff640 1 -- 172.21.15.115:0/793515255 learned_addr learned my addr 172.21.15.115:0/793515255 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:35.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.550+0000 7fddcffff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd7fff640 1 -- 172.21.15.115:0/793515255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 msgr2=0x7fddd8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd7fff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd8113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd7fff640 1 -- 172.21.15.115:0/793515255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc8005040 con 0x7fddd8102530 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddcffff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd7fff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:35.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc8038070 con 0x7fddd8102530 2024-09-13T23:16:35.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fddc802ade0 con 0x7fddd8102530 2024-09-13T23:16:35.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd810d410 con 0x7fddd8102530 2024-09-13T23:16:35.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddc802c7e0 con 0x7fddd8102530 2024-09-13T23:16:35.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.551+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd810d950 con 0x7fddd8102530 2024-09-13T23:16:35.556 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.552+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80fdcb0 con 0x7fddd8102530 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.552+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fddc8030020 con 0x7fddd8102530 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.553+0000 7fddd57fa640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 0x7fddc40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.553+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fddc80ade50 con 0x7fddd8102530 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.553+0000 7fddcffff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 0x7fddc40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.554+0000 7fddcffff640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 0x7fddc40709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009fd0 tx=0x7fddc0009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:35.558 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.557+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fddc8076f90 con 0x7fddd8102530 2024-09-13T23:16:35.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.767+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fddd804b720 con 0x7fddd8102530 2024-09-13T23:16:35.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.767+0000 7fddd57fa640 1 -- 172.21.15.115:0/793515255 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v43) v1 ==== 107+0+4932 (secure 0 0 0) 0x7fddc807a650 con 0x7fddd8102530 2024-09-13T23:16:35.768 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:35.768 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":21,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:06:21.400942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/3700826071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3700826071},{"type":"v1","addr":"172.21.15.115:6827","nonce":3700826071}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24261":{"gid":24261,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6827/510740987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":510740987},{"type":"v1","addr":"172.21.15.152:6827","nonce":510740987}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:16:35.769 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 21 2024-09-13T23:16:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 msgr2=0x7fddc40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 0x7fddc40709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009fd0 tx=0x7fddc0009e50 comp rx=0 tx=0).stop 2024-09-13T23:16:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 msgr2=0x7fddd8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.770 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 shutdown_connections 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fddc406e530 0x7fddc40709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fddd8102ed0 0x7fddd8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 --2- 172.21.15.115:0/793515255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddd8102530 0x7fddd8113210 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 >> 172.21.15.115:0/793515255 conn(0x7fddd80f80f0 msgr2=0x7fddd80f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 shutdown_connections 2024-09-13T23:16:35.771 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:35.769+0000 7fddde694640 1 -- 172.21.15.115:0/793515255 wait complete. 2024-09-13T23:16:36.049 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:35 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/793515255' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T23:16:36.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:35 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/793515255' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T23:16:36.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T23:16:36.716 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:37.080 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:36 smithi115 ceph-mon[91340]: pgmap v284: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:37.218 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:36 smithi152 ceph-mon[80164]: pgmap v284: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:38.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 -- 172.21.15.115:0/2428194039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102550 msgr2=0x7fb458102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:38.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/2428194039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102550 0x7fb458102920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4500048d0 tx=0x7fb450009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 -- 172.21.15.115:0/2428194039 shutdown_connections 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/2428194039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102ef0 0x7fb4580fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/2428194039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102550 0x7fb458102920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 -- 172.21.15.115:0/2428194039 >> 172.21.15.115:0/2428194039 conn(0x7fb4580f80f0 msgr2=0x7fb4580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 -- 172.21.15.115:0/2428194039 shutdown_connections 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.331+0000 7fb45d6f5640 1 -- 172.21.15.115:0/2428194039 wait complete. 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 Processor -- start 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 -- start start 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102550 0x7fb4581135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581141d0 con 0x7fb458102ef0 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb45d6f5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45810d550 con 0x7fb458102550 2024-09-13T23:16:38.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37318/0 (socket says 172.21.15.115:37318) 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 -- 172.21.15.115:0/1839479193 learned_addr learned my addr 172.21.15.115:0/1839479193 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb456ffd640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102550 0x7fb4581135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 -- 172.21.15.115:0/1839479193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102550 msgr2=0x7fb4581135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102550 0x7fb4581135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.332+0000 7fb4567fc640 1 -- 172.21.15.115:0/1839479193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450005040 con 0x7fb458102ef0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb4567fc640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb44000b540 tx=0x7fb4400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44000f6f0 con 0x7fb458102ef0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45810d7e0 con 0x7fb458102ef0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb44000fcf0 con 0x7fb458102ef0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4400103a0 con 0x7fb458102ef0 2024-09-13T23:16:38.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.333+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45810dd00 con 0x7fb458102ef0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.334+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580fdcd0 con 0x7fb458102ef0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.334+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb44000f850 con 0x7fb458102ef0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.335+0000 7fb44f7fe640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 0x7fb4440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.335+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb44008e1a0 con 0x7fb458102ef0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.335+0000 7fb456ffd640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 0x7fb4440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.335+0000 7fb456ffd640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 0x7fb4440709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb450035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:38.366 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.339+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4400572b0 con 0x7fb458102ef0 2024-09-13T23:16:38.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.539+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fb458109690 con 0x7fb458102ef0 2024-09-13T23:16:38.540 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.539+0000 7fb44f7fe640 1 -- 172.21.15.115:0/1839479193 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v43) v1 ==== 107+0+4946 (secure 0 0 0) 0x7fb44005a970 con 0x7fb458102ef0 2024-09-13T23:16:38.540 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:38.541 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":22,"btime":"2024-09-13T23:09:15:375366+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:09:15.375359+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/3700826071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3700826071},{"type":"v1","addr":"172.21.15.115:6827","nonce":3700826071}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24261":{"gid":24261,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6827/510740987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":510740987},{"type":"v1","addr":"172.21.15.152:6827","nonce":510740987}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24257]},"id":1}]} 2024-09-13T23:16:38.541 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 22 2024-09-13T23:16:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.541+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 msgr2=0x7fb4440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.541+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 0x7fb4440709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb450000c00 tx=0x7fb450035040 comp rx=0 tx=0).stop 2024-09-13T23:16:38.542 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.541+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 msgr2=0x7fb458113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.541+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb44000b540 tx=0x7fb4400091a0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 shutdown_connections 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb44406e530 0x7fb4440709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb458102ef0 0x7fb458113af0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 --2- 172.21.15.115:0/1839479193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb458102550 0x7fb4581135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 >> 172.21.15.115:0/1839479193 conn(0x7fb4580f80f0 msgr2=0x7fb4580f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 shutdown_connections 2024-09-13T23:16:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:38.542+0000 7fb45d6f5640 1 -- 172.21.15.115:0/1839479193 wait complete. 2024-09-13T23:16:39.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T23:16:39.446 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:39 smithi152 ceph-mon[80164]: pgmap v285: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:39 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1839479193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T23:16:39.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:39 smithi115 ceph-mon[91340]: pgmap v285: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:39 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1839479193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T23:16:39.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:41.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- 172.21.15.115:0/2744900572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 msgr2=0x7f85881007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:41.144 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 --2- 172.21.15.115:0/2744900572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f85881007e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f857c0048d0 tx=0x7f857c009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- 172.21.15.115:0/2744900572 shutdown_connections 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 --2- 172.21.15.115:0/2744900572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f85880fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 --2- 172.21.15.115:0/2744900572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f85881007e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- 172.21.15.115:0/2744900572 >> 172.21.15.115:0/2744900572 conn(0x7f8588070ce0 msgr2=0x7f85880710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- 172.21.15.115:0/2744900572 shutdown_connections 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- 172.21.15.115:0/2744900572 wait complete. 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 Processor -- start 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 -- start start 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f858810e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.121+0000 7f858f219640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858f219640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858810ed60 con 0x7f8588100410 2024-09-13T23:16:41.145 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858f219640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858810eed0 con 0x7f85880fbd90 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37332/0 (socket says 172.21.15.115:37332) 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 -- 172.21.15.115:0/1787941276 learned_addr learned my addr 172.21.15.115:0/1787941276 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858cfb5640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f858810e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 -- 172.21.15.115:0/1787941276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 msgr2=0x7f858810e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f858810e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 -- 172.21.15.115:0/1787941276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c005040 con 0x7f8588100410 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858cfb5640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f858810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f8587fff640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f857400c810 tx=0x7f85740043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f857400a820 con 0x7f8588100410 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8588117240 con 0x7f8588100410 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f857400ae20 con 0x7f8588100410 2024-09-13T23:16:41.146 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85740115c0 con 0x7f8588100410 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.122+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85881176d0 con 0x7f8588100410 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.123+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85880fcda0 con 0x7f8588100410 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.124+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8574012840 con 0x7f8588100410 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.124+0000 7f85857fa640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 0x7f85780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.124+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f857408e740 con 0x7f8588100410 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.124+0000 7f858cfb5640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 0x7f85780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.125+0000 7f858cfb5640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 0x7f85780709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f857c007ac0 tx=0x7f857c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:41.147 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.129+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f857405b300 con 0x7f8588100410 2024-09-13T23:16:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.335+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f8588074c00 con 0x7f8588100410 2024-09-13T23:16:41.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.336+0000 7f85857fa640 1 -- 172.21.15.115:0/1787941276 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v43) v1 ==== 107+0+4945 (secure 0 0 0) 0x7f857405ae90 con 0x7f8588100410 2024-09-13T23:16:41.337 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:41.337 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":23,"btime":"2024-09-13T23:09:41:170028+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:09:40.461781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14474":{"gid":14474,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6827/3700826071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3700826071},{"type":"v1","addr":"172.21.15.115:6827","nonce":3700826071}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24261":{"gid":24261,"name":"cephfs.smithi152.pntaqr","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6827/510740987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":510740987},{"type":"v1","addr":"172.21.15.152:6827","nonce":510740987}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24257,14464]},"id":1}]} 2024-09-13T23:16:41.337 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 23 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 msgr2=0x7f85780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 0x7f85780709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f857c007ac0 tx=0x7f857c035040 comp rx=0 tx=0).stop 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 msgr2=0x7f858810e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f857400c810 tx=0x7f85740043c0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 shutdown_connections 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f857806e530 0x7f85780709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.339 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8588100410 0x7f858810e710 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 --2- 172.21.15.115:0/1787941276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85880fbd90 0x7f858810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 >> 172.21.15.115:0/1787941276 conn(0x7f8588070ce0 msgr2=0x7f85880f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 shutdown_connections 2024-09-13T23:16:41.340 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:41.338+0000 7f858f219640 1 -- 172.21.15.115:0/1787941276 wait complete. 2024-09-13T23:16:41.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:41 smithi152 ceph-mon[80164]: pgmap v286: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:41 smithi115 ceph-mon[91340]: pgmap v286: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:42.042 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T23:16:42.291 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:42.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:42 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1787941276' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T23:16:42.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:42 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1787941276' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T23:16:43.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:43 smithi115 ceph-mon[91340]: pgmap v287: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:43 smithi152 ceph-mon[80164]: pgmap v287: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 -- 172.21.15.115:0/3023094653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 msgr2=0x7f49740fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 --2- 172.21.15.115:0/3023094653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49740fb160 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49680048d0 tx=0x7f4968009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 -- 172.21.15.115:0/3023094653 shutdown_connections 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 --2- 172.21.15.115:0/3023094653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49740fb160 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 --2- 172.21.15.115:0/3023094653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 0x7f4974102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 -- 172.21.15.115:0/3023094653 >> 172.21.15.115:0/3023094653 conn(0x7f4974070d50 msgr2=0x7f4974071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:43.930 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 -- 172.21.15.115:0/3023094653 shutdown_connections 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.927+0000 7f4978cae640 1 -- 172.21.15.115:0/3023094653 wait complete. 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 Processor -- start 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 -- start start 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 0x7f4974113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974113e10 con 0x7f49740facf0 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4978cae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497410d250 con 0x7f4974102680 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f497259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f497259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37352/0 (socket says 172.21.15.115:37352) 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f497259c640 1 -- 172.21.15.115:0/2183797424 learned_addr learned my addr 172.21.15.115:0/2183797424 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f4971d9b640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 0x7f4974113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.928+0000 7f497259c640 1 -- 172.21.15.115:0/2183797424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 msgr2=0x7f4974113810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:43.931 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f497259c640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 0x7f4974113810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f497259c640 1 -- 172.21.15.115:0/2183797424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968005040 con 0x7f49740facf0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f497259c640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f496c00cb10 tx=0x7f496c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f496c004200 con 0x7f49740facf0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f496c00acc0 con 0x7f49740facf0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497410d530 con 0x7f49740facf0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f496c003cd0 con 0x7f49740facf0 2024-09-13T23:16:43.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.929+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497410da20 con 0x7f49740facf0 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.930+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49740657f0 con 0x7f49740facf0 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.930+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f496c00a820 con 0x7f49740facf0 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.931+0000 7f4962ffd640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 0x7f495c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.931+0000 7f4971d9b640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 0x7f495c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.931+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f496c08e920 con 0x7f49740facf0 2024-09-13T23:16:43.933 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.932+0000 7f4971d9b640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 0x7f495c0709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49740fa830 tx=0x7f4968035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:43.936 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:43.936+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f496c0579b0 con 0x7f49740facf0 2024-09-13T23:16:44.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.136+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f497404b720 con 0x7f49740facf0 2024-09-13T23:16:44.137 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.136+0000 7f4962ffd640 1 -- 172.21.15.115:0/2183797424 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v43) v1 ==== 107+0+3370 (secure 0 0 0) 0x7f496c016d40 con 0x7f49740facf0 2024-09-13T23:16:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:44.138 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":24,"btime":"2024-09-13T23:12:35:294599+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:12:34.297541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24257]},"id":1}]} 2024-09-13T23:16:44.138 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 24 2024-09-13T23:16:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 msgr2=0x7f495c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:44.139 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 0x7f495c0709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49740fa830 tx=0x7f4968035040 comp rx=0 tx=0).stop 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 msgr2=0x7f49741132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f496c00cb10 tx=0x7f496c007ee0 comp rx=0 tx=0).stop 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 shutdown_connections 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f495c06e530 0x7f495c0709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4974102680 0x7f4974113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 --2- 172.21.15.115:0/2183797424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49740facf0 0x7f49741132d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.138+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 >> 172.21.15.115:0/2183797424 conn(0x7f4974070d50 msgr2=0x7f49740fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.139+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 shutdown_connections 2024-09-13T23:16:44.140 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:44.139+0000 7f4978cae640 1 -- 172.21.15.115:0/2183797424 wait complete. 2024-09-13T23:16:44.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:44 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2183797424' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T23:16:44.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:44 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2183797424' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T23:16:45.004 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T23:16:45.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T23:16:45.251 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:45.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:45 smithi115 ceph-mon[91340]: pgmap v288: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:45.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:45 smithi152 ceph-mon[80164]: pgmap v288: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:46.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 -- 172.21.15.115:0/3411314903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 msgr2=0x7fcea80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 --2- 172.21.15.115:0/3411314903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea80fc5b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0048d0 tx=0x7fce9c009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 -- 172.21.15.115:0/3411314903 shutdown_connections 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 --2- 172.21.15.115:0/3411314903 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea80fc5b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 --2- 172.21.15.115:0/3411314903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 0x7fcea8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 -- 172.21.15.115:0/3411314903 >> 172.21.15.115:0/3411314903 conn(0x7fcea80f80f0 msgr2=0x7fcea80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 -- 172.21.15.115:0/3411314903 shutdown_connections 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 -- 172.21.15.115:0/3411314903 wait complete. 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.950+0000 7fceae3b8640 1 Processor -- start 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fceae3b8640 1 -- start start 2024-09-13T23:16:46.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fceae3b8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 0x7fcea806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fceae3b8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fceae3b8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8070520 con 0x7fcea8102ef0 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fceae3b8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8070690 con 0x7fcea8102550 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48870/0 (socket says 172.21.15.115:48870) 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 -- 172.21.15.115:0/216458341 learned_addr learned my addr 172.21.15.115:0/216458341 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea7fff640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 0x7fcea806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 -- 172.21.15.115:0/216458341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 msgr2=0x7fcea806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 0x7fcea806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 -- 172.21.15.115:0/216458341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c005040 con 0x7fcea8102ef0 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea77fe640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce9c003080 tx=0x7fce9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:46.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.951+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c038070 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.952+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea81198d0 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.952+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce9c009760 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.952+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c033420 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.952+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea8119c00 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.952+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea80fdcd0 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.953+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fce9c030020 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.953+0000 7fcea4ff9640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 0x7fce900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.954+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fce9c0adf90 con 0x7fcea8102ef0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.954+0000 7fcea7fff640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 0x7fce900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.954+0000 7fcea7fff640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 0x7fce900709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce98006fd0 tx=0x7fce98008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:46.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:46.958+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce9c077020 con 0x7fcea8102ef0 2024-09-13T23:16:47.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.162+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fcea80fbd50 con 0x7fcea8102ef0 2024-09-13T23:16:47.164 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.163+0000 7fcea4ff9640 1 -- 172.21.15.115:0/216458341 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v43) v1 ==== 107+0+4930 (secure 0 0 0) 0x7fce9c07a6e0 con 0x7fcea8102ef0 2024-09-13T23:16:47.164 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:47.164 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":25,"btime":"2024-09-13T23:12:36:307043+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1997927104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1997927104},{"type":"v1","addr":"172.21.15.115:6827","nonce":1997927104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:12:35.435682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24257,14464]},"id":1}]} 2024-09-13T23:16:47.165 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 25 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 msgr2=0x7fce900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 0x7fce900709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce98006fd0 tx=0x7fce98008040 comp rx=0 tx=0).stop 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 msgr2=0x7fcea806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce9c003080 tx=0x7fce9c009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 shutdown_connections 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fce9006e530 0x7fce900709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:47.166 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcea8102ef0 0x7fcea806ff50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:47.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 --2- 172.21.15.115:0/216458341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcea8102550 0x7fcea806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:47.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 >> 172.21.15.115:0/216458341 conn(0x7fcea80f80f0 msgr2=0x7fcea80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:47.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 shutdown_connections 2024-09-13T23:16:47.167 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:47.165+0000 7fceae3b8640 1 -- 172.21.15.115:0/216458341 wait complete. 2024-09-13T23:16:47.319 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:47 smithi115 ceph-mon[91340]: pgmap v289: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:47.319 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:47 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/216458341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T23:16:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:47 smithi152 ceph-mon[80164]: pgmap v289: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:47.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:47 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/216458341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T23:16:47.943 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-13T23:16:47.943 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T23:16:47.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T23:16:48.198 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:49.334 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:49 smithi115 ceph-mon[91340]: pgmap v290: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:49.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:49 smithi152 ceph-mon[80164]: pgmap v290: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 -- 172.21.15.115:0/2785363005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 msgr2=0x7ff43c0fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 --2- 172.21.15.115:0/2785363005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c0fc5d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4240048d0 tx=0x7ff424009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 -- 172.21.15.115:0/2785363005 shutdown_connections 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 --2- 172.21.15.115:0/2785363005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c0fc5d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 --2- 172.21.15.115:0/2785363005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 0x7ff43c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 -- 172.21.15.115:0/2785363005 >> 172.21.15.115:0/2785363005 conn(0x7ff43c0f8110 msgr2=0x7ff43c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 -- 172.21.15.115:0/2785363005 shutdown_connections 2024-09-13T23:16:49.871 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.848+0000 7ff441a81640 1 -- 172.21.15.115:0/2785363005 wait complete. 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 Processor -- start 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 -- start start 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 0x7ff43c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c113d30 con 0x7ff43c102f10 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff441a81640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c10d170 con 0x7ff43c102570 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48884/0 (socket says 172.21.15.115:48884) 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 -- 172.21.15.115:0/3818888154 learned_addr learned my addr 172.21.15.115:0/3818888154 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 -- 172.21.15.115:0/3818888154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 msgr2=0x7ff43c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff43b7fe640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 0x7ff43c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 0x7ff43c1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.849+0000 7ff433fff640 1 -- 172.21.15.115:0/3818888154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424005040 con 0x7ff43c102f10 2024-09-13T23:16:49.872 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff433fff640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff424003080 tx=0x7ff424009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff424038070 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff424009760 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c10d3f0 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff424033420 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.850+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c10d8d0 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.851+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c0fdcf0 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.851+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7ff424030020 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.852+0000 7ff438ff9640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 0x7ff4280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.852+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff4240adf90 con 0x7ff43c102f10 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.852+0000 7ff43b7fe640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 0x7ff4280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.852+0000 7ff43b7fe640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 0x7ff4280709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:49.873 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:49.856+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff424077020 con 0x7ff43c102f10 2024-09-13T23:16:50.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.062+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7ff43c04b720 con 0x7ff43c102f10 2024-09-13T23:16:50.063 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.062+0000 7ff438ff9640 1 -- 172.21.15.115:0/3818888154 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v43) v1 ==== 107+0+4926 (secure 0 0 0) 0x7ff42407a6e0 con 0x7ff43c102f10 2024-09-13T23:16:50.063 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:50.063 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":26,"btime":"2024-09-13T23:12:36:313592+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1997927104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1997927104},{"type":"v1","addr":"172.21.15.115:6827","nonce":1997927104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:12:36.313588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:16:50.064 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 26 2024-09-13T23:16:50.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 msgr2=0x7ff4280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:50.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 0x7ff4280709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c009040 comp rx=0 tx=0).stop 2024-09-13T23:16:50.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 msgr2=0x7ff43c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:50.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff424003080 tx=0x7ff424009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 shutdown_connections 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7ff42806e530 0x7ff4280709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff43c102f10 0x7ff43c113730 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 --2- 172.21.15.115:0/3818888154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff43c102570 0x7ff43c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.064+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 >> 172.21.15.115:0/3818888154 conn(0x7ff43c0f8110 msgr2=0x7ff43c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.065+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 shutdown_connections 2024-09-13T23:16:50.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:50.065+0000 7ff441a81640 1 -- 172.21.15.115:0/3818888154 wait complete. 2024-09-13T23:16:50.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:50 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3818888154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T23:16:50.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:50 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:16:50.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:50 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3818888154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T23:16:50.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:50 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:16:50.758 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-13T23:16:50.758 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T23:16:50.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T23:16:51.004 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:51.445 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:51 smithi115 ceph-mon[91340]: pgmap v291: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:51.445 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:51 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:16:51.446 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:51 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:16:51.446 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:51 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:16:51.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:51 smithi152 ceph-mon[80164]: pgmap v291: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:51.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:51 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:16:51.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:51 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:16:51.719 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:51 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- 172.21.15.115:0/1633531439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 msgr2=0x7f02800fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 --2- 172.21.15.115:0/1633531439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f02800fd940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02700048d0 tx=0x7f0270009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- 172.21.15.115:0/1633531439 shutdown_connections 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 --2- 172.21.15.115:0/1633531439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 0x7f02801065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 --2- 172.21.15.115:0/1633531439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f02800fd940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- 172.21.15.115:0/1633531439 >> 172.21.15.115:0/1633531439 conn(0x7f02800f7030 msgr2=0x7f02800f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- 172.21.15.115:0/1633531439 shutdown_connections 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- 172.21.15.115:0/1633531439 wait complete. 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 Processor -- start 2024-09-13T23:16:52.773 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.771+0000 7f0284b71640 1 -- start start 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0284b71640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0284b71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 0x7f0280113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0284b71640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280113d50 con 0x7f02800fd570 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0284b71640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028010d190 con 0x7f02800fdf10 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48892/0 (socket says 172.21.15.115:48892) 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 -- 172.21.15.115:0/1509330449 learned_addr learned my addr 172.21.15.115:0/1509330449 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0275d9b640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 0x7f0280113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 -- 172.21.15.115:0/1509330449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 msgr2=0x7f0280113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 0x7f0280113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 -- 172.21.15.115:0/1509330449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270005040 con 0x7f02800fd570 2024-09-13T23:16:52.774 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f027e59c640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0270003080 tx=0x7f0270009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0270038070 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f02700097e0 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028010d410 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.772+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f027003d420 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.773+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028010d8d0 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.773+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0280066050 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.774+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0270030020 con 0x7f02800fd570 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.775+0000 7f02777fe640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 0x7f026c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:52.776 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.775+0000 7f0275d9b640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 0x7f026c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:52.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.775+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f02700ae730 con 0x7f02800fd570 2024-09-13T23:16:52.777 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.775+0000 7f0275d9b640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 0x7f026c0709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f028010ead0 tx=0x7f0268004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:52.780 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.779+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f02700777c0 con 0x7f02800fd570 2024-09-13T23:16:52.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.981+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f028004b720 con 0x7f02800fd570 2024-09-13T23:16:52.982 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.981+0000 7f02777fe640 1 -- 172.21.15.115:0/1509330449 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v43) v1 ==== 107+0+4927 (secure 0 0 0) 0x7f027007ae80 con 0x7f02800fd570 2024-09-13T23:16:52.982 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:52.982 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":27,"btime":"2024-09-13T23:12:46:225883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1997927104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1997927104},{"type":"v1","addr":"172.21.15.115:6827","nonce":1997927104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:12:45.465565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14464,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi152.cmykpw","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.152:6825/992634188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":992634188},{"type":"v1","addr":"172.21.15.152:6825","nonce":992634188}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:16:52.983 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 27 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 msgr2=0x7f026c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 0x7f026c0709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f028010ead0 tx=0x7f0268004330 comp rx=0 tx=0).stop 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 msgr2=0x7f0280113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0270003080 tx=0x7f0270009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 shutdown_connections 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f026c06e530 0x7f026c0709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02800fdf10 0x7f0280113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.985 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 --2- 172.21.15.115:0/1509330449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02800fd570 0x7f0280113210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:52.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 >> 172.21.15.115:0/1509330449 conn(0x7f02800f7030 msgr2=0x7f02800f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:52.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 shutdown_connections 2024-09-13T23:16:52.986 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:52.984+0000 7f0284b71640 1 -- 172.21.15.115:0/1509330449 wait complete. 2024-09-13T23:16:53.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:53 smithi115 ceph-mon[91340]: pgmap v292: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:53.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:53 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1509330449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T23:16:53.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:53 smithi152 ceph-mon[80164]: pgmap v292: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:16:53.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:53 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1509330449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T23:16:53.674 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-13T23:16:53.675 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T23:16:53.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T23:16:53.926 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:54.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:54 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:54.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:54 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:16:55.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:55 smithi115 ceph-mon[91340]: pgmap v293: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:55.613 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 -- 172.21.15.115:0/231859620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 msgr2=0x7fdd640fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 --2- 172.21.15.115:0/231859620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd640fb040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009c50 tx=0x7fdd4c004d10 comp rx=0 tx=0).stop 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 -- 172.21.15.115:0/231859620 shutdown_connections 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 --2- 172.21.15.115:0/231859620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd640fb040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 --2- 172.21.15.115:0/231859620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 -- 172.21.15.115:0/231859620 >> 172.21.15.115:0/231859620 conn(0x7fdd64071ac0 msgr2=0x7fdd64071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 -- 172.21.15.115:0/231859620 shutdown_connections 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.611+0000 7fdd689be640 1 -- 172.21.15.115:0/231859620 wait complete. 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 Processor -- start 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 -- start start 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:55.614 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64113eb0 con 0x7fdd640fabd0 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd689be640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6410d260 con 0x7fdd64102680 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd6259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd6259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:48912/0 (socket says 172.21.15.115:48912) 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd6259c640 1 -- 172.21.15.115:0/1699716077 learned_addr learned my addr 172.21.15.115:0/1699716077 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.612+0000 7fdd61d9b640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd6259c640 1 -- 172.21.15.115:0/1699716077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 msgr2=0x7fdd64113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd6259c640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd6259c640 1 -- 172.21.15.115:0/1699716077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0098b0 con 0x7fdd640fabd0 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd61d9b640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd6259c640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00b790 tx=0x7fdd5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:55.615 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5c00c700 con 0x7fdd640fabd0 2024-09-13T23:16:55.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd5c00cd00 con 0x7fdd640fabd0 2024-09-13T23:16:55.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6410d540 con 0x7fdd640fabd0 2024-09-13T23:16:55.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5c015e70 con 0x7fdd640fabd0 2024-09-13T23:16:55.616 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.613+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6410da60 con 0x7fdd640fabd0 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.614+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640725d0 con 0x7fdd640fabd0 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.614+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdd5c012070 con 0x7fdd640fabd0 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.615+0000 7fdd5affd640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 0x7fdd500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.615+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdd5c08dda0 con 0x7fdd640fabd0 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.615+0000 7fdd61d9b640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 0x7fdd500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:55.617 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.615+0000 7fdd61d9b640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 0x7fdd500709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c000f80 tx=0x7fdd4c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:55.620 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.619+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd5c056e30 con 0x7fdd640fabd0 2024-09-13T23:16:55.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:55 smithi152 ceph-mon[80164]: pgmap v293: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:55.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.822+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fdd640ff070 con 0x7fdd640fabd0 2024-09-13T23:16:55.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.823+0000 7fdd5affd640 1 -- 172.21.15.115:0/1699716077 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v43) v1 ==== 107+0+4131 (secure 0 0 0) 0x7fdd640ff070 con 0x7fdd640fabd0 2024-09-13T23:16:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:55.824 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":28,"btime":"2024-09-13T23:13:16:185566+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1997927104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1997927104},{"type":"v1","addr":"172.21.15.115:6827","nonce":1997927104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:15.466949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:16:55.824 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 28 2024-09-13T23:16:55.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 msgr2=0x7fdd500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:55.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 0x7fdd500709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c000f80 tx=0x7fdd4c004d10 comp rx=0 tx=0).stop 2024-09-13T23:16:55.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 msgr2=0x7fdd641132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00b790 tx=0x7fdd5c0091d0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 shutdown_connections 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdd5006e530 0x7fdd500709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd64102680 0x7fdd64113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 --2- 172.21.15.115:0/1699716077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd640fabd0 0x7fdd641132e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.825+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 >> 172.21.15.115:0/1699716077 conn(0x7fdd64071ac0 msgr2=0x7fdd64105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.826+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 shutdown_connections 2024-09-13T23:16:55.827 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:55.826+0000 7fdd689be640 1 -- 172.21.15.115:0/1699716077 wait complete. 2024-09-13T23:16:56.495 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:56 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1699716077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T23:16:56.522 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-13T23:16:56.522 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T23:16:56.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T23:16:56.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:56 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1699716077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T23:16:56.770 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:57.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:57 smithi115 ceph-mon[91340]: pgmap v294: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:57.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:57 smithi152 ceph-mon[80164]: pgmap v294: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- 172.21.15.115:0/3401337742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102550 msgr2=0x7f8b64102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 --2- 172.21.15.115:0/3401337742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102550 0x7f8b64102920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b580048d0 tx=0x7f8b58009da0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- 172.21.15.115:0/3401337742 shutdown_connections 2024-09-13T23:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 --2- 172.21.15.115:0/3401337742 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102ef0 0x7f8b640fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.447 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 --2- 172.21.15.115:0/3401337742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102550 0x7f8b64102920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- 172.21.15.115:0/3401337742 >> 172.21.15.115:0/3401337742 conn(0x7f8b640f80f0 msgr2=0x7f8b640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- 172.21.15.115:0/3401337742 shutdown_connections 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- 172.21.15.115:0/3401337742 wait complete. 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 Processor -- start 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.423+0000 7f8b6af85640 1 -- start start 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102550 0x7f8b641135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b641141d0 con 0x7f8b64102ef0 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6410d550 con 0x7f8b64102550 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:58.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47320/0 (socket says 172.21.15.115:47320) 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 -- 172.21.15.115:0/892527526 learned_addr learned my addr 172.21.15.115:0/892527526 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b68d21640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102550 0x7f8b641135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 -- 172.21.15.115:0/892527526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102550 msgr2=0x7f8b641135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102550 0x7f8b641135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 -- 172.21.15.115:0/892527526 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58005040 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b63fff640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b540 tx=0x7f8b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5000f6f0 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6410d7e0 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b5000fcf0 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b500103a0 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.424+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6410dd00 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.426+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b640fdcd0 con 0x7f8b64102ef0 2024-09-13T23:16:58.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.426+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8b5000f850 con 0x7f8b64102ef0 2024-09-13T23:16:58.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.427+0000 7f8b617fa640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 0x7f8b540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:16:58.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.427+0000 7f8b68d21640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 0x7f8b540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:16:58.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.427+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8b5008e170 con 0x7f8b64102ef0 2024-09-13T23:16:58.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.427+0000 7f8b68d21640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 0x7f8b540709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000c00 tx=0x7f8b58035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:16:58.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.431+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8b50057280 con 0x7f8b64102ef0 2024-09-13T23:16:58.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.632+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f8b640fbd50 con 0x7f8b64102ef0 2024-09-13T23:16:58.634 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.633+0000 7f8b617fa640 1 -- 172.21.15.115:0/892527526 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v43) v1 ==== 107+0+4910 (secure 0 0 0) 0x7f8b5005a940 con 0x7f8b64102ef0 2024-09-13T23:16:58.634 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:16:58.634 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":29,"btime":"2024-09-13T23:13:17:191038+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34374,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/1997927104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":1997927104},{"type":"v1","addr":"172.21.15.115:6827","nonce":1997927104}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:15.466949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:16:58.634 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 29 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 msgr2=0x7f8b540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 0x7f8b540709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000c00 tx=0x7f8b58035040 comp rx=0 tx=0).stop 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 msgr2=0x7f8b64113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b540 tx=0x7f8b500091a0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 shutdown_connections 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8b5406e530 0x7f8b540709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b64102ef0 0x7f8b64113af0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.636 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 --2- 172.21.15.115:0/892527526 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b64102550 0x7f8b641135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:16:58.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 >> 172.21.15.115:0/892527526 conn(0x7f8b640f80f0 msgr2=0x7f8b640f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:16:58.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 shutdown_connections 2024-09-13T23:16:58.637 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:16:58.635+0000 7f8b6af85640 1 -- 172.21.15.115:0/892527526 wait complete. 2024-09-13T23:16:59.315 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-13T23:16:59.315 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T23:16:59.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T23:16:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:59 smithi115 ceph-mon[91340]: pgmap v295: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:59.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:16:59 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/892527526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T23:16:59.564 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:16:59.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:59 smithi152 ceph-mon[80164]: pgmap v295: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:16:59.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:16:59 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/892527526' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T23:17:00.610 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:00 smithi115 ceph-mon[91340]: pgmap v296: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:00.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:00 smithi152 ceph-mon[80164]: pgmap v296: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 -- 172.21.15.115:0/4119060008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 msgr2=0x7fdc040fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 --2- 172.21.15.115:0/4119060008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc040fd940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009c80 tx=0x7fdbf4004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 -- 172.21.15.115:0/4119060008 shutdown_connections 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 --2- 172.21.15.115:0/4119060008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 0x7fdc041065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 --2- 172.21.15.115:0/4119060008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc040fd940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 -- 172.21.15.115:0/4119060008 >> 172.21.15.115:0/4119060008 conn(0x7fdc040f7090 msgr2=0x7fdc040f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 -- 172.21.15.115:0/4119060008 shutdown_connections 2024-09-13T23:17:01.108 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.105+0000 7fdc08da5640 1 -- 172.21.15.115:0/4119060008 wait complete. 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 Processor -- start 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 -- start start 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 0x7fdc04113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04113eb0 con 0x7fdc040fd570 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc08da5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0410d260 con 0x7fdc040fdf10 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc0259c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47332/0 (socket says 172.21.15.115:47332) 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdc0259c640 1 -- 172.21.15.115:0/2568989351 learned_addr learned my addr 172.21.15.115:0/2568989351 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.106+0000 7fdbf9d9b640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 0x7fdc04113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:01.109 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc0259c640 1 -- 172.21.15.115:0/2568989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 msgr2=0x7fdc04113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc0259c640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 0x7fdc04113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc0259c640 1 -- 172.21.15.115:0/2568989351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40098b0 con 0x7fdc040fd570 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc0259c640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4000f80 tx=0x7fdbf4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf4032880 con 0x7fdc040fd570 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbf4032e80 con 0x7fdc040fd570 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0410d4e0 con 0x7fdc040fd570 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbf403dd30 con 0x7fdc040fd570 2024-09-13T23:17:01.110 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.107+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0410da00 con 0x7fdc040fd570 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.108+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04066310 con 0x7fdc040fd570 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.108+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fdbf402f030 con 0x7fdc040fd570 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.109+0000 7fdbfb7fe640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 0x7fdbf00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.109+0000 7fdbf9d9b640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 0x7fdbf00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.109+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdbf40af640 con 0x7fdc040fd570 2024-09-13T23:17:01.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.110+0000 7fdbf9d9b640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 0x7fdbf00709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbec006fd0 tx=0x7fdbec008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:01.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.114+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbf40786d0 con 0x7fdc040fd570 2024-09-13T23:17:01.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.323+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fdc040fac90 con 0x7fdc040fd570 2024-09-13T23:17:01.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.324+0000 7fdbfb7fe640 1 -- 172.21.15.115:0/2568989351 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v43) v1 ==== 107+0+4128 (secure 0 0 0) 0x7fdbf407bd90 con 0x7fdc040fd570 2024-09-13T23:17:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:01.325 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":30,"btime":"2024-09-13T23:13:21:204879+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:15.466949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:17:01.325 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 30 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 msgr2=0x7fdbf00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 0x7fdbf00709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbec006fd0 tx=0x7fdbec008040 comp rx=0 tx=0).stop 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 msgr2=0x7fdc041132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4000f80 tx=0x7fdbf4004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 shutdown_connections 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fdbf006e530 0x7fdbf00709e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc040fdf10 0x7fdc04113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.327 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 --2- 172.21.15.115:0/2568989351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc040fd570 0x7fdc041132e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:01.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 >> 172.21.15.115:0/2568989351 conn(0x7fdc040f7090 msgr2=0x7fdc040f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:01.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 shutdown_connections 2024-09-13T23:17:01.328 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:01.326+0000 7fdc08da5640 1 -- 172.21.15.115:0/2568989351 wait complete. 2024-09-13T23:17:01.617 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:01 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2568989351' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T23:17:01.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:01 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2568989351' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T23:17:01.890 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-13T23:17:01.891 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T23:17:01.891 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T23:17:02.135 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:02.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:02 smithi115 ceph-mon[91340]: pgmap v297: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:02.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:02 smithi152 ceph-mon[80164]: pgmap v297: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 -- 172.21.15.115:0/960547047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 msgr2=0x7fb8480fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 --2- 172.21.15.115:0/960547047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb8480fc590 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb8380048d0 tx=0x7fb838009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 -- 172.21.15.115:0/960547047 shutdown_connections 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 --2- 172.21.15.115:0/960547047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb8480fc590 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 --2- 172.21.15.115:0/960547047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 0x7fb848102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 -- 172.21.15.115:0/960547047 >> 172.21.15.115:0/960547047 conn(0x7fb8480f80f0 msgr2=0x7fb8480fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 -- 172.21.15.115:0/960547047 shutdown_connections 2024-09-13T23:17:03.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.853+0000 7fb84fae0640 1 -- 172.21.15.115:0/960547047 wait complete. 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 Processor -- start 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 -- start start 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 0x7fb8481131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848113d30 con 0x7fb848102ed0 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84fae0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84810d170 con 0x7fb848102530 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47344/0 (socket says 172.21.15.115:47344) 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 -- 172.21.15.115:0/234190694 learned_addr learned my addr 172.21.15.115:0/234190694 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d87c640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 0x7fb8481131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 -- 172.21.15.115:0/234190694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 msgr2=0x7fb8481131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:03.857 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 0x7fb8481131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.854+0000 7fb84d07b640 1 -- 172.21.15.115:0/234190694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838005040 con 0x7fb848102ed0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb84d07b640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb838003080 tx=0x7fb838009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb838038070 con 0x7fb848102ed0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb838009760 con 0x7fb848102ed0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84810d3f0 con 0x7fb848102ed0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb838033420 con 0x7fb848102ed0 2024-09-13T23:17:03.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.855+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84810d8d0 con 0x7fb848102ed0 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.856+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480fdcb0 con 0x7fb848102ed0 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.856+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fb838030020 con 0x7fb848102ed0 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.857+0000 7fb83e7fc640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.857+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb8380adda0 con 0x7fb848102ed0 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.857+0000 7fb84d87c640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:03.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.857+0000 7fb84d87c640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb8440041d0 tx=0x7fb844004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:03.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:03.861+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb838076eb0 con 0x7fb848102ed0 2024-09-13T23:17:04.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.067+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fb8481095f0 con 0x7fb848102ed0 2024-09-13T23:17:04.068 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.068+0000 7fb83e7fc640 1 -- 172.21.15.115:0/234190694 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v43) v1 ==== 107+0+4978 (secure 0 0 0) 0x7fb83807a570 con 0x7fb848102ed0 2024-09-13T23:17:04.069 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:04.069 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":31,"btime":"2024-09-13T23:13:25:220787+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:15.466949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14464},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi115.vlvabd","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6829/62115484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":62115484},{"type":"v1","addr":"172.21.15.115:6829","nonce":62115484}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464]},"id":1}]} 2024-09-13T23:17:04.069 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 31 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 msgr2=0x7fb8340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb8440041d0 tx=0x7fb844004330 comp rx=0 tx=0).stop 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 msgr2=0x7fb848113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb838003080 tx=0x7fb838009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 shutdown_connections 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fb83406e530 0x7fb8340709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb848102ed0 0x7fb848113730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 --2- 172.21.15.115:0/234190694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb848102530 0x7fb8481131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 >> 172.21.15.115:0/234190694 conn(0x7fb8480f80f0 msgr2=0x7fb8480f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:04.071 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 shutdown_connections 2024-09-13T23:17:04.072 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:04.070+0000 7fb84fae0640 1 -- 172.21.15.115:0/234190694 wait complete. 2024-09-13T23:17:04.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:04 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/234190694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T23:17:04.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:04 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/234190694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T23:17:04.721 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-13T23:17:04.721 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T23:17:04.722 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T23:17:04.967 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:05.341 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:05 smithi115 ceph-mon[91340]: pgmap v298: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:05.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:05 smithi152 ceph-mon[80164]: pgmap v298: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:06.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 -- 172.21.15.115:0/2408822617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 msgr2=0x7f86b00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:06.628 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 --2- 172.21.15.115:0/2408822617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b00fc590 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f86a40048d0 tx=0x7f86a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 -- 172.21.15.115:0/2408822617 shutdown_connections 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 --2- 172.21.15.115:0/2408822617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b00fc590 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 --2- 172.21.15.115:0/2408822617 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 -- 172.21.15.115:0/2408822617 >> 172.21.15.115:0/2408822617 conn(0x7f86b00f80f0 msgr2=0x7f86b00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 -- 172.21.15.115:0/2408822617 shutdown_connections 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.626+0000 7f86b5812640 1 -- 172.21.15.115:0/2408822617 wait complete. 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 Processor -- start 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 -- start start 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b01132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b0113e80 con 0x7f86b0102ed0 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86b5812640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b010d230 con 0x7f86b0102530 2024-09-13T23:17:06.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54952/0 (socket says 172.21.15.115:54952) 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 -- 172.21.15.115:0/2304067218 learned_addr learned my addr 172.21.15.115:0/2304067218 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86aeffd640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b01132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 -- 172.21.15.115:0/2304067218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 msgr2=0x7f86b01132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b01132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 -- 172.21.15.115:0/2304067218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4005040 con 0x7f86b0102ed0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86aeffd640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b01132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.627+0000 7f86ae7fc640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86a4003080 tx=0x7f86a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.628+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a4038070 con 0x7f86b0102ed0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.628+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b010d4b0 con 0x7f86b0102ed0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.628+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86a4009760 con 0x7f86b0102ed0 2024-09-13T23:17:06.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.628+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a4033420 con 0x7f86b0102ed0 2024-09-13T23:17:06.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.628+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b010d910 con 0x7f86b0102ed0 2024-09-13T23:17:06.631 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.629+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b00fdcb0 con 0x7f86b0102ed0 2024-09-13T23:17:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.629+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f86a4030020 con 0x7f86b0102ed0 2024-09-13T23:17:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.630+0000 7f86977fe640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 0x7f86980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.630+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f86a40adf90 con 0x7f86b0102ed0 2024-09-13T23:17:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.630+0000 7f86aeffd640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 0x7f86980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:06.632 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.630+0000 7f86aeffd640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 0x7f86980709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86a0006fd0 tx=0x7f86a0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:06.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.634+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f86a4077020 con 0x7f86b0102ed0 2024-09-13T23:17:06.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.838+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f86b00fbd30 con 0x7f86b0102ed0 2024-09-13T23:17:06.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.838+0000 7f86977fe640 1 -- 172.21.15.115:0/2304067218 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v43) v1 ==== 107+0+4183 (secure 0 0 0) 0x7f86a407a6e0 con 0x7f86b0102ed0 2024-09-13T23:17:06.839 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:06.839 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":32,"btime":"2024-09-13T23:13:37:200023+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:37.200021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:17:06.840 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 32 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 msgr2=0x7f86980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 0x7f86980709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f86a0006fd0 tx=0x7f86a0008040 comp rx=0 tx=0).stop 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 msgr2=0x7f86b01137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86a4003080 tx=0x7f86a4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 shutdown_connections 2024-09-13T23:17:06.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f869806e530 0x7f86980709e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86b0102ed0 0x7f86b01137f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 --2- 172.21.15.115:0/2304067218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b0102530 0x7f86b01132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.840+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 >> 172.21.15.115:0/2304067218 conn(0x7f86b00f80f0 msgr2=0x7f86b00f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.841+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 shutdown_connections 2024-09-13T23:17:06.842 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:06.841+0000 7f86b5812640 1 -- 172.21.15.115:0/2304067218 wait complete. 2024-09-13T23:17:07.445 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-13T23:17:07.445 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T23:17:07.445 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T23:17:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:07 smithi152 ceph-mon[80164]: pgmap v299: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:07.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:07 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2304067218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T23:17:07.468 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:07 smithi115 ceph-mon[91340]: pgmap v299: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:07.469 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:07 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2304067218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T23:17:07.693 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:09.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/2088759650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102ed0 msgr2=0x7f0cd00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:09.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/2088759650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102ed0 0x7f0cd00fc590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40048d0 tx=0x7f0cc4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/2088759650 shutdown_connections 2024-09-13T23:17:09.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/2088759650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102ed0 0x7f0cd00fc590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/2088759650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd0102530 0x7f0cd0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/2088759650 >> 172.21.15.115:0/2088759650 conn(0x7f0cd00f80f0 msgr2=0x7f0cd00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/2088759650 shutdown_connections 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/2088759650 wait complete. 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 Processor -- start 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.224+0000 7f0cd4f6d640 1 -- start start 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd0102ed0 0x7f0cd006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0070490 con 0x7f0cd0102530 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0070600 con 0x7f0cd0102ed0 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54976/0 (socket says 172.21.15.115:54976) 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 -- 172.21.15.115:0/3324751851 learned_addr learned my addr 172.21.15.115:0/3324751851 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:09.227 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 -- 172.21.15.115:0/3324751851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd0102ed0 msgr2=0x7f0cd006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd0102ed0 0x7f0cd006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 -- 172.21.15.115:0/3324751851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4005040 con 0x7f0cd0102530 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cce59c640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c790 tx=0x7f0cc00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cc000a820 con 0x7f0cd0102530 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd0070890 con 0x7f0cd0102530 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cc000ae20 con 0x7f0cd0102530 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cc00113a0 con 0x7f0cd0102530 2024-09-13T23:17:09.228 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.225+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd0119920 con 0x7f0cd0102530 2024-09-13T23:17:09.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.226+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd00fdcb0 con 0x7f0cd0102530 2024-09-13T23:17:09.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.227+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0cc0012400 con 0x7f0cd0102530 2024-09-13T23:17:09.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.227+0000 7f0cbeffd640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 0x7f0cb80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:09.229 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.227+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0cc008e380 con 0x7f0cd0102530 2024-09-13T23:17:09.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.227+0000 7f0ccdd9b640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 0x7f0cb80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:09.230 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.228+0000 7f0ccdd9b640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 0x7f0cb80709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4000c00 tx=0x7f0cc4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:09.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.232+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0cc0057490 con 0x7f0cd0102530 2024-09-13T23:17:09.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:09 smithi115 ceph-mon[91340]: pgmap v300: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:09.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:09 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:09.437 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.436+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f0cd00fbd30 con 0x7f0cd0102530 2024-09-13T23:17:09.438 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.437+0000 7f0cbeffd640 1 -- 172.21.15.115:0/3324751851 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v43) v1 ==== 107+0+4262 (secure 0 0 0) 0x7f0cc000a980 con 0x7f0cd0102530 2024-09-13T23:17:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:09.438 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":33,"btime":"2024-09-13T23:13:37:204355+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:37.204345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:17:09.438 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 33 2024-09-13T23:17:09.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 msgr2=0x7f0cb80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:09.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 0x7f0cb80709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4000c00 tx=0x7f0cc4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 msgr2=0x7f0cd006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:09.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c790 tx=0x7f0cc00043c0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.440 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 shutdown_connections 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f0cb806e530 0x7f0cb80709e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cd0102ed0 0x7f0cd006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 --2- 172.21.15.115:0/3324751851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cd0102530 0x7f0cd006fa10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 >> 172.21.15.115:0/3324751851 conn(0x7f0cd00f80f0 msgr2=0x7f0cd00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 shutdown_connections 2024-09-13T23:17:09.441 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:09.439+0000 7f0cd4f6d640 1 -- 172.21.15.115:0/3324751851 wait complete. 2024-09-13T23:17:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:09 smithi152 ceph-mon[80164]: pgmap v300: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:09.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:09 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:10.117 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-13T23:17:10.117 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T23:17:10.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T23:17:10.408 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:10.529 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:10 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3324751851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T23:17:10.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:10 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3324751851' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T23:17:11.522 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:11 smithi115 ceph-mon[91340]: pgmap v301: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:11.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:11 smithi152 ceph-mon[80164]: pgmap v301: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 -- 172.21.15.115:0/1330636941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102f00 msgr2=0x7facf40fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 --2- 172.21.15.115:0/1330636941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102f00 0x7facf40fc5c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7face80048d0 tx=0x7face8009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 -- 172.21.15.115:0/1330636941 shutdown_connections 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 --2- 172.21.15.115:0/1330636941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102f00 0x7facf40fc5c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 --2- 172.21.15.115:0/1330636941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4102560 0x7facf4102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 -- 172.21.15.115:0/1330636941 >> 172.21.15.115:0/1330636941 conn(0x7facf40f8100 msgr2=0x7facf40fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 -- 172.21.15.115:0/1330636941 shutdown_connections 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.034+0000 7facfa1ca640 1 -- 172.21.15.115:0/1330636941 wait complete. 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 Processor -- start 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 -- start start 2024-09-13T23:17:12.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4102f00 0x7facf41137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4113e50 con 0x7facf4102560 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facfa1ca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf410d200 con 0x7facf4102f00 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facf37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facf37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54998/0 (socket says 172.21.15.115:54998) 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.035+0000 7facf37fe640 1 -- 172.21.15.115:0/562860733 learned_addr learned my addr 172.21.15.115:0/562860733 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facf37fe640 1 -- 172.21.15.115:0/562860733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4102f00 msgr2=0x7facf41137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facf37fe640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4102f00 0x7facf41137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facf37fe640 1 -- 172.21.15.115:0/562860733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8005040 con 0x7facf4102560 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facf37fe640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7face400b790 tx=0x7face40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face400c700 con 0x7facf4102560 2024-09-13T23:17:12.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7face400cd00 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf410d4e0 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face4015e70 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.036+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf410da00 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.037+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf40fdce0 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.038+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7face4012070 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.038+0000 7facdbfff640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 0x7facdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.038+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7face408dde0 con 0x7facf4102560 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.038+0000 7facf2ffd640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 0x7facdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.039+0000 7facf2ffd640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 0x7facdc0709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7face8009ac0 tx=0x7face8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:12.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.042+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7face4056e70 con 0x7facf4102560 2024-09-13T23:17:12.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.245+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7facf4109680 con 0x7facf4102560 2024-09-13T23:17:12.248 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.246+0000 7facdbfff640 1 -- 172.21.15.115:0/562860733 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v43) v1 ==== 107+0+4265 (secure 0 0 0) 0x7face405a530 con 0x7facf4102560 2024-09-13T23:17:12.248 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:12.248 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":34,"btime":"2024-09-13T23:13:44:158088+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:43.290377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:17:12.248 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 34 2024-09-13T23:17:12.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 msgr2=0x7facdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:12.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 0x7facdc0709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7face8009ac0 tx=0x7face8009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 msgr2=0x7facf4113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7face400b790 tx=0x7face40091d0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 shutdown_connections 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7facdc06e530 0x7facdc0709e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4102f00 0x7facf41137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 --2- 172.21.15.115:0/562860733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facf4102560 0x7facf4113280 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 >> 172.21.15.115:0/562860733 conn(0x7facf40f8100 msgr2=0x7facf40f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 shutdown_connections 2024-09-13T23:17:12.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:12.248+0000 7facfa1ca640 1 -- 172.21.15.115:0/562860733 wait complete. 2024-09-13T23:17:12.931 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-13T23:17:12.932 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T23:17:12.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T23:17:13.181 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:13.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:13 smithi115 ceph-mon[91340]: pgmap v302: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:13.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:13 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/562860733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T23:17:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:13 smithi152 ceph-mon[80164]: pgmap v302: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:13.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:13 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/562860733' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T23:17:14.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 -- 172.21.15.115:0/4074538709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf0064fc0 msgr2=0x7fbcf0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/4074538709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf0064fc0 0x7fbcf0065430 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbce40048d0 tx=0x7fbce4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 -- 172.21.15.115:0/4074538709 shutdown_connections 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/4074538709 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf0064fc0 0x7fbcf0065430 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/4074538709 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcf00fe460 0x7fbcf00fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 -- 172.21.15.115:0/4074538709 >> 172.21.15.115:0/4074538709 conn(0x7fbcf00723b0 msgr2=0x7fbcf00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 -- 172.21.15.115:0/4074538709 shutdown_connections 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 -- 172.21.15.115:0/4074538709 wait complete. 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.815+0000 7fbcf63bd640 1 Processor -- start 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcf63bd640 1 -- start start 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcf63bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcf0064fc0 0x7fbcf0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:14.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcf63bd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcf63bd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0113e00 con 0x7fbcf00fe460 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcf63bd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf010d1b0 con 0x7fbcf0064fc0 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55024/0 (socket says 172.21.15.115:55024) 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 -- 172.21.15.115:0/2024681667 learned_addr learned my addr 172.21.15.115:0/2024681667 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 -- 172.21.15.115:0/2024681667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcf0064fc0 msgr2=0x7fbcf0113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcf0064fc0 0x7fbcf0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.816+0000 7fbcef7fe640 1 -- 172.21.15.115:0/2024681667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4005040 con 0x7fbcf00fe460 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcef7fe640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbce4003080 tx=0x7fbce4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce4038070 con 0x7fbcf00fe460 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbce40097e0 con 0x7fbcf00fe460 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf010d430 con 0x7fbcf00fe460 2024-09-13T23:17:14.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce403d420 con 0x7fbcf00fe460 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.817+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf010d8f0 con 0x7fbcf00fe460 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.818+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf00fdcf0 con 0x7fbcf00fe460 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.818+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7fbce4030020 con 0x7fbcf00fe460 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.819+0000 7fbcecff9640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 0x7fbcd80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.819+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbce40ae780 con 0x7fbcf00fe460 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.819+0000 7fbceffff640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 0x7fbcd80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.819+0000 7fbceffff640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 0x7fbcd80709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097e0 tx=0x7fbce0006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:14.841 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:14.823+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbce4077810 con 0x7fbcf00fe460 2024-09-13T23:17:15.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.024+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fbcf0072ec0 con 0x7fbcf00fe460 2024-09-13T23:17:15.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.025+0000 7fbcecff9640 1 -- 172.21.15.115:0/2024681667 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v43) v1 ==== 107+0+4262 (secure 0 0 0) 0x7fbce407aed0 con 0x7fbcf00fe460 2024-09-13T23:17:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:15.027 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":35,"btime":"2024-09-13T23:13:45:162751+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:44.171000+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:17:15.027 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 35 2024-09-13T23:17:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 msgr2=0x7fbcd80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 0x7fbcd80709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097e0 tx=0x7fbce0006d20 comp rx=0 tx=0).stop 2024-09-13T23:17:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 msgr2=0x7fbcf0113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:15.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbce4003080 tx=0x7fbce4009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 shutdown_connections 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.027+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7fbcd806e530 0x7fbcd80709e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.028+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcf00fe460 0x7fbcf0113770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.028+0000 7fbcf63bd640 1 --2- 172.21.15.115:0/2024681667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcf0064fc0 0x7fbcf0113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.028+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 >> 172.21.15.115:0/2024681667 conn(0x7fbcf00723b0 msgr2=0x7fbcf0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.028+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 shutdown_connections 2024-09-13T23:17:15.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:15.028+0000 7fbcf63bd640 1 -- 172.21.15.115:0/2024681667 wait complete. 2024-09-13T23:17:15.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:15 smithi115 ceph-mon[91340]: pgmap v303: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:15.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:15 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2024681667' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T23:17:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:15 smithi152 ceph-mon[80164]: pgmap v303: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:15.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:15 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2024681667' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T23:17:15.801 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-13T23:17:15.801 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-13T23:17:15.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T23:17:16.046 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:17.452 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:17 smithi115 ceph-mon[91340]: pgmap v304: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:17.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 -- 172.21.15.115:0/285738134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 msgr2=0x7efde80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:17.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 --2- 172.21.15.115:0/285738134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde80fd3d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efdd80048d0 tx=0x7efdd8009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 -- 172.21.15.115:0/285738134 shutdown_connections 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 --2- 172.21.15.115:0/285738134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde80fd3d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 --2- 172.21.15.115:0/285738134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 0x7efde80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 -- 172.21.15.115:0/285738134 >> 172.21.15.115:0/285738134 conn(0x7efde80723b0 msgr2=0x7efde80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 -- 172.21.15.115:0/285738134 shutdown_connections 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.645+0000 7efdef493640 1 -- 172.21.15.115:0/285738134 wait complete. 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 Processor -- start 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 -- start start 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 0x7efde810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde810ed20 con 0x7efde80fcf80 2024-09-13T23:17:17.661 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdef493640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde810ee90 con 0x7efde80fb810 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdeca2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdeca2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56432/0 (socket says 172.21.15.115:56432) 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.646+0000 7efdeca2e640 1 -- 172.21.15.115:0/533487244 learned_addr learned my addr 172.21.15.115:0/533487244 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdeca2e640 1 -- 172.21.15.115:0/533487244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 msgr2=0x7efde810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efded22f640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 0x7efde810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdeca2e640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 0x7efde810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdeca2e640 1 -- 172.21.15.115:0/533487244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8005040 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdeca2e640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efdd8003080 tx=0x7efdd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdd8038070 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdd80097e0 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde8117200 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdd803d420 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.647+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde8117660 con 0x7efde80fcf80 2024-09-13T23:17:17.662 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.648+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde80fcbc0 con 0x7efde80fcf80 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.649+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7efdd8030020 con 0x7efde80fcf80 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.649+0000 7efdddffb640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 0x7efdd40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.649+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efdd80ae780 con 0x7efde80fcf80 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.649+0000 7efded22f640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 0x7efdd40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.650+0000 7efded22f640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 0x7efdd40709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efde4004550 tx=0x7efde4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:17.663 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.654+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efdd8077810 con 0x7efde80fcf80 2024-09-13T23:17:17.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:17 smithi152 ceph-mon[80164]: pgmap v304: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:17.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.857+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7efde804b720 con 0x7efde80fcf80 2024-09-13T23:17:17.860 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.858+0000 7efdddffb640 1 -- 172.21.15.115:0/533487244 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v43) v1 ==== 107+0+5121 (secure 0 0 0) 0x7efdd807aed0 con 0x7efde80fcf80 2024-09-13T23:17:17.860 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:17.860 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":36,"btime":"2024-09-13T23:13:46:168805+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44289,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/311722183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":311722183},{"type":"v1","addr":"172.21.15.152:6825","nonce":311722183}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:46.168803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:17.860 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 36 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 msgr2=0x7efdd40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 0x7efdd40709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efde4004550 tx=0x7efde4009040 comp rx=0 tx=0).stop 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 msgr2=0x7efde810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efdd8003080 tx=0x7efdd8009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 shutdown_connections 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7efdd406e530 0x7efdd40709e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efde80fcf80 0x7efde810e6d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 --2- 172.21.15.115:0/533487244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efde80fb810 0x7efde810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.860+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 >> 172.21.15.115:0/533487244 conn(0x7efde80723b0 msgr2=0x7efde80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.861+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 shutdown_connections 2024-09-13T23:17:17.863 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:17.861+0000 7efdef493640 1 -- 172.21.15.115:0/533487244 wait complete. 2024-09-13T23:17:18.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:18 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/533487244' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T23:17:18.590 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-13T23:17:18.591 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-13T23:17:18.591 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T23:17:18.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:18 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/533487244' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T23:17:18.847 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:19.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:19 smithi115 ceph-mon[91340]: pgmap v305: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:19.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:19 smithi152 ceph-mon[80164]: pgmap v305: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 -- 172.21.15.115:0/3741419920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102530 msgr2=0x7f3108102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 --2- 172.21.15.115:0/3741419920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102530 0x7f3108102900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31000048d0 tx=0x7f3100009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 -- 172.21.15.115:0/3741419920 shutdown_connections 2024-09-13T23:17:20.496 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 --2- 172.21.15.115:0/3741419920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102ed0 0x7f31080fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 --2- 172.21.15.115:0/3741419920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102530 0x7f3108102900 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.493+0000 7f310e528640 1 -- 172.21.15.115:0/3741419920 >> 172.21.15.115:0/3741419920 conn(0x7f31080f80f0 msgr2=0x7f31080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.494+0000 7f310e528640 1 -- 172.21.15.115:0/3741419920 shutdown_connections 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.494+0000 7f310e528640 1 -- 172.21.15.115:0/3741419920 wait complete. 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.494+0000 7f310e528640 1 Processor -- start 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.494+0000 7f310e528640 1 -- start start 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f310e528640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 0x7f3108113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f310e528640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f310e528640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108113d80 con 0x7f3108102ed0 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f310e528640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310810d1c0 con 0x7f3108102530 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56450/0 (socket says 172.21.15.115:56450) 2024-09-13T23:17:20.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 -- 172.21.15.115:0/3832046303 learned_addr learned my addr 172.21.15.115:0/3832046303 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f3107fff640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 0x7f3108113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 -- 172.21.15.115:0/3832046303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 msgr2=0x7f3108113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 0x7f3108113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 -- 172.21.15.115:0/3832046303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100005040 con 0x7f3108102ed0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f3107fff640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 0x7f3108113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f31077fe640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30fc002840 tx=0x7f30fc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc007c30 con 0x7f3108102ed0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310810d4a0 con 0x7f3108102ed0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30fc00f040 con 0x7f3108102ed0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.495+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30fc009510 con 0x7f3108102ed0 2024-09-13T23:17:20.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.496+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310810da40 con 0x7f3108102ed0 2024-09-13T23:17:20.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.496+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31080fdcb0 con 0x7f3108102ed0 2024-09-13T23:17:20.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.497+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f30fc009780 con 0x7f3108102ed0 2024-09-13T23:17:20.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.497+0000 7f3104ff9640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 0x7f30f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:20.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.498+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f30fc08da60 con 0x7f3108102ed0 2024-09-13T23:17:20.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.498+0000 7f3107fff640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 0x7f30f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:20.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.498+0000 7f3107fff640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 0x7f30f00709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3100007ac0 tx=0x7f3100035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:20.502 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.502+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f30fc056af0 con 0x7f3108102ed0 2024-09-13T23:17:20.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.704+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f31081095a0 con 0x7f3108102ed0 2024-09-13T23:17:20.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.705+0000 7f3104ff9640 1 -- 172.21.15.115:0/3832046303 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v43) v1 ==== 107+0+4342 (secure 0 0 0) 0x7f30fc05a1b0 con 0x7f3108102ed0 2024-09-13T23:17:20.706 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:20.706 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":37,"btime":"2024-09-13T23:14:01:202342+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:46.168803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:20.706 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 37 2024-09-13T23:17:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 msgr2=0x7f30f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 0x7f30f00709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3100007ac0 tx=0x7f3100035040 comp rx=0 tx=0).stop 2024-09-13T23:17:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 msgr2=0x7f3108113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30fc002840 tx=0x7f30fc004570 comp rx=0 tx=0).stop 2024-09-13T23:17:20.708 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 shutdown_connections 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f30f006e530 0x7f30f00709e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3108102ed0 0x7f3108113780 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 --2- 172.21.15.115:0/3832046303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3108102530 0x7f3108113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 >> 172.21.15.115:0/3832046303 conn(0x7f31080f80f0 msgr2=0x7f31080f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 shutdown_connections 2024-09-13T23:17:20.709 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:20.707+0000 7f310e528640 1 -- 172.21.15.115:0/3832046303 wait complete. 2024-09-13T23:17:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:21 smithi115 ceph-mon[91340]: pgmap v306: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:21 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3832046303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T23:17:21.395 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-13T23:17:21.395 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-13T23:17:21.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-13T23:17:21.642 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:21 smithi152 ceph-mon[80164]: pgmap v306: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:21.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:21 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3832046303' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 -- 172.21.15.115:0/1736943255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 msgr2=0x7f1b000fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 --2- 172.21.15.115:0/1736943255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b000fb910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1af00048d0 tx=0x7f1af0009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 -- 172.21.15.115:0/1736943255 shutdown_connections 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 --2- 172.21.15.115:0/1736943255 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b000fb910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 --2- 172.21.15.115:0/1736943255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 0x7f1b001018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.214+0000 7f1b08552640 1 -- 172.21.15.115:0/1736943255 >> 172.21.15.115:0/1736943255 conn(0x7f1b000f7060 msgr2=0x7f1b000f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:23.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.215+0000 7f1b08552640 1 -- 172.21.15.115:0/1736943255 shutdown_connections 2024-09-13T23:17:23.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.215+0000 7f1b08552640 1 -- 172.21.15.115:0/1736943255 wait complete. 2024-09-13T23:17:23.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.215+0000 7f1b08552640 1 Processor -- start 2024-09-13T23:17:23.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.215+0000 7f1b08552640 1 -- start start 2024-09-13T23:17:23.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.215+0000 7f1b08552640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b08552640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 0x7f1b001125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b08552640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00112bf0 con 0x7f1b000fb4a0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b08552640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0010c030 con 0x7f1b001014e0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56472/0 (socket says 172.21.15.115:56472) 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 -- 172.21.15.115:0/1110477141 learned_addr learned my addr 172.21.15.115:0/1110477141 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b05aed640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 0x7f1b001125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 -- 172.21.15.115:0/1110477141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 msgr2=0x7f1b001125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 0x7f1b001125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 -- 172.21.15.115:0/1110477141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0005040 con 0x7f1b000fb4a0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b062ee640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1afc002a50 tx=0x7f1afc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:23.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1afc007c30 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1afc00f040 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1afc00dad0 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.216+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0010c310 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.217+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0010c880 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.218+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b000fcbe0 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.218+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1afc00dc30 con 0x7f1b000fb4a0 2024-09-13T23:17:23.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.218+0000 7f1af6ffd640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 0x7f1aec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:23.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.219+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1afc08dfc0 con 0x7f1b000fb4a0 2024-09-13T23:17:23.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.219+0000 7f1b05aed640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 0x7f1aec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:23.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.219+0000 7f1b05aed640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 0x7f1aec0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009ac0 tx=0x7f1af0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:23.224 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.223+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1afc0570d0 con 0x7f1b000fb4a0 2024-09-13T23:17:23.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:23 smithi115 ceph-mon[91340]: pgmap v307: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.424+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f1b000fac60 con 0x7f1b000fb4a0 2024-09-13T23:17:23.425 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.425+0000 7f1af6ffd640 1 -- 172.21.15.115:0/1110477141 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v43) v1 ==== 107+0+5192 (secure 0 0 0) 0x7f1afc05a790 con 0x7f1b000fb4a0 2024-09-13T23:17:23.426 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:23.426 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":38,"btime":"2024-09-13T23:14:06:217972+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44267,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/135789338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":135789338},{"type":"v1","addr":"172.21.15.152:6827","nonce":135789338}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:46.168803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:23.426 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 38 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 msgr2=0x7f1aec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 0x7f1aec0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009ac0 tx=0x7f1af0035040 comp rx=0 tx=0).stop 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 msgr2=0x7f1b001120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1afc002a50 tx=0x7f1afc004600 comp rx=0 tx=0).stop 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 shutdown_connections 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1aec06e530 0x7f1aec0709e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b001014e0 0x7f1b001125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 --2- 172.21.15.115:0/1110477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b000fb4a0 0x7f1b001120b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:23.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 >> 172.21.15.115:0/1110477141 conn(0x7f1b000f7060 msgr2=0x7f1b000f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:23.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 shutdown_connections 2024-09-13T23:17:23.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:23.427+0000 7f1b08552640 1 -- 172.21.15.115:0/1110477141 wait complete. 2024-09-13T23:17:23.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:23 smithi152 ceph-mon[80164]: pgmap v307: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:24.033 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-13T23:17:24.033 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-13T23:17:24.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-13T23:17:24.286 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:24.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:24 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1110477141' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T23:17:24.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:24 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:24 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1110477141' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T23:17:24.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:24 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:25.490 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:25 smithi115 ceph-mon[91340]: pgmap v308: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:25.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:25 smithi152 ceph-mon[80164]: pgmap v308: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:26.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 -- 172.21.15.115:0/856051759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 msgr2=0x7f024c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 --2- 172.21.15.115:0/856051759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c0fe830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f023c009c50 tx=0x7f023c004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 -- 172.21.15.115:0/856051759 shutdown_connections 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 --2- 172.21.15.115:0/856051759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 0x7f024c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 --2- 172.21.15.115:0/856051759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c0fe830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 -- 172.21.15.115:0/856051759 >> 172.21.15.115:0/856051759 conn(0x7f024c0723b0 msgr2=0x7f024c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 -- 172.21.15.115:0/856051759 shutdown_connections 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.021+0000 7f025133a640 1 -- 172.21.15.115:0/856051759 wait complete. 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 Processor -- start 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 -- start start 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 0x7f024c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:26.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c113cf0 con 0x7f024c0fe460 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f025133a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c10d130 con 0x7f024c064fc0 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38680/0 (socket says 172.21.15.115:38680) 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 -- 172.21.15.115:0/2999144945 learned_addr learned my addr 172.21.15.115:0/2999144945 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024affd640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 0x7f024c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 -- 172.21.15.115:0/2999144945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 msgr2=0x7f024c1131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 0x7f024c1131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.022+0000 7f024a7fc640 1 -- 172.21.15.115:0/2999144945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0098b0 con 0x7f024c0fe460 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f024a7fc640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f023400c790 tx=0x7f02340043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023400a820 con 0x7f024c0fe460 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f023400ae20 con 0x7f024c0fe460 2024-09-13T23:17:26.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c10d410 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02340113a0 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.023+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c10d9b0 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.024+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c0fdcf0 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.024+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f0234012400 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.025+0000 7f02437fe640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 0x7f02380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.025+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f023408e2f0 con 0x7f024c0fe460 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.025+0000 7f024affd640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 0x7f02380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:26.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.026+0000 7f024affd640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 0x7f02380709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f023c009c20 tx=0x7f023c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:26.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.029+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0234057400 con 0x7f024c0fe460 2024-09-13T23:17:26.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.231+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f024c10e820 con 0x7f024c0fe460 2024-09-13T23:17:26.232 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.232+0000 7f02437fe640 1 -- 172.21.15.115:0/2999144945 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v43) v1 ==== 107+0+4413 (secure 0 0 0) 0x7f023405aac0 con 0x7f024c0fe460 2024-09-13T23:17:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:26.233 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":39,"btime":"2024-09-13T23:14:16:169132+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:46.168803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:26.233 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 39 2024-09-13T23:17:26.234 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 msgr2=0x7f02380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 0x7f02380709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f023c009c20 tx=0x7f023c004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 msgr2=0x7f024c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f023400c790 tx=0x7f02340043c0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 shutdown_connections 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f023806e530 0x7f02380709e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f024c0fe460 0x7f024c1136f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 --2- 172.21.15.115:0/2999144945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f024c064fc0 0x7f024c1131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 >> 172.21.15.115:0/2999144945 conn(0x7f024c0723b0 msgr2=0x7f024c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 shutdown_connections 2024-09-13T23:17:26.235 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:26.234+0000 7f025133a640 1 -- 172.21.15.115:0/2999144945 wait complete. 2024-09-13T23:17:26.552 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:26 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2999144945' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T23:17:26.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:26 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2999144945' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T23:17:26.880 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-13T23:17:26.880 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-13T23:17:26.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-13T23:17:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:27.533 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:27 smithi115 ceph-mon[91340]: pgmap v309: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:27.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:27 smithi152 ceph-mon[80164]: pgmap v309: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- 172.21.15.115:0/2410379176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 msgr2=0x7f1b500fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 --2- 172.21.15.115:0/2410379176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b500fb910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1b400048d0 tx=0x7f1b40009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- 172.21.15.115:0/2410379176 shutdown_connections 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 --2- 172.21.15.115:0/2410379176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b500fb910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 --2- 172.21.15.115:0/2410379176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b501014e0 0x7f1b501018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- 172.21.15.115:0/2410379176 >> 172.21.15.115:0/2410379176 conn(0x7f1b500f7060 msgr2=0x7f1b500f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:28.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- 172.21.15.115:0/2410379176 shutdown_connections 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- 172.21.15.115:0/2410379176 wait complete. 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 Processor -- start 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.700+0000 7f1b57607640 1 -- start start 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b57607640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b57607640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b501014e0 0x7f1b5010e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b57607640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5010ee10 con 0x7f1b500fb4a0 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b57607640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5010ef80 con 0x7f1b501014e0 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38696/0 (socket says 172.21.15.115:38696) 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 -- 172.21.15.115:0/2394528252 learned_addr learned my addr 172.21.15.115:0/2394528252 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 -- 172.21.15.115:0/2394528252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b501014e0 msgr2=0x7f1b5010e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:28.725 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b501014e0 0x7f1b5010e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 -- 172.21.15.115:0/2394528252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40005040 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b553a3640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00bbb0 tx=0x7f1b4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c00c9c0 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50117260 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b4c0092e0 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.701+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c007640 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.702+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50117780 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.702+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b500fcbe0 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.703+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f1b4c012070 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.703+0000 7f1b45ffb640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.703+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1b4c08e3a0 con 0x7f1b500fb4a0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.704+0000 7f1b54ba2640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.704+0000 7f1b54ba2640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 0x7f1b3c0709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b400043d0 tx=0x7f1b40009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:28.726 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.708+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1b4c057430 con 0x7f1b500fb4a0 2024-09-13T23:17:28.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.909+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f1b50066220 con 0x7f1b500fb4a0 2024-09-13T23:17:28.910 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.910+0000 7f1b45ffb640 1 -- 172.21.15.115:0/2394528252 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v43) v1 ==== 107+0+5263 (secure 0 0 0) 0x7f1b4c05aaf0 con 0x7f1b500fb4a0 2024-09-13T23:17:28.911 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:28.911 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":40,"btime":"2024-09-13T23:14:21:177042+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44331,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2974383973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2974383973},{"type":"v1","addr":"172.21.15.152:6827","nonce":2974383973}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:13:46.168803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34438},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:28.911 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 40 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 msgr2=0x7f1b3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 0x7f1b3c0709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b400043d0 tx=0x7f1b40009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 msgr2=0x7f1b5010e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00bbb0 tx=0x7f1b4c009840 comp rx=0 tx=0).stop 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 shutdown_connections 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f1b3c06e530 0x7f1b3c0709e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1b501014e0 0x7f1b5010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 --2- 172.21.15.115:0/2394528252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1b500fb4a0 0x7f1b5010e1f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 >> 172.21.15.115:0/2394528252 conn(0x7f1b500f7060 msgr2=0x7f1b500f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 shutdown_connections 2024-09-13T23:17:28.913 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:28.912+0000 7f1b57607640 1 -- 172.21.15.115:0/2394528252 wait complete. 2024-09-13T23:17:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:29 smithi115 ceph-mon[91340]: pgmap v310: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:29.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:29 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2394528252' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T23:17:29.609 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-13T23:17:29.609 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-13T23:17:29.609 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-13T23:17:29.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:29 smithi152 ceph-mon[80164]: pgmap v310: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:29.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:29 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2394528252' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T23:17:29.854 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:31.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 -- 172.21.15.115:0/2275095208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a480fb480 msgr2=0x7f8a480fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:31.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2275095208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a480fb480 0x7f8a480fb8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0048d0 tx=0x7f8a3c009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 -- 172.21.15.115:0/2275095208 shutdown_connections 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2275095208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a480fb480 0x7f8a480fb8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2275095208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a481014c0 0x7f8a48101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 -- 172.21.15.115:0/2275095208 >> 172.21.15.115:0/2275095208 conn(0x7f8a480f7000 msgr2=0x7f8a480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 -- 172.21.15.115:0/2275095208 shutdown_connections 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.446+0000 7f8a4e622640 1 -- 172.21.15.115:0/2275095208 wait complete. 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 Processor -- start 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 -- start start 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a480fb480 0x7f8a481131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:31.450 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48113cf0 con 0x7f8a481014c0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a4e622640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4810d130 con 0x7f8a480fb480 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38712/0 (socket says 172.21.15.115:38712) 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 -- 172.21.15.115:0/2430058587 learned_addr learned my addr 172.21.15.115:0/2430058587 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a47fff640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a480fb480 0x7f8a481131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 -- 172.21.15.115:0/2430058587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a480fb480 msgr2=0x7f8a481131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a480fb480 0x7f8a481131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.447+0000 7f8a477fe640 1 -- 172.21.15.115:0/2430058587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c005040 con 0x7f8a481014c0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a477fe640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000c00 tx=0x7f8a3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c038070 con 0x7f8a481014c0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a3c02ade0 con 0x7f8a481014c0 2024-09-13T23:17:31.451 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4810d3b0 con 0x7f8a481014c0 2024-09-13T23:17:31.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a3c02c7e0 con 0x7f8a481014c0 2024-09-13T23:17:31.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.448+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4810d8f0 con 0x7f8a481014c0 2024-09-13T23:17:31.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.449+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480fcbc0 con 0x7f8a481014c0 2024-09-13T23:17:31.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.449+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f8a3c030020 con 0x7f8a481014c0 2024-09-13T23:17:31.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.450+0000 7f8a44ff9640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 0x7f8a300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:31.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.450+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8a3c0ade50 con 0x7f8a481014c0 2024-09-13T23:17:31.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.450+0000 7f8a47fff640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 0x7f8a300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:31.453 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.450+0000 7f8a47fff640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 0x7f8a300709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009fd0 tx=0x7f8a38009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:31.455 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.454+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8a3c076f90 con 0x7f8a481014c0 2024-09-13T23:17:31.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:31 smithi115 ceph-mon[91340]: pgmap v311: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.656+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f8a48108470 con 0x7f8a481014c0 2024-09-13T23:17:31.657 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.657+0000 7f8a44ff9640 1 -- 172.21.15.115:0/2430058587 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v43) v1 ==== 107+0+5280 (secure 0 0 0) 0x7f8a3c07a650 con 0x7f8a481014c0 2024-09-13T23:17:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:31.658 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":41,"btime":"2024-09-13T23:14:27:562730+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44331,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2974383973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2974383973},{"type":"v1","addr":"172.21.15.152:6827","nonce":2974383973}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:14:27.562700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34438,"mds_1":34442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":1,"incarnation":41,"state":"up:starting","state_seq":1,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438]},"id":1}]} 2024-09-13T23:17:31.658 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 41 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 msgr2=0x7f8a300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 0x7f8a300709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009fd0 tx=0x7f8a38009e50 comp rx=0 tx=0).stop 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 msgr2=0x7f8a481136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c000c00 tx=0x7f8a3c009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 shutdown_connections 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f8a3006e530 0x7f8a300709e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a481014c0 0x7f8a481136f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 --2- 172.21.15.115:0/2430058587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a480fb480 0x7f8a481131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 >> 172.21.15.115:0/2430058587 conn(0x7f8a480f7000 msgr2=0x7f8a48065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 shutdown_connections 2024-09-13T23:17:31.660 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:31.659+0000 7f8a4e622640 1 -- 172.21.15.115:0/2430058587 wait complete. 2024-09-13T23:17:31.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:31 smithi152 ceph-mon[80164]: pgmap v311: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:32.314 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-09-13T23:17:32.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-13T23:17:32.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:32 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/2430058587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T23:17:32.560 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:32.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:32 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/2430058587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T23:17:33.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:33 smithi115 ceph-mon[91340]: pgmap v312: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:33.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:33 smithi152 ceph-mon[80164]: pgmap v312: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:34.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 -- 172.21.15.115:0/3348077319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 msgr2=0x7f5860104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:34.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 --2- 172.21.15.115:0/3348077319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f5860104ba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5850009c50 tx=0x7f5850004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:34.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 -- 172.21.15.115:0/3348077319 shutdown_connections 2024-09-13T23:17:34.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 --2- 172.21.15.115:0/3348077319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f58600fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 --2- 172.21.15.115:0/3348077319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f5860104ba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 -- 172.21.15.115:0/3348077319 >> 172.21.15.115:0/3348077319 conn(0x7f58600fa330 msgr2=0x7f58600fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 -- 172.21.15.115:0/3348077319 shutdown_connections 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.194+0000 7f5865dea640 1 -- 172.21.15.115:0/3348077319 wait complete. 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 Processor -- start 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 -- start start 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f5860115390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860115ed0 con 0x7f58601047d0 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f5865dea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586010f310 con 0x7f58600fe7b0 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.195+0000 7f585effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:38736/0 (socket says 172.21.15.115:38736) 2024-09-13T23:17:34.217 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 -- 172.21.15.115:0/718240412 learned_addr learned my addr 172.21.15.115:0/718240412 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585f7fe640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f5860115390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 -- 172.21.15.115:0/718240412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 msgr2=0x7f5860115390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f5860115390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 -- 172.21.15.115:0/718240412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500098b0 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585f7fe640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f5860115390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f585effd640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f585400c810 tx=0x7f58540043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f585400a820 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586010f5f0 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f585400ae20 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58540115c0 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.196+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586010fb90 con 0x7f58601047d0 2024-09-13T23:17:34.218 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.197+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58600ffef0 con 0x7f58601047d0 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.198+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f5854012840 con 0x7f58601047d0 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.198+0000 7f5847fff640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 0x7f58480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.198+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f585408e7a0 con 0x7f58601047d0 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.198+0000 7f585f7fe640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 0x7f58480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.199+0000 7f585f7fe640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 0x7f58480709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5850004a30 tx=0x7f5850004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:34.219 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.203+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5854057830 con 0x7f58601047d0 2024-09-13T23:17:34.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.406+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f586010b790 con 0x7f58601047d0 2024-09-13T23:17:34.407 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.406+0000 7f5847fff640 1 -- 172.21.15.115:0/718240412 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v43) v1 ==== 107+0+5284 (secure 0 0 0) 0x7f585405aef0 con 0x7f58601047d0 2024-09-13T23:17:34.407 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-13T23:17:34.408 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":42,"btime":"2024-09-13T23:14:28:568259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44327,"name":"cephfs.smithi152.cmykpw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6825/1935544166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1935544166},{"type":"v1","addr":"172.21.15.152:6825","nonce":1935544166}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44331,"name":"cephfs.smithi152.pntaqr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6827/2974383973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2974383973},{"type":"v1","addr":"172.21.15.152:6827","nonce":2974383973}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T23:03:48.502784+0000","modified":"2024-09-13T23:14:28.568256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34438,"mds_1":34442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34438":{"gid":34438,"name":"cephfs.smithi115.ywbcks","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6827/2183849912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2183849912},{"type":"v1","addr":"172.21.15.115:6827","nonce":2183849912}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"cephfs.smithi115.vlvabd","rank":1,"incarnation":41,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6829/3057534468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":3057534468},{"type":"v1","addr":"172.21.15.115:6829","nonce":3057534468}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34438,"qdb_cluster":[34438,34442]},"id":1}]} 2024-09-13T23:17:34.408 INFO:teuthology.orchestra.run.smithi115.stderr:dumped fsmap epoch 42 2024-09-13T23:17:34.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 msgr2=0x7f58480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:34.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 0x7f58480709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5850004a30 tx=0x7f5850004d10 comp rx=0 tx=0).stop 2024-09-13T23:17:34.409 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 msgr2=0x7f58601158d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f585400c810 tx=0x7f58540043c0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 shutdown_connections 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f584806e530 0x7f58480709e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58601047d0 0x7f58601158d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 --2- 172.21.15.115:0/718240412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58600fe7b0 0x7f5860115390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.408+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 >> 172.21.15.115:0/718240412 conn(0x7f58600fa330 msgr2=0x7f58600fb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.409+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 shutdown_connections 2024-09-13T23:17:34.410 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:34.409+0000 7f5865dea640 1 -- 172.21.15.115:0/718240412 wait complete. 2024-09-13T23:17:35.088 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T23:17:35.101 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T23:17:35.101 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T23:17:35.101 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:17:35.120 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-13T23:17:35.120 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:17:35.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T23:17:35.464 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:35 smithi115 ceph-mon[91340]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:35.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:35 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/718240412' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T23:17:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:35 smithi152 ceph-mon[80164]: pgmap v313: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:35.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:35 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/718240412' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T23:17:37.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- 172.21.15.115:0/570827291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 msgr2=0x7f2d100fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 --2- 172.21.15.115:0/570827291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d100fc5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d000048d0 tx=0x7f2d00009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- 172.21.15.115:0/570827291 shutdown_connections 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 --2- 172.21.15.115:0/570827291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d100fc5b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 --2- 172.21.15.115:0/570827291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d10102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- 172.21.15.115:0/570827291 >> 172.21.15.115:0/570827291 conn(0x7f2d100f80f0 msgr2=0x7f2d100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- 172.21.15.115:0/570827291 shutdown_connections 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- 172.21.15.115:0/570827291 wait complete. 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 Processor -- start 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.053+0000 7f2d18570640 1 -- start start 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d18570640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d101135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d18570640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d18570640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d101141d0 con 0x7f2d10102ef0 2024-09-13T23:17:37.080 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d18570640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1010d550 con 0x7f2d10102550 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40420/0 (socket says 172.21.15.115:40420) 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 -- 172.21.15.115:0/3484426120 learned_addr learned my addr 172.21.15.115:0/3484426120 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d1630c640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d101135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 -- 172.21.15.115:0/3484426120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 msgr2=0x7f2d101135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d101135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 -- 172.21.15.115:0/3484426120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00005040 con 0x7f2d10102ef0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d1630c640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d101135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d15b0b640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d00003080 tx=0x7f2d00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d00038070 con 0x7f2d10102ef0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d00009760 con 0x7f2d10102ef0 2024-09-13T23:17:37.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1010d780 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.054+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d00033420 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.055+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1010dbe0 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.056+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d100fdcd0 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.056+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f2d00030020 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.056+0000 7f2d06ffd640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 0x7f2cfc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.057+0000 7f2d1630c640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 0x7f2cfc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.057+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2d000adf90 con 0x7f2d10102ef0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.057+0000 7f2d1630c640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 0x7f2cfc0709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c006fd0 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:37.082 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.061+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d00077020 con 0x7f2d10102ef0 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.239+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d1004b720 con 0x7f2d10102ef0 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.240+0000 7f2d06ffd640 1 -- 172.21.15.115:0/3484426120 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2459 (secure 0 0 0) 0x7f2d0007a6e0 con 0x7f2d10102ef0 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6829/62115484 2024-09-14T23:13:37.199795+0000 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6828/62115484 2024-09-14T23:13:37.199795+0000 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1798240241 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.241 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/4125949334 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/4275400754 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2340686319 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1762341523 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/4125949334 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3118866913 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/4160355678 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2231349841 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.242 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/3265730915 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1192149054 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2742407743 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2563199978 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1172049998 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3178837450 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/628273285 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1229781236 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6826/2293557563 2024-09-14T23:04:04.258253+0000 2024-09-13T23:17:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/621622576 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1038926251 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3577026767 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2001217743 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/595553649 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/1740627202 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/1740627202 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6827/2293557563 2024-09-14T23:04:04.258253+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/3265730915 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.244 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1638639701 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:6828/3157283215 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3924280677 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/2527729769 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2055434874 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2154717769 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/2890033267 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/3727867720 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2055434874 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:6829/3157283215 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/212356059 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2340686319 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:37.246 INFO:teuthology.orchestra.run.smithi115.stderr:listed 41 entries 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 msgr2=0x7f2cfc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 0x7f2cfc0709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c006fd0 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 msgr2=0x7f2d10113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d00003080 tx=0x7f2d00009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 shutdown_connections 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f2cfc06e530 0x7f2cfc0709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d10102ef0 0x7f2d10113af0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 --2- 172.21.15.115:0/3484426120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d10102550 0x7f2d101135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 >> 172.21.15.115:0/3484426120 conn(0x7f2d100f80f0 msgr2=0x7f2d100f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 shutdown_connections 2024-09-13T23:17:37.247 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:37.243+0000 7f2d18570640 1 -- 172.21.15.115:0/3484426120 wait complete. 2024-09-13T23:17:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:37 smithi115 ceph-mon[91340]: pgmap v314: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:37.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:37 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/3484426120' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:17:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:37 smithi152 ceph-mon[80164]: pgmap v314: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T23:17:37.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:37 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/3484426120' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:17:37.849 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T23:17:37.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:37.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T23:17:37.878 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:17:37.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:37.878 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T23:17:37.946 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T23:17:37.947 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:17:37.967 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-13T23:17:37.967 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:17:38.026 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T23:17:38.272 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/mon.smithi115/config 2024-09-13T23:17:38.525 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:38 smithi115 ceph-mon[91340]: pgmap v315: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:38.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:38 smithi152 ceph-mon[80164]: pgmap v315: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T23:17:39.533 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:39 smithi115 ceph-mon[91340]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:39.718 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:39 smithi152 ceph-mon[80164]: from='mgr.34104 172.21.15.115:0/2268765857' entity='mgr.smithi115.eqesbc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:17:39.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 -- 172.21.15.115:0/4136081485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 msgr2=0x7f9f6c0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:39.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 --2- 172.21.15.115:0/4136081485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c0fb0f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0048d0 tx=0x7f9f5c009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:39.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 -- 172.21.15.115:0/4136081485 shutdown_connections 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 --2- 172.21.15.115:0/4136081485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c0fb0f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 --2- 172.21.15.115:0/4136081485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 -- 172.21.15.115:0/4136081485 >> 172.21.15.115:0/4136081485 conn(0x7f9f6c070ce0 msgr2=0x7f9f6c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 -- 172.21.15.115:0/4136081485 shutdown_connections 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.852+0000 7f9f715d5640 1 -- 172.21.15.115:0/4136081485 wait complete. 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 Processor -- start 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 -- start start 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c113e20 con 0x7f9f6c0fac80 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f715d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c10d1d0 con 0x7f9f6c102620 2024-09-13T23:17:39.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:40448/0 (socket says 172.21.15.115:40448) 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 -- 172.21.15.115:0/1737527385 learned_addr learned my addr 172.21.15.115:0/1737527385 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 -- 172.21.15.115:0/1737527385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 msgr2=0x7f9f6c113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6a7fc640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.853+0000 7f9f6affd640 1 -- 172.21.15.115:0/1737527385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c005040 con 0x7f9f6c0fac80 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f6a7fc640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f6affd640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000b580 tx=0x7f9f600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f6000f570 con 0x7f9f6c0fac80 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c10d4b0 con 0x7f9f6c0fac80 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f6000fb70 con 0x7f9f6c0fac80 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f60010d40 con 0x7f9f6c0fac80 2024-09-13T23:17:39.887 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.854+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c10d9d0 con 0x7f9f6c0fac80 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.855+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c065790 con 0x7f9f6c0fac80 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.855+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 39) v1 ==== 92553+0+0 (secure 0 0 0) 0x7f9f6000fce0 con 0x7f9f6c0fac80 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.856+0000 7f9f537fe640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.856+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9f6008e0c0 con 0x7f9f6c0fac80 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.856+0000 7f9f6a7fc640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.856+0000 7f9f6a7fc640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 0x7f9f540709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00b020 tx=0x7f9f5c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:17:39.888 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:39.860+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f600571d0 con 0x7f9f6c0fac80 2024-09-13T23:17:40.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.039+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f6c04b780 con 0x7f9f6c0fac80 2024-09-13T23:17:40.040 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.040+0000 7f9f537fe640 1 -- 172.21.15.115:0/1737527385 <== mon.0 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2459 (secure 0 0 0) 0x7f9f6005a890 con 0x7f9f6c0fac80 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6829/62115484 2024-09-14T23:13:37.199795+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6828/62115484 2024-09-14T23:13:37.199795+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1798240241 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/4125949334 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/4275400754 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2340686319 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:40.041 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1762341523 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/4125949334 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3118866913 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/4160355678 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2231349841 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/3265730915 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1192149054 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2742407743 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2563199978 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1172049998 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3178837450 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/628273285 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/1229781236 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.042 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6826/2293557563 2024-09-14T23:04:04.258253+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/621622576 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1038926251 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3577026767 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2001217743 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/595553649 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/1740627202 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/1740627202 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6827/2293557563 2024-09-14T23:04:04.258253+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/3265730915 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/1638639701 2024-09-14T23:08:24.015078+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:6828/3157283215 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/3924280677 2024-09-14T22:59:08.164587+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/2527729769 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2055434874 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/2154717769 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/2890033267 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:0/3727867720 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6801/2055434874 2024-09-14T22:58:07.885443+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.152:6829/3157283215 2024-09-14T23:07:43.783265+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:0/212356059 2024-09-14T23:06:13.295885+0000 2024-09-13T23:17:40.044 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115:6800/2340686319 2024-09-14T22:57:39.503820+0000 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:listed 41 entries 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 msgr2=0x7f9f540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 0x7f9f540709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c00b020 tx=0x7f9f5c009da0 comp rx=0 tx=0).stop 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 msgr2=0x7f9f6c113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000b580 tx=0x7f9f600091a0 comp rx=0 tx=0).stop 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 shutdown_connections 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:6800/68209964,v1:172.21.15.115:6801/68209964] conn(0x7f9f5406e530 0x7f9f540709e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f6c102620 0x7f9f6c113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 --2- 172.21.15.115:0/1737527385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f6c0fac80 0x7f9f6c113250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:17:40.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 >> 172.21.15.115:0/1737527385 conn(0x7f9f6c070ce0 msgr2=0x7f9f6c0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:17:40.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 shutdown_connections 2024-09-13T23:17:40.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-13T23:17:40.042+0000 7f9f715d5640 1 -- 172.21.15.115:0/1737527385 wait complete. 2024-09-13T23:17:40.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:40 smithi115 ceph-mon[91340]: from='client.? 172.21.15.115:0/1737527385' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:17:40.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:40 smithi115 ceph-mon[91340]: pgmap v316: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:40.655 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T23:17:40.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T23:17:40.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:40 smithi152 ceph-mon[80164]: from='client.? 172.21.15.115:0/1737527385' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:17:40.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:40 smithi152 ceph-mon[80164]: pgmap v316: 65 pgs: 65 active+clean; 181 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T23:17:40.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-09-13T23:17:40.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.691 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T23:17:40.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.760 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-09-13T23:17:40.777 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T23:17:40.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T23:17:40.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-09-13T23:17:40.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.941 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-09-13T23:17:40.961 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T23:17:40.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:40.961 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T23:17:41.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:17:41.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-09-13T23:17:41.130 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T23:17:41.141 INFO:tasks.cephadm:Teardown begin 2024-09-13T23:17:41.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:17:41.168 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:17:41.196 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T23:17:41.196 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T23:17:41.224 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T23:17:41.252 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T23:17:41.252 INFO:tasks.cephadm.mon.smithi115:Stopping mon.smithi115... 2024-09-13T23:17:41.253 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115 2024-09-13T23:17:41.549 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:41 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:17:42.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:41 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[91336]: 2024-09-13T23:17:41.604+0000 7ff98b918640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:17:42.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:41 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115[91336]: 2024-09-13T23:17:41.604+0000 7ff98b918640 -1 mon.smithi115@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T23:17:42.028 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:41 smithi115 podman[136691]: 2024-09-13 23:17:41.747233785 +0000 UTC m=+0.294763011 container died 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T23:17:42.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:42 smithi115 podman[136691]: 2024-09-13 23:17:42.118126374 +0000 UTC m=+0.665655588 container cleanup 4fc39f079203c989bbd389b4a6c7f866004a7165fe39946a522e7fbd885b47c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:17:42.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Sep 13 23:17:42 smithi115 bash[136691]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi115 2024-09-13T23:17:42.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi115.service' 2024-09-13T23:17:42.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:17:42.588 INFO:tasks.cephadm.mon.smithi115:Stopped mon.smithi115 2024-09-13T23:17:42.589 INFO:tasks.cephadm.mon.smithi152:Stopping mon.smithi152... 2024-09-13T23:17:42.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152 2024-09-13T23:17:42.883 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:42 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:17:43.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:42 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152[80160]: 2024-09-13T23:17:42.882+0000 7f74d5085640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:17:43.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:42 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152[80160]: 2024-09-13T23:17:42.882+0000 7f74d5085640 -1 mon.smithi152@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T23:17:43.201 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:42 smithi152 podman[112580]: 2024-09-13 23:17:42.90335174 +0000 UTC m=+0.120963856 container died 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T23:17:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 podman[112580]: 2024-09-13 23:17:43.391862801 +0000 UTC m=+0.609474916 container cleanup 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T23:17:43.468 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 bash[112580]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152 2024-09-13T23:17:43.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service' 2024-09-13T23:17:43.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 podman[112594]: 2024-09-13 23:17:43.66900593 +0000 UTC m=+0.766895558 container remove 0ce493fa832a439ab233fdc9201252e7db7157a78c0dd53ebb06f9d4863c2bc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-mon-smithi152, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-ecab7be) 2024-09-13T23:17:43.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service: Deactivated successfully. 2024-09-13T23:17:43.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 62d5ccce-7223-11ef-bceb-c7b262605968. 2024-09-13T23:17:43.834 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Sep 13 23:17:43 smithi152 systemd[1]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968@mon.smithi152.service: Consumed 5.016s CPU time. 2024-09-13T23:17:43.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:17:43.858 INFO:tasks.cephadm.mon.smithi152:Stopped mon.smithi152 2024-09-13T23:17:43.859 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T23:17:43.859 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.0 2024-09-13T23:17:44.173 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:43 smithi115 systemd[1]: Stopping Ceph osd.0 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:17:44.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:17:44.172+0000 7fe4ad843640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:17:44.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:17:44.172+0000 7fe4ad843640 -1 osd.0 83 *** Got signal Terminated *** 2024-09-13T23:17:44.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:44 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0[99526]: 2024-09-13T23:17:44.172+0000 7fe4ad843640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:17:49.866 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:49 smithi115 podman[136822]: 2024-09-13 23:17:49.595629555 +0000 UTC m=+5.542595973 container died ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T23:17:50.257 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:49 smithi115 podman[136822]: 2024-09-13 23:17:49.972446742 +0000 UTC m=+5.919413150 container cleanup ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T23:17:50.257 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:49 smithi115 bash[136822]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0 2024-09-13T23:17:50.549 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136838]: 2024-09-13 23:17:50.257383757 +0000 UTC m=+0.658321752 container remove ad3f53534fd48ca551eac5774afa380d84714b30c09646a6bc1d4367ea506822 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be) 2024-09-13T23:17:50.877 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136928]: 2024-09-13 23:17:50.486921691 +0000 UTC m=+0.016434078 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:17:50.877 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136928]: 2024-09-13 23:17:50.599997178 +0000 UTC m=+0.129509556 container create 8faf382b4547487cea8979b1f87d38a54df578253e57767e9af8810f0886dbea (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-13T23:17:51.299 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136928]: 2024-09-13 23:17:50.877568237 +0000 UTC m=+0.407080627 container init 8faf382b4547487cea8979b1f87d38a54df578253e57767e9af8810f0886dbea (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-13T23:17:51.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136928]: 2024-09-13 23:17:50.881184248 +0000 UTC m=+0.410696629 container start 8faf382b4547487cea8979b1f87d38a54df578253e57767e9af8810f0886dbea (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T23:17:51.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:50 smithi115 podman[136928]: 2024-09-13 23:17:50.977490879 +0000 UTC m=+0.507003275 container attach 8faf382b4547487cea8979b1f87d38a54df578253e57767e9af8810f0886dbea (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T23:17:51.300 INFO:journalctl@ceph.osd.0.smithi115.stdout:Sep 13 23:17:51 smithi115 podman[136928]: 2024-09-13 23:17:51.06829119 +0000 UTC m=+0.597803568 container died 8faf382b4547487cea8979b1f87d38a54df578253e57767e9af8810f0886dbea (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:17:51.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T23:17:51.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:17:51.798 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T23:17:51.799 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T23:17:51.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.1 2024-09-13T23:17:52.049 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:51 smithi115 systemd[1]: Stopping Ceph osd.1 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:17:52.549 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:52 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:17:52.142+0000 7f3cf52dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:17:52.549 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:52 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:17:52.142+0000 7f3cf52dc640 -1 osd.1 83 *** Got signal Terminated *** 2024-09-13T23:17:52.549 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:52 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1[105372]: 2024-09-13T23:17:52.142+0000 7f3cf52dc640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:17:57.956 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:57 smithi115 podman[137041]: 2024-09-13 23:17:57.669705083 +0000 UTC m=+5.645939706 container died 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:17:58.285 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137041]: 2024-09-13 23:17:58.059156566 +0000 UTC m=+6.035391189 container cleanup 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T23:17:58.285 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 bash[137041]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1 2024-09-13T23:17:58.549 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137057]: 2024-09-13 23:17:58.285343265 +0000 UTC m=+0.613736725 container remove 2df7474939a8a0fada9470ea2c71677db125aa9ff6a418310ae671aa4d419244 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T23:17:58.864 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137146]: 2024-09-13 23:17:58.510915381 +0000 UTC m=+0.015806442 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:17:58.864 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137146]: 2024-09-13 23:17:58.636112822 +0000 UTC m=+0.141003869 container create e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be) 2024-09-13T23:17:58.864 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137146]: 2024-09-13 23:17:58.864093249 +0000 UTC m=+0.368984298 container init e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T23:17:59.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137146]: 2024-09-13 23:17:58.867781359 +0000 UTC m=+0.372672408 container start e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T23:17:59.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:58 smithi115 podman[137146]: 2024-09-13 23:17:58.947014635 +0000 UTC m=+0.451905688 container attach e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-13T23:17:59.300 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:59 smithi115 podman[137146]: 2024-09-13 23:17:59.058440095 +0000 UTC m=+0.563331153 container died e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:17:59.594 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 13 23:17:59 smithi115 podman[137169]: 2024-09-13 23:17:59.591899085 +0000 UTC m=+0.524244667 container remove e31c03dfd0cd8e28dde50a2367d1703904accc7095064a8c31e37a84d6fa9fdf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T23:17:59.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T23:17:59.654 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:17:59.654 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T23:17:59.655 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T23:17:59.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.2 2024-09-13T23:17:59.995 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:17:59 smithi115 systemd[1]: Stopping Ceph osd.2 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:18:00.299 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:17:59 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:17:59.994+0000 7fd1823b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:18:00.299 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:17:59 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:17:59.994+0000 7fd1823b1640 -1 osd.2 83 *** Got signal Terminated *** 2024-09-13T23:18:00.299 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:17:59 smithi115 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2[111122]: 2024-09-13T23:17:59.994+0000 7fd1823b1640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:18:05.679 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:05 smithi115 podman[137250]: 2024-09-13 23:18:05.397697385 +0000 UTC m=+5.510821696 container died b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:18:06.012 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:05 smithi115 podman[137250]: 2024-09-13 23:18:05.760673888 +0000 UTC m=+5.873798198 container cleanup b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2) 2024-09-13T23:18:06.012 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:05 smithi115 bash[137250]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2 2024-09-13T23:18:06.299 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137266]: 2024-09-13 23:18:06.011998251 +0000 UTC m=+0.615800698 container remove b1b42c6073794f9faee1ad897d4be60d77a5f5d3046e080a749e46be4d5742cf (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T23:18:06.673 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.247109111 +0000 UTC m=+0.015887965 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:18:06.674 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.371282232 +0000 UTC m=+0.140061121 container create 6a7cd06a7a03676de63d8a504cad994efd7cca85498817381d411eeef9f9c932 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T23:18:06.674 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.590126127 +0000 UTC m=+0.358904973 container init 6a7cd06a7a03676de63d8a504cad994efd7cca85498817381d411eeef9f9c932 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:18:06.674 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.594056136 +0000 UTC m=+0.362834980 container start 6a7cd06a7a03676de63d8a504cad994efd7cca85498817381d411eeef9f9c932 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T23:18:06.674 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.673361739 +0000 UTC m=+0.442140591 container attach 6a7cd06a7a03676de63d8a504cad994efd7cca85498817381d411eeef9f9c932 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T23:18:07.049 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 13 23:18:06 smithi115 podman[137356]: 2024-09-13 23:18:06.784242757 +0000 UTC m=+0.553021607 container died 6a7cd06a7a03676de63d8a504cad994efd7cca85498817381d411eeef9f9c932 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T23:18:07.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T23:18:07.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:18:07.432 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T23:18:07.433 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T23:18:07.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.3 2024-09-13T23:18:07.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:07 smithi152 systemd[1]: Stopping Ceph osd.3 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:18:08.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:07 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:07.737+0000 7f2493b59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:18:08.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:07 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:07.737+0000 7f2493b59640 -1 osd.3 83 *** Got signal Terminated *** 2024-09-13T23:18:08.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:07 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:07.737+0000 7f2493b59640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:18:10.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:09 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:09.838+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:10.864 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:10 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:10.539+0000 7f249015e640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:46.679349+0000 front 2024-09-13T23:17:46.679361+0000 (oldest deadline 2024-09-13T23:18:10.179143+0000) 2024-09-13T23:18:11.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:10 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:10.863+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:11.840 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:11 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:11.568+0000 7f249015e640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:46.679349+0000 front 2024-09-13T23:17:46.679361+0000 (oldest deadline 2024-09-13T23:18:10.179143+0000) 2024-09-13T23:18:11.840 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:11 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:11.481+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:12.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:11 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:11.840+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:12.851 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:12 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:12.521+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:12.851 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:12 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3[89349]: 2024-09-13T23:18:12.592+0000 7f249015e640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:46.679349+0000 front 2024-09-13T23:17:46.679361+0000 (oldest deadline 2024-09-13T23:18:10.179143+0000) 2024-09-13T23:18:13.218 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:13 smithi152 podman[112719]: 2024-09-13 23:18:13.089963671 +0000 UTC m=+5.462617502 container died fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T23:18:13.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:12 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:12.850+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:13.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:13 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:13.480+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:13.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:13 smithi152 podman[112719]: 2024-09-13 23:18:13.468632032 +0000 UTC m=+5.841285861 container cleanup fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T23:18:13.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:13 smithi152 bash[112719]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3 2024-09-13T23:18:14.110 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:13 smithi152 podman[112734]: 2024-09-13 23:18:13.754787736 +0000 UTC m=+0.662493146 container remove fb09c583afe707e2b46b9618af50165f25904342b5d83aead70e55d5d2f9961e (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T23:18:14.110 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:13 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:13.858+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:14.438 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.013201352 +0000 UTC m=+0.015629499 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:18:14.438 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.110172297 +0000 UTC m=+0.112600482 container create bedb8c51de720f3da846688ab060e27353eb62e130a40acdc4ec5ea8e3e8093c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T23:18:14.438 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.321265538 +0000 UTC m=+0.323693671 container init bedb8c51de720f3da846688ab060e27353eb62e130a40acdc4ec5ea8e3e8093c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-13T23:18:14.438 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.324605246 +0000 UTC m=+0.327033374 container start bedb8c51de720f3da846688ab060e27353eb62e130a40acdc4ec5ea8e3e8093c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T23:18:14.438 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.437932198 +0000 UTC m=+0.440360339 container attach bedb8c51de720f3da846688ab060e27353eb62e130a40acdc4ec5ea8e3e8093c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:18:14.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:14 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:14.459+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:14.718 INFO:journalctl@ceph.osd.3.smithi152.stdout:Sep 13 23:18:14 smithi152 podman[112822]: 2024-09-13 23:18:14.516164748 +0000 UTC m=+0.518592897 container died bedb8c51de720f3da846688ab060e27353eb62e130a40acdc4ec5ea8e3e8093c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T23:18:15.143 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:14 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:14.890+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:15.158 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T23:18:15.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:18:15.198 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T23:18:15.198 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T23:18:15.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.4 2024-09-13T23:18:15.453 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:15 smithi152 systemd[1]: Stopping Ceph osd.4 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:18:15.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:15.452+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:15.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:15.554+0000 7fd1dbb5d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:18:15.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:15.554+0000 7fd1dbb5d640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-13T23:18:15.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:15.554+0000 7fd1dbb5d640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:18:16.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:15 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:15.854+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:16.837 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:16 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:16.500+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:17.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:16 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:16.835+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:17.826 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:17 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:17.481+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:18.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:17 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:17.825+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:18.836 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:18 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:18.476+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:19.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:18 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:18.834+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:19.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:19 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:19.434+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:19.718 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:19 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:19.434+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.600049+0000 front 2024-09-13T23:17:56.599974+0000 (oldest deadline 2024-09-13T23:18:18.899891+0000) 2024-09-13T23:18:20.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:19 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:19.878+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:20.897 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:20.479+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:45.598126+0000 front 2024-09-13T23:17:45.598186+0000 (oldest deadline 2024-09-13T23:18:10.898159+0000) 2024-09-13T23:18:20.898 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4[94188]: 2024-09-13T23:18:20.479+0000 7fd1d8162640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.600049+0000 front 2024-09-13T23:17:56.599974+0000 (oldest deadline 2024-09-13T23:18:18.899891+0000) 2024-09-13T23:18:21.170 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:20 smithi152 podman[112924]: 2024-09-13 23:18:20.897192356 +0000 UTC m=+5.477575279 container died 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T23:18:21.171 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:20 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:20.923+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:21.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:21 smithi152 podman[112924]: 2024-09-13 23:18:21.262549237 +0000 UTC m=+5.842932157 container cleanup 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:18:21.468 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:21 smithi152 bash[112924]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4 2024-09-13T23:18:21.927 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:21 smithi152 podman[112941]: 2024-09-13 23:18:21.567157159 +0000 UTC m=+0.663854188 container remove 3cc5f1e5cb089e5ab4b90de6f5800c4a491f2255e0f199b31dd70f97885d38b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T23:18:22.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:21 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:21.970+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:22.218 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:21 smithi152 podman[113028]: 2024-09-13 23:18:21.830020616 +0000 UTC m=+0.015892831 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:18:22.218 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:21 smithi152 podman[113028]: 2024-09-13 23:18:21.928033798 +0000 UTC m=+0.113905999 container create f135de7c2baf479ee325e19f9b6c5078c4e5280b9ea5d68baf850b15c811c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-13T23:18:22.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:22 smithi152 podman[113028]: 2024-09-13 23:18:22.166056813 +0000 UTC m=+0.351929014 container init f135de7c2baf479ee325e19f9b6c5078c4e5280b9ea5d68baf850b15c811c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T23:18:22.219 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:22 smithi152 podman[113028]: 2024-09-13 23:18:22.169455953 +0000 UTC m=+0.355328158 container start f135de7c2baf479ee325e19f9b6c5078c4e5280b9ea5d68baf850b15c811c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T23:18:22.669 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:22 smithi152 podman[113028]: 2024-09-13 23:18:22.245507589 +0000 UTC m=+0.431379793 container attach f135de7c2baf479ee325e19f9b6c5078c4e5280b9ea5d68baf850b15c811c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T23:18:22.670 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 13 23:18:22 smithi152 podman[113028]: 2024-09-13 23:18:22.362830488 +0000 UTC m=+0.548702692 container died f135de7c2baf479ee325e19f9b6c5078c4e5280b9ea5d68baf850b15c811c663 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:18:22.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T23:18:23.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:18:23.018 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T23:18:23.018 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T23:18:23.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.5 2024-09-13T23:18:23.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:22 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:22.951+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:23.219 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:22 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:22.951+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:23.219 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 systemd[1]: Stopping Ceph osd.5 for 62d5ccce-7223-11ef-bceb-c7b262605968... 2024-09-13T23:18:23.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:23.339+0000 7f89dd609640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:18:23.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:23.339+0000 7f89dd609640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-13T23:18:23.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:23.339+0000 7f89dd609640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:18:24.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:23.943+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:24.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:23 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:23.943+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:25.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:24 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:24.901+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:25.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:24 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:24.901+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:26.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:25.923+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:26.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:25 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:25.923+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:27.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:26 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:26.889+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:27.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:26 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:26.889+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:28.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:27 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:27.863+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6806 osd.0 since back 2024-09-13T23:17:44.983314+0000 front 2024-09-13T23:17:44.983224+0000 (oldest deadline 2024-09-13T23:18:09.683082+0000) 2024-09-13T23:18:28.218 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:27 smithi152 ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5[99465]: 2024-09-13T23:18:27.863+0000 7f89d9c0e640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.115:6814 osd.1 since back 2024-09-13T23:17:56.684307+0000 front 2024-09-13T23:17:56.684351+0000 (oldest deadline 2024-09-13T23:18:21.984139+0000) 2024-09-13T23:18:29.041 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:28 smithi152 podman[113129]: 2024-09-13 23:18:28.765153741 +0000 UTC m=+5.529015008 container died 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be) 2024-09-13T23:18:29.398 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:29 smithi152 podman[113129]: 2024-09-13 23:18:29.140619457 +0000 UTC m=+5.904480723 container cleanup 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be) 2024-09-13T23:18:29.398 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:29 smithi152 bash[113129]: ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5 2024-09-13T23:18:29.718 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:29 smithi152 podman[113157]: 2024-09-13 23:18:29.39848636 +0000 UTC m=+0.631019237 container remove 5e3e7221a0b660fbda8a25ef07a5f3a8c8339ac59da20437b2550ff42cb8f091 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:18:30.011 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:29 smithi152 podman[113243]: 2024-09-13 23:18:29.651373523 +0000 UTC m=+0.015823323 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:18:30.011 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:29 smithi152 podman[113243]: 2024-09-13 23:18:29.783235401 +0000 UTC m=+0.147685242 container create 1b85c0b10663a5df05de9a41a2c460c0d48752cf07a638d84cc15e04354e86a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be) 2024-09-13T23:18:30.011 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:30 smithi152 podman[113243]: 2024-09-13 23:18:30.010814435 +0000 UTC m=+0.375264244 container init 1b85c0b10663a5df05de9a41a2c460c0d48752cf07a638d84cc15e04354e86a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T23:18:30.468 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:30 smithi152 podman[113243]: 2024-09-13 23:18:30.014181574 +0000 UTC m=+0.378631373 container start 1b85c0b10663a5df05de9a41a2c460c0d48752cf07a638d84cc15e04354e86a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T23:18:30.469 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:30 smithi152 podman[113243]: 2024-09-13 23:18:30.077688773 +0000 UTC m=+0.442138598 container attach 1b85c0b10663a5df05de9a41a2c460c0d48752cf07a638d84cc15e04354e86a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-ecab7be, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:18:30.469 INFO:journalctl@ceph.osd.5.smithi152.stdout:Sep 13 23:18:30 smithi152 podman[113243]: 2024-09-13 23:18:30.207825573 +0000 UTC m=+0.572275373 container died 1b85c0b10663a5df05de9a41a2c460c0d48752cf07a638d84cc15e04354e86a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-62d5ccce-7223-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be) 2024-09-13T23:18:30.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-62d5ccce-7223-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T23:18:30.852 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:18:30.852 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T23:18:30.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T23:18:54.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T23:19:06.470 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:19:06.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:19:06.530 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T23:19:06.533 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi115/crash 2024-09-13T23:19:06.534 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash -- . 2024-09-13T23:19:06.571 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T23:19:06.571 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-09-13T23:19:06.573 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi152/crash 2024-09-13T23:19:06.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash -- . 2024-09-13T23:19:06.597 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T23:19:06.598 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-09-13T23:19:06.599 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T23:19:06.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T23:19:06.649 INFO:tasks.cephadm:Compressing logs... 2024-09-13T23:19:06.650 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:19:06.692 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:19:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T23:19:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:: No such file or directory 2024-09-13T23:19:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T23:19:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T23:19:06.716 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T23:19:06.719 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi115.eqesbc.log 2024-09-13T23:19:06.719 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi115.log 2024-09-13T23:19:06.719 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi115.eqesbc.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.ywbcks.log 2024-09-13T23:19:06.719 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi115.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T23:19:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi152.ntylos.log 2024-09-13T23:19:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-09-13T23:19:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T23:19:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T23:19:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi152.ntylos.log: /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.pntaqr.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.pntaqr.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log: 85.1% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi152.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi152.log: 87.5% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T23:19:06.722 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T23:19:06.723 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.ywbcks.log: gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T23:19:06.723 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.3% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T23:19:06.723 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log 2024-09-13T23:19:06.723 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.2% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T23:19:06.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.cmykpw.log 2024-09-13T23:19:06.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T23:19:06.732 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.vlvabd.log 2024-09-13T23:19:06.736 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log: 87.5% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T23:19:06.737 INFO:teuthology.orchestra.run.smithi115.stderr: 91.0% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T23:19:06.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.cmykpw.log: 91.0% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T23:19:06.746 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T23:19:06.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T23:19:06.778 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.vlvabd.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T23:19:06.782 INFO:teuthology.orchestra.run.smithi152.stderr: 89.8% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi152.ntylos.log.gz 2024-09-13T23:19:06.984 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi152.log.gz 2024-09-13T23:19:07.062 INFO:teuthology.orchestra.run.smithi115.stderr: 88.7% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mgr.smithi115.eqesbc.log.gz 2024-09-13T23:19:07.731 INFO:teuthology.orchestra.run.smithi115.stderr: 90.6% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mon.smithi115.log.gz 2024-09-13T23:19:09.792 INFO:teuthology.orchestra.run.smithi152.stderr: 95.2% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.pntaqr.log.gz 2024-09-13T23:19:10.963 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T23:19:11.494 INFO:teuthology.orchestra.run.smithi115.stderr: 93.3% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T23:19:11.728 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T23:19:12.707 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T23:19:13.064 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T23:19:13.113 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T23:19:15.791 INFO:teuthology.orchestra.run.smithi115.stderr: 95.2% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.ywbcks.log.gz 2024-09-13T23:19:46.563 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi152.cmykpw.log.gz 2024-09-13T23:19:46.564 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-13T23:19:46.564 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m39.858s 2024-09-13T23:19:46.565 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m58.506s 2024-09-13T23:19:46.565 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.994s 2024-09-13T23:19:57.316 INFO:teuthology.orchestra.run.smithi115.stderr: 92.8% -- replaced with /var/log/ceph/62d5ccce-7223-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi115.vlvabd.log.gz 2024-09-13T23:19:57.317 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-13T23:19:57.317 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m50.612s 2024-09-13T23:19:57.318 INFO:teuthology.orchestra.run.smithi115.stderr:user 1m13.967s 2024-09-13T23:19:57.318 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m2.384s 2024-09-13T23:19:57.318 INFO:tasks.cephadm:Archiving logs... 2024-09-13T23:19:57.318 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi115/log 2024-09-13T23:19:57.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:20:08.114 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi152/log 2024-09-13T23:20:08.115 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:20:16.635 INFO:tasks.cephadm:Removing cluster... 2024-09-13T23:20:16.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 --force 2024-09-13T23:20:17.239 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 62d5ccce-7223-11ef-bceb-c7b262605968 --force 2024-09-13T23:20:17.784 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T23:20:17.784 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T23:20:17.800 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T23:20:17.816 INFO:tasks.cephadm:Teardown complete 2024-09-13T23:20:17.816 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T23:20:17.829 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T23:20:17.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:20:17.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:20:17.946 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T23:20:17.961 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T23:20:17.961 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:20:17.964 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:20:17.976 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:20:17.978 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +9543ns[ +21us] +/- 41ms 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -76us[ -65us] +/- 66ms 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +71us[ +82us] +/- 72ms 2024-09-13T23:20:17.981 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +18us[ +23us] +/- 41ms 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -77us[ -73us] +/- 66ms 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +74us[ +78us] +/- 72ms 2024-09-13T23:20:17.983 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:20:17.983 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T23:20:17.996 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T23:20:17.997 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T23:20:18.010 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:20:18.103 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:20:18.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:20:18.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:20:18.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:20:18.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:20:18.238 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T23:20:18.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T23:20:18.265 INFO:teuthology.task.internal:Duration was 1786.918628 seconds 2024-09-13T23:20:18.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T23:20:18.276 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T23:20:18.276 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:20:18.279 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:20:18.315 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:20:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:20:18.591 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T23:20:18.592 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-13T23:20:18.592 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:20:18.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-13T23:20:18.655 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:20:18.680 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T23:20:18.680 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:20:18.698 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:20:18.747 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T23:20:18.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:20:18.766 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:20:19.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T23:20:19.528 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T23:20:19.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:20:19.553 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:20:19.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T23:20:19.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:20:19.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:20:19.616 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-13T23:20:19.648 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-13T23:20:19.662 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:20:19.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:20:19.684 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:20:19.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:20:19.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T23:20:19.730 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T23:20:19.731 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi115 2024-09-13T23:20:19.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:20:19.781 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904356/remote/smithi152 2024-09-13T23:20:19.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:20:19.823 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T23:20:19.823 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:20:19.826 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:20:19.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T23:20:19.891 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T23:20:19.892 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T23:20:19.904 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T23:20:19.905 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:20:19.907 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:20:19.920 INFO:teuthology.orchestra.run.smithi115.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:20 /home/ubuntu/cephtest 2024-09-13T23:20:19.932 INFO:teuthology.orchestra.run.smithi152.stdout: 265722 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:20 /home/ubuntu/cephtest 2024-09-13T23:20:19.934 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T23:20:19.946 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T23:20:19.975 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1786.9186282157898 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T23:20:19.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:20:20.077 INFO:teuthology.run:pass